2024-09-10T10:16:26.355 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T10:16:26.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T10:16:26.466 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026 branch: wip-rishabh-testing-20240909.165402-squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/postgres}} email: null first_in_suite: false job_id: '7899026' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCWcsoE+sHD7qU+d7TQrjh8lKMrc6bGfYlvbAm1QUQI3yFOLDUhTOxo6qabftUSWZzSJ23qXsFVEVQ4UVcLineA= smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUQbCKm0428fEL0NMkmtZvd3lM9OCnXWhHhbIWqkNAqtJ+0yTaET9uZ2AIvLHtqVqdtWNpZYaBWAZOaBAuqaz4= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGEJT7mKZ4AwtHCRQ/mL5YpxgA/F1k4e7f5mPQiOcqJO+8qKzRpee3UExS2/WLPslPo2L4e8iWNw9HU2KBTTbY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T10:16:26.467 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T10:16:26.467 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T10:16:26.467 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T10:16:26.469 INFO:teuthology.task.internal:Checking packages... 2024-09-10T10:16:26.491 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T10:16:26.491 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T10:16:26.491 INFO:teuthology.packaging:ref: None 2024-09-10T10:16:26.491 INFO:teuthology.packaging:tag: None 2024-09-10T10:16:26.491 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T10:16:26.491 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:16:26.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T10:16:26.635 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T10:16:26.637 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T10:16:26.643 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T10:16:26.643 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T10:16:26.663 INFO:teuthology.task.internal:Saving configuration 2024-09-10T10:16:26.683 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T10:16:26.690 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T10:16:26.713 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 10:11:28.280775', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCWcsoE+sHD7qU+d7TQrjh8lKMrc6bGfYlvbAm1QUQI3yFOLDUhTOxo6qabftUSWZzSJ23qXsFVEVQ4UVcLineA='} 2024-09-10T10:16:26.735 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 10:11:28.278518', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUQbCKm0428fEL0NMkmtZvd3lM9OCnXWhHhbIWqkNAqtJ+0yTaET9uZ2AIvLHtqVqdtWNpZYaBWAZOaBAuqaz4='} 2024-09-10T10:16:26.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 10:11:28.279732', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCGEJT7mKZ4AwtHCRQ/mL5YpxgA/F1k4e7f5mPQiOcqJO+8qKzRpee3UExS2/WLPslPo2L4e8iWNw9HU2KBTTbY='} 2024-09-10T10:16:26.756 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T10:16:26.764 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T10:16:26.764 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T10:16:26.764 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T10:16:26.764 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T10:16:26.841 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffa248bbbe0>, signals=[15]) 2024-09-10T10:16:26.841 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T10:16:26.846 INFO:teuthology.task.internal:Opening connections... 2024-09-10T10:16:26.846 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:16:26.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:16:26.923 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-09-10T10:16:26.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:16:27.000 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-09-10T10:16:27.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:16:27.080 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T10:16:27.086 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-09-10T10:16:27.104 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-09-10T10:16:27.104 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T10:16:27.162 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-09-10T10:16:27.163 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T10:16:27.163 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T10:16:27.163 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T10:16:27.163 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-09-10T10:16:27.183 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-09-10T10:16:27.202 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-09-10T10:16:27.202 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-09-10T10:16:27.260 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2024-09-10T10:16:27.260 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9" 2024-09-10T10:16:27.260 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2024-09-10T10:16:27.261 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2024-09-10T10:16:27.261 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9" 2024-09-10T10:16:27.261 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9" 2024-09-10T10:16:27.261 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T10:16:27.261 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2024-09-10T10:16:27.262 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon" 2024-09-10T10:16:27.262 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T10:16:27.262 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2024-09-10T10:16:27.262 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T10:16:27.262 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T10:16:27.262 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T10:16:27.263 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-09-10T10:16:27.283 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-09-10T10:16:27.301 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-09-10T10:16:27.302 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-09-10T10:16:27.360 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-09-10T10:16:27.360 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-09-10T10:16:27.360 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-09-10T10:16:27.360 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-09-10T10:16:27.360 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-09-10T10:16:27.360 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-09-10T10:16:27.361 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T10:16:27.361 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-09-10T10:16:27.361 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-09-10T10:16:27.361 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T10:16:27.361 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-09-10T10:16:27.361 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T10:16:27.361 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T10:16:27.361 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T10:16:27.361 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-09-10T10:16:27.383 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T10:16:27.392 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T10:16:27.397 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T10:16:27.397 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-09-10T10:16:27.399 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-09-10T10:16:27.402 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-09-10T10:16:27.418 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T10:16:27.423 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T10:16:27.423 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-09-10T10:16:27.457 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-09-10T10:16:27.459 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-09-10T10:16:27.555 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T10:16:27.616 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T10:16:27.630 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T10:16:27.630 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T10:16:27.630 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T10:16:27.630 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T10:16:27.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:16:27.647 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-10T10:16:27.704 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-503.el9.x86_64 2024-09-10T10:16:27.704 INFO:teuthology.task.kernel:Running kernel on smithi092: 5.14.0-503.el9.x86_64 2024-09-10T10:16:27.704 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2024-09-10T10:16:30.074 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-10T10:16:34.106 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 20 MB 00:02 2024-09-10T10:16:38.492 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-10T10:16:40.001 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-10T10:16:40.880 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-10T10:16:46.302 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-10T10:16:48.258 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T10:16:48.258 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T10:16:48.355 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-10T10:16:48.365 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-10T10:16:48.365 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-09-10T10:16:48.365 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-10T10:16:48.365 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-10T10:16:48.365 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T10:16:48.365 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-10T10:16:48.365 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T10:16:48.365 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T10:16:48.365 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T10:16:48.366 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:16:48.366 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-10T10:16:48.366 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-09-10T10:16:48.366 INFO:teuthology.orchestra.run.smithi092.stdout:Install 4 Packages 2024-09-10T10:16:48.366 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:16:48.366 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 79 M 2024-09-10T10:16:48.366 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 126 M 2024-09-10T10:16:48.367 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-10T10:16:48.495 INFO:teuthology.orchestra.run.smithi092.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 285 kB/s | 23 kB 00:00 2024-09-10T10:16:48.845 INFO:teuthology.orchestra.run.smithi092.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-10T10:16:49.245 INFO:teuthology.orchestra.run.smithi092.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 42 MB/s | 35 MB 00:00 2024-09-10T10:16:49.654 INFO:teuthology.orchestra.run.smithi092.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-10T10:16:49.654 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:16:49.654 INFO:teuthology.orchestra.run.smithi092.stdout:Total 61 MB/s | 79 MB 00:01 2024-09-10T10:16:50.340 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-10T10:16:50.702 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-10T10:16:50.702 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-10T10:16:51.651 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-10T10:16:51.651 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-10T10:16:54.096 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-10T10:16:54.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T10:16:54.837 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T10:16:57.626 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T10:16:57.750 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T10:17:02.565 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T10:17:02.683 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:17:07.520 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:17:45.791 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:17:45.832 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:17:46.181 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:17:46.181 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T10:17:46.181 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T10:17:46.181 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T10:17:47.070 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T10:17:47.070 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:17:47.070 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-10T10:17:47.070 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T10:17:47.070 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T10:17:47.070 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T10:17:47.070 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T10:17:47.070 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:17:47.070 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-10T10:17:47.388 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T10:17:47.464 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T10:17:47.465 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T10:17:47.466 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T10:17:47.466 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T10:17:47.466 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T10:17:47.466 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T10:17:47.466 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T10:17:47.466 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T10:17:47.524 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T10:17:47.525 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T10:17:47.525 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2024-09-10T10:17:47.557 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2024-09-10T10:17:47.557 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2024-09-10T10:17:47.557 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.06 2024-09-10T10:17:47.557 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 82.el9 2024-09-10T10:17:47.557 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2024-09-10T10:17:47.557 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T10:17:47.557 INFO:teuthology.orchestra.run.smithi092.stdout:Group : Unspecified 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 8274670 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : builder@centos.org 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T10:17:47.558 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T10:17:47.559 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T10:17:47.559 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2024-09-10T10:17:47.559 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:17:47.559 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T10:17:47.559 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T10:17:47.560 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 5.14.0-505.el9.x86_64 2024-09-10T10:17:47.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T10:17:48.270 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2024-09-10T10:17:49.640 INFO:teuthology.orchestra.run.smithi092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T10:17:49.679 INFO:teuthology.orchestra.run.smithi092.stderr:done 2024-09-10T10:17:49.684 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-09-10T10:17:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.Qv2IrdqLJ9 2024-09-10T10:17:49.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Qv2IrdqLJ9 2024-09-10T10:17:49.773 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.Qv2IrdqLJ9 2024-09-10T10:17:49.930 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.Qv2IrdqLJ9 is 6KB 2024-09-10T10:17:49.952 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.Qv2IrdqLJ9 2024-09-10T10:17:49.971 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T10:17:50.048 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T10:17:50.048 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T10:17:50.048 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T10:17:50.048 INFO:teuthology.orchestra.run.smithi092.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T10:17:50.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T10:17:50.207 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2024-09-10T10:18:20.215 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T10:18:20.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-10T10:18:20.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:18:38.781 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-10T10:18:47.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-10T10:18:47.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:18:50.849 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-09-10T10:19:02.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-10T10:19:02.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:19:34.804 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-10T10:19:35.344 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-10T10:19:35.345 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T10:19:35.345 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-09-10T10:19:35.378 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-505.el9.x86_64 2024-09-10T10:19:35.378 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T10:19:35.379 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T10:19:35.379 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T10:19:36.380 DEBUG:teuthology.parallel:result is None 2024-09-10T10:19:36.380 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T10:19:36.387 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T10:19:36.387 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T10:19:36.390 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T10:19:36.393 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T10:19:36.412 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T10:19:36.418 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T10:19:36.427 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T10:19:36.427 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T10:19:36.444 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T10:19:36.452 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T10:19:36.566 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T10:19:36.572 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T10:19:36.573 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T10:19:36.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:19:36.590 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T10:19:36.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:19:36.607 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T10:19:36.610 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T10:19:36.633 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T10:19:36.709 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:19:36.710 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:19:36.714 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:19:36.731 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:19:36.732 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:19:36.832 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T10:19:36.834 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T10:19:36.842 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T10:19:36.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T10:19:36.844 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T10:19:36.846 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T10:19:36.876 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T10:19:36.885 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T10:19:36.885 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T10:19:36.909 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T10:19:36.917 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T10:19:36.934 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:19:37.007 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:19:37.056 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:19:37.137 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:19:37.177 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:19:37.177 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T10:19:37.238 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:19:37.285 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:19:37.332 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:19:37.417 DEBUG:teuthology.orchestra.run.smithi097:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:19:37.460 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:19:37.460 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T10:19:37.528 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:19:37.576 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T10:19:37.632 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:19:37.716 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T10:19:37.759 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:19:37.759 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T10:19:37.825 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-09-10T10:19:37.828 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-09-10T10:19:37.830 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-09-10T10:19:37.868 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:19:37.868 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:19:37.902 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:19:38.384 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T10:19:38.393 INFO:teuthology.task.internal:Starting timer... 2024-09-10T10:19:38.394 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T10:19:38.406 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T10:19:38.413 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T10:19:38.413 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-09-10T10:19:38.489 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-09-10T10:19:38.491 DEBUG:teuthology.orchestra.run.smithi097:> sudo service auditd rotate 2024-09-10T10:19:38.549 INFO:teuthology.orchestra.run.smithi097.stdout:Rotating logs: 2024-09-10T10:19:38.551 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-09-10T10:19:38.612 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-09-10T10:19:38.613 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T10:19:38.614 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-09-10T10:19:38.634 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-09-10T10:19:38.634 DEBUG:teuthology.orchestra.run.smithi097:> /usr/sbin/getenforce 2024-09-10T10:19:38.662 INFO:teuthology.orchestra.run.smithi097.stdout:Permissive 2024-09-10T10:19:38.662 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-09-10T10:19:38.685 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-09-10T10:19:38.685 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi097.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive'} 2024-09-10T10:19:38.686 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:19:38.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:19:38.713 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:19:38.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:19:38.742 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:19:38.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:19:38.769 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T10:19:38.769 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-09-10T10:19:38.813 DEBUG:teuthology.orchestra.run.smithi097:> sudo /usr/sbin/setenforce permissive 2024-09-10T10:19:38.846 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-09-10T10:19:38.878 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T10:19:38.891 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T10:19:38.902 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T10:19:38.903 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com,smithi097.front.sepia.ceph.com,smithi121.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T10:23:44.051 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com')] 2024-09-10T10:23:44.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-10T10:23:44.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:23:44.133 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-10T10:23:44.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-10T10:23:44.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-10T10:23:44.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:23:44.289 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-09-10T10:23:44.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-09-10T10:23:44.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-10T10:23:44.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T10:23:44.447 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-10T10:23:44.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-10T10:23:44.525 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T10:23:44.535 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T10:23:44.536 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T10:23:44.536 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:23:44.538 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T10:23:44.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:23:44.541 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T10:23:44.541 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:23:44.566 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T10:23:44.572 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T10:23:44.581 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T10:23:44.589 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T10:23:44.594 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T10:23:44.605 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-09-10T10:23:44.608 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T10:23:44.615 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: ntpd: command not found 2024-09-10T10:23:44.616 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-09-10T10:23:44.627 INFO:teuthology.orchestra.run.smithi097.stdout:506 Cannot talk to daemon 2024-09-10T10:23:44.630 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T10:23:44.632 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-09-10T10:23:44.642 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T10:23:44.643 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-09-10T10:23:44.644 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T10:23:44.657 INFO:teuthology.orchestra.run.smithi097.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T10:23:44.658 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T10:23:44.671 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T10:23:44.701 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:23:44.704 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:23:44.704 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-10T10:23:44.704 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.704 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.704 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.704 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.712 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:23:44.716 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:23:44.716 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2024-09-10T10:23:44.716 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.716 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.716 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.717 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.736 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:23:44.739 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:23:44.740 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-10T10:23:44.740 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.740 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.740 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.740 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:23:44.740 INFO:teuthology.run_tasks:Running task install... 2024-09-10T10:23:44.749 DEBUG:teuthology.task.install:project ceph 2024-09-10T10:23:44.749 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T10:23:44.749 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T10:23:44.749 INFO:teuthology.task.install:Using flavor: default 2024-09-10T10:23:44.755 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T10:23:44.755 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T10:23:44.755 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T10:23:44.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:23:44.758 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T10:23:44.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:23:44.759 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T10:23:44.759 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:23:44.915 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T10:23:44.915 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T10:23:44.920 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T10:23:44.920 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T10:23:44.921 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T10:23:44.921 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T10:23:45.029 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T10:23:45.029 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:23:45.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T10:23:45.042 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T10:23:45.042 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:23:45.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T10:23:45.045 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T10:23:45.045 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:23:45.045 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T10:23:45.056 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T10:23:45.056 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T10:23:45.071 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T10:23:45.071 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T10:23:45.072 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T10:23:45.072 DEBUG:teuthology.orchestra.run.smithi097:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T10:23:45.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T10:23:45.137 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T10:23:45.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T10:23:45.198 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T10:23:45.213 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T10:23:45.214 DEBUG:teuthology.orchestra.run.smithi097:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T10:23:45.263 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-09-10T10:23:45.265 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-09-10T10:23:45.277 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-09-10T10:23:45.278 INFO:teuthology.orchestra.run.smithi097.stdout:check_obsoletes = 1 2024-09-10T10:23:45.279 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-09-10T10:23:45.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum clean all 2024-09-10T10:23:45.497 INFO:teuthology.orchestra.run.smithi092.stdout:45 files removed 2024-09-10T10:23:45.503 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-09-10T10:23:45.503 INFO:teuthology.orchestra.run.smithi097.stdout:45 files removed 2024-09-10T10:23:45.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T10:23:45.530 DEBUG:teuthology.orchestra.run.smithi097:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T10:23:45.531 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T10:23:46.068 INFO:teuthology.orchestra.run.smithi097.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-10T10:23:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-10T10:23:46.094 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 290 kB/s | 84 kB 00:00 2024-09-10T10:23:46.352 INFO:teuthology.orchestra.run.smithi097.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T10:23:46.370 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-10T10:23:46.378 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-10T10:23:46.646 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-10T10:23:46.646 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T10:23:46.669 INFO:teuthology.orchestra.run.smithi097.stdout:ceph source packages 6.7 kB/s | 1.9 kB 00:00 2024-09-10T10:23:47.387 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-10T10:23:49.386 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-10T10:23:50.512 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.2 MB 00:03 2024-09-10T10:23:51.195 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-10T10:23:53.564 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-10T10:23:55.555 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-10T10:23:57.030 INFO:teuthology.orchestra.run.smithi097.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-10T10:23:57.952 INFO:teuthology.orchestra.run.smithi097.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-10T10:23:59.138 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-10T10:24:00.618 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-10T10:24:01.402 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-10T10:24:03.466 INFO:teuthology.orchestra.run.smithi097.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T10:24:05.743 INFO:teuthology.orchestra.run.smithi097.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:24:05.744 INFO:teuthology.orchestra.run.smithi097.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:24:05.755 INFO:teuthology.orchestra.run.smithi097.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T10:24:05.756 INFO:teuthology.orchestra.run.smithi097.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T10:24:05.757 INFO:teuthology.orchestra.run.smithi097.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T10:24:05.758 INFO:teuthology.orchestra.run.smithi097.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T10:24:05.760 INFO:teuthology.orchestra.run.smithi097.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T10:24:05.762 INFO:teuthology.orchestra.run.smithi097.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T10:24:05.763 INFO:teuthology.orchestra.run.smithi097.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T10:24:05.825 INFO:teuthology.orchestra.run.smithi097.stdout:Dependencies resolved. 2024-09-10T10:24:05.844 INFO:teuthology.orchestra.run.smithi097.stdout:====================================================================================== 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: Package Arch Version Repository Size 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout:====================================================================================== 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout:Installing: 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T10:24:05.845 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T10:24:05.846 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T10:24:05.847 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrading: 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout:Installing dependencies: 2024-09-10T10:24:05.848 INFO:teuthology.orchestra.run.smithi097.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T10:24:05.849 INFO:teuthology.orchestra.run.smithi097.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T10:24:05.849 INFO:teuthology.orchestra.run.smithi097.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T10:24:05.849 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T10:24:05.849 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T10:24:05.850 INFO:teuthology.orchestra.run.smithi097.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T10:24:05.851 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T10:24:05.852 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T10:24:05.852 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T10:24:05.852 INFO:teuthology.orchestra.run.smithi097.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T10:24:05.852 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T10:24:05.852 INFO:teuthology.orchestra.run.smithi097.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T10:24:05.852 INFO:teuthology.orchestra.run.smithi097.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T10:24:05.852 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T10:24:05.852 INFO:teuthology.orchestra.run.smithi097.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T10:24:05.853 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T10:24:05.854 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T10:24:05.855 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T10:24:05.856 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T10:24:05.857 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T10:24:05.858 INFO:teuthology.orchestra.run.smithi097.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T10:24:05.859 INFO:teuthology.orchestra.run.smithi097.stdout:Installing weak dependencies: 2024-09-10T10:24:05.859 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T10:24:05.859 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:24:05.859 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction Summary 2024-09-10T10:24:05.859 INFO:teuthology.orchestra.run.smithi097.stdout:====================================================================================== 2024-09-10T10:24:05.859 INFO:teuthology.orchestra.run.smithi097.stdout:Install 148 Packages 2024-09-10T10:24:05.859 INFO:teuthology.orchestra.run.smithi097.stdout:Upgrade 8 Packages 2024-09-10T10:24:05.859 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:24:05.860 INFO:teuthology.orchestra.run.smithi097.stdout:Total download size: 226 M 2024-09-10T10:24:05.860 INFO:teuthology.orchestra.run.smithi097.stdout:Downloading Packages: 2024-09-10T10:24:05.893 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-10T10:24:06.334 INFO:teuthology.orchestra.run.smithi097.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-10T10:24:06.545 INFO:teuthology.orchestra.run.smithi097.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 4.2 MB/s | 897 kB 00:00 2024-09-10T10:24:06.643 INFO:teuthology.orchestra.run.smithi097.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.4 MB/s | 145 kB 00:00 2024-09-10T10:24:06.718 INFO:teuthology.orchestra.run.smithi097.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-10T10:24:06.757 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-10T10:24:06.835 INFO:teuthology.orchestra.run.smithi097.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-10T10:24:06.918 INFO:teuthology.orchestra.run.smithi097.stdout:(6/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 8.7 MB/s | 2.4 MB 00:00 2024-09-10T10:24:07.902 INFO:teuthology.orchestra.run.smithi097.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 4.4 MB/s | 4.7 MB 00:01 2024-09-10T10:24:08.319 INFO:teuthology.orchestra.run.smithi097.stdout:(8/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86_ 12 MB/s | 17 MB 00:01 2024-09-10T10:24:08.411 INFO:teuthology.orchestra.run.smithi097.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 275 kB/s | 25 kB 00:00 2024-09-10T10:24:09.052 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:24:09.053 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:24:09.066 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T10:24:09.067 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T10:24:09.068 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T10:24:09.069 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T10:24:09.071 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T10:24:09.074 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T10:24:09.075 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T10:24:09.137 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-10T10:24:09.161 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2024-09-10T10:24:09.161 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-10T10:24:09.161 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2024-09-10T10:24:09.161 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-10T10:24:09.161 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T10:24:09.161 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T10:24:09.161 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T10:24:09.162 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T10:24:09.163 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T10:24:09.164 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T10:24:09.164 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T10:24:09.164 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T10:24:09.164 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T10:24:09.164 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T10:24:09.164 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T10:24:09.164 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T10:24:09.164 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T10:24:09.164 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T10:24:09.165 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T10:24:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T10:24:09.167 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T10:24:09.168 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T10:24:09.169 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T10:24:09.170 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T10:24:09.171 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T10:24:09.172 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T10:24:09.173 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T10:24:09.174 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T10:24:09.175 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout:Install 148 Packages 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 8 Packages 2024-09-10T10:24:09.176 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:24:09.177 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 226 M 2024-09-10T10:24:09.177 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-10T10:24:09.678 INFO:teuthology.orchestra.run.smithi097.stdout:(10/156): ceph-common-19.1.1-305.g1cf819b7.el9. 6.1 MB/s | 21 MB 00:03 2024-09-10T10:24:09.725 INFO:teuthology.orchestra.run.smithi121.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2024-09-10T10:24:09.770 INFO:teuthology.orchestra.run.smithi097.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 2.4 MB/s | 228 kB 00:00 2024-09-10T10:24:09.845 INFO:teuthology.orchestra.run.smithi097.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 360 kB/s | 27 kB 00:00 2024-09-10T10:24:09.937 INFO:teuthology.orchestra.run.smithi097.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 346 kB/s | 32 kB 00:00 2024-09-10T10:24:10.096 INFO:teuthology.orchestra.run.smithi097.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 4.6 MB/s | 751 kB 00:00 2024-09-10T10:24:10.196 INFO:teuthology.orchestra.run.smithi097.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 1.6 MB/s | 164 kB 00:00 2024-09-10T10:24:10.280 INFO:teuthology.orchestra.run.smithi097.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 1.5 MB/s | 127 kB 00:00 2024-09-10T10:24:10.355 INFO:teuthology.orchestra.run.smithi097.stdout:(17/156): libradosstriper1-19.1.1-305.g1cf819b7 6.6 MB/s | 506 kB 00:00 2024-09-10T10:24:10.475 INFO:teuthology.orchestra.run.smithi121.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.2 MB/s | 897 kB 00:00 2024-09-10T10:24:10.488 INFO:teuthology.orchestra.run.smithi097.stdout:(18/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 4.1 MB/s | 11 MB 00:02 2024-09-10T10:24:10.547 INFO:teuthology.orchestra.run.smithi097.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 777 kB/s | 45 kB 00:00 2024-09-10T10:24:10.567 INFO:teuthology.orchestra.run.smithi121.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.5 MB/s | 145 kB 00:00 2024-09-10T10:24:10.614 INFO:teuthology.orchestra.run.smithi097.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.0 MB/s | 136 kB 00:00 2024-09-10T10:24:10.689 INFO:teuthology.orchestra.run.smithi097.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.1 MB/s | 161 kB 00:00 2024-09-10T10:24:10.815 INFO:teuthology.orchestra.run.smithi097.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 2.5 MB/s | 320 kB 00:00 2024-09-10T10:24:10.834 INFO:teuthology.orchestra.run.smithi121.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 3.9 MB/s | 5.4 MB 00:01 2024-09-10T10:24:10.907 INFO:teuthology.orchestra.run.smithi097.stdout:(23/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 9.7 MB/s | 5.3 MB 00:00 2024-09-10T10:24:10.932 INFO:teuthology.orchestra.run.smithi097.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 2.5 MB/s | 301 kB 00:00 2024-09-10T10:24:10.982 INFO:teuthology.orchestra.run.smithi097.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.3 MB/s | 99 kB 00:00 2024-09-10T10:24:10.999 INFO:teuthology.orchestra.run.smithi097.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-10T10:24:11.009 INFO:teuthology.orchestra.run.smithi121.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-10T10:24:11.074 INFO:teuthology.orchestra.run.smithi097.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-09-10T10:24:11.158 INFO:teuthology.orchestra.run.smithi097.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 382 kB/s | 32 kB 00:00 2024-09-10T10:24:11.250 INFO:teuthology.orchestra.run.smithi097.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.6 MB/s | 146 kB 00:00 2024-09-10T10:24:11.343 INFO:teuthology.orchestra.run.smithi121.stdout:(6/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 3.1 MB/s | 2.4 MB 00:00 2024-09-10T10:24:11.469 INFO:teuthology.orchestra.run.smithi121.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 10 MB/s | 4.7 MB 00:00 2024-09-10T10:24:11.692 INFO:teuthology.orchestra.run.smithi097.stdout:(30/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 15 MB/s | 49 MB 00:03 2024-09-10T10:24:11.751 INFO:teuthology.orchestra.run.smithi097.stdout:(31/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 4.0 MB/s | 3.1 MB 00:00 2024-09-10T10:24:11.851 INFO:teuthology.orchestra.run.smithi097.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.4 MB/s | 249 kB 00:00 2024-09-10T10:24:11.960 INFO:teuthology.orchestra.run.smithi097.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 456 kB/s | 49 kB 00:00 2024-09-10T10:24:12.051 INFO:teuthology.orchestra.run.smithi097.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 180 kB/s | 16 kB 00:00 2024-09-10T10:24:12.119 INFO:teuthology.orchestra.run.smithi121.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 8.0 MB/s | 21 MB 00:02 2024-09-10T10:24:12.152 INFO:teuthology.orchestra.run.smithi097.stdout:(35/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 3.9 MB/s | 3.6 MB 00:00 2024-09-10T10:24:12.177 INFO:teuthology.orchestra.run.smithi097.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 2.2 MB/s | 285 kB 00:00 2024-09-10T10:24:12.211 INFO:teuthology.orchestra.run.smithi121.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 275 kB/s | 25 kB 00:00 2024-09-10T10:24:12.302 INFO:teuthology.orchestra.run.smithi097.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-10T10:24:12.319 INFO:teuthology.orchestra.run.smithi097.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 129 kB/s | 18 kB 00:00 2024-09-10T10:24:12.319 INFO:teuthology.orchestra.run.smithi121.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 12 MB/s | 11 MB 00:00 2024-09-10T10:24:12.353 INFO:teuthology.orchestra.run.smithi097.stdout:(39/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 3.7 MB/s | 766 kB 00:00 2024-09-10T10:24:12.386 INFO:teuthology.orchestra.run.smithi121.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 3.4 MB/s | 228 kB 00:00 2024-09-10T10:24:12.445 INFO:teuthology.orchestra.run.smithi097.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-10T10:24:12.453 INFO:teuthology.orchestra.run.smithi121.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 406 kB/s | 27 kB 00:00 2024-09-10T10:24:12.486 INFO:teuthology.orchestra.run.smithi097.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-10T10:24:12.520 INFO:teuthology.orchestra.run.smithi121.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 476 kB/s | 32 kB 00:00 2024-09-10T10:24:12.528 INFO:teuthology.orchestra.run.smithi097.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-10T10:24:12.562 INFO:teuthology.orchestra.run.smithi097.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 801 kB 00:00 2024-09-10T10:24:12.588 INFO:teuthology.orchestra.run.smithi097.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T10:24:12.613 INFO:teuthology.orchestra.run.smithi097.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T10:24:12.620 INFO:teuthology.orchestra.run.smithi121.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 7.3 MB/s | 751 kB 00:00 2024-09-10T10:24:12.638 INFO:teuthology.orchestra.run.smithi097.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T10:24:12.664 INFO:teuthology.orchestra.run.smithi097.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-10T10:24:12.695 INFO:teuthology.orchestra.run.smithi121.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.1 MB/s | 164 kB 00:00 2024-09-10T10:24:12.706 INFO:teuthology.orchestra.run.smithi097.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.6 MB/s | 1.2 MB 00:00 2024-09-10T10:24:12.779 INFO:teuthology.orchestra.run.smithi121.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 1.5 MB/s | 127 kB 00:00 2024-09-10T10:24:12.871 INFO:teuthology.orchestra.run.smithi121.stdout:(17/156): libradosstriper1-19.1.1-305.g1cf819b7 5.4 MB/s | 506 kB 00:00 2024-09-10T10:24:13.364 INFO:teuthology.orchestra.run.smithi097.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 162 kB/s | 107 kB 00:00 2024-09-10T10:24:13.455 INFO:teuthology.orchestra.run.smithi121.stdout:(18/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 9.2 MB/s | 5.3 MB 00:00 2024-09-10T10:24:13.506 INFO:teuthology.orchestra.run.smithi097.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 794 kB/s | 689 kB 00:00 2024-09-10T10:24:13.530 INFO:teuthology.orchestra.run.smithi121.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 602 kB/s | 45 kB 00:00 2024-09-10T10:24:13.556 INFO:teuthology.orchestra.run.smithi097.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-10T10:24:13.597 INFO:teuthology.orchestra.run.smithi121.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.0 MB/s | 136 kB 00:00 2024-09-10T10:24:13.602 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.5 MB 00:03 2024-09-10T10:24:13.672 INFO:teuthology.orchestra.run.smithi121.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.1 MB/s | 161 kB 00:00 2024-09-10T10:24:13.772 INFO:teuthology.orchestra.run.smithi121.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 3.1 MB/s | 320 kB 00:00 2024-09-10T10:24:13.907 INFO:teuthology.orchestra.run.smithi097.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 40 kB/s | 22 kB 00:00 2024-09-10T10:24:14.107 INFO:teuthology.orchestra.run.smithi097.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-10T10:24:14.215 INFO:teuthology.orchestra.run.smithi121.stdout:(23/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 24 MB/s | 49 MB 00:02 2024-09-10T10:24:14.240 INFO:teuthology.orchestra.run.smithi121.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 644 kB/s | 301 kB 00:00 2024-09-10T10:24:14.274 INFO:teuthology.orchestra.run.smithi121.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.7 MB/s | 99 kB 00:00 2024-09-10T10:24:14.299 INFO:teuthology.orchestra.run.smithi097.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 396 kB/s | 313 kB 00:00 2024-09-10T10:24:14.432 INFO:teuthology.orchestra.run.smithi121.stdout:(26/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 5.5 MB/s | 17 MB 00:03 2024-09-10T10:24:14.457 INFO:teuthology.orchestra.run.smithi121.stdout:(27/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 391 kB/s | 85 kB 00:00 2024-09-10T10:24:14.482 INFO:teuthology.orchestra.run.smithi121.stdout:(28/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-10T10:24:14.516 INFO:teuthology.orchestra.run.smithi121.stdout:(29/156): ceph-grafana-dashboards-19.1.1-305.g1 543 kB/s | 32 kB 00:00 2024-09-10T10:24:14.533 INFO:teuthology.orchestra.run.smithi121.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.8 MB/s | 146 kB 00:00 2024-09-10T10:24:14.584 INFO:teuthology.orchestra.run.smithi121.stdout:(31/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 10 MB/s | 3.1 MB 00:00 2024-09-10T10:24:14.590 INFO:teuthology.orchestra.run.smithi097.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-10T10:24:14.675 INFO:teuthology.orchestra.run.smithi121.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 2.7 MB/s | 249 kB 00:00 2024-09-10T10:24:14.751 INFO:teuthology.orchestra.run.smithi121.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 659 kB/s | 49 kB 00:00 2024-09-10T10:24:14.774 INFO:teuthology.orchestra.run.smithi097.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-10T10:24:14.809 INFO:teuthology.orchestra.run.smithi121.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 283 kB/s | 16 kB 00:00 2024-09-10T10:24:14.893 INFO:teuthology.orchestra.run.smithi121.stdout:(35/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 3.3 MB/s | 285 kB 00:00 2024-09-10T10:24:14.952 INFO:teuthology.orchestra.run.smithi121.stdout:(36/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 8.2 MB/s | 3.6 MB 00:00 2024-09-10T10:24:14.985 INFO:teuthology.orchestra.run.smithi121.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 8.2 MB/s | 766 kB 00:00 2024-09-10T10:24:15.027 INFO:teuthology.orchestra.run.smithi121.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 243 kB/s | 18 kB 00:00 2024-09-10T10:24:15.053 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-10T10:24:15.058 INFO:teuthology.orchestra.run.smithi097.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-09-10T10:24:15.119 INFO:teuthology.orchestra.run.smithi121.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-10T10:24:15.186 INFO:teuthology.orchestra.run.smithi121.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T10:24:15.244 INFO:teuthology.orchestra.run.smithi121.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-10T10:24:15.270 INFO:teuthology.orchestra.run.smithi121.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-10T10:24:15.320 INFO:teuthology.orchestra.run.smithi121.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-10T10:24:15.345 INFO:teuthology.orchestra.run.smithi121.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-10T10:24:15.358 INFO:teuthology.orchestra.run.smithi097.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-10T10:24:15.371 INFO:teuthology.orchestra.run.smithi121.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T10:24:15.396 INFO:teuthology.orchestra.run.smithi121.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T10:24:15.421 INFO:teuthology.orchestra.run.smithi121.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-10T10:24:15.442 INFO:teuthology.orchestra.run.smithi097.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 188 kB/s | 160 kB 00:00 2024-09-10T10:24:15.597 INFO:teuthology.orchestra.run.smithi121.stdout:(48/156): ceph-mgr-diskprediction-local-19.1.1- 6.9 MB/s | 7.4 MB 00:01 2024-09-10T10:24:15.790 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-10T10:24:15.942 INFO:teuthology.orchestra.run.smithi097.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 750 kB/s | 662 kB 00:00 2024-09-10T10:24:16.001 INFO:teuthology.orchestra.run.smithi097.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-10T10:24:16.330 INFO:teuthology.orchestra.run.smithi097.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 612 kB/s | 581 kB 00:00 2024-09-10T10:24:16.330 INFO:teuthology.orchestra.run.smithi121.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 257 kB/s | 107 kB 00:00 2024-09-10T10:24:16.330 INFO:teuthology.orchestra.run.smithi121.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-10T10:24:16.330 INFO:teuthology.orchestra.run.smithi121.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 878 kB/s | 689 kB 00:00 2024-09-10T10:24:16.331 INFO:teuthology.orchestra.run.smithi121.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-10T10:24:16.331 INFO:teuthology.orchestra.run.smithi121.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-10T10:24:16.390 INFO:teuthology.orchestra.run.smithi121.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-10T10:24:16.474 INFO:teuthology.orchestra.run.smithi121.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 893 kB/s | 313 kB 00:00 2024-09-10T10:24:16.499 INFO:teuthology.orchestra.run.smithi121.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-10T10:24:16.526 INFO:teuthology.orchestra.run.smithi097.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-10T10:24:16.582 INFO:teuthology.orchestra.run.smithi121.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-10T10:24:16.608 INFO:teuthology.orchestra.run.smithi121.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-10T10:24:16.658 INFO:teuthology.orchestra.run.smithi121.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-09-10T10:24:16.766 INFO:teuthology.orchestra.run.smithi121.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-10T10:24:16.793 INFO:teuthology.orchestra.run.smithi097.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-09-10T10:24:16.875 INFO:teuthology.orchestra.run.smithi121.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-10T10:24:16.900 INFO:teuthology.orchestra.run.smithi121.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 355 kB/s | 47 kB 00:00 2024-09-10T10:24:16.934 INFO:teuthology.orchestra.run.smithi121.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 1.7 MB/s | 581 kB 00:00 2024-09-10T10:24:16.984 INFO:teuthology.orchestra.run.smithi121.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-10T10:24:17.034 INFO:teuthology.orchestra.run.smithi121.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 384 kB/s | 38 kB 00:00 2024-09-10T10:24:17.035 INFO:teuthology.orchestra.run.smithi097.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 260 kB/s | 188 kB 00:00 2024-09-10T10:24:17.094 INFO:teuthology.orchestra.run.smithi097.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-10T10:24:17.168 INFO:teuthology.orchestra.run.smithi121.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 704 kB/s | 188 kB 00:00 2024-09-10T10:24:18.035 INFO:teuthology.orchestra.run.smithi097.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.0 MB/s | 4.9 MB 00:01 2024-09-10T10:24:18.085 INFO:teuthology.orchestra.run.smithi097.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-10T10:24:18.169 INFO:teuthology.orchestra.run.smithi097.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-09-10T10:24:18.251 INFO:teuthology.orchestra.run.smithi121.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-09-10T10:24:18.560 INFO:teuthology.orchestra.run.smithi121.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.1 MB/s | 4.9 MB 00:01 2024-09-10T10:24:18.794 INFO:teuthology.orchestra.run.smithi097.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 194 kB/s | 137 kB 00:00 2024-09-10T10:24:18.819 INFO:teuthology.orchestra.run.smithi121.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 532 kB/s | 137 kB 00:00 2024-09-10T10:24:18.945 INFO:teuthology.orchestra.run.smithi097.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-09-10T10:24:19.295 INFO:teuthology.orchestra.run.smithi097.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-09-10T10:24:19.313 INFO:teuthology.orchestra.run.smithi121.stdout:(70/156): postgresql-13.16-1.el9.x86_64.rpm 757 kB/s | 1.6 MB 00:02 2024-09-10T10:24:19.522 INFO:teuthology.orchestra.run.smithi121.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 716 kB/s | 910 kB 00:01 2024-09-10T10:24:19.662 INFO:teuthology.orchestra.run.smithi097.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 122 kB/s | 87 kB 00:00 2024-09-10T10:24:19.714 INFO:teuthology.orchestra.run.smithi121.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 456 kB/s | 87 kB 00:00 2024-09-10T10:24:19.771 INFO:teuthology.orchestra.run.smithi097.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-10T10:24:20.271 INFO:teuthology.orchestra.run.smithi097.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 101 kB/s | 61 kB 00:00 2024-09-10T10:24:20.455 INFO:teuthology.orchestra.run.smithi097.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-10T10:24:20.605 INFO:teuthology.orchestra.run.smithi097.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 294 kB/s | 245 kB 00:00 2024-09-10T10:24:20.697 INFO:teuthology.orchestra.run.smithi121.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 747 kB/s | 1.0 MB 00:01 2024-09-10T10:24:20.797 INFO:teuthology.orchestra.run.smithi121.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 614 kB/s | 61 kB 00:00 2024-09-10T10:24:21.005 INFO:teuthology.orchestra.run.smithi097.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 47 kB/s | 26 kB 00:00 2024-09-10T10:24:21.064 INFO:teuthology.orchestra.run.smithi097.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 313 kB/s | 248 kB 00:00 2024-09-10T10:24:21.097 INFO:teuthology.orchestra.run.smithi097.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-10T10:24:21.112 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T10:24:21.139 INFO:teuthology.orchestra.run.smithi121.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 716 kB/s | 245 kB 00:00 2024-09-10T10:24:21.481 INFO:teuthology.orchestra.run.smithi121.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 727 kB/s | 248 kB 00:00 2024-09-10T10:24:21.590 INFO:teuthology.orchestra.run.smithi121.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-10T10:24:21.614 INFO:teuthology.orchestra.run.smithi097.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-10T10:24:21.693 INFO:teuthology.orchestra.run.smithi121.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 192 kB/s | 19 kB 00:00 2024-09-10T10:24:21.739 INFO:teuthology.orchestra.run.smithi097.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 235 kB/s | 172 kB 00:00 2024-09-10T10:24:21.957 INFO:teuthology.orchestra.run.smithi121.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 646 kB/s | 172 kB 00:00 2024-09-10T10:24:22.057 INFO:teuthology.orchestra.run.smithi121.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 35 kB 00:00 2024-09-10T10:24:22.207 INFO:teuthology.orchestra.run.smithi097.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-10T10:24:22.482 INFO:teuthology.orchestra.run.smithi097.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 289 kB/s | 250 kB 00:00 2024-09-10T10:24:22.582 INFO:teuthology.orchestra.run.smithi097.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 264 kB/s | 222 kB 00:00 2024-09-10T10:24:22.849 INFO:teuthology.orchestra.run.smithi097.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-09-10T10:24:23.066 INFO:teuthology.orchestra.run.smithi097.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 72 kB/s | 42 kB 00:00 2024-09-10T10:24:23.449 INFO:teuthology.orchestra.run.smithi097.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 311 kB/s | 269 kB 00:00 2024-09-10T10:24:23.457 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:24:23.458 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T10:24:23.472 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T10:24:23.473 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T10:24:23.474 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T10:24:23.475 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T10:24:23.477 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T10:24:23.480 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T10:24:23.481 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T10:24:23.543 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-10T10:24:23.558 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-10T10:24:23.558 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-10T10:24:23.558 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-10T10:24:23.558 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-10T10:24:23.558 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T10:24:23.558 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T10:24:23.558 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T10:24:23.558 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T10:24:23.559 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T10:24:23.560 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T10:24:23.561 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T10:24:23.562 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T10:24:23.563 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T10:24:23.564 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T10:24:23.565 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T10:24:23.566 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T10:24:23.567 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T10:24:23.568 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T10:24:23.569 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T10:24:23.569 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T10:24:23.569 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T10:24:23.569 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T10:24:23.569 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T10:24:23.569 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T10:24:23.569 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T10:24:23.569 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T10:24:23.569 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T10:24:23.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T10:24:23.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T10:24:23.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T10:24:23.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T10:24:23.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T10:24:23.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T10:24:23.570 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T10:24:23.570 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T10:24:23.570 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout:Install 148 Packages 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 8 Packages 2024-09-10T10:24:23.571 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:24:23.572 INFO:teuthology.orchestra.run.smithi097.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 221 kB/s | 159 kB 00:00 2024-09-10T10:24:23.573 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 226 M 2024-09-10T10:24:23.573 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-10T10:24:23.966 INFO:teuthology.orchestra.run.smithi097.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 312 kB/s | 279 kB 00:00 2024-09-10T10:24:24.041 INFO:teuthology.orchestra.run.smithi097.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-10T10:24:24.106 INFO:teuthology.orchestra.run.smithi092.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-10T10:24:24.234 INFO:teuthology.orchestra.run.smithi097.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 80 kB/s | 54 kB 00:00 2024-09-10T10:24:24.339 INFO:teuthology.orchestra.run.smithi092.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 3.8 MB/s | 897 kB 00:00 2024-09-10T10:24:24.456 INFO:teuthology.orchestra.run.smithi092.stdout:(3/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-10T10:24:24.481 INFO:teuthology.orchestra.run.smithi092.stdout:(4/156): ceph-immutable-object-cache-19.1.1-305 1.0 MB/s | 145 kB 00:00 2024-09-10T10:24:24.573 INFO:teuthology.orchestra.run.smithi092.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-10T10:24:24.601 INFO:teuthology.orchestra.run.smithi097.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 75 kB/s | 42 kB 00:00 2024-09-10T10:24:24.707 INFO:teuthology.orchestra.run.smithi092.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 6.7 MB/s | 1.5 MB 00:00 2024-09-10T10:24:24.809 INFO:teuthology.orchestra.run.smithi097.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 77 kB/s | 44 kB 00:00 2024-09-10T10:24:24.824 INFO:teuthology.orchestra.run.smithi092.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-10T10:24:25.174 INFO:teuthology.orchestra.run.smithi092.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 18 MB/s | 21 MB 00:01 2024-09-10T10:24:25.208 INFO:teuthology.orchestra.run.smithi092.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 758 kB/s | 25 kB 00:00 2024-09-10T10:24:25.368 INFO:teuthology.orchestra.run.smithi097.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-10T10:24:25.393 INFO:teuthology.orchestra.run.smithi097.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 61 kB/s | 36 kB 00:00 2024-09-10T10:24:25.418 INFO:teuthology.orchestra.run.smithi097.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 270 kB/s | 221 kB 00:00 2024-09-10T10:24:25.441 INFO:teuthology.orchestra.run.smithi092.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 17 MB/s | 11 MB 00:00 2024-09-10T10:24:25.500 INFO:teuthology.orchestra.run.smithi092.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 3.8 MB/s | 228 kB 00:00 2024-09-10T10:24:25.583 INFO:teuthology.orchestra.run.smithi092.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 325 kB/s | 27 kB 00:00 2024-09-10T10:24:25.776 INFO:teuthology.orchestra.run.smithi092.stdout:(13/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 16 MB/s | 17 MB 00:01 2024-09-10T10:24:25.792 INFO:teuthology.orchestra.run.smithi092.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 152 kB/s | 32 kB 00:00 2024-09-10T10:24:25.826 INFO:teuthology.orchestra.run.smithi092.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 15 MB/s | 751 kB 00:00 2024-09-10T10:24:25.851 INFO:teuthology.orchestra.run.smithi092.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.7 MB/s | 164 kB 00:00 2024-09-10T10:24:25.877 INFO:teuthology.orchestra.run.smithi092.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T10:24:25.902 INFO:teuthology.orchestra.run.smithi092.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 9.8 MB/s | 506 kB 00:00 2024-09-10T10:24:25.961 INFO:teuthology.orchestra.run.smithi092.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 775 kB/s | 45 kB 00:00 2024-09-10T10:24:26.044 INFO:teuthology.orchestra.run.smithi092.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.6 MB/s | 136 kB 00:00 2024-09-10T10:24:26.117 INFO:teuthology.orchestra.run.smithi097.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 63 kB/s | 47 kB 00:00 2024-09-10T10:24:26.119 INFO:teuthology.orchestra.run.smithi092.stdout:(21/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 22 MB/s | 5.3 MB 00:00 2024-09-10T10:24:26.139 INFO:teuthology.orchestra.run.smithi097.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 80 kB/s | 58 kB 00:00 2024-09-10T10:24:26.144 INFO:teuthology.orchestra.run.smithi092.stdout:(22/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.6 MB/s | 161 kB 00:00 2024-09-10T10:24:26.182 INFO:teuthology.orchestra.run.smithi092.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 5.4 MB/s | 320 kB 00:00 2024-09-10T10:24:26.203 INFO:teuthology.orchestra.run.smithi092.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.0 MB/s | 301 kB 00:00 2024-09-10T10:24:26.228 INFO:teuthology.orchestra.run.smithi092.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T10:24:26.254 INFO:teuthology.orchestra.run.smithi092.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-10T10:24:26.280 INFO:teuthology.orchestra.run.smithi097.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 343 kB/s | 304 kB 00:00 2024-09-10T10:24:26.313 INFO:teuthology.orchestra.run.smithi092.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.8 MB/s | 170 kB 00:00 2024-09-10T10:24:26.371 INFO:teuthology.orchestra.run.smithi092.stdout:(28/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 22 MB/s | 3.1 MB 00:00 2024-09-10T10:24:26.396 INFO:teuthology.orchestra.run.smithi092.stdout:(29/156): ceph-grafana-dashboards-19.1.1-305.g1 382 kB/s | 32 kB 00:00 2024-09-10T10:24:26.430 INFO:teuthology.orchestra.run.smithi092.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.4 MB/s | 146 kB 00:00 2024-09-10T10:24:26.498 INFO:teuthology.orchestra.run.smithi121.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 770 kB/s | 5.8 MB 00:07 2024-09-10T10:24:26.655 INFO:teuthology.orchestra.run.smithi092.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 14 MB/s | 3.6 MB 00:00 2024-09-10T10:24:26.722 INFO:teuthology.orchestra.run.smithi092.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 3.7 MB/s | 249 kB 00:00 2024-09-10T10:24:26.756 INFO:teuthology.orchestra.run.smithi097.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-10T10:24:26.797 INFO:teuthology.orchestra.run.smithi097.stdout:(102/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 141 kB/s | 96 kB 00:00 2024-09-10T10:24:26.848 INFO:teuthology.orchestra.run.smithi097.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-10T10:24:26.848 INFO:teuthology.orchestra.run.smithi121.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 716 kB/s | 250 kB 00:00 2024-09-10T10:24:26.850 INFO:teuthology.orchestra.run.smithi092.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-10T10:24:26.867 INFO:teuthology.orchestra.run.smithi092.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 342 kB/s | 49 kB 00:00 2024-09-10T10:24:26.873 INFO:teuthology.orchestra.run.smithi097.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-10T10:24:26.900 INFO:teuthology.orchestra.run.smithi092.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 328 kB/s | 16 kB 00:00 2024-09-10T10:24:26.915 INFO:teuthology.orchestra.run.smithi097.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-10T10:24:26.925 INFO:teuthology.orchestra.run.smithi092.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 4.8 MB/s | 285 kB 00:00 2024-09-10T10:24:26.932 INFO:teuthology.orchestra.run.smithi097.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-09-10T10:24:26.965 INFO:teuthology.orchestra.run.smithi097.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-09-10T10:24:26.984 INFO:teuthology.orchestra.run.smithi092.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 9.0 MB/s | 766 kB 00:00 2024-09-10T10:24:26.991 INFO:teuthology.orchestra.run.smithi097.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T10:24:27.005 INFO:teuthology.orchestra.run.smithi092.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 242 kB/s | 18 kB 00:00 2024-09-10T10:24:27.016 INFO:teuthology.orchestra.run.smithi097.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T10:24:27.041 INFO:teuthology.orchestra.run.smithi097.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T10:24:27.067 INFO:teuthology.orchestra.run.smithi097.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-10T10:24:27.085 INFO:teuthology.orchestra.run.smithi092.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 796 kB/s | 80 kB 00:00 2024-09-10T10:24:27.109 INFO:teuthology.orchestra.run.smithi097.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-10T10:24:27.159 INFO:teuthology.orchestra.run.smithi097.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-10T10:24:27.184 INFO:teuthology.orchestra.run.smithi097.stdout:(114/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-10T10:24:27.190 INFO:teuthology.orchestra.run.smithi121.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 650 kB/s | 222 kB 00:00 2024-09-10T10:24:27.209 INFO:teuthology.orchestra.run.smithi097.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-09-10T10:24:27.243 INFO:teuthology.orchestra.run.smithi097.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 545 kB/s | 14 kB 00:00 2024-09-10T10:24:27.293 INFO:teuthology.orchestra.run.smithi097.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 295 kB/s | 32 kB 00:00 2024-09-10T10:24:27.310 INFO:teuthology.orchestra.run.smithi097.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.6 MB/s | 172 kB 00:00 2024-09-10T10:24:27.344 INFO:teuthology.orchestra.run.smithi097.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-10T10:24:27.369 INFO:teuthology.orchestra.run.smithi097.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-10T10:24:27.374 INFO:teuthology.orchestra.run.smithi121.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 421 kB/s | 77 kB 00:00 2024-09-10T10:24:27.428 INFO:teuthology.orchestra.run.smithi097.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-10T10:24:27.456 INFO:teuthology.orchestra.run.smithi097.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.9 MB/s | 220 kB 00:00 2024-09-10T10:24:27.478 INFO:teuthology.orchestra.run.smithi097.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 492 kB/s | 11 kB 00:00 2024-09-10T10:24:27.482 INFO:teuthology.orchestra.run.smithi121.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-09-10T10:24:27.502 INFO:teuthology.orchestra.run.smithi092.stdout:(40/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 21 MB/s | 49 MB 00:02 2024-09-10T10:24:27.503 INFO:teuthology.orchestra.run.smithi097.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-10T10:24:27.527 INFO:teuthology.orchestra.run.smithi092.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 432 kB/s | 191 kB 00:00 2024-09-10T10:24:27.529 INFO:teuthology.orchestra.run.smithi097.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 349 kB/s | 18 kB 00:00 2024-09-10T10:24:27.554 INFO:teuthology.orchestra.run.smithi097.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-10T10:24:27.560 INFO:teuthology.orchestra.run.smithi092.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-10T10:24:27.580 INFO:teuthology.orchestra.run.smithi097.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-10T10:24:27.602 INFO:teuthology.orchestra.run.smithi092.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-10T10:24:27.605 INFO:teuthology.orchestra.run.smithi097.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T10:24:27.630 INFO:teuthology.orchestra.run.smithi097.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T10:24:27.644 INFO:teuthology.orchestra.run.smithi092.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-10T10:24:27.656 INFO:teuthology.orchestra.run.smithi097.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T10:24:27.670 INFO:teuthology.orchestra.run.smithi092.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-10T10:24:27.681 INFO:teuthology.orchestra.run.smithi097.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T10:24:27.695 INFO:teuthology.orchestra.run.smithi092.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T10:24:27.715 INFO:teuthology.orchestra.run.smithi097.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-10T10:24:27.728 INFO:teuthology.orchestra.run.smithi092.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-10T10:24:27.740 INFO:teuthology.orchestra.run.smithi097.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-10T10:24:27.762 INFO:teuthology.orchestra.run.smithi092.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.2 MB/s | 1.2 MB 00:00 2024-09-10T10:24:27.765 INFO:teuthology.orchestra.run.smithi097.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T10:24:27.782 INFO:teuthology.orchestra.run.smithi097.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-10T10:24:27.807 INFO:teuthology.orchestra.run.smithi097.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 673 kB/s | 28 kB 00:00 2024-09-10T10:24:27.833 INFO:teuthology.orchestra.run.smithi097.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-10T10:24:27.858 INFO:teuthology.orchestra.run.smithi097.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T10:24:27.883 INFO:teuthology.orchestra.run.smithi097.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-10T10:24:27.899 INFO:teuthology.orchestra.run.smithi121.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 646 kB/s | 269 kB 00:00 2024-09-10T10:24:27.908 INFO:teuthology.orchestra.run.smithi097.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-10T10:24:27.929 INFO:teuthology.orchestra.run.smithi092.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 642 kB/s | 107 kB 00:00 2024-09-10T10:24:27.934 INFO:teuthology.orchestra.run.smithi097.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T10:24:27.975 INFO:teuthology.orchestra.run.smithi121.stdout:(87/156): python3-babel-2.9.1-2.el9.noarch.rpm 739 kB/s | 6.0 MB 00:08 2024-09-10T10:24:27.976 INFO:teuthology.orchestra.run.smithi097.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-10T10:24:27.979 INFO:teuthology.orchestra.run.smithi092.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-10T10:24:28.001 INFO:teuthology.orchestra.run.smithi097.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-10T10:24:28.004 INFO:teuthology.orchestra.run.smithi092.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-10T10:24:28.026 INFO:teuthology.orchestra.run.smithi097.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-10T10:24:28.046 INFO:teuthology.orchestra.run.smithi092.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-10T10:24:28.052 INFO:teuthology.orchestra.run.smithi097.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-09-10T10:24:28.071 INFO:teuthology.orchestra.run.smithi092.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-10T10:24:28.077 INFO:teuthology.orchestra.run.smithi097.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T10:24:28.102 INFO:teuthology.orchestra.run.smithi097.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T10:24:28.122 INFO:teuthology.orchestra.run.smithi092.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T10:24:28.147 INFO:teuthology.orchestra.run.smithi092.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-10T10:24:28.152 INFO:teuthology.orchestra.run.smithi097.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T10:24:28.167 INFO:teuthology.orchestra.run.smithi121.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 595 kB/s | 159 kB 00:00 2024-09-10T10:24:28.172 INFO:teuthology.orchestra.run.smithi092.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T10:24:28.198 INFO:teuthology.orchestra.run.smithi092.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-10T10:24:28.223 INFO:teuthology.orchestra.run.smithi092.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-10T10:24:28.267 INFO:teuthology.orchestra.run.smithi121.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2024-09-10T10:24:28.323 INFO:teuthology.orchestra.run.smithi092.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-10T10:24:28.336 INFO:teuthology.orchestra.run.smithi097.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-10T10:24:28.357 INFO:teuthology.orchestra.run.smithi092.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-10T10:24:28.367 INFO:teuthology.orchestra.run.smithi121.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 537 kB/s | 54 kB 00:00 2024-09-10T10:24:28.373 INFO:teuthology.orchestra.run.smithi092.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-10T10:24:28.395 INFO:teuthology.orchestra.run.smithi097.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 31 MB/s | 1.8 MB 00:00 2024-09-10T10:24:28.399 INFO:teuthology.orchestra.run.smithi092.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-10T10:24:28.400 INFO:teuthology.orchestra.run.smithi121.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 655 kB/s | 279 kB 00:00 2024-09-10T10:24:28.432 INFO:teuthology.orchestra.run.smithi092.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-10T10:24:28.437 INFO:teuthology.orchestra.run.smithi097.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 982 kB/s | 41 kB 00:00 2024-09-10T10:24:28.458 INFO:teuthology.orchestra.run.smithi092.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-10T10:24:28.479 INFO:teuthology.orchestra.run.smithi097.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-10T10:24:28.483 INFO:teuthology.orchestra.run.smithi092.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 762 kB/s | 38 kB 00:00 2024-09-10T10:24:28.518 INFO:teuthology.orchestra.run.smithi121.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-09-10T10:24:28.537 INFO:teuthology.orchestra.run.smithi097.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-10T10:24:28.613 INFO:teuthology.orchestra.run.smithi097.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-10T10:24:28.651 INFO:teuthology.orchestra.run.smithi121.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 331 kB/s | 44 kB 00:00 2024-09-10T10:24:28.672 INFO:teuthology.orchestra.run.smithi097.stdout:(155/156): librados2-19.1.1-305.g1cf819b7.el9.x 5.8 MB/s | 3.4 MB 00:00 2024-09-10T10:24:28.811 INFO:teuthology.orchestra.run.smithi121.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 773 kB/s | 5.1 MB 00:06 2024-09-10T10:24:28.918 INFO:teuthology.orchestra.run.smithi121.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-10T10:24:28.921 INFO:teuthology.orchestra.run.smithi097.stdout:(156/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 3.9 MB/s | 3.2 MB 00:00 2024-09-10T10:24:28.928 INFO:teuthology.orchestra.run.smithi097.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:24:28.928 INFO:teuthology.orchestra.run.smithi097.stdout:Total 9.8 MB/s | 226 MB 00:23 2024-09-10T10:24:28.983 INFO:teuthology.orchestra.run.smithi092.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.2 MB/s | 3.0 MB 00:00 2024-09-10T10:24:29.027 INFO:teuthology.orchestra.run.smithi121.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-10T10:24:29.053 INFO:teuthology.orchestra.run.smithi121.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 551 kB/s | 221 kB 00:00 2024-09-10T10:24:29.161 INFO:teuthology.orchestra.run.smithi121.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 533 kB/s | 58 kB 00:00 2024-09-10T10:24:29.345 INFO:teuthology.orchestra.run.smithi121.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 522 kB/s | 96 kB 00:00 2024-09-10T10:24:29.453 INFO:teuthology.orchestra.run.smithi121.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 714 kB/s | 304 kB 00:00 2024-09-10T10:24:29.562 INFO:teuthology.orchestra.run.smithi121.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 414 kB/s | 45 kB 00:00 2024-09-10T10:24:29.587 INFO:teuthology.orchestra.run.smithi121.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 263 kB/s | 64 kB 00:00 2024-09-10T10:24:29.654 INFO:teuthology.orchestra.run.smithi121.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-10T10:24:29.713 INFO:teuthology.orchestra.run.smithi121.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T10:24:29.738 INFO:teuthology.orchestra.run.smithi121.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-10T10:24:29.763 INFO:teuthology.orchestra.run.smithi121.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-10T10:24:29.767 INFO:teuthology.orchestra.run.smithi092.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-10T10:24:29.797 INFO:teuthology.orchestra.run.smithi121.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-10T10:24:29.839 INFO:teuthology.orchestra.run.smithi121.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 628 kB/s | 26 kB 00:00 2024-09-10T10:24:29.856 INFO:teuthology.orchestra.run.smithi121.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.8 MB/s | 49 kB 00:00 2024-09-10T10:24:29.881 INFO:teuthology.orchestra.run.smithi121.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T10:24:29.915 INFO:teuthology.orchestra.run.smithi121.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T10:24:29.917 INFO:teuthology.orchestra.run.smithi092.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.1 MB/s | 4.4 MB 00:01 2024-09-10T10:24:29.982 INFO:teuthology.orchestra.run.smithi121.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-10T10:24:30.024 INFO:teuthology.orchestra.run.smithi121.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-09-10T10:24:30.049 INFO:teuthology.orchestra.run.smithi121.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T10:24:30.067 INFO:teuthology.orchestra.run.smithi092.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.1 MB/s | 4.9 MB 00:01 2024-09-10T10:24:30.074 INFO:teuthology.orchestra.run.smithi121.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T10:24:30.084 INFO:teuthology.orchestra.run.smithi092.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 823 kB/s | 137 kB 00:00 2024-09-10T10:24:30.099 INFO:teuthology.orchestra.run.smithi121.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-10T10:24:30.125 INFO:teuthology.orchestra.run.smithi121.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-10T10:24:30.146 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction check 2024-09-10T10:24:30.150 INFO:teuthology.orchestra.run.smithi121.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T10:24:30.175 INFO:teuthology.orchestra.run.smithi121.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-10T10:24:30.200 INFO:teuthology.orchestra.run.smithi121.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-10T10:24:30.226 INFO:teuthology.orchestra.run.smithi121.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T10:24:30.251 INFO:teuthology.orchestra.run.smithi121.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T10:24:30.276 INFO:teuthology.orchestra.run.smithi121.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-10T10:24:30.300 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction check succeeded. 2024-09-10T10:24:30.300 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction test 2024-09-10T10:24:30.301 INFO:teuthology.orchestra.run.smithi121.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-10T10:24:30.317 INFO:teuthology.orchestra.run.smithi092.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.6 MB/s | 910 kB 00:00 2024-09-10T10:24:30.327 INFO:teuthology.orchestra.run.smithi121.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-10T10:24:30.352 INFO:teuthology.orchestra.run.smithi121.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-10T10:24:30.378 INFO:teuthology.orchestra.run.smithi121.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-10T10:24:30.402 INFO:teuthology.orchestra.run.smithi092.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-10T10:24:30.420 INFO:teuthology.orchestra.run.smithi121.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 24 MB/s | 1.0 MB 00:00 2024-09-10T10:24:30.461 INFO:teuthology.orchestra.run.smithi121.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-10T10:24:30.487 INFO:teuthology.orchestra.run.smithi121.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 693 kB/s | 46 kB 00:00 2024-09-10T10:24:30.512 INFO:teuthology.orchestra.run.smithi121.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-10T10:24:30.537 INFO:teuthology.orchestra.run.smithi121.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T10:24:30.554 INFO:teuthology.orchestra.run.smithi121.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 990 kB/s | 16 kB 00:00 2024-09-10T10:24:30.588 INFO:teuthology.orchestra.run.smithi121.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-10T10:24:30.613 INFO:teuthology.orchestra.run.smithi121.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-10T10:24:30.635 INFO:teuthology.orchestra.run.smithi092.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-09-10T10:24:30.638 INFO:teuthology.orchestra.run.smithi121.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T10:24:30.664 INFO:teuthology.orchestra.run.smithi121.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-10T10:24:30.677 INFO:teuthology.orchestra.run.smithi092.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-10T10:24:30.689 INFO:teuthology.orchestra.run.smithi121.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T10:24:30.714 INFO:teuthology.orchestra.run.smithi121.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T10:24:30.748 INFO:teuthology.orchestra.run.smithi121.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-09-10T10:24:30.773 INFO:teuthology.orchestra.run.smithi121.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-10T10:24:30.799 INFO:teuthology.orchestra.run.smithi121.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T10:24:30.818 INFO:teuthology.orchestra.run.smithi092.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-10T10:24:30.824 INFO:teuthology.orchestra.run.smithi121.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T10:24:30.849 INFO:teuthology.orchestra.run.smithi121.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-10T10:24:30.874 INFO:teuthology.orchestra.run.smithi121.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-10T10:24:30.900 INFO:teuthology.orchestra.run.smithi121.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T10:24:30.950 INFO:teuthology.orchestra.run.smithi121.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T10:24:30.969 INFO:teuthology.orchestra.run.smithi092.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-10T10:24:31.011 INFO:teuthology.orchestra.run.smithi092.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 616 kB/s | 26 kB 00:00 2024-09-10T10:24:31.053 INFO:teuthology.orchestra.run.smithi092.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-10T10:24:31.161 INFO:teuthology.orchestra.run.smithi092.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-10T10:24:31.211 INFO:teuthology.orchestra.run.smithi092.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-10T10:24:31.500 INFO:teuthology.orchestra.run.smithi121.stdout:(148/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 5.7 MB/s | 3.2 MB 00:00 2024-09-10T10:24:31.559 INFO:teuthology.orchestra.run.smithi121.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 5.2 MB/s | 3.4 MB 00:00 2024-09-10T10:24:31.709 INFO:teuthology.orchestra.run.smithi121.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-09-10T10:24:31.751 INFO:teuthology.orchestra.run.smithi121.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 983 kB/s | 41 kB 00:00 2024-09-10T10:24:31.793 INFO:teuthology.orchestra.run.smithi121.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 7.7 MB/s | 1.8 MB 00:00 2024-09-10T10:24:31.818 INFO:teuthology.orchestra.run.smithi121.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-10T10:24:31.860 INFO:teuthology.orchestra.run.smithi121.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-10T10:24:31.927 INFO:teuthology.orchestra.run.smithi121.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-10T10:24:32.103 INFO:teuthology.orchestra.run.smithi097.stdout:Transaction test succeeded. 2024-09-10T10:24:32.103 INFO:teuthology.orchestra.run.smithi097.stdout:Running transaction 2024-09-10T10:24:32.961 INFO:teuthology.orchestra.run.smithi092.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 2.0 MB/s | 5.8 MB 00:02 2024-09-10T10:24:33.112 INFO:teuthology.orchestra.run.smithi092.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-09-10T10:24:33.262 INFO:teuthology.orchestra.run.smithi092.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-10T10:24:33.345 INFO:teuthology.orchestra.run.smithi092.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 926 kB/s | 77 kB 00:00 2024-09-10T10:24:33.421 INFO:teuthology.orchestra.run.smithi092.stdout:(85/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.0 MB/s | 6.0 MB 00:03 2024-09-10T10:24:33.446 INFO:teuthology.orchestra.run.smithi092.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-10T10:24:33.554 INFO:teuthology.orchestra.run.smithi092.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-10T10:24:33.605 INFO:teuthology.orchestra.run.smithi092.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-09-10T10:24:33.655 INFO:teuthology.orchestra.run.smithi092.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T10:24:33.705 INFO:teuthology.orchestra.run.smithi092.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-09-10T10:24:33.755 INFO:teuthology.orchestra.run.smithi092.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-09-10T10:24:33.814 INFO:teuthology.orchestra.run.smithi092.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.0 MB/s | 5.1 MB 00:02 2024-09-10T10:24:33.839 INFO:teuthology.orchestra.run.smithi092.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 497 kB/s | 42 kB 00:00 2024-09-10T10:24:33.865 INFO:teuthology.orchestra.run.smithi092.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-10T10:24:33.923 INFO:teuthology.orchestra.run.smithi092.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-10T10:24:33.974 INFO:teuthology.orchestra.run.smithi092.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-10T10:24:34.007 INFO:teuthology.orchestra.run.smithi092.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.3 MB/s | 221 kB 00:00 2024-09-10T10:24:34.058 INFO:teuthology.orchestra.run.smithi092.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T10:24:34.149 INFO:teuthology.orchestra.run.smithi092.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-09-10T10:24:34.183 INFO:teuthology.orchestra.run.smithi092.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-10T10:24:34.233 INFO:teuthology.orchestra.run.smithi092.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-09-10T10:24:34.259 INFO:teuthology.orchestra.run.smithi092.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 596 kB/s | 45 kB 00:00 2024-09-10T10:24:34.517 INFO:teuthology.orchestra.run.smithi092.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-09-10T10:24:34.568 INFO:teuthology.orchestra.run.smithi092.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-10T10:24:34.593 INFO:teuthology.orchestra.run.smithi092.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-10T10:24:34.618 INFO:teuthology.orchestra.run.smithi092.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-10T10:24:34.718 INFO:teuthology.orchestra.run.smithi092.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-09-10T10:24:34.743 INFO:teuthology.orchestra.run.smithi092.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T10:24:34.768 INFO:teuthology.orchestra.run.smithi092.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T10:24:34.794 INFO:teuthology.orchestra.run.smithi092.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T10:24:34.819 INFO:teuthology.orchestra.run.smithi092.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-10T10:24:34.853 INFO:teuthology.orchestra.run.smithi092.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-10T10:24:34.886 INFO:teuthology.orchestra.run.smithi092.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-10T10:24:34.912 INFO:teuthology.orchestra.run.smithi092.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T10:24:34.937 INFO:teuthology.orchestra.run.smithi092.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T10:24:34.962 INFO:teuthology.orchestra.run.smithi092.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-10T10:24:34.987 INFO:teuthology.orchestra.run.smithi092.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-10T10:24:35.030 INFO:teuthology.orchestra.run.smithi092.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-10T10:24:35.055 INFO:teuthology.orchestra.run.smithi092.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-10T10:24:35.080 INFO:teuthology.orchestra.run.smithi092.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-10T10:24:35.147 INFO:teuthology.orchestra.run.smithi092.stdout:(121/156): python3-grpcio-1.46.7-10.el9.x86_64. 31 MB/s | 2.0 MB 00:00 2024-09-10T10:24:35.172 INFO:teuthology.orchestra.run.smithi092.stdout:(122/156): protobuf-compiler-3.14.0-13.el9.x86_ 945 kB/s | 863 kB 00:00 2024-09-10T10:24:35.206 INFO:teuthology.orchestra.run.smithi092.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-10T10:24:35.231 INFO:teuthology.orchestra.run.smithi092.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-10T10:24:35.256 INFO:teuthology.orchestra.run.smithi092.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 366 kB/s | 18 kB 00:00 2024-09-10T10:24:35.282 INFO:teuthology.orchestra.run.smithi092.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-10T10:24:35.315 INFO:teuthology.orchestra.run.smithi092.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 330 kB/s | 19 kB 00:00 2024-09-10T10:24:35.332 INFO:teuthology.orchestra.run.smithi092.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 389 kB/s | 20 kB 00:00 2024-09-10T10:24:35.349 INFO:teuthology.orchestra.run.smithi092.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-10T10:24:35.375 INFO:teuthology.orchestra.run.smithi092.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T10:24:35.392 INFO:teuthology.orchestra.run.smithi092.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-10T10:24:35.425 INFO:teuthology.orchestra.run.smithi092.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 9.3 MB/s | 1.0 MB 00:00 2024-09-10T10:24:35.450 INFO:teuthology.orchestra.run.smithi092.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-10T10:24:35.468 INFO:teuthology.orchestra.run.smithi092.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 392 kB/s | 16 kB 00:00 2024-09-10T10:24:35.493 INFO:teuthology.orchestra.run.smithi092.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-10T10:24:35.518 INFO:teuthology.orchestra.run.smithi092.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-10T10:24:35.543 INFO:teuthology.orchestra.run.smithi092.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-10T10:24:35.568 INFO:teuthology.orchestra.run.smithi092.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T10:24:35.593 INFO:teuthology.orchestra.run.smithi092.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-10T10:24:35.619 INFO:teuthology.orchestra.run.smithi092.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-10T10:24:35.644 INFO:teuthology.orchestra.run.smithi092.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T10:24:35.678 INFO:teuthology.orchestra.run.smithi092.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-10T10:24:35.703 INFO:teuthology.orchestra.run.smithi092.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-10T10:24:35.728 INFO:teuthology.orchestra.run.smithi092.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-10T10:24:35.753 INFO:teuthology.orchestra.run.smithi092.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-10T10:24:35.779 INFO:teuthology.orchestra.run.smithi092.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T10:24:35.829 INFO:teuthology.orchestra.run.smithi092.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T10:24:36.063 INFO:teuthology.orchestra.run.smithi092.stdout:(148/156): librados2-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-10T10:24:36.121 INFO:teuthology.orchestra.run.smithi092.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-10T10:24:36.338 INFO:teuthology.orchestra.run.smithi092.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 8.4 MB/s | 2.3 MB 00:00 2024-09-10T10:24:36.380 INFO:teuthology.orchestra.run.smithi092.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 7.0 MB/s | 1.8 MB 00:00 2024-09-10T10:24:36.405 INFO:teuthology.orchestra.run.smithi092.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 610 kB/s | 41 kB 00:00 2024-09-10T10:24:36.430 INFO:teuthology.orchestra.run.smithi092.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-10T10:24:36.472 INFO:teuthology.orchestra.run.smithi092.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-10T10:24:36.523 INFO:teuthology.orchestra.run.smithi092.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-10T10:24:38.384 INFO:teuthology.orchestra.run.smithi097.stdout: Preparing : 1/1 2024-09-10T10:24:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T10:24:38.623 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T10:24:38.827 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T10:24:38.868 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T10:24:38.893 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T10:24:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T10:24:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T10:24:39.369 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:24:39.500 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:24:39.529 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:24:39.612 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:24:39.641 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:24:39.772 INFO:teuthology.orchestra.run.smithi092.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.7 MB/s | 16 MB 00:06 2024-09-10T10:24:39.778 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:24:39.778 INFO:teuthology.orchestra.run.smithi092.stdout:Total 14 MB/s | 226 MB 00:16 2024-09-10T10:24:39.790 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T10:24:39.847 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T10:24:39.875 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:24:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:24:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:24:40.063 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:24:40.085 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:24:40.111 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:24:40.303 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:24:40.458 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:24:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T10:24:40.672 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:24:40.752 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:24:40.981 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:24:41.016 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-10T10:24:41.095 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T10:24:41.167 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-10T10:24:41.167 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-10T10:24:41.197 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T10:24:41.232 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T10:24:41.275 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T10:24:41.349 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T10:24:41.393 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T10:24:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T10:24:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T10:24:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T10:24:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T10:24:41.607 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T10:24:41.660 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T10:24:41.698 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T10:24:41.742 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T10:24:41.819 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T10:24:41.853 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T10:24:41.896 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T10:24:41.925 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T10:24:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T10:24:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T10:24:42.115 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T10:24:42.255 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T10:24:42.309 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T10:24:42.833 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T10:24:42.921 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T10:24:42.951 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T10:24:42.993 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T10:24:43.031 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T10:24:43.072 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T10:24:43.234 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T10:24:43.288 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T10:24:43.343 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T10:24:43.400 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-10T10:24:43.401 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-10T10:24:43.415 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T10:24:43.447 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T10:24:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T10:24:43.538 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T10:24:43.575 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T10:24:43.617 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T10:24:43.661 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T10:24:43.795 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T10:24:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T10:24:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T10:24:43.980 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T10:24:44.012 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T10:24:44.051 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T10:24:44.077 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T10:24:44.102 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T10:24:44.176 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T10:24:44.303 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T10:24:44.335 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T10:24:44.362 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T10:24:44.396 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T10:24:44.436 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T10:24:44.475 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T10:24:44.509 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T10:24:44.534 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T10:24:44.568 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T10:24:44.610 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T10:24:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T10:24:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T10:24:44.776 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T10:24:44.807 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T10:24:44.909 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T10:24:44.958 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T10:24:45.676 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T10:24:45.722 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T10:24:45.756 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T10:24:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T10:24:45.930 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T10:24:45.973 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T10:24:46.051 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T10:24:46.084 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T10:24:46.267 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T10:24:46.290 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T10:24:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T10:24:46.994 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T10:24:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T10:24:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T10:24:48.403 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T10:24:48.431 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T10:24:48.464 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T10:24:48.772 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T10:24:48.819 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:24:48.909 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:24:48.940 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T10:24:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T10:24:49.454 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T10:24:49.497 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:24:49.568 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:24:49.590 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T10:24:49.705 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-10T10:24:49.834 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T10:24:49.873 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T10:24:49.926 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T10:24:49.959 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T10:24:49.993 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T10:24:50.055 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T10:24:50.066 INFO:teuthology.orchestra.run.smithi121.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 767 kB/s | 16 MB 00:21 2024-09-10T10:24:50.072 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:24:50.072 INFO:teuthology.orchestra.run.smithi121.stdout:Total 5.5 MB/s | 226 MB 00:40 2024-09-10T10:24:50.395 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T10:24:50.519 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:24:50.650 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:24:50.687 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:24:50.787 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:24:50.816 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:24:50.976 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T10:24:51.029 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T10:24:51.058 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:24:51.163 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:24:51.192 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:24:51.255 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:24:51.293 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:24:51.297 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-10T10:24:51.318 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:24:51.450 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-10T10:24:51.450 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-10T10:24:51.528 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:24:51.755 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:24:51.884 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:24:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:24:52.049 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T10:24:52.167 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:24:52.242 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:24:52.464 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:24:52.470 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:24:52.509 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:24:52.578 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T10:24:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:24:52.623 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T10:24:52.623 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T10:24:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:24:52.667 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T10:24:52.706 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T10:24:52.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T10:24:52.821 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T10:24:52.836 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:24:52.866 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T10:24:52.898 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T10:24:52.942 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T10:24:52.975 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T10:24:53.002 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T10:24:53.070 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T10:24:53.125 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T10:24:53.164 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T10:24:53.207 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T10:24:53.265 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-10T10:24:53.265 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-10T10:24:53.283 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T10:24:53.318 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T10:24:53.361 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T10:24:53.390 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T10:24:53.458 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T10:24:53.505 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T10:24:53.578 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T10:24:53.728 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T10:24:53.782 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T10:24:54.303 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T10:24:54.394 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T10:24:54.431 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T10:24:54.466 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T10:24:54.503 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T10:24:54.545 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T10:24:54.714 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T10:24:54.782 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T10:24:54.837 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T10:24:54.911 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T10:24:54.949 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T10:24:54.994 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T10:24:55.040 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T10:24:55.076 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T10:24:55.119 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T10:24:55.161 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T10:24:55.296 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T10:24:55.338 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T10:24:55.380 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T10:24:55.482 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T10:24:55.522 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T10:24:55.562 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T10:24:55.587 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T10:24:55.612 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T10:24:55.699 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T10:24:55.871 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T10:24:55.986 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T10:24:56.014 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T10:24:56.056 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T10:24:56.095 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T10:24:56.127 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T10:24:56.157 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T10:24:56.191 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T10:24:56.225 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T10:24:56.266 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T10:24:56.300 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T10:24:56.386 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T10:24:56.438 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T10:24:56.470 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T10:24:56.574 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T10:24:56.629 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T10:24:57.343 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T10:24:57.397 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T10:24:57.430 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T10:24:57.539 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T10:24:57.594 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T10:24:57.639 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T10:24:57.726 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T10:24:57.757 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T10:24:57.940 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T10:24:57.972 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T10:24:58.049 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T10:24:58.706 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T10:24:58.819 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T10:24:59.511 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-10T10:24:59.611 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T10:24:59.649 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T10:24:59.711 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T10:24:59.745 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T10:24:59.770 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T10:24:59.813 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T10:25:00.068 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T10:25:00.144 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T10:25:00.158 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T10:25:00.186 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T10:25:00.219 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T10:25:00.254 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:25:00.368 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:25:00.397 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:25:00.489 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:25:00.518 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:25:00.531 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T10:25:00.574 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:25:00.673 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:25:00.685 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T10:25:00.703 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T10:25:00.740 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T10:25:00.741 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T10:25:00.777 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:25:00.880 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:25:00.902 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:25:00.969 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T10:25:00.995 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:25:01.018 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T10:25:01.189 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:25:01.225 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T10:25:01.260 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:25:01.322 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:25:01.342 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T10:25:01.345 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T10:25:01.460 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T10:25:01.574 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:25:01.645 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:25:01.889 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T10:25:02.263 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T10:25:02.354 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T10:25:02.392 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T10:25:02.435 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T10:25:02.500 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T10:25:02.544 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T10:25:02.576 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T10:25:02.628 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T10:25:02.660 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T10:25:02.688 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T10:25:02.757 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T10:25:02.810 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T10:25:02.841 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T10:25:02.877 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T10:25:02.953 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T10:25:02.989 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T10:25:03.032 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T10:25:03.060 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T10:25:03.130 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T10:25:03.174 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T10:25:03.250 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T10:25:03.385 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T10:25:03.439 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T10:25:03.664 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:25:03.691 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:25:03.960 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T10:25:04.043 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T10:25:04.072 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T10:25:04.114 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T10:25:04.153 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T10:25:04.194 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T10:25:04.249 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:25:04.294 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:25:04.360 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T10:25:04.386 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:25:04.387 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T10:25:04.387 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T10:25:04.387 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:04.422 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T10:25:04.429 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:25:04.477 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T10:25:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:25:04.514 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /sys 2024-09-10T10:25:04.514 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /proc 2024-09-10T10:25:04.514 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /mnt 2024-09-10T10:25:04.514 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /var/tmp 2024-09-10T10:25:04.515 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /home 2024-09-10T10:25:04.515 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /root 2024-09-10T10:25:04.515 INFO:teuthology.orchestra.run.smithi097.stdout:skipping the directory /tmp 2024-09-10T10:25:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:04.551 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T10:25:04.582 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T10:25:04.618 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T10:25:04.664 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T10:25:04.679 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:25:04.694 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:25:04.694 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:04.695 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T10:25:04.695 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:04.700 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T10:25:04.743 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T10:25:04.786 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T10:25:04.922 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T10:25:04.971 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T10:25:05.012 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T10:25:05.115 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T10:25:05.146 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T10:25:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T10:25:05.214 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T10:25:05.239 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T10:25:05.312 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T10:25:05.439 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T10:25:05.479 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T10:25:05.507 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T10:25:05.541 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T10:25:05.580 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T10:25:05.612 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T10:25:05.642 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T10:25:05.677 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T10:25:05.710 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T10:25:05.751 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T10:25:05.794 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T10:25:05.881 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T10:25:05.925 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T10:25:05.956 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T10:25:06.057 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T10:25:06.107 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T10:25:06.182 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:25:06.208 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:25:06.209 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:06.209 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T10:25:06.209 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:25:06.209 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:25:06.209 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:06.442 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:25:06.465 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:25:06.465 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:06.465 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T10:25:06.466 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:25:06.466 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:25:06.466 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:06.829 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T10:25:06.879 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T10:25:06.910 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:25:06.913 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T10:25:06.934 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:25:06.934 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:06.934 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T10:25:06.934 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:25:06.934 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:25:06.934 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:07.020 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T10:25:07.040 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T10:25:07.068 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T10:25:07.097 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T10:25:07.113 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T10:25:07.152 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T10:25:07.202 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T10:25:07.249 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T10:25:07.339 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T10:25:07.394 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T10:25:07.433 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T10:25:07.463 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T10:25:07.471 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T10:25:07.541 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T10:25:07.561 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T10:25:07.699 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T10:25:07.744 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T10:25:07.776 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T10:25:07.804 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T10:25:08.187 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T10:25:08.258 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:25:08.286 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:25:08.314 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T10:25:08.317 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T10:25:08.380 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T10:25:08.409 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:25:09.451 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:25:09.486 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:25:09.532 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T10:25:09.611 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T10:25:09.639 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T10:25:09.672 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T10:25:09.982 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T10:25:10.027 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:25:10.118 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T10:25:10.148 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T10:25:10.184 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T10:25:10.448 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:25:10.486 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:25:10.590 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:25:10.670 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T10:25:10.696 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:25:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T10:25:10.768 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T10:25:10.780 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:25:10.798 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T10:25:10.804 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:25:10.804 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:10.804 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T10:25:10.804 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:25:10.804 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:25:10.804 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:10.856 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:25:10.867 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:25:10.965 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T10:25:11.012 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T10:25:11.934 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T10:25:11.967 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:25:11.990 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:25:11.990 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:11.991 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T10:25:11.991 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:25:11.991 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:25:11.991 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:12.034 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:25:12.057 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:25:12.058 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:12.058 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T10:25:12.058 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:12.110 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:25:12.133 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:25:12.133 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:12.133 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T10:25:12.133 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:25:12.133 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:25:12.133 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:12.435 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:25:12.459 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:25:12.459 INFO:teuthology.orchestra.run.smithi097.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:12.459 INFO:teuthology.orchestra.run.smithi097.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T10:25:12.459 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:25:12.459 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:25:12.459 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:13.082 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:25:13.128 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:25:13.669 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T10:25:13.714 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:25:13.807 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T10:25:13.808 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T10:25:13.808 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T10:25:13.808 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:13.840 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:25:16.515 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:25:16.516 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-09-10T10:25:16.516 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-09-10T10:25:16.516 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-09-10T10:25:16.516 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-09-10T10:25:16.516 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-09-10T10:25:16.516 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-09-10T10:25:16.516 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-09-10T10:25:16.516 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:16.689 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:25:16.705 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:25:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:16.705 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T10:25:16.705 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:17.014 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T10:25:17.056 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T10:25:17.105 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T10:25:17.137 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T10:25:17.165 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T10:25:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T10:25:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T10:25:17.433 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T10:25:17.463 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T10:25:17.518 INFO:teuthology.orchestra.run.smithi097.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T10:25:18.081 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:25:18.115 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:25:18.136 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:25:18.208 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:25:18.236 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:25:18.236 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:18.236 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T10:25:18.236 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:25:18.237 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:25:18.237 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:18.477 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:25:18.501 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:25:18.501 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:18.501 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T10:25:18.501 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:25:18.501 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:25:18.501 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:18.944 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:25:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T10:25:18.969 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:25:18.969 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:18.969 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T10:25:18.969 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:25:18.969 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:25:18.969 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:19.029 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T10:25:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T10:25:19.074 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T10:25:19.131 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T10:25:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T10:25:19.187 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T10:25:19.190 INFO:teuthology.orchestra.run.smithi097.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T10:25:19.216 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T10:25:19.242 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T10:25:19.242 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:25:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:25:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:25:19.373 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T10:25:19.419 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:25:19.429 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T10:25:19.444 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T10:25:19.449 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:25:19.449 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:25:19.506 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T10:25:19.594 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T10:25:19.629 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:25:19.629 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:25:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:25:19.733 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T10:25:19.784 INFO:teuthology.orchestra.run.smithi097.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:25:19.789 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T10:25:19.819 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T10:25:19.846 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T10:25:20.267 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:25:20.295 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:25:20.326 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T10:25:20.389 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T10:25:20.418 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:25:21.457 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:25:21.495 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:25:22.460 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:25:22.486 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:25:22.588 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:25:22.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T10:25:22.780 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:25:22.804 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:25:22.804 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:22.804 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T10:25:22.804 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:25:22.805 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:25:22.805 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:22.856 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:25:22.868 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:25:22.965 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T10:25:23.019 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T10:25:23.953 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T10:25:23.983 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:25:24.007 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:25:24.007 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:24.007 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T10:25:24.007 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:25:24.007 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:25:24.007 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:24.050 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:25:24.073 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:25:24.074 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:24.074 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T10:25:24.074 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:24.117 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:25:24.141 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:25:24.141 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:24.141 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T10:25:24.141 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:25:24.141 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:25:24.141 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:24.443 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:25:24.467 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:25:24.467 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:24.467 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T10:25:24.467 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:25:24.467 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:25:24.467 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:25:25.293 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T10:25:25.294 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T10:25:25.295 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T10:25:25.295 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T10:25:25.295 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T10:25:25.307 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T10:25:25.307 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T10:25:25.307 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T10:25:25.307 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T10:25:25.307 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T10:25:25.307 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T10:25:25.307 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T10:25:25.307 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T10:25:25.308 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T10:25:25.309 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T10:25:25.310 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T10:25:25.311 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T10:25:25.312 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T10:25:25.313 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T10:25:25.314 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T10:25:25.315 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T10:25:25.316 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T10:25:25.317 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T10:25:25.318 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T10:25:25.318 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T10:25:25.318 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T10:25:25.318 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T10:25:25.318 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T10:25:25.663 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T10:25:25.663 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-09-10T10:25:25.664 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-09-10T10:25:25.664 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-09-10T10:25:25.664 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-09-10T10:25:25.664 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-09-10T10:25:25.664 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-09-10T10:25:25.664 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-09-10T10:25:25.664 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:25.844 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:25:25.863 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T10:25:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:25.863 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T10:25:25.863 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:27.355 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:25:27.382 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T10:25:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T10:25:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:25:27.383 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T10:25:27.383 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:27.606 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:25:27.629 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T10:25:27.630 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:27.630 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T10:25:27.630 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:25:27.630 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T10:25:27.630 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:27.791 INFO:teuthology.orchestra.run.smithi097.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:25:27.791 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:27.791 INFO:teuthology.orchestra.run.smithi097.stdout:Upgraded: 2024-09-10T10:25:27.791 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout:Installed: 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.793 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T10:25:27.794 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.795 INFO:teuthology.orchestra.run.smithi097.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T10:25:27.796 INFO:teuthology.orchestra.run.smithi097.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T10:25:27.797 INFO:teuthology.orchestra.run.smithi097.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T10:25:27.798 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T10:25:27.799 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T10:25:27.800 INFO:teuthology.orchestra.run.smithi097.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T10:25:27.801 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T10:25:27.802 INFO:teuthology.orchestra.run.smithi097.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T10:25:27.803 INFO:teuthology.orchestra.run.smithi097.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T10:25:27.804 INFO:teuthology.orchestra.run.smithi097.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T10:25:27.804 INFO:teuthology.orchestra.run.smithi097.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T10:25:27.804 INFO:teuthology.orchestra.run.smithi097.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T10:25:27.804 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T10:25:27.804 INFO:teuthology.orchestra.run.smithi097.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T10:25:27.804 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:25:27.804 INFO:teuthology.orchestra.run.smithi097.stdout:Complete! 2024-09-10T10:25:28.073 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:25:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T10:25:28.097 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:28.097 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T10:25:28.097 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:25:28.098 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T10:25:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:28.204 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T10:25:28.209 DEBUG:teuthology.parallel:result is None 2024-09-10T10:25:28.260 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T10:25:28.315 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T10:25:28.501 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T10:25:28.549 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T10:25:28.627 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T10:25:28.715 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T10:25:28.855 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T10:25:28.908 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T10:25:28.940 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T10:25:28.967 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T10:25:29.097 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T10:25:29.138 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T10:25:29.186 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T10:25:29.219 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T10:25:29.246 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T10:25:29.396 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:25:29.424 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T10:25:29.426 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T10:25:29.456 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T10:25:29.476 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T10:25:29.506 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T10:25:29.519 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T10:25:29.536 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T10:25:29.556 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:25:29.582 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T10:25:30.142 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:25:30.180 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:25:30.200 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:25:30.593 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T10:25:30.641 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:25:31.019 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T10:25:31.109 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T10:25:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T10:25:31.245 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T10:25:31.278 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T10:25:31.304 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T10:25:31.330 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T10:25:31.330 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:25:31.414 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:25:31.414 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:25:31.481 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:25:31.506 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T10:25:31.512 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:25:31.512 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:25:31.609 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T10:25:31.641 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:25:31.691 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:25:31.692 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:25:31.744 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T10:25:31.776 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:25:31.840 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:25:31.905 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T10:25:31.944 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:25:31.968 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T10:25:31.968 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:31.968 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T10:25:31.968 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:25:31.968 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T10:25:31.968 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:32.019 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:25:32.031 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T10:25:32.129 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T10:25:32.175 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T10:25:33.100 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T10:25:33.138 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:25:33.162 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T10:25:33.162 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:33.162 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T10:25:33.162 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:25:33.162 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T10:25:33.162 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:33.205 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:25:33.229 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T10:25:33.229 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:33.229 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T10:25:33.229 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:33.281 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:25:33.304 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T10:25:33.305 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:33.305 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T10:25:33.305 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:25:33.305 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T10:25:33.305 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:33.607 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:25:33.630 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T10:25:33.631 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T10:25:33.631 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T10:25:33.631 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:25:33.631 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T10:25:33.631 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:25:37.398 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T10:25:37.399 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T10:25:37.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T10:25:37.401 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T10:25:37.402 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T10:25:37.403 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T10:25:37.404 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T10:25:37.405 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T10:25:37.406 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T10:25:37.407 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T10:25:37.408 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T10:25:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T10:25:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T10:25:38.169 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T10:25:38.211 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T10:25:38.251 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T10:25:38.283 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T10:25:38.310 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T10:25:38.490 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T10:25:38.541 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T10:25:38.562 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T10:25:38.592 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T10:25:38.630 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T10:25:39.280 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:25:39.320 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:25:39.341 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T10:25:40.183 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T10:25:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-10T10:25:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T10:25:40.251 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T10:25:40.252 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T10:25:40.253 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.254 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T10:25:40.255 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T10:25:40.256 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T10:25:40.257 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T10:25:40.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.259 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:40.260 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T10:25:40.260 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T10:25:40.260 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T10:25:40.260 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T10:25:40.260 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T10:25:40.260 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T10:25:40.260 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T10:25:40.260 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:25:40.260 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-10T10:25:40.275 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T10:25:40.317 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T10:25:40.398 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T10:25:40.437 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T10:25:40.462 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T10:25:40.488 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T10:25:40.488 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:25:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T10:25:40.572 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:25:40.656 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T10:25:40.676 DEBUG:teuthology.parallel:result is None 2024-09-10T10:25:40.681 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T10:25:40.686 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:25:40.687 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:25:40.876 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T10:25:40.876 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:25:40.967 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T10:25:41.031 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:25:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:25:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T10:25:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T10:25:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T10:25:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T10:25:47.025 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T10:25:47.026 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T10:25:47.027 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T10:25:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T10:25:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T10:25:47.039 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T10:25:47.040 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T10:25:47.041 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T10:25:47.042 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T10:25:47.043 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T10:25:47.044 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T10:25:47.045 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T10:25:47.046 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T10:25:47.047 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T10:25:47.048 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T10:25:47.049 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T10:25:47.050 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T10:25:47.050 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T10:25:47.050 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T10:25:47.050 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T10:25:49.875 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T10:25:49.875 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:49.875 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-09-10T10:25:49.875 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:49.875 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:49.875 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:49.875 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T10:25:49.875 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.876 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.876 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T10:25:49.876 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T10:25:49.876 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-10T10:25:49.876 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T10:25:49.876 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T10:25:49.876 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T10:25:49.876 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T10:25:49.876 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.877 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.878 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.879 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T10:25:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T10:25:49.881 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T10:25:49.881 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T10:25:49.881 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T10:25:49.881 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T10:25:49.881 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T10:25:49.881 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T10:25:49.881 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T10:25:49.881 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T10:25:49.881 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T10:25:49.882 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T10:25:49.883 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T10:25:49.884 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T10:25:49.885 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.886 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T10:25:49.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T10:25:49.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T10:25:49.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T10:25:49.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T10:25:49.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T10:25:49.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T10:25:49.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T10:25:49.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T10:25:49.887 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T10:25:49.888 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T10:25:49.889 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T10:25:49.889 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T10:25:49.889 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:25:49.889 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-10T10:25:50.301 DEBUG:teuthology.parallel:result is None 2024-09-10T10:25:50.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:25:50.457 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T10:25:50.483 INFO:teuthology.orchestra.run.smithi092.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T10:25:50.484 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T10:25:50.484 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T10:25:50.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:25:50.623 DEBUG:teuthology.orchestra.run.smithi097:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T10:25:50.650 INFO:teuthology.orchestra.run.smithi097.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T10:25:50.650 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T10:25:50.650 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T10:25:50.652 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:25:50.797 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T10:25:50.820 INFO:teuthology.orchestra.run.smithi121.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T10:25:50.820 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T10:25:50.820 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T10:25:50.822 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T10:25:50.822 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:25:50.822 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T10:25:50.853 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:25:50.853 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T10:25:50.886 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:25:50.886 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T10:25:50.914 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T10:25:50.914 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:25:50.914 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T10:25:50.941 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T10:25:51.008 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:25:51.008 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T10:25:51.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T10:25:51.118 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:25:51.118 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T10:25:51.144 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T10:25:51.210 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T10:25:51.210 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:25:51.210 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T10:25:51.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T10:25:51.301 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:25:51.301 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T10:25:51.327 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T10:25:51.391 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:25:51.391 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T10:25:51.417 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T10:25:51.483 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T10:25:51.484 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:25:51.484 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T10:25:51.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T10:25:51.575 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:25:51.575 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T10:25:51.599 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T10:25:51.664 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:25:51.665 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T10:25:51.689 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T10:25:51.755 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T10:25:51.848 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-10T10:25:51.848 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:25:51.849 INFO:tasks.cephadm:Cluster fsid is 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:25:51.849 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T10:25:51.849 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.92', 'mon.b': '172.21.15.97', 'mon.c': '172.21.15.121'} 2024-09-10T10:25:51.849 INFO:tasks.cephadm:First mon is mon.a on smithi092 2024-09-10T10:25:51.849 INFO:tasks.cephadm:First mgr is x 2024-09-10T10:25:51.849 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T10:25:51.850 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2024-09-10T10:25:51.875 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname $(hostname -s) 2024-09-10T10:25:51.900 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname $(hostname -s) 2024-09-10T10:25:51.925 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T10:25:51.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:25:52.070 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82914/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:14:38.445020', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82912/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:05:03.996701', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-10T10:25:52.210 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240909.165402-squid, sha1 1cf819b7212a6048e92fc78c4eff963344f6d56b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:25:52.212 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T10:25:52.212 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T10:25:52.212 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T10:25:52.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 10:25 /home/ubuntu/cephtest/cephadm 2024-09-10T10:25:52.622 DEBUG:teuthology.orchestra.run.smithi097:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T10:25:53.007 INFO:teuthology.orchestra.run.smithi097.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 10:25 /home/ubuntu/cephtest/cephadm 2024-09-10T10:25:53.007 DEBUG:teuthology.orchestra.run.smithi121:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T10:25:53.392 INFO:teuthology.orchestra.run.smithi121.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 10:25 /home/ubuntu/cephtest/cephadm 2024-09-10T10:25:53.392 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T10:25:53.415 DEBUG:teuthology.orchestra.run.smithi097:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T10:25:53.439 DEBUG:teuthology.orchestra.run.smithi121:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T10:25:53.479 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b on all hosts... 2024-09-10T10:25:53.479 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T10:25:53.484 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T10:25:53.488 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T10:25:54.993 INFO:teuthology.orchestra.run.smithi097.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:25:55.120 INFO:teuthology.orchestra.run.smithi121.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:25:55.128 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:26:42.909 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-10T10:26:42.909 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T10:26:42.909 INFO:teuthology.orchestra.run.smithi121.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T10:26:42.909 INFO:teuthology.orchestra.run.smithi121.stdout: "repo_digests": [ 2024-09-10T10:26:42.910 INFO:teuthology.orchestra.run.smithi121.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T10:26:42.910 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-10T10:26:42.910 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-10T10:26:46.870 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:26:46.871 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T10:26:46.871 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T10:26:46.871 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2024-09-10T10:26:46.871 INFO:teuthology.orchestra.run.smithi092.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T10:26:46.871 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:26:46.871 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:26:49.182 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-10T10:26:49.183 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T10:26:49.183 INFO:teuthology.orchestra.run.smithi097.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T10:26:49.183 INFO:teuthology.orchestra.run.smithi097.stdout: "repo_digests": [ 2024-09-10T10:26:49.183 INFO:teuthology.orchestra.run.smithi097.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T10:26:49.183 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-09-10T10:26:49.183 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-10T10:26:49.208 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2024-09-10T10:26:49.240 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph 2024-09-10T10:26:49.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph 2024-09-10T10:26:49.301 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2024-09-10T10:26:49.328 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /etc/ceph 2024-09-10T10:26:49.352 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /etc/ceph 2024-09-10T10:26:49.382 INFO:tasks.cephadm:Writing seed config... 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-10T10:26:49.383 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T10:26:49.384 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T10:26:49.385 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T10:26:49.386 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T10:26:49.388 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:26:49.388 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T10:26:49.405 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0df4af84-6f5f-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-10T10:26:49.405 DEBUG:teuthology.orchestra.run.smithi092:mon.a> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T10:26:49.447 DEBUG:teuthology.orchestra.run.smithi092:mgr.x> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T10:26:49.490 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T10:26:49.490 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b -v bootstrap --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.92 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:26:49.694 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-10T10:26:49.694 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b', '-v', 'bootstrap', '--fsid', '0df4af84-6f5f-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.92', '--skip-admin-label'] 2024-09-10T10:26:49.695 INFO:teuthology.orchestra.run.smithi092.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T10:26:49.695 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying podman|docker is present... 2024-09-10T10:26:49.718 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 5.2.2 2024-09-10T10:26:49.718 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying lvm2 is present... 2024-09-10T10:26:49.718 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying time synchronization is in place... 2024-09-10T10:26:49.725 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T10:26:49.726 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T10:26:49.732 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T10:26:49.732 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-10T10:26:49.738 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2024-09-10T10:26:49.744 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2024-09-10T10:26:49.744 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2024-09-10T10:26:49.745 INFO:teuthology.orchestra.run.smithi092.stdout:Repeating the final host check... 2024-09-10T10:26:49.766 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 5.2.2 2024-09-10T10:26:49.766 INFO:teuthology.orchestra.run.smithi092.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T10:26:49.766 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl is present 2024-09-10T10:26:49.766 INFO:teuthology.orchestra.run.smithi092.stdout:lvcreate is present 2024-09-10T10:26:49.772 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T10:26:49.772 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T10:26:49.778 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T10:26:49.778 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-10T10:26:49.785 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2024-09-10T10:26:49.791 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2024-09-10T10:26:49.792 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2024-09-10T10:26:49.792 INFO:teuthology.orchestra.run.smithi092.stdout:Host looks OK 2024-09-10T10:26:49.792 INFO:teuthology.orchestra.run.smithi092.stdout:Cluster fsid: 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:26:49.792 INFO:teuthology.orchestra.run.smithi092.stdout:Acquiring lock 140189577368576 on /run/cephadm/0df4af84-6f5f-11ef-bcea-c7b262605968.lock 2024-09-10T10:26:49.792 INFO:teuthology.orchestra.run.smithi092.stdout:Lock 140189577368576 acquired on /run/cephadm/0df4af84-6f5f-11ef-bcea-c7b262605968.lock 2024-09-10T10:26:49.792 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 3300 ... 2024-09-10T10:26:49.793 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 6789 ... 2024-09-10T10:26:49.793 INFO:teuthology.orchestra.run.smithi092.stdout:Base mon IP(s) is [172.21.15.92:3300, 172.21.15.92:6789], mon addrv is [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-09-10T10:26:49.796 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.92 metric 100 2024-09-10T10:26:49.796 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.92 metric 100 2024-09-10T10:26:49.799 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T10:26:49.799 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-10T10:26:49.799 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-10T10:26:49.801 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T10:26:49.802 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T10:26:49.802 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T10:26:49.802 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-10T10:26:49.802 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-10T10:26:49.802 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T10:26:49.802 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2024-09-10T10:26:49.802 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2024-09-10T10:26:49.802 INFO:teuthology.orchestra.run.smithi092.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T10:26:49.803 INFO:teuthology.orchestra.run.smithi092.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T10:26:49.803 INFO:teuthology.orchestra.run.smithi092.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:26:53.012 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T10:26:53.012 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T10:26:53.013 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T10:26:53.013 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:3965ca83761b6e221cd35b61f2ebac0e3b1f9d68a1ce39c1ada69153a1d73116 2024-09-10T10:26:53.013 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T10:26:53.013 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying config sha256:41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T10:26:53.013 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T10:27:00.969 INFO:teuthology.orchestra.run.smithi092.stdout:ceph: stdout ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T10:27:00.969 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph version: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T10:27:00.969 INFO:teuthology.orchestra.run.smithi092.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T10:27:02.016 INFO:teuthology.orchestra.run.smithi092.stdout:stat: stdout 167 167 2024-09-10T10:27:02.016 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial keys... 2024-09-10T10:27:02.887 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQD2HuBm5Dc+ERAAtGiKblHD7T+sqNsOxCaurg== 2024-09-10T10:27:03.785 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQD3HuBmkKcmDRAAQtMokCXrdmPI28vEQTh54g== 2024-09-10T10:27:04.742 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQD4HuBmOlQGCRAA3xQRx6b7k1bGYWiO6dNZ+w== 2024-09-10T10:27:04.742 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial monmap... 2024-09-10T10:27:05.878 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T10:27:05.878 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T10:27:05.878 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:05.879 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T10:27:05.879 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool for a [v2:172.21.15.92:3300,v1:172.21.15.92:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T10:27:05.879 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = quincy 2024-09-10T10:27:05.879 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: set fsid to 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:05.879 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T10:27:05.879 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:27:05.879 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mon... 2024-09-10T10:27:07.697 INFO:teuthology.orchestra.run.smithi092.stdout:create mon.a on 2024-09-10T10:27:07.909 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T10:27:08.052 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T10:27:08.241 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968.target. 2024-09-10T10:27:08.241 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968.target. 2024-09-10T10:27:08.483 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.a 2024-09-10T10:27:08.483 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T10:27:08.647 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968.target.wants/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@.service. 2024-09-10T10:27:09.154 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:27:09.154 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-10T10:27:09.161 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:27:09.161 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-10T10:27:09.161 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-10T10:27:09.161 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T10:27:09.161 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon to start... 2024-09-10T10:27:09.161 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon... 2024-09-10T10:27:10.206 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:10 smithi092 ceph-mon[30467]: from='client.? 172.21.15.92:0/3352971649' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T10:27:10.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T10:27:10.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout id: 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:10.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T10:27:10.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:10.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout services: 2024-09-10T10:27:10.214 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.534166s) 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout data: 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.567+0000 7fa5ca5bd640 1 Processor -- start 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.567+0000 7fa5ca5bd640 1 -- start start 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.568+0000 7fa5ca5bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c4106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:10.215 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.568+0000 7fa5ca5bd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c4106ee0 con 0x7fa5c4106510 2024-09-10T10:27:10.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.568+0000 7fa5c3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c4106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:10.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.568+0000 7fa5c3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c4106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52334/0 (socket says 172.21.15.92:52334) 2024-09-10T10:27:10.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.568+0000 7fa5c3fff640 1 -- 172.21.15.92:0/2943142618 learned_addr learned my addr 172.21.15.92:0/2943142618 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:10.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.568+0000 7fa5c3fff640 1 -- 172.21.15.92:0/2943142618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c41076c0 con 0x7fa5c4106510 2024-09-10T10:27:10.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.570+0000 7fa5c3fff640 1 --2- 172.21.15.92:0/2943142618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c4106910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009820 tx=0x7fa5b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb455ae93fab747 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:10.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5c2ffd640 1 -- 172.21.15.92:0/2943142618 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b4037070 con 0x7fa5c4106510 2024-09-10T10:27:10.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5c2ffd640 1 -- 172.21.15.92:0/2943142618 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b4032440 con 0x7fa5c4106510 2024-09-10T10:27:10.216 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5c2ffd640 1 -- 172.21.15.92:0/2943142618 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b4032740 con 0x7fa5c4106510 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/2943142618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 msgr2=0x7fa5c4106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5ca5bd640 1 --2- 172.21.15.92:0/2943142618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c4106910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009820 tx=0x7fa5b402a270 comp rx=0 tx=0).stop 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/2943142618 shutdown_connections 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5ca5bd640 1 --2- 172.21.15.92:0/2943142618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c4106910 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/2943142618 >> 172.21.15.92:0/2943142618 conn(0x7fa5c4101ca0 msgr2=0x7fa5c41040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/2943142618 shutdown_connections 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.571+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/2943142618 wait complete. 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.572+0000 7fa5ca5bd640 1 Processor -- start 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.572+0000 7fa5ca5bd640 1 -- start start 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.572+0000 7fa5ca5bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.572+0000 7fa5ca5bd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c4107c60 con 0x7fa5c4106510 2024-09-10T10:27:10.217 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.572+0000 7fa5c3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.572+0000 7fa5c3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c419adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52338/0 (socket says 172.21.15.92:52338) 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.572+0000 7fa5c3fff640 1 -- 172.21.15.92:0/3352971649 learned_addr learned my addr 172.21.15.92:0/3352971649 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.573+0000 7fa5c3fff640 1 -- 172.21.15.92:0/3352971649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c419b2f0 con 0x7fa5c4106510 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.573+0000 7fa5c3fff640 1 --2- 172.21.15.92:0/3352971649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c419adb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40090b0 tx=0x7fa5b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.573+0000 7fa5c17fa640 1 -- 172.21.15.92:0/3352971649 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b4041070 con 0x7fa5c4106510 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.573+0000 7fa5c17fa640 1 -- 172.21.15.92:0/3352971649 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b403c7a0 con 0x7fa5c4106510 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.573+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/3352971649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c419b580 con 0x7fa5c4106510 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.573+0000 7fa5c17fa640 1 -- 172.21.15.92:0/3352971649 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b4037040 con 0x7fa5c4106510 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.573+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/3352971649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c419e230 con 0x7fa5c4106510 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.573+0000 7fa5c17fa640 1 -- 172.21.15.92:0/3352971649 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa5b4044070 con 0x7fa5c4106510 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.573+0000 7fa5c17fa640 1 -- 172.21.15.92:0/3352971649 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa5b403d3f0 con 0x7fa5c4106510 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.574+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/3352971649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c41082b0 con 0x7fa5c4106510 2024-09-10T10:27:10.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.576+0000 7fa5c17fa640 1 -- 172.21.15.92:0/3352971649 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa5b4046450 con 0x7fa5c4106510 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.636+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/3352971649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fa5c402d9b0 con 0x7fa5c4106510 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.636+0000 7fa5c17fa640 1 -- 172.21.15.92:0/3352971649 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fa5b4046630 con 0x7fa5c4106510 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.637+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/3352971649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 msgr2=0x7fa5c419adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.637+0000 7fa5ca5bd640 1 --2- 172.21.15.92:0/3352971649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c419adb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40090b0 tx=0x7fa5b40046c0 comp rx=0 tx=0).stop 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.637+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/3352971649 shutdown_connections 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.637+0000 7fa5ca5bd640 1 --2- 172.21.15.92:0/3352971649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5c4106510 0x7fa5c419adb0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.637+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/3352971649 >> 172.21.15.92:0/3352971649 conn(0x7fa5c4101ca0 msgr2=0x7fa5c418de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.637+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/3352971649 shutdown_connections 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:09.637+0000 7fa5ca5bd640 1 -- 172.21.15.92:0/3352971649 wait complete. 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:mon is available 2024-09-10T10:27:10.219 INFO:teuthology.orchestra.run.smithi092.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T10:27:11.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:11 smithi092 ceph-mon[30467]: from='client.? 172.21.15.92:0/306546307' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T10:27:11.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:11 smithi092 ceph-mon[30467]: from='client.? 172.21.15.92:0/306546307' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T10:27:11.230 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:11.236 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T10:27:11.237 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.607+0000 7f8a01a75640 1 Processor -- start 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.607+0000 7f8a01a75640 1 -- start start 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.607+0000 7f8a01a75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc07c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.607+0000 7f8a01a75640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc07c8e0 con 0x7f89fc07deb0 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.608+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc07c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.608+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc07c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52348/0 (socket says 172.21.15.92:52348) 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.608+0000 7f89fb7fe640 1 -- 172.21.15.92:0/2935272743 learned_addr learned my addr 172.21.15.92:0/2935272743 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.608+0000 7f89fb7fe640 1 -- 172.21.15.92:0/2935272743 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc07ca60 con 0x7f89fc07deb0 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.609+0000 7f89fb7fe640 1 --2- 172.21.15.92:0/2935272743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc07c310 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009820 tx=0x7f89ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe668ba2031c19ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:11.238 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.609+0000 7f89fa7fc640 1 -- 172.21.15.92:0/2935272743 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89ec037070 con 0x7f89fc07deb0 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.609+0000 7f89fa7fc640 1 -- 172.21.15.92:0/2935272743 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ec032440 con 0x7f89fc07deb0 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.609+0000 7f89fa7fc640 1 -- 172.21.15.92:0/2935272743 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89ec032740 con 0x7f89fc07deb0 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.609+0000 7f8a01a75640 1 -- 172.21.15.92:0/2935272743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 msgr2=0x7f89fc07c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.609+0000 7f8a01a75640 1 --2- 172.21.15.92:0/2935272743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc07c310 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009820 tx=0x7f89ec02a270 comp rx=0 tx=0).stop 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.609+0000 7f8a01a75640 1 -- 172.21.15.92:0/2935272743 shutdown_connections 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.609+0000 7f8a01a75640 1 --2- 172.21.15.92:0/2935272743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc07c310 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.610+0000 7f8a01a75640 1 -- 172.21.15.92:0/2935272743 >> 172.21.15.92:0/2935272743 conn(0x7f89fc102db0 msgr2=0x7f89fc1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.610+0000 7f8a01a75640 1 -- 172.21.15.92:0/2935272743 shutdown_connections 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.610+0000 7f8a01a75640 1 -- 172.21.15.92:0/2935272743 wait complete. 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.610+0000 7f8a01a75640 1 Processor -- start 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.610+0000 7f8a01a75640 1 -- start start 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.610+0000 7f8a01a75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc1a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:11.239 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.610+0000 7f8a01a75640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc07d000 con 0x7f89fc07deb0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc1a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89fb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc1a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52358/0 (socket says 172.21.15.92:52358) 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89fb7fe640 1 -- 172.21.15.92:0/306546307 learned_addr learned my addr 172.21.15.92:0/306546307 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89fb7fe640 1 -- 172.21.15.92:0/306546307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc1a18f0 con 0x7f89fc07deb0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89fb7fe640 1 --2- 172.21.15.92:0/306546307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc1a13b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0090b0 tx=0x7f89ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89f8ff9640 1 -- 172.21.15.92:0/306546307 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89ec041070 con 0x7f89fc07deb0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89f8ff9640 1 -- 172.21.15.92:0/306546307 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ec03c7a0 con 0x7f89fc07deb0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f8a01a75640 1 -- 172.21.15.92:0/306546307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc1a1b80 con 0x7f89fc07deb0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89f8ff9640 1 -- 172.21.15.92:0/306546307 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89ec037040 con 0x7f89fc07deb0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f8a01a75640 1 -- 172.21.15.92:0/306546307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc1a4870 con 0x7f89fc07deb0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89f8ff9640 1 -- 172.21.15.92:0/306546307 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f89ec044070 con 0x7f89fc07deb0 2024-09-10T10:27:11.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.611+0000 7f89f8ff9640 1 -- 172.21.15.92:0/306546307 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f89ec03d3f0 con 0x7f89fc07deb0 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.612+0000 7f8a01a75640 1 -- 172.21.15.92:0/306546307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc07c390 con 0x7f89fc07deb0 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.614+0000 7f89f8ff9640 1 -- 172.21.15.92:0/306546307 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f89ec046450 con 0x7f89fc07deb0 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.671+0000 7f8a01a75640 1 -- 172.21.15.92:0/306546307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f89fc1a4a40 con 0x7f89fc07deb0 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.674+0000 7f89f8ff9640 1 -- 172.21.15.92:0/306546307 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f89ec046630 con 0x7f89fc07deb0 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.675+0000 7f89f8ff9640 1 -- 172.21.15.92:0/306546307 <== mon.0 v2:172.21.15.92:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89ec056070 con 0x7f89fc07deb0 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.676+0000 7f8a01a75640 1 -- 172.21.15.92:0/306546307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 msgr2=0x7f89fc1a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.676+0000 7f8a01a75640 1 --2- 172.21.15.92:0/306546307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc1a13b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0090b0 tx=0x7f89ec0046c0 comp rx=0 tx=0).stop 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.676+0000 7f8a01a75640 1 -- 172.21.15.92:0/306546307 shutdown_connections 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.676+0000 7f8a01a75640 1 --2- 172.21.15.92:0/306546307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc07deb0 0x7f89fc1a13b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.676+0000 7f8a01a75640 1 -- 172.21.15.92:0/306546307 >> 172.21.15.92:0/306546307 conn(0x7f89fc102db0 msgr2=0x7f89fc1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.676+0000 7f8a01a75640 1 -- 172.21.15.92:0/306546307 shutdown_connections 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:10.676+0000 7f8a01a75640 1 -- 172.21.15.92:0/306546307 wait complete. 2024-09-10T10:27:11.241 INFO:teuthology.orchestra.run.smithi092.stdout:Generating new minimal ceph.conf... 2024-09-10T10:27:12.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:12 smithi092 ceph-mon[30467]: from='client.? 172.21.15.92:0/1289906300' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:27:12.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.605+0000 7f787dce1640 1 Processor -- start 2024-09-10T10:27:12.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.605+0000 7f787dce1640 1 -- start start 2024-09-10T10:27:12.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.606+0000 7f787dce1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787810a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:12.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.606+0000 7f787dce1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f787807bdf0 con 0x7f78781080c0 2024-09-10T10:27:12.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.606+0000 7f78777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787810a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:12.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.606+0000 7f78777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787810a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52366/0 (socket says 172.21.15.92:52366) 2024-09-10T10:27:12.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.606+0000 7f78777fe640 1 -- 172.21.15.92:0/3552224331 learned_addr learned my addr 172.21.15.92:0/3552224331 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:12.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.606+0000 7f78777fe640 1 -- 172.21.15.92:0/3552224331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787810a9f0 con 0x7f78781080c0 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.607+0000 7f78777fe640 1 --2- 172.21.15.92:0/3552224331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787810a4b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7868009820 tx=0x7f786802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a19f7c3154c2cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.607+0000 7f7876ffd640 1 -- 172.21.15.92:0/3552224331 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7868037070 con 0x7f78781080c0 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.607+0000 7f7876ffd640 1 -- 172.21.15.92:0/3552224331 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7868032900 con 0x7f78781080c0 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.607+0000 7f7876ffd640 1 -- 172.21.15.92:0/3552224331 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7868030850 con 0x7f78781080c0 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.607+0000 7f787dce1640 1 -- 172.21.15.92:0/3552224331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 msgr2=0x7f787810a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.607+0000 7f787dce1640 1 --2- 172.21.15.92:0/3552224331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787810a4b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7868009820 tx=0x7f786802a270 comp rx=0 tx=0).stop 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.607+0000 7f787dce1640 1 -- 172.21.15.92:0/3552224331 shutdown_connections 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.607+0000 7f787dce1640 1 --2- 172.21.15.92:0/3552224331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787810a4b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.607+0000 7f787dce1640 1 -- 172.21.15.92:0/3552224331 >> 172.21.15.92:0/3552224331 conn(0x7f7878101ca0 msgr2=0x7f78781040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.608+0000 7f787dce1640 1 -- 172.21.15.92:0/3552224331 shutdown_connections 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.608+0000 7f787dce1640 1 -- 172.21.15.92:0/3552224331 wait complete. 2024-09-10T10:27:12.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.608+0000 7f787dce1640 1 Processor -- start 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.608+0000 7f787dce1640 1 -- start start 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.608+0000 7f787dce1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.608+0000 7f787dce1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f787810b9d0 con 0x7f78781080c0 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.608+0000 7f78777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.608+0000 7f78777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52370/0 (socket says 172.21.15.92:52370) 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.608+0000 7f78777fe640 1 -- 172.21.15.92:0/1289906300 learned_addr learned my addr 172.21.15.92:0/1289906300 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.609+0000 7f78777fe640 1 -- 172.21.15.92:0/1289906300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787819bb20 con 0x7f78781080c0 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.609+0000 7f78777fe640 1 --2- 172.21.15.92:0/1289906300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787819b5e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f78680097f0 tx=0x7f7868030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.609+0000 7f78757fa640 1 -- 172.21.15.92:0/1289906300 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7868042070 con 0x7f78781080c0 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.609+0000 7f78757fa640 1 -- 172.21.15.92:0/1289906300 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7868032ca0 con 0x7f78781080c0 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.609+0000 7f787dce1640 1 -- 172.21.15.92:0/1289906300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787819bdb0 con 0x7f78781080c0 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.609+0000 7f78757fa640 1 -- 172.21.15.92:0/1289906300 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7868037040 con 0x7f78781080c0 2024-09-10T10:27:12.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.609+0000 7f787dce1640 1 -- 172.21.15.92:0/1289906300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787819eaa0 con 0x7f78781080c0 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.609+0000 7f78757fa640 1 -- 172.21.15.92:0/1289906300 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7868045070 con 0x7f78781080c0 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.609+0000 7f78757fa640 1 -- 172.21.15.92:0/1289906300 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7868047af0 con 0x7f78781080c0 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.610+0000 7f787dce1640 1 -- 172.21.15.92:0/1289906300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7878108520 con 0x7f78781080c0 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.612+0000 7f78757fa640 1 -- 172.21.15.92:0/1289906300 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f786803db10 con 0x7f78781080c0 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.670+0000 7f787dce1640 1 -- 172.21.15.92:0/1289906300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f787819f010 con 0x7f78781080c0 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.670+0000 7f78757fa640 1 -- 172.21.15.92:0/1289906300 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f786803d430 con 0x7f78781080c0 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.671+0000 7f787dce1640 1 -- 172.21.15.92:0/1289906300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 msgr2=0x7f787819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.671+0000 7f787dce1640 1 --2- 172.21.15.92:0/1289906300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787819b5e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f78680097f0 tx=0x7f7868030ec0 comp rx=0 tx=0).stop 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.671+0000 7f787dce1640 1 -- 172.21.15.92:0/1289906300 shutdown_connections 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.671+0000 7f787dce1640 1 --2- 172.21.15.92:0/1289906300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78781080c0 0x7f787819b5e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.671+0000 7f787dce1640 1 -- 172.21.15.92:0/1289906300 >> 172.21.15.92:0/1289906300 conn(0x7f7878101ca0 msgr2=0x7f7878102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.671+0000 7f787dce1640 1 -- 172.21.15.92:0/1289906300 shutdown_connections 2024-09-10T10:27:12.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:11.671+0000 7f787dce1640 1 -- 172.21.15.92:0/1289906300 wait complete. 2024-09-10T10:27:12.379 INFO:teuthology.orchestra.run.smithi092.stdout:Restarting the monitor... 2024-09-10T10:27:12.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:12 smithi092 systemd[1]: Stopping Ceph mon.a for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:27:12.910 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:12 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a[30463]: 2024-09-10T10:27:12.653+0000 7fdb7de4e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:27:12.910 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:12 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a[30463]: 2024-09-10T10:27:12.653+0000 7fdb7de4e640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T10:27:13.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:12 smithi092 podman[30708]: 2024-09-10 10:27:12.909501885 +0000 UTC m=+0.367546174 container died b2cea4004e7bcf165423a85e9c2ae8835a1ba831a9ab651016e3749b1810b93b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T10:27:13.572 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:13 smithi092 podman[30708]: 2024-09-10 10:27:13.295968217 +0000 UTC m=+0.754012515 container cleanup b2cea4004e7bcf165423a85e9c2ae8835a1ba831a9ab651016e3749b1810b93b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T10:27:13.573 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:13 smithi092 bash[30708]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a 2024-09-10T10:27:13.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:13 smithi092 podman[30721]: 2024-09-10 10:27:13.572238361 +0000 UTC m=+0.663210824 container remove b2cea4004e7bcf165423a85e9c2ae8835a1ba831a9ab651016e3749b1810b93b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T10:27:13.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:13 smithi092 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T10:27:13.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:13 smithi092 systemd[1]: Stopped Ceph mon.a for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:27:13.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:13 smithi092 systemd[1]: Starting Ceph mon.a for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:27:14.210 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:13 smithi092 podman[30815]: 2024-09-10 10:27:13.832501021 +0000 UTC m=+0.015676880 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T10:27:14.210 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:13 smithi092 podman[30815]: 2024-09-10 10:27:13.939891324 +0000 UTC m=+0.123067173 container create 46dfc501a658e1d3041fb408b6bad10441ff10e951426effe3abb41298a5b3f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:27:14.210 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 podman[30815]: 2024-09-10 10:27:14.133766528 +0000 UTC m=+0.316942380 container init 46dfc501a658e1d3041fb408b6bad10441ff10e951426effe3abb41298a5b3f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T10:27:14.210 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 podman[30815]: 2024-09-10 10:27:14.136890391 +0000 UTC m=+0.320066240 container start 46dfc501a658e1d3041fb408b6bad10441ff10e951426effe3abb41298a5b3f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T10:27:14.211 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T10:27:14.211 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T10:27:14.211 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: pidfile_write: ignore empty --pid-file 2024-09-10T10:27:14.211 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: load: jerasure load: lrc 2024-09-10T10:27:14.211 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: RocksDB version: 7.9.2 2024-09-10T10:27:14.211 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Git sha 0 2024-09-10T10:27:14.212 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T10:27:14.212 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: DB SUMMARY 2024-09-10T10:27:14.212 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: DB Session ID: WZEX24E0N2N7WQZZTHJ0 2024-09-10T10:27:14.212 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: CURRENT file: CURRENT 2024-09-10T10:27:14.212 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T10:27:14.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T10:27:14.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T10:27:14.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105238 ; 2024-09-10T10:27:14.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.error_if_exists: 0 2024-09-10T10:27:14.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.create_if_missing: 0 2024-09-10T10:27:14.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.paranoid_checks: 1 2024-09-10T10:27:14.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.env: 0x55f8c01c3940 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.info_log: 0x55f8c239d6e0 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.statistics: (nil) 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.use_fsync: 0 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_log_file_size: 0 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T10:27:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.allow_fallocate: 1 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.use_direct_reads: 0 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.db_log_dir: 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.wal_dir: 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T10:27:14.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.write_buffer_manager: 0x55f8c23acdc0 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.unordered_write: 0 2024-09-10T10:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.row_cache: None 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.wal_filter: None 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.two_write_queues: 0 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.wal_compression: 0 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.atomic_flush: 0 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T10:27:14.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.log_readahead_size: 0 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_background_jobs: 2 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_background_compactions: -1 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_subcompactions: 1 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T10:27:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_open_files: -1 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_background_flushes: -1 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Compression algorithms supported: 2024-09-10T10:27:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: kZSTD supported: 0 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: kXpressCompression supported: 0 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: kBZip2Compression supported: 0 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: kLZ4Compression supported: 1 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: kZlibCompression supported: 1 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: kSnappyCompression supported: 1 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.merge_operator: 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_filter: None 2024-09-10T10:27:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f8c239d320) 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks: 1 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_top_level_index_and_filter: 1 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_type: 0 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_index_type: 0 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_shortening: 1 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: checksum: 4 2024-09-10T10:27:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout: no_block_cache: 0 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache: 0x55f8c23911f0 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_name: BinnedLRUCache 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_options: 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: capacity : 536870912 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_shard_bits : 4 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: strict_capacity_limit : 0 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: high_pri_pool_ratio: 0.000 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_compressed: (nil) 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: persistent_cache: (nil) 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size: 4096 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size_deviation: 10 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_restart_interval: 16 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_block_restart_interval: 1 2024-09-10T10:27:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout: metadata_block_size: 4096 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: partition_filters: 0 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: use_delta_encoding: 1 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: filter_policy: bloomfilter 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: whole_key_filtering: 1 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: verify_compression: 0 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: read_amp_bytes_per_bit: 0 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: format_version: 5 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_index_compression: 1 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_align: 0 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: max_auto_readahead_size: 262144 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: prepopulate_block_cache: 0 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: initial_auto_readahead_size: 8192 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T10:27:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression: NoCompression 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.num_levels: 7 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:27:14.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T10:27:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T10:27:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T10:27:14.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.inplace_update_support: 0 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.bloom_locality: 0 2024-09-10T10:27:14.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.max_successive_merges: 0 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.ttl: 2592000 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.enable_blob_files: false 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.min_blob_size: 0 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T10:27:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c97641d2-eb44-42e0-8ace-9ebfb1150253 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725964034162801, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T10:27:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725964034163802, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100305, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98190, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14290, "raw_average_key_size": 49, "raw_value_size": 90463, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725964034, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c97641d2-eb44-42e0-8ace-9ebfb1150253", "db_session_id": "WZEX24E0N2N7WQZZTHJ0", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725964034163897, "job": 1, "event": "recovery_finished"} 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f8c23bee00 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: DB pointer 0x55f8c24ba000 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** DB Stats ** 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:27:14.234 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: L0 2/0 99.81 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: Sum 2/0 99.81 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 151.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T10:27:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 151.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative compaction: 0.00 GB write, 31.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval compaction: 0.00 GB write, 31.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T10:27:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache BinnedLRUCache@0x55f8c23911f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: starting mon.a rank 0 at public addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] at bind addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mon.a@-1(???) e1 preinit fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mon.a@-1(???).mds e1 new map 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mon.a@-1(???).mds e1 print_map 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: e1 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: btime 2024-09-10T10:27:09:104157+0000 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: legacy client fscid: -1 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-09-10T10:27:14.237 INFO:journalctl@ceph.mon.a.smithi092.stdout: No filesystems configured 2024-09-10T10:27:14.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T10:27:14.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:27:14.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:27:14.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:27:14.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T10:27:14.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 bash[30815]: 46dfc501a658e1d3041fb408b6bad10441ff10e951426effe3abb41298a5b3f2 2024-09-10T10:27:14.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 systemd[1]: Started Ceph mon.a for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:27:14.238 INFO:teuthology.orchestra.run.smithi092.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T10:27:14.530 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T10:27:14.530 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: monmap epoch 1 2024-09-10T10:27:14.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:14.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: last_changed 2024-09-10T10:27:05.038412+0000 2024-09-10T10:27:14.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:27:14.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: min_mon_release 19 (squid) 2024-09-10T10:27:14.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: election_strategy: 1 2024-09-10T10:27:14.532 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:27:14.532 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: fsmap 2024-09-10T10:27:14.532 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T10:27:14.532 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:14 smithi092 ceph-mon[30834]: mgrmap e1: no daemons active 2024-09-10T10:27:15.218 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.610+0000 7fb8a6897640 1 Processor -- start 2024-09-10T10:27:15.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.610+0000 7fb8a6897640 1 -- start start 2024-09-10T10:27:15.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.610+0000 7fb8a6897640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a0107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:15.223 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.610+0000 7fb8a6897640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a0107ff0 con 0x7fb8a0107620 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.611+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a0107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.611+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a0107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44558/0 (socket says 172.21.15.92:44558) 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.611+0000 7fb89ffff640 1 -- 172.21.15.92:0/4046626264 learned_addr learned my addr 172.21.15.92:0/4046626264 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.611+0000 7fb89ffff640 1 -- 172.21.15.92:0/4046626264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0108820 con 0x7fb8a0107620 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.613+0000 7fb89ffff640 1 --2- 172.21.15.92:0/4046626264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a0107a20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb890009820 tx=0x7fb89002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e757b5eac43607 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.613+0000 7fb89effd640 1 -- 172.21.15.92:0/4046626264 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb890037070 con 0x7fb8a0107620 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.613+0000 7fb89effd640 1 -- 172.21.15.92:0/4046626264 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb890032900 con 0x7fb8a0107620 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.613+0000 7fb89effd640 1 -- 172.21.15.92:0/4046626264 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb890030850 con 0x7fb8a0107620 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.613+0000 7fb8a6897640 1 -- 172.21.15.92:0/4046626264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 msgr2=0x7fb8a0107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.613+0000 7fb8a6897640 1 --2- 172.21.15.92:0/4046626264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a0107a20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb890009820 tx=0x7fb89002a270 comp rx=0 tx=0).stop 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.614+0000 7fb8a6897640 1 -- 172.21.15.92:0/4046626264 shutdown_connections 2024-09-10T10:27:15.224 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.614+0000 7fb8a6897640 1 --2- 172.21.15.92:0/4046626264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a0107a20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.614+0000 7fb8a6897640 1 -- 172.21.15.92:0/4046626264 >> 172.21.15.92:0/4046626264 conn(0x7fb8a0102db0 msgr2=0x7fb8a01051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.614+0000 7fb8a6897640 1 -- 172.21.15.92:0/4046626264 shutdown_connections 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.614+0000 7fb8a6897640 1 -- 172.21.15.92:0/4046626264 wait complete. 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.614+0000 7fb8a6897640 1 Processor -- start 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.614+0000 7fb8a6897640 1 -- start start 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.614+0000 7fb8a6897640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a007db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb8a6897640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a010bbd0 con 0x7fb8a0107620 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a007db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb89ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a007db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44574/0 (socket says 172.21.15.92:44574) 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb89ffff640 1 -- 172.21.15.92:0/3749050374 learned_addr learned my addr 172.21.15.92:0/3749050374 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb89ffff640 1 -- 172.21.15.92:0/3749050374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a007e080 con 0x7fb8a0107620 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb89ffff640 1 --2- 172.21.15.92:0/3749050374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a007db40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb890009940 tx=0x7fb8900326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb89d7fa640 1 -- 172.21.15.92:0/3749050374 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb890042070 con 0x7fb8a0107620 2024-09-10T10:27:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb8a6897640 1 -- 172.21.15.92:0/3749050374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a007c270 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb89d7fa640 1 -- 172.21.15.92:0/3749050374 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb890032be0 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb89d7fa640 1 -- 172.21.15.92:0/3749050374 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb890037040 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb8a6897640 1 -- 172.21.15.92:0/3749050374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a007c7b0 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.615+0000 7fb89d7fa640 1 -- 172.21.15.92:0/3749050374 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb890045070 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.616+0000 7fb89d7fa640 1 -- 172.21.15.92:0/3749050374 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb890047a80 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.616+0000 7fb8a6897640 1 -- 172.21.15.92:0/3749050374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a0107aa0 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.619+0000 7fb89d7fa640 1 -- 172.21.15.92:0/3749050374 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb890032d90 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.675+0000 7fb8a6897640 1 -- 172.21.15.92:0/3749050374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fb8a007cce0 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.680+0000 7fb89d7fa640 1 -- 172.21.15.92:0/3749050374 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fb89003d430 con 0x7fb8a0107620 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.681+0000 7fb8a6897640 1 -- 172.21.15.92:0/3749050374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 msgr2=0x7fb8a007db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.681+0000 7fb8a6897640 1 --2- 172.21.15.92:0/3749050374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a007db40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb890009940 tx=0x7fb8900326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:15.227 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.681+0000 7fb8a6897640 1 -- 172.21.15.92:0/3749050374 shutdown_connections 2024-09-10T10:27:15.227 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.681+0000 7fb8a6897640 1 --2- 172.21.15.92:0/3749050374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8a0107620 0x7fb8a007db40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:15.227 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.681+0000 7fb8a6897640 1 -- 172.21.15.92:0/3749050374 >> 172.21.15.92:0/3749050374 conn(0x7fb8a0102db0 msgr2=0x7fb8a0103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:15.227 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.681+0000 7fb8a6897640 1 -- 172.21.15.92:0/3749050374 shutdown_connections 2024-09-10T10:27:15.227 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:14.681+0000 7fb8a6897640 1 -- 172.21.15.92:0/3749050374 wait complete. 2024-09-10T10:27:15.227 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T10:27:15.241 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:27:15.241 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mgr... 2024-09-10T10:27:15.241 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T10:27:15.241 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T10:27:15.495 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.x 2024-09-10T10:27:15.495 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T10:27:15.643 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968.target.wants/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@.service. 2024-09-10T10:27:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:15 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3749050374' entity='client.admin' 2024-09-10T10:27:16.154 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:16 smithi092 podman[31045]: 2024-09-10 10:27:16.097837422 +0000 UTC m=+0.335829679 container start 69cf79c28a628b81c1b52f116be99d8e8cad3060d6c1786fbb3e31872985ab6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731) 2024-09-10T10:27:16.154 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:16 smithi092 bash[31045]: 69cf79c28a628b81c1b52f116be99d8e8cad3060d6c1786fbb3e31872985ab6c 2024-09-10T10:27:16.168 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:27:16.168 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-10T10:27:16.175 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:27:16.175 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-10T10:27:16.175 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-10T10:27:16.175 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T10:27:16.184 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:27:16.184 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-10T10:27:16.191 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:27:16.192 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-10T10:27:16.192 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-10T10:27:16.192 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T10:27:16.192 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr to start... 2024-09-10T10:27:16.192 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr... 2024-09-10T10:27:16.430 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:16 smithi092 systemd[1]: Started Ceph mgr.x for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:27:16.431 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:16.221+0000 7f36241a5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:27:16.431 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:16.278+0000 7f36241a5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:27:16.431 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:16.428+0000 7f36241a5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:27:16.718 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:16.498+0000 7f36241a5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:27:16.719 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:16.667+0000 7f36241a5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:27:17.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:16 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1301363077' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T10:27:17.110 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:16.821+0000 7f36241a5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:27:17.453 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:17 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:17.141+0000 7f36241a5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:27:17.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:17 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:17.201+0000 7f36241a5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:27:17.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:17 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:17.388+0000 7f36241a5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:27:17.504 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:17.504 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:27:17.504 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T10:27:17.505 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T10:27:17.506 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:17.507 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T10:27:09:104157+0000", 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T10:27:17.508 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T10:27:09.104796+0000", 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.627+0000 7f6e360c0640 1 Processor -- start 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.627+0000 7f6e360c0640 1 -- start start 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.627+0000 7f6e360c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e3010a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:17.509 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.627+0000 7f6e360c0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3007bdd0 con 0x7f6e301080e0 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.628+0000 7f6e2f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e3010a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.628+0000 7f6e2f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e3010a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44598/0 (socket says 172.21.15.92:44598) 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.628+0000 7f6e2f7fe640 1 -- 172.21.15.92:0/3817142651 learned_addr learned my addr 172.21.15.92:0/3817142651 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.628+0000 7f6e2f7fe640 1 -- 172.21.15.92:0/3817142651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3010aa10 con 0x7f6e301080e0 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.629+0000 7f6e2f7fe640 1 --2- 172.21.15.92:0/3817142651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e3010a4d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009820 tx=0x7f6e2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e3a150ad5a7631 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.629+0000 7f6e2e7fc640 1 -- 172.21.15.92:0/3817142651 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e20037070 con 0x7f6e301080e0 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.629+0000 7f6e2e7fc640 1 -- 172.21.15.92:0/3817142651 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e20032900 con 0x7f6e301080e0 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.629+0000 7f6e2e7fc640 1 -- 172.21.15.92:0/3817142651 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e20030850 con 0x7f6e301080e0 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.630+0000 7f6e360c0640 1 -- 172.21.15.92:0/3817142651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 msgr2=0x7f6e3010a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.630+0000 7f6e360c0640 1 --2- 172.21.15.92:0/3817142651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e3010a4d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009820 tx=0x7f6e2002a270 comp rx=0 tx=0).stop 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.630+0000 7f6e360c0640 1 -- 172.21.15.92:0/3817142651 shutdown_connections 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.630+0000 7f6e360c0640 1 --2- 172.21.15.92:0/3817142651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e3010a4d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:17.510 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.630+0000 7f6e360c0640 1 -- 172.21.15.92:0/3817142651 >> 172.21.15.92:0/3817142651 conn(0x7f6e30101ca0 msgr2=0x7f6e301040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.630+0000 7f6e360c0640 1 -- 172.21.15.92:0/3817142651 shutdown_connections 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.630+0000 7f6e360c0640 1 -- 172.21.15.92:0/3817142651 wait complete. 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.631+0000 7f6e360c0640 1 Processor -- start 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.631+0000 7f6e360c0640 1 -- start start 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.631+0000 7f6e360c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e30107960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.631+0000 7f6e360c0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3010b9f0 con 0x7f6e301080e0 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.631+0000 7f6e2f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e30107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.631+0000 7f6e2f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e30107960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44610/0 (socket says 172.21.15.92:44610) 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.631+0000 7f6e2f7fe640 1 -- 172.21.15.92:0/1301363077 learned_addr learned my addr 172.21.15.92:0/1301363077 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.632+0000 7f6e2f7fe640 1 -- 172.21.15.92:0/1301363077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e30107ea0 con 0x7f6e301080e0 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.632+0000 7f6e2f7fe640 1 --2- 172.21.15.92:0/1301363077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e30107960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6e200097f0 tx=0x7f6e20030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.632+0000 7f6e2cff9640 1 -- 172.21.15.92:0/1301363077 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e20042070 con 0x7f6e301080e0 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.632+0000 7f6e2cff9640 1 -- 172.21.15.92:0/1301363077 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e20032ca0 con 0x7f6e301080e0 2024-09-10T10:27:17.511 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.632+0000 7f6e360c0640 1 -- 172.21.15.92:0/1301363077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e30106090 con 0x7f6e301080e0 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.632+0000 7f6e2cff9640 1 -- 172.21.15.92:0/1301363077 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e20037040 con 0x7f6e301080e0 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.632+0000 7f6e360c0640 1 -- 172.21.15.92:0/1301363077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e301065d0 con 0x7f6e301080e0 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.632+0000 7f6e2cff9640 1 -- 172.21.15.92:0/1301363077 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6e20045070 con 0x7f6e301080e0 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.632+0000 7f6e2cff9640 1 -- 172.21.15.92:0/1301363077 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6e20047a90 con 0x7f6e301080e0 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.633+0000 7f6e360c0640 1 -- 172.21.15.92:0/1301363077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e30108540 con 0x7f6e301080e0 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.635+0000 7f6e2cff9640 1 -- 172.21.15.92:0/1301363077 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6e2003db10 con 0x7f6e301080e0 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.717+0000 7f6e360c0640 1 -- 172.21.15.92:0/1301363077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6e30106910 con 0x7f6e301080e0 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.717+0000 7f6e2cff9640 1 -- 172.21.15.92:0/1301363077 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f6e2003d430 con 0x7f6e301080e0 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.718+0000 7f6e360c0640 1 -- 172.21.15.92:0/1301363077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 msgr2=0x7f6e30107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.718+0000 7f6e360c0640 1 --2- 172.21.15.92:0/1301363077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e30107960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6e200097f0 tx=0x7f6e20030ec0 comp rx=0 tx=0).stop 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.718+0000 7f6e360c0640 1 -- 172.21.15.92:0/1301363077 shutdown_connections 2024-09-10T10:27:17.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.718+0000 7f6e360c0640 1 --2- 172.21.15.92:0/1301363077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e301080e0 0x7f6e30107960 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:17.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.718+0000 7f6e360c0640 1 -- 172.21.15.92:0/1301363077 >> 172.21.15.92:0/1301363077 conn(0x7f6e30101ca0 msgr2=0x7f6e30102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:17.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.718+0000 7f6e360c0640 1 -- 172.21.15.92:0/1301363077 shutdown_connections 2024-09-10T10:27:17.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:16.718+0000 7f6e360c0640 1 -- 172.21.15.92:0/1301363077 wait complete. 2024-09-10T10:27:17.513 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (1/15)... 2024-09-10T10:27:18.610 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:18 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:18.263+0000 7f36241a5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:27:18.611 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:18 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:18.329+0000 7f36241a5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:27:19.291 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.034+0000 7f36241a5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:27:19.291 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.148+0000 7f36241a5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:27:19.291 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.289+0000 7f36241a5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:27:19.578 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.350+0000 7f36241a5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:27:19.578 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.507+0000 7f36241a5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:27:19.578 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.576+0000 7f36241a5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:27:19.860 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.638+0000 7f36241a5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:27:19.860 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.800+0000 7f36241a5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:27:20.147 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:20 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/4279446825' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T10:27:20.147 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.869+0000 7f36241a5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:27:20.147 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:19.939+0000 7f36241a5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:27:20.148 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:20 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:20.026+0000 7f36241a5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:27:20.148 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:20 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:20.086+0000 7f36241a5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:27:20.148 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:20 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:20.145+0000 7f36241a5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:27:20.588 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:27:20.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T10:27:20.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T10:27:20.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T10:27:09:104157+0000", 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T10:27:20.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T10:27:09.104796+0000", 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.890+0000 7f64093e9640 1 Processor -- start 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.890+0000 7f64093e9640 1 -- start start 2024-09-10T10:27:20.593 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.890+0000 7f64093e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640410a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.890+0000 7f64093e9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f640407bdd0 con 0x7f64041080e0 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.890+0000 7f6402ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640410a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.890+0000 7f6402ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640410a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44612/0 (socket says 172.21.15.92:44612) 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.890+0000 7f6402ffd640 1 -- 172.21.15.92:0/1172320665 learned_addr learned my addr 172.21.15.92:0/1172320665 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.890+0000 7f6402ffd640 1 -- 172.21.15.92:0/1172320665 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640410aa10 con 0x7f64041080e0 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.891+0000 7f6402ffd640 1 --2- 172.21.15.92:0/1172320665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640410a4d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009820 tx=0x7f63f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a03508db766ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.891+0000 7f6401ffb640 1 -- 172.21.15.92:0/1172320665 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f4037070 con 0x7f64041080e0 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.891+0000 7f6401ffb640 1 -- 172.21.15.92:0/1172320665 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63f4032900 con 0x7f64041080e0 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.891+0000 7f6401ffb640 1 -- 172.21.15.92:0/1172320665 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f4030850 con 0x7f64041080e0 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.892+0000 7f64093e9640 1 -- 172.21.15.92:0/1172320665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 msgr2=0x7f640410a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.892+0000 7f64093e9640 1 --2- 172.21.15.92:0/1172320665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640410a4d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009820 tx=0x7f63f402a270 comp rx=0 tx=0).stop 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.892+0000 7f64093e9640 1 -- 172.21.15.92:0/1172320665 shutdown_connections 2024-09-10T10:27:20.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.892+0000 7f64093e9640 1 --2- 172.21.15.92:0/1172320665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640410a4d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.892+0000 7f64093e9640 1 -- 172.21.15.92:0/1172320665 >> 172.21.15.92:0/1172320665 conn(0x7f6404101ca0 msgr2=0x7f64041040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.892+0000 7f64093e9640 1 -- 172.21.15.92:0/1172320665 shutdown_connections 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.892+0000 7f64093e9640 1 -- 172.21.15.92:0/1172320665 wait complete. 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.893+0000 7f64093e9640 1 Processor -- start 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.893+0000 7f64093e9640 1 -- start start 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.893+0000 7f64093e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640419b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.893+0000 7f64093e9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f640410b9f0 con 0x7f64041080e0 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.893+0000 7f6402ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640419b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.893+0000 7f6402ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640419b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44624/0 (socket says 172.21.15.92:44624) 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.893+0000 7f6402ffd640 1 -- 172.21.15.92:0/4279446825 learned_addr learned my addr 172.21.15.92:0/4279446825 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.894+0000 7f6402ffd640 1 -- 172.21.15.92:0/4279446825 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640419bb70 con 0x7f64041080e0 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.894+0000 7f6402ffd640 1 --2- 172.21.15.92:0/4279446825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640419b630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f63f4031000 tx=0x7f63f40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:20.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.894+0000 7f63ebfff640 1 -- 172.21.15.92:0/4279446825 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f4042070 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.894+0000 7f64093e9640 1 -- 172.21.15.92:0/4279446825 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640419be00 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.894+0000 7f63ebfff640 1 -- 172.21.15.92:0/4279446825 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63f4032be0 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.894+0000 7f63ebfff640 1 -- 172.21.15.92:0/4279446825 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f4037040 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.894+0000 7f64093e9640 1 -- 172.21.15.92:0/4279446825 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640419eaf0 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.894+0000 7f63ebfff640 1 -- 172.21.15.92:0/4279446825 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f63f4045070 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.894+0000 7f63ebfff640 1 -- 172.21.15.92:0/4279446825 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f63f4047b70 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.895+0000 7f64093e9640 1 -- 172.21.15.92:0/4279446825 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6404108540 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.897+0000 7f63ebfff640 1 -- 172.21.15.92:0/4279446825 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f63f404c030 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.959+0000 7f64093e9640 1 -- 172.21.15.92:0/4279446825 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f640419ecc0 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.959+0000 7f63ebfff640 1 -- 172.21.15.92:0/4279446825 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f63f40328a0 con 0x7f64041080e0 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.960+0000 7f64093e9640 1 -- 172.21.15.92:0/4279446825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 msgr2=0x7f640419b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.960+0000 7f64093e9640 1 --2- 172.21.15.92:0/4279446825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640419b630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f63f4031000 tx=0x7f63f40326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:20.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.960+0000 7f64093e9640 1 -- 172.21.15.92:0/4279446825 shutdown_connections 2024-09-10T10:27:20.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.960+0000 7f64093e9640 1 --2- 172.21.15.92:0/4279446825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64041080e0 0x7f640419b630 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:20.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.960+0000 7f64093e9640 1 -- 172.21.15.92:0/4279446825 >> 172.21.15.92:0/4279446825 conn(0x7f6404101ca0 msgr2=0x7f6404102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:20.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.960+0000 7f64093e9640 1 -- 172.21.15.92:0/4279446825 shutdown_connections 2024-09-10T10:27:20.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:19.960+0000 7f64093e9640 1 -- 172.21.15.92:0/4279446825 wait complete. 2024-09-10T10:27:20.597 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (2/15)... 2024-09-10T10:27:21.360 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:20 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:20.951+0000 7f36241a5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: Activating manager daemon x 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: mgrmap e2: x(active, starting, since 0.00319357s) 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: Manager daemon x is now available 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:27:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' 2024-09-10T10:27:21.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' 2024-09-10T10:27:21.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:21 smithi092 ceph-mon[30834]: from='mgr.14100 172.21.15.92:0/2850958933' entity='mgr.x' 2024-09-10T10:27:23.012 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:22 smithi092 ceph-mon[30834]: mgrmap e3: x(active, since 1.00713s) 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:27:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T10:27:23.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T10:27:23.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T10:27:23.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T10:27:23.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T10:27:23.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:23.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T10:27:23.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T10:27:09:104157+0000", 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T10:27:23.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T10:27:09.104796+0000", 2024-09-10T10:27:23.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.012+0000 7f6f2c443640 1 Processor -- start 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.012+0000 7f6f2c443640 1 -- start start 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.012+0000 7f6f2c443640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f24107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.012+0000 7f6f2c443640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24107ff0 con 0x7f6f24107620 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.013+0000 7f6f2a1df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f24107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.013+0000 7f6f2a1df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f24107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59414/0 (socket says 172.21.15.92:59414) 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.013+0000 7f6f2a1df640 1 -- 172.21.15.92:0/2520596645 learned_addr learned my addr 172.21.15.92:0/2520596645 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.013+0000 7f6f2a1df640 1 -- 172.21.15.92:0/2520596645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f24108820 con 0x7f6f24107620 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.014+0000 7f6f2a1df640 1 --2- 172.21.15.92:0/2520596645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f24107a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009820 tx=0x7f6f1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db37b09b5d7c10cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:23.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.014+0000 7f6f291dd640 1 -- 172.21.15.92:0/2520596645 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f18037070 con 0x7f6f24107620 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.014+0000 7f6f291dd640 1 -- 172.21.15.92:0/2520596645 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f18032900 con 0x7f6f24107620 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.014+0000 7f6f291dd640 1 -- 172.21.15.92:0/2520596645 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f18030850 con 0x7f6f24107620 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.014+0000 7f6f2c443640 1 -- 172.21.15.92:0/2520596645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 msgr2=0x7f6f24107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.014+0000 7f6f2c443640 1 --2- 172.21.15.92:0/2520596645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f24107a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009820 tx=0x7f6f1802a270 comp rx=0 tx=0).stop 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.015+0000 7f6f2c443640 1 -- 172.21.15.92:0/2520596645 shutdown_connections 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.015+0000 7f6f2c443640 1 --2- 172.21.15.92:0/2520596645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f24107a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.015+0000 7f6f2c443640 1 -- 172.21.15.92:0/2520596645 >> 172.21.15.92:0/2520596645 conn(0x7f6f24102db0 msgr2=0x7f6f241051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.015+0000 7f6f2c443640 1 -- 172.21.15.92:0/2520596645 shutdown_connections 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.015+0000 7f6f2c443640 1 -- 172.21.15.92:0/2520596645 wait complete. 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.015+0000 7f6f2c443640 1 Processor -- start 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.015+0000 7f6f2c443640 1 -- start start 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.015+0000 7f6f2c443640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f2419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.015+0000 7f6f2c443640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2410bbd0 con 0x7f6f24107620 2024-09-10T10:27:23.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f2a1df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f2419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f2a1df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f2419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59422/0 (socket says 172.21.15.92:59422) 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f2a1df640 1 -- 172.21.15.92:0/1149575612 learned_addr learned my addr 172.21.15.92:0/1149575612 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f2a1df640 1 -- 172.21.15.92:0/1149575612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2419bb90 con 0x7f6f24107620 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f2a1df640 1 --2- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f2419b650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009940 tx=0x7f6f180326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f177fe640 1 -- 172.21.15.92:0/1149575612 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f18042070 con 0x7f6f24107620 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f177fe640 1 -- 172.21.15.92:0/1149575612 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f18032be0 con 0x7f6f24107620 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2419be20 con 0x7f6f24107620 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f177fe640 1 -- 172.21.15.92:0/1149575612 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f18037040 con 0x7f6f24107620 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.016+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f2419eb10 con 0x7f6f24107620 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.017+0000 7f6f177fe640 1 -- 172.21.15.92:0/1149575612 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f6f18045070 con 0x7f6f24107620 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.017+0000 7f6f177fe640 1 --2- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6f10038f20 0x7f6f1003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.017+0000 7f6f177fe640 1 -- 172.21.15.92:0/1149575612 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6f1806c1c0 con 0x7f6f24107620 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.017+0000 7f6f299de640 1 --2- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6f10038f20 0x7f6f1003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:23.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.017+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2410bd50 con 0x7f6f24107620 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.018+0000 7f6f299de640 1 --2- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6f10038f20 0x7f6f1003b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6f200098c0 tx=0x7f6f20006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.023+0000 7f6f177fe640 1 -- 172.21.15.92:0/1149575612 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f18032e00 con 0x7f6f24107620 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.250+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6f2407c5b0 con 0x7f6f24107620 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.251+0000 7f6f177fe640 1 -- 172.21.15.92:0/1149575612 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f6f1806bbe0 con 0x7f6f24107620 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6f10038f20 msgr2=0x7f6f1003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 --2- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6f10038f20 0x7f6f1003b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6f200098c0 tx=0x7f6f20006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 msgr2=0x7f6f2419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 --2- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f2419b650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009940 tx=0x7f6f180326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 shutdown_connections 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 --2- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6f10038f20 0x7f6f1003b3e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 --2- 172.21.15.92:0/1149575612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f24107620 0x7f6f2419b650 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 >> 172.21.15.92:0/1149575612 conn(0x7f6f24102db0 msgr2=0x7f6f24103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 shutdown_connections 2024-09-10T10:27:23.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:23.254+0000 7f6f2c443640 1 -- 172.21.15.92:0/1149575612 wait complete. 2024-09-10T10:27:23.870 INFO:teuthology.orchestra.run.smithi092.stdout:mgr is available 2024-09-10T10:27:23.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:23 smithi092 ceph-mon[30834]: mgrmap e4: x(active, since 2s) 2024-09-10T10:27:23.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:23 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1149575612' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T10:27:24.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:24 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/669671987' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T10:27:24.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.252+0000 7f6a6e8df640 1 Processor -- start 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.253+0000 7f6a6e8df640 1 -- start start 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.253+0000 7f6a6e8df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a68106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.253+0000 7f6a6e8df640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6a68106ee0 con 0x7f6a68106510 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.253+0000 7f6a67fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a68106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:25.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.253+0000 7f6a67fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a68106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59426/0 (socket says 172.21.15.92:59426) 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.253+0000 7f6a67fff640 1 -- 172.21.15.92:0/1439979382 learned_addr learned my addr 172.21.15.92:0/1439979382 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.253+0000 7f6a67fff640 1 -- 172.21.15.92:0/1439979382 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a681076c0 con 0x7f6a68106510 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.254+0000 7f6a67fff640 1 --2- 172.21.15.92:0/1439979382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a68106910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009820 tx=0x7f6a5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0e46bdf45782a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.254+0000 7f6a677fe640 1 -- 172.21.15.92:0/1439979382 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a58037070 con 0x7f6a68106510 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.254+0000 7f6a677fe640 1 -- 172.21.15.92:0/1439979382 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a58032900 con 0x7f6a68106510 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.254+0000 7f6a677fe640 1 -- 172.21.15.92:0/1439979382 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a58030850 con 0x7f6a68106510 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.255+0000 7f6a6e8df640 1 -- 172.21.15.92:0/1439979382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 msgr2=0x7f6a68106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.255+0000 7f6a6e8df640 1 --2- 172.21.15.92:0/1439979382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a68106910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009820 tx=0x7f6a5802a270 comp rx=0 tx=0).stop 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.255+0000 7f6a6e8df640 1 -- 172.21.15.92:0/1439979382 shutdown_connections 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.255+0000 7f6a6e8df640 1 --2- 172.21.15.92:0/1439979382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a68106910 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.255+0000 7f6a6e8df640 1 -- 172.21.15.92:0/1439979382 >> 172.21.15.92:0/1439979382 conn(0x7f6a68101ca0 msgr2=0x7f6a681040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:25.001 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.255+0000 7f6a6e8df640 1 -- 172.21.15.92:0/1439979382 shutdown_connections 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.255+0000 7f6a6e8df640 1 -- 172.21.15.92:0/1439979382 wait complete. 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.255+0000 7f6a6e8df640 1 Processor -- start 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.255+0000 7f6a6e8df640 1 -- start start 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a6e8df640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a6807ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a6e8df640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6810aa70 con 0x7f6a68106510 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a67fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a6807ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a67fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a6807ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59442/0 (socket says 172.21.15.92:59442) 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a67fff640 1 -- 172.21.15.92:0/669671987 learned_addr learned my addr 172.21.15.92:0/669671987 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a67fff640 1 -- 172.21.15.92:0/669671987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6819e3b0 con 0x7f6a68106510 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a67fff640 1 --2- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a6807ba20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009940 tx=0x7f6a580326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a65ffb640 1 -- 172.21.15.92:0/669671987 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a58042070 con 0x7f6a68106510 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a65ffb640 1 -- 172.21.15.92:0/669671987 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6a58032be0 con 0x7f6a68106510 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a65ffb640 1 -- 172.21.15.92:0/669671987 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a58037040 con 0x7f6a68106510 2024-09-10T10:27:25.002 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6819e580 con 0x7f6a68106510 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.256+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6819e920 con 0x7f6a68106510 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.257+0000 7f6a65ffb640 1 -- 172.21.15.92:0/669671987 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f6a58045070 con 0x7f6a68106510 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.257+0000 7f6a65ffb640 1 --2- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6a54038f20 0x7f6a5403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.257+0000 7f6a65ffb640 1 -- 172.21.15.92:0/669671987 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6a5806be70 con 0x7f6a68106510 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.257+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a68106990 con 0x7f6a68106510 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.257+0000 7f6a5ffff640 1 --2- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6a54038f20 0x7f6a5403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.258+0000 7f6a5ffff640 1 --2- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6a54038f20 0x7f6a5403b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a500098c0 tx=0x7f6a50006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.263+0000 7f6a65ffb640 1 -- 172.21.15.92:0/669671987 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a5804b170 con 0x7f6a68106510 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.429+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f6a6819ee40 con 0x7f6a68106510 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.429+0000 7f6a65ffb640 1 -- 172.21.15.92:0/669671987 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f6a58032d90 con 0x7f6a68106510 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.431+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6a54038f20 msgr2=0x7f6a5403b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.431+0000 7f6a6e8df640 1 --2- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6a54038f20 0x7f6a5403b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a500098c0 tx=0x7f6a50006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:25.003 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.431+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 msgr2=0x7f6a6807ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:25.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.431+0000 7f6a6e8df640 1 --2- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a6807ba20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009940 tx=0x7f6a580326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:25.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.432+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 shutdown_connections 2024-09-10T10:27:25.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.432+0000 7f6a6e8df640 1 --2- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f6a54038f20 0x7f6a5403b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:25.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.432+0000 7f6a6e8df640 1 --2- 172.21.15.92:0/669671987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a68106510 0x7f6a6807ba20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:25.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.432+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 >> 172.21.15.92:0/669671987 conn(0x7f6a68101ca0 msgr2=0x7f6a68102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:25.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.432+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 shutdown_connections 2024-09-10T10:27:25.004 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:24.432+0000 7f6a6e8df640 1 -- 172.21.15.92:0/669671987 wait complete. 2024-09-10T10:27:25.004 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling cephadm module... 2024-09-10T10:27:26.303 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:25 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3773470209' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T10:27:26.303 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: ignoring --setuser ceph since I am not root 2024-09-10T10:27:26.303 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: ignoring --setgroup ceph since I am not root 2024-09-10T10:27:26.303 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:26.098+0000 7fa71fa9d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:27:26.303 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:26.154+0000 7fa71fa9d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:27:26.303 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:26.301+0000 7fa71fa9d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:27:26.610 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:26.370+0000 7fa71fa9d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:27:26.610 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:26.517+0000 7fa71fa9d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:27:26.619 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.388+0000 7ff1ae3c3640 1 Processor -- start 2024-09-10T10:27:26.619 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.388+0000 7ff1ae3c3640 1 -- start start 2024-09-10T10:27:26.619 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.388+0000 7ff1ae3c3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a8107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:26.619 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.388+0000 7ff1ae3c3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a8107ff0 con 0x7ff1a8107620 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.388+0000 7ff1a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a8107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.388+0000 7ff1a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a8107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59448/0 (socket says 172.21.15.92:59448) 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.388+0000 7ff1a7fff640 1 -- 172.21.15.92:0/3064730994 learned_addr learned my addr 172.21.15.92:0/3064730994 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.388+0000 7ff1a7fff640 1 -- 172.21.15.92:0/3064730994 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a8108820 con 0x7ff1a8107620 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.389+0000 7ff1a7fff640 1 --2- 172.21.15.92:0/3064730994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a8107a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff198009820 tx=0x7ff19802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e90ac60be09932c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.389+0000 7ff1a6ffd640 1 -- 172.21.15.92:0/3064730994 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff198037070 con 0x7ff1a8107620 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.389+0000 7ff1a6ffd640 1 -- 172.21.15.92:0/3064730994 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff198032900 con 0x7ff1a8107620 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.389+0000 7ff1a6ffd640 1 -- 172.21.15.92:0/3064730994 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff198030850 con 0x7ff1a8107620 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.390+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3064730994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 msgr2=0x7ff1a8107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.390+0000 7ff1ae3c3640 1 --2- 172.21.15.92:0/3064730994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a8107a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff198009820 tx=0x7ff19802a270 comp rx=0 tx=0).stop 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.390+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3064730994 shutdown_connections 2024-09-10T10:27:26.620 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.390+0000 7ff1ae3c3640 1 --2- 172.21.15.92:0/3064730994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a8107a20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.390+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3064730994 >> 172.21.15.92:0/3064730994 conn(0x7ff1a8102db0 msgr2=0x7ff1a81051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.390+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3064730994 shutdown_connections 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.390+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3064730994 wait complete. 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.390+0000 7ff1ae3c3640 1 Processor -- start 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.391+0000 7ff1ae3c3640 1 -- start start 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.391+0000 7ff1ae3c3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a807db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.391+0000 7ff1ae3c3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a810bbd0 con 0x7ff1a8107620 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.391+0000 7ff1a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a807db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.391+0000 7ff1a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a807db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59452/0 (socket says 172.21.15.92:59452) 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.391+0000 7ff1a7fff640 1 -- 172.21.15.92:0/3773470209 learned_addr learned my addr 172.21.15.92:0/3773470209 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.391+0000 7ff1a7fff640 1 -- 172.21.15.92:0/3773470209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a807e080 con 0x7ff1a8107620 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.391+0000 7ff1a7fff640 1 --2- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a807db40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff198009940 tx=0x7ff1980326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.391+0000 7ff1a57fa640 1 -- 172.21.15.92:0/3773470209 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff198042070 con 0x7ff1a8107620 2024-09-10T10:27:26.621 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.392+0000 7ff1a57fa640 1 -- 172.21.15.92:0/3773470209 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff198032be0 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.392+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a807c270 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.392+0000 7ff1a57fa640 1 -- 172.21.15.92:0/3773470209 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff198037040 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.392+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a807c7b0 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.392+0000 7ff1a57fa640 1 -- 172.21.15.92:0/3773470209 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7ff198045070 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.393+0000 7ff1a57fa640 1 --2- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7ff190038f20 0x7ff19003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.393+0000 7ff1a57fa640 1 -- 172.21.15.92:0/3773470209 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff19806cef0 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.393+0000 7ff1a77fe640 1 --2- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7ff190038f20 0x7ff19003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.393+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a810bd50 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.393+0000 7ff1a77fe640 1 --2- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7ff190038f20 0x7ff19003b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0098c0 tx=0x7ff19c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.398+0000 7ff1a57fa640 1 -- 172.21.15.92:0/3773470209 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff19806c910 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.608+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff1a807ce30 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.963+0000 7ff1a57fa640 1 -- 172.21.15.92:0/3773470209 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7ff198032d90 con 0x7ff1a8107620 2024-09-10T10:27:26.622 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.965+0000 7ff1a57fa640 1 -- 172.21.15.92:0/3773470209 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7ff19803b330 con 0x7ff1a8107620 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.966+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7ff190038f20 msgr2=0x7ff19003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.966+0000 7ff1ae3c3640 1 --2- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7ff190038f20 0x7ff19003b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff19c0098c0 tx=0x7ff19c006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.966+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 msgr2=0x7ff1a807db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.966+0000 7ff1ae3c3640 1 --2- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a807db40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff198009940 tx=0x7ff1980326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.967+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 shutdown_connections 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.967+0000 7ff1ae3c3640 1 --2- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7ff190038f20 0x7ff19003b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.967+0000 7ff1ae3c3640 1 --2- 172.21.15.92:0/3773470209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a8107620 0x7ff1a807db40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.967+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 >> 172.21.15.92:0/3773470209 conn(0x7ff1a8102db0 msgr2=0x7ff1a8103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.967+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 shutdown_connections 2024-09-10T10:27:26.623 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:25.967+0000 7ff1ae3c3640 1 -- 172.21.15.92:0/3773470209 wait complete. 2024-09-10T10:27:26.941 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:26.664+0000 7fa71fa9d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:27:27.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3773470209' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T10:27:27.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-mon[30834]: mgrmap e5: x(active, since 5s) 2024-09-10T10:27:27.225 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:26.989+0000 7fa71fa9d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:27:27.225 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:27 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:27.054+0000 7fa71fa9d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:27:27.527 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:27 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:27.246+0000 7fa71fa9d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:27:27.796 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.016+0000 7f5ca5726640 1 Processor -- start 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.016+0000 7f5ca5726640 1 -- start start 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.017+0000 7f5ca5726640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca0107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.017+0000 7f5ca5726640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0108000 con 0x7f5ca0107630 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.017+0000 7f5c9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca0107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:27.797 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.017+0000 7f5c9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca0107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59490/0 (socket says 172.21.15.92:59490) 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.017+0000 7f5c9effd640 1 -- 172.21.15.92:0/3421251153 learned_addr learned my addr 172.21.15.92:0/3421251153 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.017+0000 7f5c9effd640 1 -- 172.21.15.92:0/3421251153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca01087e0 con 0x7f5ca0107630 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.018+0000 7f5c9effd640 1 --2- 172.21.15.92:0/3421251153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca0107a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009820 tx=0x7f5c9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49def5f0724e7b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.018+0000 7f5c9e7fc640 1 -- 172.21.15.92:0/3421251153 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c90037070 con 0x7f5ca0107630 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.018+0000 7f5c9e7fc640 1 -- 172.21.15.92:0/3421251153 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c90032900 con 0x7f5ca0107630 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.018+0000 7f5c9e7fc640 1 -- 172.21.15.92:0/3421251153 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c90030850 con 0x7f5ca0107630 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.019+0000 7f5ca5726640 1 -- 172.21.15.92:0/3421251153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 msgr2=0x7f5ca0107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.019+0000 7f5ca5726640 1 --2- 172.21.15.92:0/3421251153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca0107a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009820 tx=0x7f5c9002a270 comp rx=0 tx=0).stop 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.019+0000 7f5ca5726640 1 -- 172.21.15.92:0/3421251153 shutdown_connections 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.019+0000 7f5ca5726640 1 --2- 172.21.15.92:0/3421251153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca0107a30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.019+0000 7f5ca5726640 1 -- 172.21.15.92:0/3421251153 >> 172.21.15.92:0/3421251153 conn(0x7f5ca0102da0 msgr2=0x7f5ca0105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:27.798 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.019+0000 7f5ca5726640 1 -- 172.21.15.92:0/3421251153 shutdown_connections 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.019+0000 7f5ca5726640 1 -- 172.21.15.92:0/3421251153 wait complete. 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.020+0000 7f5ca5726640 1 Processor -- start 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.020+0000 7f5ca5726640 1 -- start start 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.020+0000 7f5ca5726640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.020+0000 7f5ca5726640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca010bb90 con 0x7f5ca0107630 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.020+0000 7f5c9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.020+0000 7f5c9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59496/0 (socket says 172.21.15.92:59496) 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.020+0000 7f5c9effd640 1 -- 172.21.15.92:0/1466750154 learned_addr learned my addr 172.21.15.92:0/1466750154 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.020+0000 7f5c9effd640 1 -- 172.21.15.92:0/1466750154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca019bb90 con 0x7f5ca0107630 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.020+0000 7f5c9effd640 1 --2- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca019b650 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009940 tx=0x7f5c900326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.021+0000 7f5c9cff9640 1 -- 172.21.15.92:0/1466750154 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c90042070 con 0x7f5ca0107630 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.021+0000 7f5c9cff9640 1 -- 172.21.15.92:0/1466750154 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c90032be0 con 0x7f5ca0107630 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.021+0000 7f5c9cff9640 1 -- 172.21.15.92:0/1466750154 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c90037040 con 0x7f5ca0107630 2024-09-10T10:27:27.799 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.021+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca019be20 con 0x7f5ca0107630 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.021+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca019eb10 con 0x7f5ca0107630 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.022+0000 7f5c9cff9640 1 -- 172.21.15.92:0/1466750154 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f5c90045070 con 0x7f5ca0107630 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.022+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca010bd10 con 0x7f5ca0107630 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.022+0000 7f5c9cff9640 1 --2- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f5c8c038fc0 0x7f5c8c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.022+0000 7f5c97fff640 1 -- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f5c8c038fc0 msgr2=0x7f5c8c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2836317933 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.022+0000 7f5c9cff9640 1 -- 172.21.15.92:0/1466750154 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5c9006beb0 con 0x7f5ca0107630 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.022+0000 7f5c97fff640 1 --2- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f5c8c038fc0 0x7f5c8c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.027+0000 7f5c9cff9640 1 -- 172.21.15.92:0/1466750154 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c9004b170 con 0x7f5ca0107630 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.223+0000 7f5c97fff640 1 -- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f5c8c038fc0 msgr2=0x7f5c8c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2836317933 2024-09-10T10:27:27.800 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.223+0000 7f5c97fff640 1 --2- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f5c8c038fc0 0x7f5c8c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.246+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f5ca019f110 con 0x7f5ca0107630 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.246+0000 7f5c9cff9640 1 -- 172.21.15.92:0/1466750154 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f5c90032d90 con 0x7f5ca0107630 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f5c8c038fc0 msgr2=0x7f5c8c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 --2- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f5c8c038fc0 0x7f5c8c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 msgr2=0x7f5ca019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 --2- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca019b650 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009940 tx=0x7f5c900326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 shutdown_connections 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 --2- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7f5c8c038fc0 0x7f5c8c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 --2- 172.21.15.92:0/1466750154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ca0107630 0x7f5ca019b650 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 >> 172.21.15.92:0/1466750154 conn(0x7f5ca0102da0 msgr2=0x7f5ca0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 shutdown_connections 2024-09-10T10:27:27.801 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:27.249+0000 7f5ca5726640 1 -- 172.21.15.92:0/1466750154 wait complete. 2024-09-10T10:27:27.802 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2024-09-10T10:27:27.802 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 5... 2024-09-10T10:27:28.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:27 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1466750154' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T10:27:28.432 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:28 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:28.162+0000 7fa71fa9d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:27:28.432 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:28 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:28.234+0000 7fa71fa9d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:27:29.110 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:28 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:28.941+0000 7fa71fa9d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:27:29.110 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.057+0000 7fa71fa9d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:27:29.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.200+0000 7fa71fa9d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:27:29.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.260+0000 7fa71fa9d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:27:29.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.407+0000 7fa71fa9d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:27:29.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.474+0000 7fa71fa9d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:27:29.758 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.534+0000 7fa71fa9d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:27:29.758 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.691+0000 7fa71fa9d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:27:29.758 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.757+0000 7fa71fa9d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:27:30.024 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.824+0000 7fa71fa9d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:27:30.024 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.904+0000 7fa71fa9d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:27:30.024 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:29.963+0000 7fa71fa9d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:27:30.024 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:30.023+0000 7fa71fa9d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:27:31.110 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:30.809+0000 7fa71fa9d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:27:31.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: Active manager daemon x restarted 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: Activating manager daemon x 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: mgrmap e6: x(active, starting, since 0.00341488s) 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: Manager daemon x is now available 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:27:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:27:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:27:31.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:30 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:27:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:31 smithi092 ceph-mon[30834]: Found migration_current of "None". Setting to last migration. 2024-09-10T10:27:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:31 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:31 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:31 smithi092 ceph-mon[30834]: mgrmap e7: x(active, since 1.0056s) 2024-09-10T10:27:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:27:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T10:27:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T10:27:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:27:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.225+0000 7fd0607a9640 1 Processor -- start 2024-09-10T10:27:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.225+0000 7fd0607a9640 1 -- start start 2024-09-10T10:27:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.225+0000 7fd0607a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd058107a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.225+0000 7fd0607a9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd058108020 con 0x7fd058107650 2024-09-10T10:27:32.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.225+0000 7fd05e545640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd058107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.225+0000 7fd05e545640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd058107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59502/0 (socket says 172.21.15.92:59502) 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.225+0000 7fd05e545640 1 -- 172.21.15.92:0/2680246349 learned_addr learned my addr 172.21.15.92:0/2680246349 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.226+0000 7fd05e545640 1 -- 172.21.15.92:0/2680246349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd058108800 con 0x7fd058107650 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.226+0000 7fd05e545640 1 --2- 172.21.15.92:0/2680246349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd058107a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd054009820 tx=0x7fd05402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b363cf0ff187aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.226+0000 7fd05d543640 1 -- 172.21.15.92:0/2680246349 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd054037070 con 0x7fd058107650 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.226+0000 7fd05d543640 1 -- 172.21.15.92:0/2680246349 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd054032900 con 0x7fd058107650 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.227+0000 7fd05d543640 1 -- 172.21.15.92:0/2680246349 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd054030850 con 0x7fd058107650 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.227+0000 7fd0607a9640 1 -- 172.21.15.92:0/2680246349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 msgr2=0x7fd058107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.227+0000 7fd0607a9640 1 --2- 172.21.15.92:0/2680246349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd058107a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd054009820 tx=0x7fd05402a270 comp rx=0 tx=0).stop 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.227+0000 7fd0607a9640 1 -- 172.21.15.92:0/2680246349 shutdown_connections 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.227+0000 7fd0607a9640 1 --2- 172.21.15.92:0/2680246349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd058107a50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.227+0000 7fd0607a9640 1 -- 172.21.15.92:0/2680246349 >> 172.21.15.92:0/2680246349 conn(0x7fd058102de0 msgr2=0x7fd058105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:32.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.227+0000 7fd0607a9640 1 -- 172.21.15.92:0/2680246349 shutdown_connections 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.227+0000 7fd0607a9640 1 -- 172.21.15.92:0/2680246349 wait complete. 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.228+0000 7fd0607a9640 1 Processor -- start 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.228+0000 7fd0607a9640 1 -- start start 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.228+0000 7fd0607a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd05807db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.228+0000 7fd0607a9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd05810bbb0 con 0x7fd058107650 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.228+0000 7fd05e545640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd05807db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.228+0000 7fd05e545640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd05807db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59510/0 (socket says 172.21.15.92:59510) 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.228+0000 7fd05e545640 1 -- 172.21.15.92:0/1212414603 learned_addr learned my addr 172.21.15.92:0/1212414603 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.228+0000 7fd05e545640 1 -- 172.21.15.92:0/1212414603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05807e080 con 0x7fd058107650 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.229+0000 7fd05e545640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd05807db40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd054009940 tx=0x7fd054032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.229+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd054042070 con 0x7fd058107650 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.229+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0540308c0 con 0x7fd058107650 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.229+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05807c270 con 0x7fd058107650 2024-09-10T10:27:32.378 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.230+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd054037040 con 0x7fd058107650 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.230+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05807c7b0 con 0x7fd058107650 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.230+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fd054045070 con 0x7fd058107650 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.230+0000 7fd04f7fe640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 0x7fd04403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.230+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd054071170 con 0x7fd058107650 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.230+0000 7fd05dd44640 1 -- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 msgr2=0x7fd04403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2836317933 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.230+0000 7fd05dd44640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 0x7fd04403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.230+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 --> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd058107ad0 con 0x7fd044038fc0 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.431+0000 7fd05dd44640 1 -- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 msgr2=0x7fd04403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2836317933 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.431+0000 7fd05dd44640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 0x7fd04403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.832+0000 7fd05dd44640 1 -- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 msgr2=0x7fd04403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2836317933 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:28.832+0000 7fd05dd44640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 0x7fd04403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T10:27:32.379 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:29.634+0000 7fd05dd44640 1 -- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 msgr2=0x7fd04403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2836317933 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:29.634+0000 7fd05dd44640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 0x7fd04403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:30.812+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fd0540468d0 con 0x7fd058107650 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:30.812+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 msgr2=0x7fd04403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:30.812+0000 7fd04f7fe640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 0x7fd04403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.814+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fd0540463b0 con 0x7fd058107650 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.814+0000 7fd04f7fe640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd04403c700 0x7fd04403eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.814+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd05402bba0 con 0x7fd04403c700 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.814+0000 7fd05dd44640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd04403c700 0x7fd04403eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.815+0000 7fd05dd44640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd04403c700 0x7fd04403eaf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd048003980 tx=0x7fd0480092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.816+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 <== mgr.14118 v2:172.21.15.92:6800/1855060807 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fd05402bba0 con 0x7fd04403c700 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fd05810bd30 con 0x7fd04403c700 2024-09-10T10:27:32.380 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd04f7fe640 1 -- 172.21.15.92:0/1212414603 <== mgr.14118 v2:172.21.15.92:6800/1855060807 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fd05810bd30 con 0x7fd04403c700 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd04403c700 msgr2=0x7fd04403eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd04403c700 0x7fd04403eaf0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd048003980 tx=0x7fd0480092b0 comp rx=0 tx=0).stop 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 msgr2=0x7fd05807db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd05807db40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd054009940 tx=0x7fd054032ce0 comp rx=0 tx=0).stop 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 shutdown_connections 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd04403c700 0x7fd04403eaf0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:6800/2836317933,v1:172.21.15.92:6801/2836317933] conn(0x7fd044038fc0 0x7fd04403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 --2- 172.21.15.92:0/1212414603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd058107650 0x7fd05807db40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 >> 172.21.15.92:0/1212414603 conn(0x7fd058102de0 msgr2=0x7fd0581039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 shutdown_connections 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:31.823+0000 7fd0607a9640 1 -- 172.21.15.92:0/1212414603 wait complete. 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 5 is available 2024-09-10T10:27:32.381 INFO:teuthology.orchestra.run.smithi092.stdout:Setting orchestrator backend to cephadm... 2024-09-10T10:27:32.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:32 smithi092 ceph-mon[30834]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T10:27:32.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:32 smithi092 ceph-mon[30834]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T10:27:33.332 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:33.204+0000 7fa686db7640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:10:27:33] ENGINE Error in HTTPServer.serve 2024-09-10T10:27:33.332 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: Traceback (most recent call last): 2024-09-10T10:27:33.332 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self._connections.run(self.expiration_interval) 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self._run(expiration_interval) 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: s = self.context.wrap_socket( 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: return self.sslsocket_class._create( 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self.do_handshake() 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:27:33.333 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self._sslobj.do_handshake() 2024-09-10T10:27:33.334 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:27:33.334 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.772+0000 7fd285279640 1 Processor -- start 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.772+0000 7fd285279640 1 -- start start 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.772+0000 7fd285279640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd280107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.772+0000 7fd285279640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd280107ff0 con 0x7fd280107620 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.772+0000 7fd27effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd280107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.772+0000 7fd27effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd280107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45718/0 (socket says 172.21.15.92:45718) 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.772+0000 7fd27effd640 1 -- 172.21.15.92:0/243901716 learned_addr learned my addr 172.21.15.92:0/243901716 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.773+0000 7fd27effd640 1 -- 172.21.15.92:0/243901716 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd280108820 con 0x7fd280107620 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.773+0000 7fd27effd640 1 --2- 172.21.15.92:0/243901716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd280107a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd270009820 tx=0x7fd27002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8e80c39715f50a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd27dffb640 1 -- 172.21.15.92:0/243901716 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd270037070 con 0x7fd280107620 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd27dffb640 1 -- 172.21.15.92:0/243901716 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd270032900 con 0x7fd280107620 2024-09-10T10:27:33.615 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd27dffb640 1 -- 172.21.15.92:0/243901716 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd270030850 con 0x7fd280107620 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd285279640 1 -- 172.21.15.92:0/243901716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 msgr2=0x7fd280107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd285279640 1 --2- 172.21.15.92:0/243901716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd280107a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd270009820 tx=0x7fd27002a270 comp rx=0 tx=0).stop 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd285279640 1 -- 172.21.15.92:0/243901716 shutdown_connections 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd285279640 1 --2- 172.21.15.92:0/243901716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd280107a20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd285279640 1 -- 172.21.15.92:0/243901716 >> 172.21.15.92:0/243901716 conn(0x7fd280102d90 msgr2=0x7fd2801051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd285279640 1 -- 172.21.15.92:0/243901716 shutdown_connections 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.774+0000 7fd285279640 1 -- 172.21.15.92:0/243901716 wait complete. 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.775+0000 7fd285279640 1 Processor -- start 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.775+0000 7fd285279640 1 -- start start 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd285279640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd28019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd285279640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd28010bbd0 con 0x7fd280107620 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd27effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd28019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:33.616 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd27effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd28019b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45724/0 (socket says 172.21.15.92:45724) 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd27effd640 1 -- 172.21.15.92:0/2509269273 learned_addr learned my addr 172.21.15.92:0/2509269273 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd27effd640 1 -- 172.21.15.92:0/2509269273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28019bbb0 con 0x7fd280107620 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd27effd640 1 --2- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd28019b670 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd270009940 tx=0x7fd2700326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd267fff640 1 -- 172.21.15.92:0/2509269273 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd270042070 con 0x7fd280107620 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd267fff640 1 -- 172.21.15.92:0/2509269273 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd270032be0 con 0x7fd280107620 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd267fff640 1 -- 172.21.15.92:0/2509269273 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd270037040 con 0x7fd280107620 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28019be40 con 0x7fd280107620 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.776+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28019eb30 con 0x7fd280107620 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.777+0000 7fd267fff640 1 -- 172.21.15.92:0/2509269273 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fd270045070 con 0x7fd280107620 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.777+0000 7fd267fff640 1 --2- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd268038eb0 0x7fd26803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.777+0000 7fd267fff640 1 -- 172.21.15.92:0/2509269273 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd27006be60 con 0x7fd280107620 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.777+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28010bd50 con 0x7fd280107620 2024-09-10T10:27:33.617 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.777+0000 7fd27e7fc640 1 --2- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd268038eb0 0x7fd26803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.778+0000 7fd27e7fc640 1 --2- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd268038eb0 0x7fd26803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd2740098c0 tx=0x7fd274006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.782+0000 7fd267fff640 1 -- 172.21.15.92:0/2509269273 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd270032e00 con 0x7fd280107620 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.868+0000 7fd267fff640 1 -- 172.21.15.92:0/2509269273 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd27005a6e0 con 0x7fd280107620 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.972+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fd2801040e0 con 0x7fd268038eb0 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.977+0000 7fd267fff640 1 -- 172.21.15.92:0/2509269273 <== mgr.14118 v2:172.21.15.92:6800/1855060807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd2801040e0 con 0x7fd268038eb0 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.979+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd268038eb0 msgr2=0x7fd26803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.979+0000 7fd285279640 1 --2- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd268038eb0 0x7fd26803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd2740098c0 tx=0x7fd274006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.979+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 msgr2=0x7fd28019b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.979+0000 7fd285279640 1 --2- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd28019b670 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd270009940 tx=0x7fd2700326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.979+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 shutdown_connections 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.979+0000 7fd285279640 1 --2- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fd268038eb0 0x7fd26803b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.979+0000 7fd285279640 1 --2- 172.21.15.92:0/2509269273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd280107620 0x7fd28019b670 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.979+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 >> 172.21.15.92:0/2509269273 conn(0x7fd280102d90 msgr2=0x7fd2801039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:33.618 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.980+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 shutdown_connections 2024-09-10T10:27:33.619 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:32.980+0000 7fd285279640 1 -- 172.21.15.92:0/2509269273 wait complete. 2024-09-10T10:27:34.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-mon[30834]: mgrmap e8: x(active, since 2s) 2024-09-10T10:27:34.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-mon[30834]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:27:34.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:34.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:32] ENGINE Bus STARTING 2024-09-10T10:27:34.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:27:34.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:33 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:27:34.780 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T10:27:34.780 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.037+0000 7f259d2cf640 1 Processor -- start 2024-09-10T10:27:34.780 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.037+0000 7f259d2cf640 1 -- start start 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.037+0000 7f259d2cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f259810a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.037+0000 7f259d2cf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f259807be80 con 0x7f2598108070 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.038+0000 7f2596ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f259810a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.038+0000 7f2596ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f259810a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45730/0 (socket says 172.21.15.92:45730) 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.038+0000 7f2596ffd640 1 -- 172.21.15.92:0/1037617126 learned_addr learned my addr 172.21.15.92:0/1037617126 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.038+0000 7f2596ffd640 1 -- 172.21.15.92:0/1037617126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259810a9a0 con 0x7f2598108070 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.039+0000 7f2596ffd640 1 --2- 172.21.15.92:0/1037617126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f259810a460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2590009820 tx=0x7f259002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ad96ad984abbba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.039+0000 7f2595ffb640 1 -- 172.21.15.92:0/1037617126 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2590037070 con 0x7f2598108070 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.039+0000 7f2595ffb640 1 -- 172.21.15.92:0/1037617126 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2590032900 con 0x7f2598108070 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.039+0000 7f2595ffb640 1 -- 172.21.15.92:0/1037617126 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2590030850 con 0x7f2598108070 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.040+0000 7f259d2cf640 1 -- 172.21.15.92:0/1037617126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 msgr2=0x7f259810a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:34.781 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.040+0000 7f259d2cf640 1 --2- 172.21.15.92:0/1037617126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f259810a460 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2590009820 tx=0x7f259002a270 comp rx=0 tx=0).stop 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.040+0000 7f259d2cf640 1 -- 172.21.15.92:0/1037617126 shutdown_connections 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.040+0000 7f259d2cf640 1 --2- 172.21.15.92:0/1037617126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f259810a460 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.040+0000 7f259d2cf640 1 -- 172.21.15.92:0/1037617126 >> 172.21.15.92:0/1037617126 conn(0x7f2598101d10 msgr2=0x7f2598104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.040+0000 7f259d2cf640 1 -- 172.21.15.92:0/1037617126 shutdown_connections 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.040+0000 7f259d2cf640 1 -- 172.21.15.92:0/1037617126 wait complete. 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.040+0000 7f259d2cf640 1 Processor -- start 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.040+0000 7f259d2cf640 1 -- start start 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f259d2cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f25981078f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f259d2cf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f259810ba40 con 0x7f2598108070 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f2596ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f25981078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f2596ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f25981078f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45742/0 (socket says 172.21.15.92:45742) 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f2596ffd640 1 -- 172.21.15.92:0/1014115988 learned_addr learned my addr 172.21.15.92:0/1014115988 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f2596ffd640 1 -- 172.21.15.92:0/1014115988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2598107e30 con 0x7f2598108070 2024-09-10T10:27:34.782 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f2596ffd640 1 --2- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f25981078f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2590032ce0 tx=0x7f2590032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f257ffff640 1 -- 172.21.15.92:0/1014115988 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2590042070 con 0x7f2598108070 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f257ffff640 1 -- 172.21.15.92:0/1014115988 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25900308c0 con 0x7f2598108070 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2598106020 con 0x7f2598108070 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f257ffff640 1 -- 172.21.15.92:0/1014115988 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2590037040 con 0x7f2598108070 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.041+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2598106560 con 0x7f2598108070 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.042+0000 7f257ffff640 1 -- 172.21.15.92:0/1014115988 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2590045070 con 0x7f2598108070 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.042+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25981084d0 con 0x7f2598108070 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.042+0000 7f257ffff640 1 --2- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f2580038f70 0x7f258003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.042+0000 7f257ffff640 1 -- 172.21.15.92:0/1014115988 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f259006c280 con 0x7f2598108070 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.042+0000 7f25967fc640 1 --2- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f2580038f70 0x7f258003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.043+0000 7f25967fc640 1 --2- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f2580038f70 0x7f258003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f258c0098c0 tx=0x7f258c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.047+0000 7f257ffff640 1 -- 172.21.15.92:0/1014115988 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f259003cd00 con 0x7f2598108070 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.217+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f2598106e10 con 0x7f2580038f70 2024-09-10T10:27:34.783 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.218+0000 7f257ffff640 1 -- 172.21.15.92:0/1014115988 <== mgr.14118 v2:172.21.15.92:6800/1855060807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f2598106e10 con 0x7f2580038f70 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f2580038f70 msgr2=0x7f258003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 --2- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f2580038f70 0x7f258003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f258c0098c0 tx=0x7f258c006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 msgr2=0x7f25981078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 --2- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f25981078f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2590032ce0 tx=0x7f2590032d10 comp rx=0 tx=0).stop 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 shutdown_connections 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 --2- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f2580038f70 0x7f258003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 --2- 172.21.15.92:0/1014115988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2598108070 0x7f25981078f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 >> 172.21.15.92:0/1014115988 conn(0x7f2598101d10 msgr2=0x7f2598102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 shutdown_connections 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:34.220+0000 7f259d2cf640 1 -- 172.21.15.92:0/1014115988 wait complete. 2024-09-10T10:27:34.784 INFO:teuthology.orchestra.run.smithi092.stdout:Generating ssh key... 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:34 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:33] ENGINE Serving on http://172.21.15.92:8765 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:34 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:33] ENGINE Serving on https://172.21.15.92:7150 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:34 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:33] ENGINE Bus STARTED 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:34 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:33] ENGINE Error in HTTPServer.serve 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout: Traceback (most recent call last): 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._run(expiration_interval) 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:27:35.186 INFO:journalctl@ceph.mon.a.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: s = self.context.wrap_socket( 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: return self.sslsocket_class._create( 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: self.do_handshake() 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._sslobj.do_handshake() 2024-09-10T10:27:35.187 INFO:journalctl@ceph.mon.a.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: Generating public/private rsa key pair. 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: Your identification has been saved in /tmp/tmp8_48mizz/key 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: Your public key has been saved in /tmp/tmp8_48mizz/key.pub 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: The key fingerprint is: 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: SHA256:nFjnjrR2Mb8zg9+yj/cyhJLpYTfk7Zpw4L6rZVm1rfQ ceph-0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: The key's randomart image is: 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: +---[RSA 3072]----+ 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: | | 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: | | 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: | . . . | 2024-09-10T10:27:35.805 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: | + + .. o | 2024-09-10T10:27:35.806 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: | . S ==.oo .| 2024-09-10T10:27:35.806 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: | . =*B=.oo | 2024-09-10T10:27:35.806 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: | +oO=o+. E| 2024-09-10T10:27:35.806 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: | . =oo=== | 2024-09-10T10:27:35.806 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: | ..++BXo+.| 2024-09-10T10:27:35.806 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: +----[SHA256]-----+ 2024-09-10T10:27:36.072 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-mon[30834]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:27:36.072 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:36.072 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:35 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:36.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.184+0000 7f7a19ab1640 1 Processor -- start 2024-09-10T10:27:36.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.184+0000 7f7a19ab1640 1 -- start start 2024-09-10T10:27:36.079 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.184+0000 7f7a19ab1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1410a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.184+0000 7f7a19ab1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1407be30 con 0x7f7a14108080 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.184+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1410a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.184+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1410a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45756/0 (socket says 172.21.15.92:45756) 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.184+0000 7f7a137fe640 1 -- 172.21.15.92:0/2132557102 learned_addr learned my addr 172.21.15.92:0/2132557102 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.185+0000 7f7a137fe640 1 -- 172.21.15.92:0/2132557102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1410a9b0 con 0x7f7a14108080 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.185+0000 7f7a137fe640 1 --2- 172.21.15.92:0/2132557102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1410a470 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009820 tx=0x7f7a0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1514c618b9606581 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.185+0000 7f7a127fc640 1 -- 172.21.15.92:0/2132557102 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a04037070 con 0x7f7a14108080 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.186+0000 7f7a127fc640 1 -- 172.21.15.92:0/2132557102 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a04032900 con 0x7f7a14108080 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.186+0000 7f7a127fc640 1 -- 172.21.15.92:0/2132557102 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a04030850 con 0x7f7a14108080 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.186+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2132557102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 msgr2=0x7f7a1410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.186+0000 7f7a19ab1640 1 --2- 172.21.15.92:0/2132557102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1410a470 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009820 tx=0x7f7a0402a270 comp rx=0 tx=0).stop 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.186+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2132557102 shutdown_connections 2024-09-10T10:27:36.080 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.186+0000 7f7a19ab1640 1 --2- 172.21.15.92:0/2132557102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1410a470 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.186+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2132557102 >> 172.21.15.92:0/2132557102 conn(0x7f7a14101ca0 msgr2=0x7f7a141040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.186+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2132557102 shutdown_connections 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.186+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2132557102 wait complete. 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.187+0000 7f7a19ab1640 1 Processor -- start 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.187+0000 7f7a19ab1640 1 -- start start 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.187+0000 7f7a19ab1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1419b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.187+0000 7f7a19ab1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1410b9f0 con 0x7f7a14108080 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.187+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1419b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.187+0000 7f7a137fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1419b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45772/0 (socket says 172.21.15.92:45772) 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.187+0000 7f7a137fe640 1 -- 172.21.15.92:0/2701405290 learned_addr learned my addr 172.21.15.92:0/2701405290 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.187+0000 7f7a137fe640 1 -- 172.21.15.92:0/2701405290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1419bb70 con 0x7f7a14108080 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.188+0000 7f7a137fe640 1 --2- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1419b630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7a04031000 tx=0x7f7a040326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.188+0000 7f7a10ff9640 1 -- 172.21.15.92:0/2701405290 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a04042070 con 0x7f7a14108080 2024-09-10T10:27:36.081 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.188+0000 7f7a10ff9640 1 -- 172.21.15.92:0/2701405290 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a04032be0 con 0x7f7a14108080 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.188+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1419be00 con 0x7f7a14108080 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.188+0000 7f7a10ff9640 1 -- 172.21.15.92:0/2701405290 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a04037040 con 0x7f7a14108080 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.188+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1419eaf0 con 0x7f7a14108080 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.189+0000 7f7a10ff9640 1 -- 172.21.15.92:0/2701405290 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f7a04045070 con 0x7f7a14108080 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.189+0000 7f7a10ff9640 1 --2- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f79fc038fc0 0x7f79fc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.189+0000 7f7a10ff9640 1 -- 172.21.15.92:0/2701405290 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7a0403d8f0 con 0x7f7a14108080 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.189+0000 7f7a12ffd640 1 --2- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f79fc038fc0 0x7f79fc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.189+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a141084e0 con 0x7f7a14108080 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.189+0000 7f7a12ffd640 1 --2- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f79fc038fc0 0x7f79fc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7a080098c0 tx=0x7f7a08006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.194+0000 7f7a10ff9640 1 -- 172.21.15.92:0/2701405290 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7a04045360 con 0x7f7a14108080 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.361+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7a14102f80 con 0x7f79fc038fc0 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.498+0000 7f7a10ff9640 1 -- 172.21.15.92:0/2701405290 <== mgr.14118 v2:172.21.15.92:6800/1855060807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7a14102f80 con 0x7f79fc038fc0 2024-09-10T10:27:36.082 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.499+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f79fc038fc0 msgr2=0x7f79fc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:36.083 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.499+0000 7f7a19ab1640 1 --2- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f79fc038fc0 0x7f79fc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7a080098c0 tx=0x7f7a08006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:36.083 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.499+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 msgr2=0x7f7a1419b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:36.083 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.499+0000 7f7a19ab1640 1 --2- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1419b630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7a04031000 tx=0x7f7a040326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:36.083 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.500+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 shutdown_connections 2024-09-10T10:27:36.083 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.500+0000 7f7a19ab1640 1 --2- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f79fc038fc0 0x7f79fc03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:36.083 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.500+0000 7f7a19ab1640 1 --2- 172.21.15.92:0/2701405290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a14108080 0x7f7a1419b630 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:36.083 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.500+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 >> 172.21.15.92:0/2701405290 conn(0x7f7a14101ca0 msgr2=0x7f7a14102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:36.083 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.500+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 shutdown_connections 2024-09-10T10:27:36.083 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:35.500+0000 7f7a19ab1640 1 -- 172.21.15.92:0/2701405290 wait complete. 2024-09-10T10:27:37.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:36 smithi092 ceph-mon[30834]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:27:37.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:36 smithi092 ceph-mon[30834]: Generating ssh key... 2024-09-10T10:27:37.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA6GhyAhnrgEkR0CdQ4aH2IyqsYbH1EaLz6r10hBwALI/vdWOe/GsJIgK/m6FHWPKoqU2mePky5yMhCvQ8JMrBVBdbv/woNj4z7wB1h4j77lUUtjwOkzGtYGWS29zYF7TBoZL4nJNVDU3Z16zfnCHu59POj6LVMGYMN1L9n2AvQWPbXv0wocD/NOohd/IFP6l/CCwOOfpx9Vhztf0RIxbSXX8zj6kaGWQ1X/dPpDWGUaWWWwxn4lnzphOJg+8akgsXyqQb3YnxpG0x26B1hbCSiBysQ40twx3/VPa4jhHwnIKnqSZOWORH+kIcG3mXABr5yLg3VurUTGvNwgutYaDjHIUlZoj1cjmF4XuoXTKvSibbXpJf9F0W778p5gssXy7I1V1YlCmxCgYvj2+FhezlBdwXxO3dNwHXt/0R8dRRgMDr37uPwSFg07AawAtR082K9Wk/q2jRYStakFFKex/S5IhsxaVnMCklUTGRz+C7IDNaFtC6NMqkwQV8yArI6NM= ceph-0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:27:37.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.460+0000 7efc00346640 1 Processor -- start 2024-09-10T10:27:37.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.460+0000 7efc00346640 1 -- start start 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.460+0000 7efc00346640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf810a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.460+0000 7efc00346640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efbf807be30 con 0x7efbf8108080 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.460+0000 7efbfe0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf810a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.460+0000 7efbfe0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf810a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45788/0 (socket says 172.21.15.92:45788) 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.460+0000 7efbfe0e2640 1 -- 172.21.15.92:0/3750872444 learned_addr learned my addr 172.21.15.92:0/3750872444 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.460+0000 7efbfe0e2640 1 -- 172.21.15.92:0/3750872444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf810a9b0 con 0x7efbf8108080 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.461+0000 7efbfe0e2640 1 --2- 172.21.15.92:0/3750872444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf810a470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009820 tx=0x7efbf402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19091950e4cbb85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.461+0000 7efbfd0e0640 1 -- 172.21.15.92:0/3750872444 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4037070 con 0x7efbf8108080 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.461+0000 7efbfd0e0640 1 -- 172.21.15.92:0/3750872444 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efbf4032900 con 0x7efbf8108080 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.461+0000 7efbfd0e0640 1 -- 172.21.15.92:0/3750872444 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4030850 con 0x7efbf8108080 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.462+0000 7efc00346640 1 -- 172.21.15.92:0/3750872444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 msgr2=0x7efbf810a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.462+0000 7efc00346640 1 --2- 172.21.15.92:0/3750872444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf810a470 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009820 tx=0x7efbf402a270 comp rx=0 tx=0).stop 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.462+0000 7efc00346640 1 -- 172.21.15.92:0/3750872444 shutdown_connections 2024-09-10T10:27:37.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.462+0000 7efc00346640 1 --2- 172.21.15.92:0/3750872444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf810a470 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.462+0000 7efc00346640 1 -- 172.21.15.92:0/3750872444 >> 172.21.15.92:0/3750872444 conn(0x7efbf8101ca0 msgr2=0x7efbf81040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.462+0000 7efc00346640 1 -- 172.21.15.92:0/3750872444 shutdown_connections 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.462+0000 7efc00346640 1 -- 172.21.15.92:0/3750872444 wait complete. 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.463+0000 7efc00346640 1 Processor -- start 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.463+0000 7efc00346640 1 -- start start 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.463+0000 7efc00346640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.463+0000 7efc00346640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efbf810b9f0 con 0x7efbf8108080 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.463+0000 7efbfe0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.463+0000 7efbfe0e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf819b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45800/0 (socket says 172.21.15.92:45800) 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.463+0000 7efbfe0e2640 1 -- 172.21.15.92:0/3256120252 learned_addr learned my addr 172.21.15.92:0/3256120252 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.463+0000 7efbfe0e2640 1 -- 172.21.15.92:0/3256120252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf819bb70 con 0x7efbf8108080 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.463+0000 7efbfe0e2640 1 --2- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf819b630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efbf4031000 tx=0x7efbf40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:37.247 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.464+0000 7efbef7fe640 1 -- 172.21.15.92:0/3256120252 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4042070 con 0x7efbf8108080 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.464+0000 7efbef7fe640 1 -- 172.21.15.92:0/3256120252 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efbf4032be0 con 0x7efbf8108080 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.464+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf819be00 con 0x7efbf8108080 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.464+0000 7efbef7fe640 1 -- 172.21.15.92:0/3256120252 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efbf4037040 con 0x7efbf8108080 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.464+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf819eaf0 con 0x7efbf8108080 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.464+0000 7efbef7fe640 1 -- 172.21.15.92:0/3256120252 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7efbf4045070 con 0x7efbf8108080 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.465+0000 7efbef7fe640 1 --2- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7efbe4038fc0 0x7efbe403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.465+0000 7efbef7fe640 1 -- 172.21.15.92:0/3256120252 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efbf406bf90 con 0x7efbf8108080 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.465+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbf81084e0 con 0x7efbf8108080 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.465+0000 7efbfd8e1640 1 --2- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7efbe4038fc0 0x7efbe403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.465+0000 7efbfd8e1640 1 --2- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7efbe4038fc0 0x7efbe403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efbe80098c0 tx=0x7efbe8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.469+0000 7efbef7fe640 1 -- 172.21.15.92:0/3256120252 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efbf4042210 con 0x7efbf8108080 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.637+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7efbf8102f80 con 0x7efbe4038fc0 2024-09-10T10:27:37.248 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.637+0000 7efbef7fe640 1 -- 172.21.15.92:0/3256120252 <== mgr.14118 v2:172.21.15.92:6800/1855060807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7efbf8102f80 con 0x7efbe4038fc0 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7efbe4038fc0 msgr2=0x7efbe403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 --2- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7efbe4038fc0 0x7efbe403b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efbe80098c0 tx=0x7efbe8006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 msgr2=0x7efbf819b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 --2- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf819b630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efbf4031000 tx=0x7efbf40326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 shutdown_connections 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 --2- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7efbe4038fc0 0x7efbe403b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 --2- 172.21.15.92:0/3256120252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efbf8108080 0x7efbf819b630 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 >> 172.21.15.92:0/3256120252 conn(0x7efbf8101ca0 msgr2=0x7efbf8102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 shutdown_connections 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:36.640+0000 7efc00346640 1 -- 172.21.15.92:0/3256120252 wait complete. 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:27:37.249 INFO:teuthology.orchestra.run.smithi092.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T10:27:37.252 INFO:teuthology.orchestra.run.smithi092.stdout:Adding host smithi092... 2024-09-10T10:27:38.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:37 smithi092 ceph-mon[30834]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:27:38.889 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:38 smithi092 ceph-mon[30834]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "addr": "172.21.15.92", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:27:40.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:39 smithi092 ceph-mon[30834]: Deploying cephadm binary to smithi092 2024-09-10T10:27:41.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Added host 'smithi092' with addr '172.21.15.92' 2024-09-10T10:27:41.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.664+0000 7f3d8e02d640 1 Processor -- start 2024-09-10T10:27:41.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.664+0000 7f3d8e02d640 1 -- start start 2024-09-10T10:27:41.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.664+0000 7f3d8e02d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d88107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:41.594 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.664+0000 7f3d8e02d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d88107ff0 con 0x7f3d88107620 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.665+0000 7f3d877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d88107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.665+0000 7f3d877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d88107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45816/0 (socket says 172.21.15.92:45816) 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.665+0000 7f3d877fe640 1 -- 172.21.15.92:0/1392465424 learned_addr learned my addr 172.21.15.92:0/1392465424 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.665+0000 7f3d877fe640 1 -- 172.21.15.92:0/1392465424 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d88108820 con 0x7f3d88107620 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d877fe640 1 --2- 172.21.15.92:0/1392465424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d88107a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009820 tx=0x7f3d7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827acde80edf8e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d867fc640 1 -- 172.21.15.92:0/1392465424 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d78037070 con 0x7f3d88107620 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d867fc640 1 -- 172.21.15.92:0/1392465424 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d78032900 con 0x7f3d88107620 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d867fc640 1 -- 172.21.15.92:0/1392465424 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d78030850 con 0x7f3d88107620 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d8e02d640 1 -- 172.21.15.92:0/1392465424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 msgr2=0x7f3d88107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d8e02d640 1 --2- 172.21.15.92:0/1392465424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d88107a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009820 tx=0x7f3d7802a270 comp rx=0 tx=0).stop 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d8e02d640 1 -- 172.21.15.92:0/1392465424 shutdown_connections 2024-09-10T10:27:41.595 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d8e02d640 1 --2- 172.21.15.92:0/1392465424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d88107a20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d8e02d640 1 -- 172.21.15.92:0/1392465424 >> 172.21.15.92:0/1392465424 conn(0x7f3d88102db0 msgr2=0x7f3d881051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d8e02d640 1 -- 172.21.15.92:0/1392465424 shutdown_connections 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.666+0000 7f3d8e02d640 1 -- 172.21.15.92:0/1392465424 wait complete. 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.667+0000 7f3d8e02d640 1 Processor -- start 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.667+0000 7f3d8e02d640 1 -- start start 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.667+0000 7f3d8e02d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d8807db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.667+0000 7f3d8e02d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8810bbd0 con 0x7f3d88107620 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d8807db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d877fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d8807db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45826/0 (socket says 172.21.15.92:45826) 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d877fe640 1 -- 172.21.15.92:0/2599466238 learned_addr learned my addr 172.21.15.92:0/2599466238 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d877fe640 1 -- 172.21.15.92:0/2599466238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8807e080 con 0x7f3d88107620 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d877fe640 1 --2- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d8807db40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009940 tx=0x7f3d780326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:41.596 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d84ff9640 1 -- 172.21.15.92:0/2599466238 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d78042070 con 0x7f3d88107620 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d84ff9640 1 -- 172.21.15.92:0/2599466238 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d78032be0 con 0x7f3d88107620 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d84ff9640 1 -- 172.21.15.92:0/2599466238 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d78037040 con 0x7f3d88107620 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8807c270 con 0x7f3d88107620 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.668+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8807c7b0 con 0x7f3d88107620 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.669+0000 7f3d84ff9640 1 -- 172.21.15.92:0/2599466238 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f3d78045070 con 0x7f3d88107620 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.669+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8810bd50 con 0x7f3d88107620 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.670+0000 7f3d84ff9640 1 --2- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f3d70038fc0 0x7f3d7003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.670+0000 7f3d84ff9640 1 -- 172.21.15.92:0/2599466238 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3d7806bec0 con 0x7f3d88107620 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.670+0000 7f3d86ffd640 1 --2- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f3d70038fc0 0x7f3d7003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.670+0000 7f3d86ffd640 1 --2- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f3d70038fc0 0x7f3d7003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0098c0 tx=0x7f3d7c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.674+0000 7f3d84ff9640 1 -- 172.21.15.92:0/2599466238 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d7804b170 con 0x7f3d88107620 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:37.841+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi092", "addr": "172.21.15.92", "target": ["mon-mgr", ""]}) -- 0x7f3d8807d040 con 0x7f3d70038fc0 2024-09-10T10:27:41.597 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.042+0000 7f3d84ff9640 1 -- 172.21.15.92:0/2599466238 <== mgr.14118 v2:172.21.15.92:6800/1855060807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f3d8807d040 con 0x7f3d70038fc0 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f3d70038fc0 msgr2=0x7f3d7003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 --2- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f3d70038fc0 0x7f3d7003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0098c0 tx=0x7f3d7c006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 msgr2=0x7f3d8807db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 --2- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d8807db40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009940 tx=0x7f3d780326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 shutdown_connections 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 --2- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f3d70038fc0 0x7f3d7003b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 --2- 172.21.15.92:0/2599466238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d88107620 0x7f3d8807db40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 >> 172.21.15.92:0/2599466238 conn(0x7f3d88102db0 msgr2=0x7f3d88103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 shutdown_connections 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:41.046+0000 7f3d8e02d640 1 -- 172.21.15.92:0/2599466238 wait complete. 2024-09-10T10:27:41.598 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mon service... 2024-09-10T10:27:42.262 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:42 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:42.262 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:42 smithi092 ceph-mon[30834]: Added host smithi092 2024-09-10T10:27:42.262 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:42 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:27:43.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T10:27:43.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.062+0000 7fa1d2f81640 1 Processor -- start 2024-09-10T10:27:43.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.062+0000 7fa1d2f81640 1 -- start start 2024-09-10T10:27:43.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.062+0000 7fa1d2f81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc10a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:43.395 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.062+0000 7fa1d2f81640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc07bdc0 con 0x7fa1cc108150 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.062+0000 7fa1d0d1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc10a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.062+0000 7fa1d0d1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc10a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45842/0 (socket says 172.21.15.92:45842) 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.062+0000 7fa1d0d1d640 1 -- 172.21.15.92:0/1145354902 learned_addr learned my addr 172.21.15.92:0/1145354902 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.063+0000 7fa1d0d1d640 1 -- 172.21.15.92:0/1145354902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc10aa80 con 0x7fa1cc108150 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.063+0000 7fa1d0d1d640 1 --2- 172.21.15.92:0/1145354902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc10a540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009820 tx=0x7fa1c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631c394697794fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.063+0000 7fa1cb7fe640 1 -- 172.21.15.92:0/1145354902 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0037070 con 0x7fa1cc108150 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.063+0000 7fa1cb7fe640 1 -- 172.21.15.92:0/1145354902 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1c0032900 con 0x7fa1cc108150 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.063+0000 7fa1cb7fe640 1 -- 172.21.15.92:0/1145354902 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0030850 con 0x7fa1cc108150 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.064+0000 7fa1d2f81640 1 -- 172.21.15.92:0/1145354902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 msgr2=0x7fa1cc10a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.064+0000 7fa1d2f81640 1 --2- 172.21.15.92:0/1145354902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc10a540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009820 tx=0x7fa1c002a270 comp rx=0 tx=0).stop 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.064+0000 7fa1d2f81640 1 -- 172.21.15.92:0/1145354902 shutdown_connections 2024-09-10T10:27:43.396 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.064+0000 7fa1d2f81640 1 --2- 172.21.15.92:0/1145354902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc10a540 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.064+0000 7fa1d2f81640 1 -- 172.21.15.92:0/1145354902 >> 172.21.15.92:0/1145354902 conn(0x7fa1cc101cb0 msgr2=0x7fa1cc1040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.064+0000 7fa1d2f81640 1 -- 172.21.15.92:0/1145354902 shutdown_connections 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.064+0000 7fa1d2f81640 1 -- 172.21.15.92:0/1145354902 wait complete. 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.064+0000 7fa1d2f81640 1 Processor -- start 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1d2f81640 1 -- start start 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1d2f81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc1079d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1d2f81640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc10ba60 con 0x7fa1cc108150 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1d0d1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc1079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1d0d1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc1079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45854/0 (socket says 172.21.15.92:45854) 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1d0d1d640 1 -- 172.21.15.92:0/423736073 learned_addr learned my addr 172.21.15.92:0/423736073 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1d0d1d640 1 -- 172.21.15.92:0/423736073 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc107f10 con 0x7fa1cc108150 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1d0d1d640 1 --2- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc1079d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0031000 tx=0x7fa1c00326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:43.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1c9ffb640 1 -- 172.21.15.92:0/423736073 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0042070 con 0x7fa1cc108150 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1c9ffb640 1 -- 172.21.15.92:0/423736073 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1c0032be0 con 0x7fa1cc108150 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1cc106100 con 0x7fa1cc108150 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.065+0000 7fa1c9ffb640 1 -- 172.21.15.92:0/423736073 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0037040 con 0x7fa1cc108150 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.066+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1cc106640 con 0x7fa1cc108150 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.066+0000 7fa1c9ffb640 1 -- 172.21.15.92:0/423736073 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa1c0045070 con 0x7fa1cc108150 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.066+0000 7fa1c9ffb640 1 --2- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fa1bc038fc0 0x7fa1bc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.067+0000 7fa1c9ffb640 1 -- 172.21.15.92:0/423736073 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa1c006bf60 con 0x7fa1cc108150 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.067+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1cc1085b0 con 0x7fa1cc108150 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.067+0000 7fa1cbfff640 1 --2- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fa1bc038fc0 0x7fa1bc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.067+0000 7fa1cbfff640 1 --2- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fa1bc038fc0 0x7fa1bc03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80098c0 tx=0x7fa1b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.071+0000 7fa1c9ffb640 1 -- 172.21.15.92:0/423736073 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1c002f2a0 con 0x7fa1cc108150 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.260+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fa1cc106d40 con 0x7fa1bc038fc0 2024-09-10T10:27:43.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.268+0000 7fa1c9ffb640 1 -- 172.21.15.92:0/423736073 <== mgr.14118 v2:172.21.15.92:6800/1855060807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa1cc106d40 con 0x7fa1bc038fc0 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.270+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fa1bc038fc0 msgr2=0x7fa1bc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.270+0000 7fa1d2f81640 1 --2- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fa1bc038fc0 0x7fa1bc03b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80098c0 tx=0x7fa1b8006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.270+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 msgr2=0x7fa1cc1079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.270+0000 7fa1d2f81640 1 --2- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc1079d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0031000 tx=0x7fa1c00326e0 comp rx=0 tx=0).stop 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.270+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 shutdown_connections 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.270+0000 7fa1d2f81640 1 --2- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fa1bc038fc0 0x7fa1bc03b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.270+0000 7fa1d2f81640 1 --2- 172.21.15.92:0/423736073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1cc108150 0x7fa1cc1079d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.270+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 >> 172.21.15.92:0/423736073 conn(0x7fa1cc101cb0 msgr2=0x7fa1cc1028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.271+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 shutdown_connections 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:42.271+0000 7fa1d2f81640 1 -- 172.21.15.92:0/423736073 wait complete. 2024-09-10T10:27:43.399 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mgr service... 2024-09-10T10:27:43.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:43 smithi092 ceph-mon[30834]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:27:43.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:43 smithi092 ceph-mon[30834]: Saving service mon spec with placement count:5 2024-09-10T10:27:43.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:43 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:44.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:44 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:44.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:44 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:44.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:44 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:44.944 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T10:27:44.944 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.152+0000 7fc13b7e5640 1 Processor -- start 2024-09-10T10:27:44.944 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.153+0000 7fc13b7e5640 1 -- start start 2024-09-10T10:27:44.944 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.153+0000 7fc13b7e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13410a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:44.944 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.153+0000 7fc13b7e5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc13407bda0 con 0x7fc134108170 2024-09-10T10:27:44.944 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.153+0000 7fc139581640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13410a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:44.945 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.153+0000 7fc139581640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13410a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41120/0 (socket says 172.21.15.92:41120) 2024-09-10T10:27:44.945 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.153+0000 7fc139581640 1 -- 172.21.15.92:0/1917018090 learned_addr learned my addr 172.21.15.92:0/1917018090 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:44.945 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.153+0000 7fc139581640 1 -- 172.21.15.92:0/1917018090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13410aaa0 con 0x7fc134108170 2024-09-10T10:27:44.945 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.154+0000 7fc139581640 1 --2- 172.21.15.92:0/1917018090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13410a560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc128009820 tx=0x7fc12802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d331caf58ab38d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:44.945 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.154+0000 7fc127fff640 1 -- 172.21.15.92:0/1917018090 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc128037070 con 0x7fc134108170 2024-09-10T10:27:44.945 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.154+0000 7fc127fff640 1 -- 172.21.15.92:0/1917018090 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc128032920 con 0x7fc134108170 2024-09-10T10:27:44.945 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.154+0000 7fc127fff640 1 -- 172.21.15.92:0/1917018090 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc128030810 con 0x7fc134108170 2024-09-10T10:27:44.945 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.155+0000 7fc13b7e5640 1 -- 172.21.15.92:0/1917018090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 msgr2=0x7fc13410a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:44.945 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.155+0000 7fc13b7e5640 1 --2- 172.21.15.92:0/1917018090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13410a560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc128009820 tx=0x7fc12802a270 comp rx=0 tx=0).stop 2024-09-10T10:27:44.946 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.155+0000 7fc13b7e5640 1 -- 172.21.15.92:0/1917018090 shutdown_connections 2024-09-10T10:27:44.946 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.155+0000 7fc13b7e5640 1 --2- 172.21.15.92:0/1917018090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13410a560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:44.946 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.155+0000 7fc13b7e5640 1 -- 172.21.15.92:0/1917018090 >> 172.21.15.92:0/1917018090 conn(0x7fc134101cb0 msgr2=0x7fc1341040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:44.946 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.155+0000 7fc13b7e5640 1 -- 172.21.15.92:0/1917018090 shutdown_connections 2024-09-10T10:27:44.946 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.155+0000 7fc13b7e5640 1 -- 172.21.15.92:0/1917018090 wait complete. 2024-09-10T10:27:44.946 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.156+0000 7fc13b7e5640 1 Processor -- start 2024-09-10T10:27:44.946 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.156+0000 7fc13b7e5640 1 -- start start 2024-09-10T10:27:44.946 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.156+0000 7fc13b7e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:44.946 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.156+0000 7fc13b7e5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc13410ba60 con 0x7fc134108170 2024-09-10T10:27:44.947 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.156+0000 7fc139581640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:44.947 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.156+0000 7fc139581640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41130/0 (socket says 172.21.15.92:41130) 2024-09-10T10:27:44.947 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.156+0000 7fc139581640 1 -- 172.21.15.92:0/3893213287 learned_addr learned my addr 172.21.15.92:0/3893213287 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:44.947 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.156+0000 7fc139581640 1 -- 172.21.15.92:0/3893213287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13419bb90 con 0x7fc134108170 2024-09-10T10:27:44.947 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.156+0000 7fc139581640 1 --2- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13419b650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc1280097f0 tx=0x7fc1280327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:44.947 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.157+0000 7fc1267fc640 1 -- 172.21.15.92:0/3893213287 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc128037040 con 0x7fc134108170 2024-09-10T10:27:44.947 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.157+0000 7fc1267fc640 1 -- 172.21.15.92:0/3893213287 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc128030c40 con 0x7fc134108170 2024-09-10T10:27:44.947 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.157+0000 7fc1267fc640 1 -- 172.21.15.92:0/3893213287 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12803a5d0 con 0x7fc134108170 2024-09-10T10:27:44.947 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.157+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13419be20 con 0x7fc134108170 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.157+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13419eb10 con 0x7fc134108170 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.157+0000 7fc1267fc640 1 -- 172.21.15.92:0/3893213287 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc12803a810 con 0x7fc134108170 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.158+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1341085d0 con 0x7fc134108170 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.158+0000 7fc1267fc640 1 --2- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fc120038f70 0x7fc12003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.158+0000 7fc1267fc640 1 -- 172.21.15.92:0/3893213287 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc12806c5d0 con 0x7fc134108170 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.158+0000 7fc138d80640 1 --2- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fc120038f70 0x7fc12003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.158+0000 7fc138d80640 1 --2- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fc120038f70 0x7fc12003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098c0 tx=0x7fc130006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.162+0000 7fc1267fc640 1 -- 172.21.15.92:0/3893213287 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc12802cb90 con 0x7fc134108170 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.349+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc134102fc0 con 0x7fc120038f70 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.356+0000 7fc1267fc640 1 -- 172.21.15.92:0/3893213287 <== mgr.14118 v2:172.21.15.92:6800/1855060807 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc134102fc0 con 0x7fc120038f70 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fc120038f70 msgr2=0x7fc12003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:44.948 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 --2- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fc120038f70 0x7fc12003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098c0 tx=0x7fc130006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:44.949 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 msgr2=0x7fc13419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:44.949 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 --2- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13419b650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc1280097f0 tx=0x7fc1280327b0 comp rx=0 tx=0).stop 2024-09-10T10:27:44.949 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 shutdown_connections 2024-09-10T10:27:44.949 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 --2- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fc120038f70 0x7fc12003b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:44.949 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 --2- 172.21.15.92:0/3893213287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc134108170 0x7fc13419b650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:44.949 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 >> 172.21.15.92:0/3893213287 conn(0x7fc134101cb0 msgr2=0x7fc1341028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:44.949 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 shutdown_connections 2024-09-10T10:27:44.949 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:44.359+0000 7fc13b7e5640 1 -- 172.21.15.92:0/3893213287 wait complete. 2024-09-10T10:27:45.832 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:45 smithi092 ceph-mon[30834]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:27:45.832 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:45 smithi092 ceph-mon[30834]: Saving service mgr spec with placement count:2 2024-09-10T10:27:45.832 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:45 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3096329335' entity='client.admin' 2024-09-10T10:27:46.737 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.329+0000 7f1d58197640 1 Processor -- start 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.329+0000 7f1d58197640 1 -- start start 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.329+0000 7f1d58197640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d50107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.329+0000 7f1d58197640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d50107ff0 con 0x7f1d50107620 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.329+0000 7f1d55f33640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d50107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.329+0000 7f1d55f33640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d50107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41136/0 (socket says 172.21.15.92:41136) 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.329+0000 7f1d55f33640 1 -- 172.21.15.92:0/3648335950 learned_addr learned my addr 172.21.15.92:0/3648335950 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.329+0000 7f1d55f33640 1 -- 172.21.15.92:0/3648335950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d50108820 con 0x7f1d50107620 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.330+0000 7f1d55f33640 1 --2- 172.21.15.92:0/3648335950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d50107a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009820 tx=0x7f1d4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d78640b00223f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.330+0000 7f1d54f31640 1 -- 172.21.15.92:0/3648335950 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4c037070 con 0x7f1d50107620 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.330+0000 7f1d54f31640 1 -- 172.21.15.92:0/3648335950 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d4c032920 con 0x7f1d50107620 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.330+0000 7f1d54f31640 1 -- 172.21.15.92:0/3648335950 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4c030810 con 0x7f1d50107620 2024-09-10T10:27:46.738 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.331+0000 7f1d58197640 1 -- 172.21.15.92:0/3648335950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 msgr2=0x7f1d50107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.331+0000 7f1d58197640 1 --2- 172.21.15.92:0/3648335950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d50107a20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009820 tx=0x7f1d4c02a270 comp rx=0 tx=0).stop 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.331+0000 7f1d58197640 1 -- 172.21.15.92:0/3648335950 shutdown_connections 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.331+0000 7f1d58197640 1 --2- 172.21.15.92:0/3648335950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d50107a20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.331+0000 7f1d58197640 1 -- 172.21.15.92:0/3648335950 >> 172.21.15.92:0/3648335950 conn(0x7f1d50102db0 msgr2=0x7f1d501051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.331+0000 7f1d58197640 1 -- 172.21.15.92:0/3648335950 shutdown_connections 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.331+0000 7f1d58197640 1 -- 172.21.15.92:0/3648335950 wait complete. 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.332+0000 7f1d58197640 1 Processor -- start 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.332+0000 7f1d58197640 1 -- start start 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.332+0000 7f1d58197640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d5019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.332+0000 7f1d58197640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5010bbd0 con 0x7f1d50107620 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.332+0000 7f1d55f33640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d5019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.332+0000 7f1d55f33640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d5019b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41152/0 (socket says 172.21.15.92:41152) 2024-09-10T10:27:46.739 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.332+0000 7f1d55f33640 1 -- 172.21.15.92:0/3096329335 learned_addr learned my addr 172.21.15.92:0/3096329335 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.332+0000 7f1d55f33640 1 -- 172.21.15.92:0/3096329335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5019bbd0 con 0x7f1d50107620 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.332+0000 7f1d55f33640 1 --2- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d5019b690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0097f0 tx=0x7f1d4c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.333+0000 7f1d42ffd640 1 -- 172.21.15.92:0/3096329335 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4c037040 con 0x7f1d50107620 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.333+0000 7f1d42ffd640 1 -- 172.21.15.92:0/3096329335 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d4c030c40 con 0x7f1d50107620 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.333+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5019be60 con 0x7f1d50107620 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.333+0000 7f1d42ffd640 1 -- 172.21.15.92:0/3096329335 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4c03a5b0 con 0x7f1d50107620 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.333+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5019eb50 con 0x7f1d50107620 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.333+0000 7f1d42ffd640 1 -- 172.21.15.92:0/3096329335 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1d4c03a810 con 0x7f1d50107620 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.334+0000 7f1d42ffd640 1 --2- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f1d3c038f70 0x7f1d3c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.334+0000 7f1d42ffd640 1 -- 172.21.15.92:0/3096329335 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1d4c06c3c0 con 0x7f1d50107620 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.334+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5010bd50 con 0x7f1d50107620 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.334+0000 7f1d55732640 1 --2- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f1d3c038f70 0x7f1d3c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.334+0000 7f1d55732640 1 --2- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f1d3c038f70 0x7f1d3c03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1d440098c0 tx=0x7f1d44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:46.740 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.339+0000 7f1d42ffd640 1 -- 172.21.15.92:0/3096329335 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d4c0371e0 con 0x7f1d50107620 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.514+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f1d5019ed20 con 0x7f1d50107620 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.517+0000 7f1d42ffd640 1 -- 172.21.15.92:0/3096329335 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f1d4c030df0 con 0x7f1d50107620 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.519+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f1d3c038f70 msgr2=0x7f1d3c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.519+0000 7f1d58197640 1 --2- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f1d3c038f70 0x7f1d3c03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1d440098c0 tx=0x7f1d44006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.519+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 msgr2=0x7f1d5019b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.519+0000 7f1d58197640 1 --2- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d5019b690 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0097f0 tx=0x7f1d4c0327b0 comp rx=0 tx=0).stop 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.519+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 shutdown_connections 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.519+0000 7f1d58197640 1 --2- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f1d3c038f70 0x7f1d3c03b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.519+0000 7f1d58197640 1 --2- 172.21.15.92:0/3096329335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d50107620 0x7f1d5019b690 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.519+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 >> 172.21.15.92:0/3096329335 conn(0x7f1d50102db0 msgr2=0x7f1d50103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.519+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 shutdown_connections 2024-09-10T10:27:46.741 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:45.520+0000 7f1d58197640 1 -- 172.21.15.92:0/3096329335 wait complete. 2024-09-10T10:27:47.336 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:47 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:47.977 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.134+0000 7f840e72f640 1 Processor -- start 2024-09-10T10:27:47.977 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.134+0000 7f840e72f640 1 -- start start 2024-09-10T10:27:47.977 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.135+0000 7f840e72f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f8408106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:47.977 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.135+0000 7f840e72f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8408106ee0 con 0x7f8408106510 2024-09-10T10:27:47.977 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.135+0000 7f8407fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f8408106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:47.977 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.135+0000 7f8407fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f8408106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41166/0 (socket says 172.21.15.92:41166) 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.135+0000 7f8407fff640 1 -- 172.21.15.92:0/3415749798 learned_addr learned my addr 172.21.15.92:0/3415749798 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.135+0000 7f8407fff640 1 -- 172.21.15.92:0/3415749798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84081076c0 con 0x7f8408106510 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.136+0000 7f8407fff640 1 --2- 172.21.15.92:0/3415749798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f8408106910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009820 tx=0x7f83f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc1454c4054f042 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.136+0000 7f84077fe640 1 -- 172.21.15.92:0/3415749798 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f8037070 con 0x7f8408106510 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.136+0000 7f84077fe640 1 -- 172.21.15.92:0/3415749798 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83f8032920 con 0x7f8408106510 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.136+0000 7f84077fe640 1 -- 172.21.15.92:0/3415749798 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f8030810 con 0x7f8408106510 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 -- 172.21.15.92:0/3415749798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 msgr2=0x7f8408106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 --2- 172.21.15.92:0/3415749798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f8408106910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009820 tx=0x7f83f802a270 comp rx=0 tx=0).stop 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 -- 172.21.15.92:0/3415749798 shutdown_connections 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 --2- 172.21.15.92:0/3415749798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f8408106910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 -- 172.21.15.92:0/3415749798 >> 172.21.15.92:0/3415749798 conn(0x7f8408101ca0 msgr2=0x7f84081040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 -- 172.21.15.92:0/3415749798 shutdown_connections 2024-09-10T10:27:47.978 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 -- 172.21.15.92:0/3415749798 wait complete. 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 Processor -- start 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 -- start start 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f840819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f840e72f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f840810aa70 con 0x7f8408106510 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f8407fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f840819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f8407fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f840819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41170/0 (socket says 172.21.15.92:41170) 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.137+0000 7f8407fff640 1 -- 172.21.15.92:0/1245812180 learned_addr learned my addr 172.21.15.92:0/1245812180 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.138+0000 7f8407fff640 1 -- 172.21.15.92:0/1245812180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840819bb90 con 0x7f8408106510 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.138+0000 7f8407fff640 1 --2- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f840819b650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83f80097f0 tx=0x7f83f80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.138+0000 7f8405ffb640 1 -- 172.21.15.92:0/1245812180 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f8037040 con 0x7f8408106510 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.138+0000 7f8405ffb640 1 -- 172.21.15.92:0/1245812180 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83f8030c40 con 0x7f8408106510 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.138+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f840819be20 con 0x7f8408106510 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.138+0000 7f8405ffb640 1 -- 172.21.15.92:0/1245812180 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f803a5b0 con 0x7f8408106510 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.138+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f840819eb10 con 0x7f8408106510 2024-09-10T10:27:47.979 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.139+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f840810abf0 con 0x7f8408106510 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.139+0000 7f8405ffb640 1 -- 172.21.15.92:0/1245812180 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f83f803a7a0 con 0x7f8408106510 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.139+0000 7f8405ffb640 1 --2- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f83f4038fc0 0x7f83f403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.139+0000 7f8405ffb640 1 -- 172.21.15.92:0/1245812180 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f83f806c390 con 0x7f8408106510 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.139+0000 7f83fffff640 1 --2- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f83f4038fc0 0x7f83f403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.140+0000 7f83fffff640 1 --2- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f83f4038fc0 0x7f83f403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f83f00098c0 tx=0x7f83f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.144+0000 7f8405ffb640 1 -- 172.21.15.92:0/1245812180 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83f80371e0 con 0x7f8408106510 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.335+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f840802da20 con 0x7f8408106510 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.339+0000 7f8405ffb640 1 -- 172.21.15.92:0/1245812180 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f83f803b3f0 con 0x7f8408106510 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.341+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f83f4038fc0 msgr2=0x7f83f403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.341+0000 7f840e72f640 1 --2- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f83f4038fc0 0x7f83f403b480 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f83f00098c0 tx=0x7f83f0006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.341+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 msgr2=0x7f840819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:47.980 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.341+0000 7f840e72f640 1 --2- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f840819b650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83f80097f0 tx=0x7f83f80327b0 comp rx=0 tx=0).stop 2024-09-10T10:27:47.981 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.341+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 shutdown_connections 2024-09-10T10:27:47.981 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.341+0000 7f840e72f640 1 --2- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f83f4038fc0 0x7f83f403b480 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:47.981 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.341+0000 7f840e72f640 1 --2- 172.21.15.92:0/1245812180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8408106510 0x7f840819b650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:47.981 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.341+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 >> 172.21.15.92:0/1245812180 conn(0x7f8408101ca0 msgr2=0x7f8408102c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:47.981 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.342+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 shutdown_connections 2024-09-10T10:27:47.981 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:47.342+0000 7f840e72f640 1 -- 172.21.15.92:0/1245812180 wait complete. 2024-09-10T10:27:47.981 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling the dashboard module... 2024-09-10T10:27:48.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:48 smithi092 ceph-mon[30834]: from='mgr.14118 172.21.15.92:0/1637523901' entity='mgr.x' 2024-09-10T10:27:48.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:48 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1245812180' entity='client.admin' 2024-09-10T10:27:49.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:49 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2786576202' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T10:27:49.546 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: ignoring --setuser ceph since I am not root 2024-09-10T10:27:49.546 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: ignoring --setgroup ceph since I am not root 2024-09-10T10:27:49.546 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:49.344+0000 7fd2a713f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:27:49.546 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:49.401+0000 7fd2a713f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:27:49.860 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:49.551+0000 7fd2a713f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:27:49.860 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:49.619+0000 7fd2a713f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:27:49.860 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:49.765+0000 7fd2a713f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:27:50.174 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:49.908+0000 7fd2a713f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:27:50.181 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.368+0000 7fb2b2a19640 1 Processor -- start 2024-09-10T10:27:50.181 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.369+0000 7fb2b2a19640 1 -- start start 2024-09-10T10:27:50.181 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.369+0000 7fb2b2a19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac10a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:50.181 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.369+0000 7fb2b2a19640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac07be80 con 0x7fb2ac108040 2024-09-10T10:27:50.181 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.369+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac10a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:50.181 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.369+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac10a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41172/0 (socket says 172.21.15.92:41172) 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.369+0000 7fb2abfff640 1 -- 172.21.15.92:0/61452779 learned_addr learned my addr 172.21.15.92:0/61452779 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.369+0000 7fb2abfff640 1 -- 172.21.15.92:0/61452779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac10a970 con 0x7fb2ac108040 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.370+0000 7fb2abfff640 1 --2- 172.21.15.92:0/61452779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac10a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009820 tx=0x7fb29c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac10f79a6ba54c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.370+0000 7fb2ab7fe640 1 -- 172.21.15.92:0/61452779 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb29c037070 con 0x7fb2ac108040 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.370+0000 7fb2ab7fe640 1 -- 172.21.15.92:0/61452779 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb29c032920 con 0x7fb2ac108040 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.370+0000 7fb2ab7fe640 1 -- 172.21.15.92:0/61452779 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb29c030810 con 0x7fb2ac108040 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.371+0000 7fb2b2a19640 1 -- 172.21.15.92:0/61452779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 msgr2=0x7fb2ac10a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.371+0000 7fb2b2a19640 1 --2- 172.21.15.92:0/61452779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac10a430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009820 tx=0x7fb29c02a270 comp rx=0 tx=0).stop 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.371+0000 7fb2b2a19640 1 -- 172.21.15.92:0/61452779 shutdown_connections 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.371+0000 7fb2b2a19640 1 --2- 172.21.15.92:0/61452779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac10a430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.371+0000 7fb2b2a19640 1 -- 172.21.15.92:0/61452779 >> 172.21.15.92:0/61452779 conn(0x7fb2ac101d00 msgr2=0x7fb2ac104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.371+0000 7fb2b2a19640 1 -- 172.21.15.92:0/61452779 shutdown_connections 2024-09-10T10:27:50.182 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.371+0000 7fb2b2a19640 1 -- 172.21.15.92:0/61452779 wait complete. 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.372+0000 7fb2b2a19640 1 Processor -- start 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.372+0000 7fb2b2a19640 1 -- start start 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.372+0000 7fb2b2a19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.372+0000 7fb2b2a19640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac10ba50 con 0x7fb2ac108040 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.372+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.372+0000 7fb2abfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac19b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41188/0 (socket says 172.21.15.92:41188) 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.372+0000 7fb2abfff640 1 -- 172.21.15.92:0/2786576202 learned_addr learned my addr 172.21.15.92:0/2786576202 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.372+0000 7fb2abfff640 1 -- 172.21.15.92:0/2786576202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac19bb30 con 0x7fb2ac108040 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.372+0000 7fb2abfff640 1 --2- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac19b5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0097f0 tx=0x7fb29c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.373+0000 7fb2a9ffb640 1 -- 172.21.15.92:0/2786576202 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb29c037040 con 0x7fb2ac108040 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.373+0000 7fb2a9ffb640 1 -- 172.21.15.92:0/2786576202 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb29c030cc0 con 0x7fb2ac108040 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.373+0000 7fb2a9ffb640 1 -- 172.21.15.92:0/2786576202 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb29c03a6b0 con 0x7fb2ac108040 2024-09-10T10:27:50.183 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.373+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac19bdc0 con 0x7fb2ac108040 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.373+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac19eab0 con 0x7fb2ac108040 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.373+0000 7fb2a9ffb640 1 -- 172.21.15.92:0/2786576202 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb29c03a850 con 0x7fb2ac108040 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.374+0000 7fb2a9ffb640 1 --2- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fb298038fc0 0x7fb29803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.374+0000 7fb2a9ffb640 1 -- 172.21.15.92:0/2786576202 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb29c06c4c0 con 0x7fb2ac108040 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.374+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ac1084a0 con 0x7fb2ac108040 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.374+0000 7fb2a3fff640 1 --2- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fb298038fc0 0x7fb29803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.374+0000 7fb2a3fff640 1 --2- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fb298038fc0 0x7fb29803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb2940098c0 tx=0x7fb294006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.379+0000 7fb2a9ffb640 1 -- 172.21.15.92:0/2786576202 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb29c02fd60 con 0x7fb2ac108040 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:48.616+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fb2ac19ef70 con 0x7fb2ac108040 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.195+0000 7fb2a9ffb640 1 -- 172.21.15.92:0/2786576202 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fb29c044920 con 0x7fb2ac108040 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.197+0000 7fb2a9ffb640 1 -- 172.21.15.92:0/2786576202 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fb29c044400 con 0x7fb2ac108040 2024-09-10T10:27:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fb298038fc0 msgr2=0x7fb29803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:50.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 --2- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fb298038fc0 0x7fb29803b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb2940098c0 tx=0x7fb294006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:50.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 msgr2=0x7fb2ac19b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:50.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 --2- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac19b5f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0097f0 tx=0x7fb29c0327b0 comp rx=0 tx=0).stop 2024-09-10T10:27:50.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 shutdown_connections 2024-09-10T10:27:50.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 --2- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7fb298038fc0 0x7fb29803b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:50.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 --2- 172.21.15.92:0/2786576202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2ac108040 0x7fb2ac19b5f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:50.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 >> 172.21.15.92:0/2786576202 conn(0x7fb2ac101d00 msgr2=0x7fb2ac1028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:50.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 shutdown_connections 2024-09-10T10:27:50.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:49.198+0000 7fb2b2a19640 1 -- 172.21.15.92:0/2786576202 wait complete. 2024-09-10T10:27:50.425 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:50 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2786576202' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T10:27:50.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:50 smithi092 ceph-mon[30834]: mgrmap e9: x(active, since 18s) 2024-09-10T10:27:50.426 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:50.225+0000 7fd2a713f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:27:50.426 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:50.285+0000 7fd2a713f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:27:50.804 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:50.475+0000 7fd2a713f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:27:51.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:51 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3027334402' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T10:27:51.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:27:51.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T10:27:51.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T10:27:51.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T10:27:51.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T10:27:51.397 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.596+0000 7f5e4738d640 1 Processor -- start 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.596+0000 7f5e4738d640 1 -- start start 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.596+0000 7f5e4738d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e40107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.596+0000 7f5e4738d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40108000 con 0x7f5e40107630 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.596+0000 7f5e45129640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e40107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.596+0000 7f5e45129640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e40107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41200/0 (socket says 172.21.15.92:41200) 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.596+0000 7f5e45129640 1 -- 172.21.15.92:0/1603611501 learned_addr learned my addr 172.21.15.92:0/1603611501 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.597+0000 7f5e45129640 1 -- 172.21.15.92:0/1603611501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e401087e0 con 0x7f5e40107630 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.597+0000 7f5e45129640 1 --2- 172.21.15.92:0/1603611501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e40107a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009820 tx=0x7f5e3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfd766274dc02bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e37fff640 1 -- 172.21.15.92:0/1603611501 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c037070 con 0x7f5e40107630 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e37fff640 1 -- 172.21.15.92:0/1603611501 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e3c032920 con 0x7f5e40107630 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e37fff640 1 -- 172.21.15.92:0/1603611501 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c030810 con 0x7f5e40107630 2024-09-10T10:27:51.398 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e4738d640 1 -- 172.21.15.92:0/1603611501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 msgr2=0x7f5e40107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e4738d640 1 --2- 172.21.15.92:0/1603611501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e40107a30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009820 tx=0x7f5e3c02a270 comp rx=0 tx=0).stop 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e4738d640 1 -- 172.21.15.92:0/1603611501 shutdown_connections 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e4738d640 1 --2- 172.21.15.92:0/1603611501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e40107a30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e4738d640 1 -- 172.21.15.92:0/1603611501 >> 172.21.15.92:0/1603611501 conn(0x7f5e40102da0 msgr2=0x7f5e40105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e4738d640 1 -- 172.21.15.92:0/1603611501 shutdown_connections 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.598+0000 7f5e4738d640 1 -- 172.21.15.92:0/1603611501 wait complete. 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.599+0000 7f5e4738d640 1 Processor -- start 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.599+0000 7f5e4738d640 1 -- start start 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.599+0000 7f5e4738d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e4019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.599+0000 7f5e4738d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4010bb90 con 0x7f5e40107630 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.599+0000 7f5e45129640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e4019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.599+0000 7f5e45129640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e4019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41204/0 (socket says 172.21.15.92:41204) 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.599+0000 7f5e45129640 1 -- 172.21.15.92:0/3027334402 learned_addr learned my addr 172.21.15.92:0/3027334402 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:51.399 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.600+0000 7f5e45129640 1 -- 172.21.15.92:0/3027334402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4019bb90 con 0x7f5e40107630 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.600+0000 7f5e45129640 1 --2- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e4019b650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c030560 tx=0x7f5e3c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.600+0000 7f5e367fc640 1 -- 172.21.15.92:0/3027334402 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c037040 con 0x7f5e40107630 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.600+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4019be20 con 0x7f5e40107630 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.600+0000 7f5e367fc640 1 -- 172.21.15.92:0/3027334402 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e3c040070 con 0x7f5e40107630 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.600+0000 7f5e367fc640 1 -- 172.21.15.92:0/3027334402 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c03a6d0 con 0x7f5e40107630 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.600+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4019eb10 con 0x7f5e40107630 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.601+0000 7f5e367fc640 1 -- 172.21.15.92:0/3027334402 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f5e3c03a940 con 0x7f5e40107630 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.601+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4010bd10 con 0x7f5e40107630 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.601+0000 7f5e367fc640 1 --2- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f5e2c038fc0 0x7f5e2c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.601+0000 7f5e367fc640 1 -- 172.21.15.92:0/3027334402 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5e3c06c590 con 0x7f5e40107630 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.601+0000 7f5e44928640 1 -- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f5e2c038fc0 msgr2=0x7f5e2c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1855060807 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.601+0000 7f5e44928640 1 --2- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f5e2c038fc0 0x7f5e2c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:27:51.400 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.606+0000 7f5e367fc640 1 -- 172.21.15.92:0/3027334402 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e3c041270 con 0x7f5e40107630 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.802+0000 7f5e44928640 1 -- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f5e2c038fc0 msgr2=0x7f5e2c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1855060807 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.802+0000 7f5e44928640 1 --2- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f5e2c038fc0 0x7f5e2c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.826+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f5e4019ece0 con 0x7f5e40107630 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.826+0000 7f5e367fc640 1 -- 172.21.15.92:0/3027334402 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f5e3c03ad80 con 0x7f5e40107630 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f5e2c038fc0 msgr2=0x7f5e2c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 --2- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f5e2c038fc0 0x7f5e2c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 msgr2=0x7f5e4019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 --2- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e4019b650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c030560 tx=0x7f5e3c032670 comp rx=0 tx=0).stop 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 shutdown_connections 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 --2- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f5e2c038fc0 0x7f5e2c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 --2- 172.21.15.92:0/3027334402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e40107630 0x7f5e4019b650 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 >> 172.21.15.92:0/3027334402 conn(0x7f5e40102da0 msgr2=0x7f5e40103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:51.401 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 shutdown_connections 2024-09-10T10:27:51.402 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:50.829+0000 7f5e4738d640 1 -- 172.21.15.92:0/3027334402 wait complete. 2024-09-10T10:27:51.402 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2024-09-10T10:27:51.402 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 9... 2024-09-10T10:27:51.636 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:51.377+0000 7fd2a713f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:27:51.636 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:51.457+0000 7fd2a713f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:27:52.294 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:52.178+0000 7fd2a713f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:27:52.294 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:52.292+0000 7fd2a713f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:27:52.610 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:52.435+0000 7fd2a713f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:27:52.610 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:52.496+0000 7fd2a713f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:27:52.928 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:52.643+0000 7fd2a713f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:27:52.928 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:52.709+0000 7fd2a713f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:27:52.928 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:52.769+0000 7fd2a713f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:27:52.928 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:52.926+0000 7fd2a713f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:27:53.200 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:52.991+0000 7fd2a713f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:27:53.200 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:53.057+0000 7fd2a713f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:27:53.201 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:53.139+0000 7fd2a713f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:27:53.201 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:53.199+0000 7fd2a713f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:27:53.610 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:53.258+0000 7fd2a713f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:27:54.360 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:54.045+0000 7fd2a713f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:27:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: Active manager daemon x restarted 2024-09-10T10:27:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: Activating manager daemon x 2024-09-10T10:27:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T10:27:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: mgrmap e10: x(active, starting, since 0.00334311s) 2024-09-10T10:27:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:27:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:27:54.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:27:54.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:27:54.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:27:54.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: Manager daemon x is now available 2024-09-10T10:27:54.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:27:54.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:27:54.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:27:55.532 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:55.476+0000 7fd212453640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:10:27:55] ENGINE Error in HTTPServer.serve 2024-09-10T10:27:55.532 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: Traceback (most recent call last): 2024-09-10T10:27:55.532 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:27:55.532 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self._connections.run(self.expiration_interval) 2024-09-10T10:27:55.532 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:27:55.532 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self._run(expiration_interval) 2024-09-10T10:27:55.532 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:27:55.532 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:27:55.532 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: s = self.context.wrap_socket( 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: return self.sslsocket_class._create( 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self.do_handshake() 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self._sslobj.do_handshake() 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:27:55.533 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:27:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:27:55.807 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.819+0000 7f7a3c5de640 1 Processor -- start 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.819+0000 7f7a3c5de640 1 -- start start 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.819+0000 7f7a3c5de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34106900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.819+0000 7f7a3c5de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a34106ed0 con 0x7f7a34106500 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.820+0000 7f7a3a37a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34106900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.820+0000 7f7a3a37a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34106900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41212/0 (socket says 172.21.15.92:41212) 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.820+0000 7f7a3a37a640 1 -- 172.21.15.92:0/1773723811 learned_addr learned my addr 172.21.15.92:0/1773723811 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.820+0000 7f7a3a37a640 1 -- 172.21.15.92:0/1773723811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a34107700 con 0x7f7a34106500 2024-09-10T10:27:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.821+0000 7f7a3a37a640 1 --2- 172.21.15.92:0/1773723811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34106900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009820 tx=0x7f7a3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a598151cb27911 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.821+0000 7f7a39378640 1 -- 172.21.15.92:0/1773723811 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a30037070 con 0x7f7a34106500 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.821+0000 7f7a39378640 1 -- 172.21.15.92:0/1773723811 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a30032920 con 0x7f7a34106500 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.821+0000 7f7a39378640 1 -- 172.21.15.92:0/1773723811 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a30030810 con 0x7f7a34106500 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.821+0000 7f7a3c5de640 1 -- 172.21.15.92:0/1773723811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 msgr2=0x7f7a34106900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.821+0000 7f7a3c5de640 1 --2- 172.21.15.92:0/1773723811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34106900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009820 tx=0x7f7a3002a270 comp rx=0 tx=0).stop 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.821+0000 7f7a3c5de640 1 -- 172.21.15.92:0/1773723811 shutdown_connections 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.821+0000 7f7a3c5de640 1 --2- 172.21.15.92:0/1773723811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34106900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.821+0000 7f7a3c5de640 1 -- 172.21.15.92:0/1773723811 >> 172.21.15.92:0/1773723811 conn(0x7f7a34101d10 msgr2=0x7f7a34104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.822+0000 7f7a3c5de640 1 -- 172.21.15.92:0/1773723811 shutdown_connections 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.822+0000 7f7a3c5de640 1 -- 172.21.15.92:0/1773723811 wait complete. 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.822+0000 7f7a3c5de640 1 Processor -- start 2024-09-10T10:27:55.809 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.822+0000 7f7a3c5de640 1 -- start start 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.822+0000 7f7a3c5de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34191730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.822+0000 7f7a3c5de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3410aab0 con 0x7f7a34106500 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.822+0000 7f7a3a37a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34191730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.822+0000 7f7a3a37a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34191730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41222/0 (socket says 172.21.15.92:41222) 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.822+0000 7f7a3a37a640 1 -- 172.21.15.92:0/3990486238 learned_addr learned my addr 172.21.15.92:0/3990486238 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.823+0000 7f7a3a37a640 1 -- 172.21.15.92:0/3990486238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a34191c70 con 0x7f7a34106500 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.823+0000 7f7a3a37a640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34191730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a30030560 tx=0x7f7a30032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.823+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a30037040 con 0x7f7a34106500 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.823+0000 7f7a3c5de640 1 -- 172.21.15.92:0/3990486238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3418fe60 con 0x7f7a34106500 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.823+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a30040070 con 0x7f7a34106500 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.823+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a3003a740 con 0x7f7a34106500 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.823+0000 7f7a3c5de640 1 -- 172.21.15.92:0/3990486238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a341903a0 con 0x7f7a34106500 2024-09-10T10:27:55.810 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.824+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f7a3003a9b0 con 0x7f7a34106500 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.824+0000 7f7a2b7fe640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 0x7f7a2003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.824+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 --> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7a2003bb90 con 0x7f7a20038fc0 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.824+0000 7f7a39b79640 1 -- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 msgr2=0x7f7a2003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1855060807 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.824+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7a3006d730 con 0x7f7a34106500 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:51.824+0000 7f7a39b79640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 0x7f7a2003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:52.025+0000 7f7a39b79640 1 -- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 msgr2=0x7f7a2003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1855060807 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:52.025+0000 7f7a39b79640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 0x7f7a2003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:52.426+0000 7f7a39b79640 1 -- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 msgr2=0x7f7a2003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1855060807 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:52.426+0000 7f7a39b79640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 0x7f7a2003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:53.227+0000 7f7a39b79640 1 -- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 msgr2=0x7f7a2003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1855060807 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:53.227+0000 7f7a39b79640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 0x7f7a2003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:54.048+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f7a3006c120 con 0x7f7a34106500 2024-09-10T10:27:55.811 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:54.048+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 msgr2=0x7f7a2003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:54.048+0000 7f7a2b7fe640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 0x7f7a2003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.049+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f7a3003aca0 con 0x7f7a34106500 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.049+0000 7f7a2b7fe640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7a2003ca80 0x7f7a2003ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.049+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7a3003bd60 con 0x7f7a2003ca80 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.050+0000 7f7a39b79640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7a2003ca80 0x7f7a2003ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.051+0000 7f7a39b79640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7a2003ca80 0x7f7a2003ee70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7a24003980 tx=0x7f7a24006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.051+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f7a3003bd60 con 0x7f7a2003ca80 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.058+0000 7f7a3c5de640 1 -- 172.21.15.92:0/3990486238 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f7a3410ac30 con 0x7f7a2003ca80 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.058+0000 7f7a2b7fe640 1 -- 172.21.15.92:0/3990486238 <== mgr.14150 v2:172.21.15.92:6800/2834815615 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f7a3410ac30 con 0x7f7a2003ca80 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.058+0000 7f7a3c5de640 1 -- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7a2003ca80 msgr2=0x7f7a2003ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.058+0000 7f7a3c5de640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7a2003ca80 0x7f7a2003ee70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7a24003980 tx=0x7f7a24006e10 comp rx=0 tx=0).stop 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.058+0000 7f7a3c5de640 1 -- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 msgr2=0x7f7a34191730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:55.812 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.058+0000 7f7a3c5de640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34191730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a30030560 tx=0x7f7a30032670 comp rx=0 tx=0).stop 2024-09-10T10:27:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.059+0000 7f7a3c5de640 1 -- 172.21.15.92:0/3990486238 shutdown_connections 2024-09-10T10:27:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.059+0000 7f7a3c5de640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7a2003ca80 0x7f7a2003ee70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.059+0000 7f7a3c5de640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:6800/1855060807,v1:172.21.15.92:6801/1855060807] conn(0x7f7a20038fc0 0x7f7a2003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.059+0000 7f7a3c5de640 1 --2- 172.21.15.92:0/3990486238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a34106500 0x7f7a34191730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.059+0000 7f7a3c5de640 1 -- 172.21.15.92:0/3990486238 >> 172.21.15.92:0/3990486238 conn(0x7f7a34101d10 msgr2=0x7f7a34102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.059+0000 7f7a3c5de640 1 -- 172.21.15.92:0/3990486238 shutdown_connections 2024-09-10T10:27:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:55.059+0000 7f7a3c5de640 1 -- 172.21.15.92:0/3990486238 wait complete. 2024-09-10T10:27:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 9 is available 2024-09-10T10:27:55.813 INFO:teuthology.orchestra.run.smithi092.stdout:Generating a dashboard self-signed certificate... 2024-09-10T10:27:56.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:56 smithi092 ceph-mon[30834]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T10:27:56.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:56 smithi092 ceph-mon[30834]: mgrmap e11: x(active, since 1.00579s) 2024-09-10T10:27:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:56 smithi092 ceph-mon[30834]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T10:27:57.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T10:27:57.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.245+0000 7ff845b11640 1 Processor -- start 2024-09-10T10:27:57.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.245+0000 7ff845b11640 1 -- start start 2024-09-10T10:27:57.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.245+0000 7ff845b11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff84010a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:57.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.245+0000 7ff845b11640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff84007be40 con 0x7ff8401080d0 2024-09-10T10:27:57.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.245+0000 7ff83f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff84010a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:57.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.245+0000 7ff83f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff84010a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34074/0 (socket says 172.21.15.92:34074) 2024-09-10T10:27:57.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.245+0000 7ff83f7fe640 1 -- 172.21.15.92:0/2709274615 learned_addr learned my addr 172.21.15.92:0/2709274615 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:57.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.245+0000 7ff83f7fe640 1 -- 172.21.15.92:0/2709274615 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84010aa00 con 0x7ff8401080d0 2024-09-10T10:27:57.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.246+0000 7ff83f7fe640 1 --2- 172.21.15.92:0/2709274615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff84010a4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff830009820 tx=0x7ff83002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55782b2932d414c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:57.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.246+0000 7ff83e7fc640 1 -- 172.21.15.92:0/2709274615 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff830037070 con 0x7ff8401080d0 2024-09-10T10:27:57.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.246+0000 7ff83e7fc640 1 -- 172.21.15.92:0/2709274615 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff830032920 con 0x7ff8401080d0 2024-09-10T10:27:57.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.246+0000 7ff83e7fc640 1 -- 172.21.15.92:0/2709274615 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff830030810 con 0x7ff8401080d0 2024-09-10T10:27:57.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.247+0000 7ff845b11640 1 -- 172.21.15.92:0/2709274615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 msgr2=0x7ff84010a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:57.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.247+0000 7ff845b11640 1 --2- 172.21.15.92:0/2709274615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff84010a4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff830009820 tx=0x7ff83002a270 comp rx=0 tx=0).stop 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.247+0000 7ff845b11640 1 -- 172.21.15.92:0/2709274615 shutdown_connections 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.247+0000 7ff845b11640 1 --2- 172.21.15.92:0/2709274615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff84010a4c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.247+0000 7ff845b11640 1 -- 172.21.15.92:0/2709274615 >> 172.21.15.92:0/2709274615 conn(0x7ff840101cb0 msgr2=0x7ff8401040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.247+0000 7ff845b11640 1 -- 172.21.15.92:0/2709274615 shutdown_connections 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.247+0000 7ff845b11640 1 -- 172.21.15.92:0/2709274615 wait complete. 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.247+0000 7ff845b11640 1 Processor -- start 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff845b11640 1 -- start start 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff845b11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff840107950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff845b11640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff84010ba80 con 0x7ff8401080d0 2024-09-10T10:27:57.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff83f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff840107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff83f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff840107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34080/0 (socket says 172.21.15.92:34080) 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff83f7fe640 1 -- 172.21.15.92:0/1725342254 learned_addr learned my addr 172.21.15.92:0/1725342254 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff83f7fe640 1 -- 172.21.15.92:0/1725342254 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff840107e90 con 0x7ff8401080d0 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff83f7fe640 1 --2- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff840107950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff830030420 tx=0x7ff830032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff83cff9640 1 -- 172.21.15.92:0/1725342254 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff830037040 con 0x7ff8401080d0 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff83cff9640 1 -- 172.21.15.92:0/1725342254 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff830040070 con 0x7ff8401080d0 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff840106080 con 0x7ff8401080d0 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.248+0000 7ff83cff9640 1 -- 172.21.15.92:0/1725342254 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff83003a6e0 con 0x7ff8401080d0 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.249+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8401065c0 con 0x7ff8401080d0 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.250+0000 7ff83cff9640 1 -- 172.21.15.92:0/1725342254 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7ff83003a990 con 0x7ff8401080d0 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.250+0000 7ff83cff9640 1 --2- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff828039020 0x7ff82803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:57.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.250+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff840108530 con 0x7ff8401080d0 2024-09-10T10:27:57.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.250+0000 7ff83cff9640 1 -- 172.21.15.92:0/1725342254 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff83006c840 con 0x7ff8401080d0 2024-09-10T10:27:57.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.250+0000 7ff83effd640 1 --2- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff828039020 0x7ff82803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:57.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.250+0000 7ff83effd640 1 --2- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff828039020 0x7ff82803b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff8340098c0 tx=0x7ff834006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:57.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.255+0000 7ff83cff9640 1 -- 172.21.15.92:0/1725342254 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff830007dc0 con 0x7ff8401080d0 2024-09-10T10:27:57.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.450+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7ff840106ee0 con 0x7ff828039020 2024-09-10T10:27:57.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.501+0000 7ff83cff9640 1 -- 172.21.15.92:0/1725342254 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7ff840106ee0 con 0x7ff828039020 2024-09-10T10:27:57.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.503+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff828039020 msgr2=0x7ff82803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:57.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.503+0000 7ff845b11640 1 --2- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff828039020 0x7ff82803b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff8340098c0 tx=0x7ff834006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:57.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.503+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 msgr2=0x7ff840107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:57.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.503+0000 7ff845b11640 1 --2- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff840107950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff830030420 tx=0x7ff830032670 comp rx=0 tx=0).stop 2024-09-10T10:27:57.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.503+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 shutdown_connections 2024-09-10T10:27:57.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.503+0000 7ff845b11640 1 --2- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff828039020 0x7ff82803b4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:57.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.503+0000 7ff845b11640 1 --2- 172.21.15.92:0/1725342254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401080d0 0x7ff840107950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:57.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.503+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 >> 172.21.15.92:0/1725342254 conn(0x7ff840101cb0 msgr2=0x7ff840102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:57.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.504+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 shutdown_connections 2024-09-10T10:27:57.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:56.504+0000 7ff845b11640 1 -- 172.21.15.92:0/1725342254 wait complete. 2024-09-10T10:27:57.134 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial admin user... 2024-09-10T10:27:57.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:57 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:55] ENGINE Bus STARTING 2024-09-10T10:27:57.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:57 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:55] ENGINE Serving on https://172.21.15.92:7150 2024-09-10T10:27:57.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:57 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:55] ENGINE Error in HTTPServer.serve 2024-09-10T10:27:57.250 INFO:journalctl@ceph.mon.a.smithi092.stdout: Traceback (most recent call last): 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._run(expiration_interval) 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: s = self.context.wrap_socket( 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: return self.sslsocket_class._create( 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:27:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout: self.do_handshake() 2024-09-10T10:27:57.252 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:27:57.252 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._sslobj.do_handshake() 2024-09-10T10:27:57.252 INFO:journalctl@ceph.mon.a.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:27:57.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:57 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:55] ENGINE Serving on http://172.21.15.92:8765 2024-09-10T10:27:57.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:57 smithi092 ceph-mon[30834]: [10/Sep/2024:10:27:55] ENGINE Bus STARTED 2024-09-10T10:27:57.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:57 smithi092 ceph-mon[30834]: mgrmap e12: x(active, since 2s) 2024-09-10T10:27:57.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:27:57.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:27:57.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:27:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:58 smithi092 ceph-mon[30834]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:27:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:27:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:27:59.175 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$UhkzqrXvOTGnSUyCd0B6aOGPya1a3p4KLM4UsSvQjnk4K8EEfTHHO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725964078, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.609+0000 7fd755582640 1 Processor -- start 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.609+0000 7fd755582640 1 -- start start 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.609+0000 7fd755582640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd750107f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.609+0000 7fd755582640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd750108540 con 0x7fd750107b70 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.610+0000 7fd74effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd750107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.610+0000 7fd74effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd750107f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34082/0 (socket says 172.21.15.92:34082) 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.610+0000 7fd74effd640 1 -- 172.21.15.92:0/861421463 learned_addr learned my addr 172.21.15.92:0/861421463 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.610+0000 7fd74effd640 1 -- 172.21.15.92:0/861421463 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd750106740 con 0x7fd750107b70 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd74effd640 1 --2- 172.21.15.92:0/861421463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd750107f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd740009820 tx=0x7fd74002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bb7cd33713c1aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd74dffb640 1 -- 172.21.15.92:0/861421463 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd740037070 con 0x7fd750107b70 2024-09-10T10:27:59.176 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd74dffb640 1 -- 172.21.15.92:0/861421463 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd740032920 con 0x7fd750107b70 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd74dffb640 1 -- 172.21.15.92:0/861421463 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd740030810 con 0x7fd750107b70 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd755582640 1 -- 172.21.15.92:0/861421463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 msgr2=0x7fd750107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd755582640 1 --2- 172.21.15.92:0/861421463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd750107f70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd740009820 tx=0x7fd74002a270 comp rx=0 tx=0).stop 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd755582640 1 -- 172.21.15.92:0/861421463 shutdown_connections 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd755582640 1 --2- 172.21.15.92:0/861421463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd750107f70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd755582640 1 -- 172.21.15.92:0/861421463 >> 172.21.15.92:0/861421463 conn(0x7fd750101440 msgr2=0x7fd750103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd755582640 1 -- 172.21.15.92:0/861421463 shutdown_connections 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.611+0000 7fd755582640 1 -- 172.21.15.92:0/861421463 wait complete. 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.612+0000 7fd755582640 1 Processor -- start 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.612+0000 7fd755582640 1 -- start start 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.612+0000 7fd755582640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd7501917f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:59.177 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.612+0000 7fd755582640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd75010ab00 con 0x7fd750107b70 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.612+0000 7fd74effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd7501917f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.612+0000 7fd74effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd7501917f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34086/0 (socket says 172.21.15.92:34086) 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.612+0000 7fd74effd640 1 -- 172.21.15.92:0/1111016527 learned_addr learned my addr 172.21.15.92:0/1111016527 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.613+0000 7fd74effd640 1 -- 172.21.15.92:0/1111016527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd750191d30 con 0x7fd750107b70 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.613+0000 7fd74effd640 1 --2- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd7501917f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd740030380 tx=0x7fd740032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.613+0000 7fd737fff640 1 -- 172.21.15.92:0/1111016527 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd740037040 con 0x7fd750107b70 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.613+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75018ff20 con 0x7fd750107b70 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.613+0000 7fd737fff640 1 -- 172.21.15.92:0/1111016527 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd740040070 con 0x7fd750107b70 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.613+0000 7fd737fff640 1 -- 172.21.15.92:0/1111016527 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd74003a6d0 con 0x7fd750107b70 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.613+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd750190460 con 0x7fd750107b70 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.614+0000 7fd737fff640 1 -- 172.21.15.92:0/1111016527 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fd74003a9d0 con 0x7fd750107b70 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.614+0000 7fd737fff640 1 --2- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd738038fc0 0x7fd73803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:27:59.178 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.614+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd750107ff0 con 0x7fd750107b70 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.614+0000 7fd737fff640 1 -- 172.21.15.92:0/1111016527 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd74006c800 con 0x7fd750107b70 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.614+0000 7fd74e7fc640 1 --2- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd738038fc0 0x7fd73803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.614+0000 7fd74e7fc640 1 --2- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd738038fc0 0x7fd73803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd7440098c0 tx=0x7fd744006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.619+0000 7fd737fff640 1 -- 172.21.15.92:0/1111016527 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd740044c70 con 0x7fd750107b70 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:57.813+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fd750195530 con 0x7fd738038fc0 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.038+0000 7fd737fff640 1 -- 172.21.15.92:0/1111016527 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fd750195530 con 0x7fd738038fc0 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.040+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd738038fc0 msgr2=0x7fd73803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.040+0000 7fd755582640 1 --2- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd738038fc0 0x7fd73803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd7440098c0 tx=0x7fd744006db0 comp rx=0 tx=0).stop 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.040+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 msgr2=0x7fd7501917f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.040+0000 7fd755582640 1 --2- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd7501917f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd740030380 tx=0x7fd740032670 comp rx=0 tx=0).stop 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.041+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 shutdown_connections 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.041+0000 7fd755582640 1 --2- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd738038fc0 0x7fd73803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:59.179 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.041+0000 7fd755582640 1 --2- 172.21.15.92:0/1111016527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd750107b70 0x7fd7501917f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:27:59.180 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.041+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 >> 172.21.15.92:0/1111016527 conn(0x7fd750101440 msgr2=0x7fd750102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:27:59.180 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.041+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 shutdown_connections 2024-09-10T10:27:59.180 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:58.041+0000 7fd755582640 1 -- 172.21.15.92:0/1111016527 wait complete. 2024-09-10T10:27:59.180 INFO:teuthology.orchestra.run.smithi092.stdout:Fetching dashboard port number... 2024-09-10T10:27:59.437 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:27:59 smithi092 ceph-mon[30834]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:00.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:00 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/837274668' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T10:28:00.369 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T10:28:00.373 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.606+0000 7fa1af913640 1 Processor -- start 2024-09-10T10:28:00.373 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.607+0000 7fa1af913640 1 -- start start 2024-09-10T10:28:00.373 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.607+0000 7fa1af913640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a8107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.607+0000 7fa1af913640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a8107ff0 con 0x7fa1a8107620 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.607+0000 7fa1ad6af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a8107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.607+0000 7fa1ad6af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a8107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34096/0 (socket says 172.21.15.92:34096) 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.607+0000 7fa1ad6af640 1 -- 172.21.15.92:0/1631410593 learned_addr learned my addr 172.21.15.92:0/1631410593 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.607+0000 7fa1ad6af640 1 -- 172.21.15.92:0/1631410593 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a8108820 con 0x7fa1a8107620 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.608+0000 7fa1ad6af640 1 --2- 172.21.15.92:0/1631410593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a8107a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009820 tx=0x7fa1a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d9a3ef5dd068dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.608+0000 7fa19ffff640 1 -- 172.21.15.92:0/1631410593 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a4037070 con 0x7fa1a8107620 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.608+0000 7fa19ffff640 1 -- 172.21.15.92:0/1631410593 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a4032920 con 0x7fa1a8107620 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.608+0000 7fa19ffff640 1 -- 172.21.15.92:0/1631410593 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a4030810 con 0x7fa1a8107620 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 -- 172.21.15.92:0/1631410593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 msgr2=0x7fa1a8107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 --2- 172.21.15.92:0/1631410593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a8107a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009820 tx=0x7fa1a402a270 comp rx=0 tx=0).stop 2024-09-10T10:28:00.374 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 -- 172.21.15.92:0/1631410593 shutdown_connections 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 --2- 172.21.15.92:0/1631410593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a8107a20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 -- 172.21.15.92:0/1631410593 >> 172.21.15.92:0/1631410593 conn(0x7fa1a8102db0 msgr2=0x7fa1a81051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 -- 172.21.15.92:0/1631410593 shutdown_connections 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 -- 172.21.15.92:0/1631410593 wait complete. 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 Processor -- start 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 -- start start 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.609+0000 7fa1af913640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a810bbd0 con 0x7fa1a8107620 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa1ad6af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa1ad6af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a819b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34104/0 (socket says 172.21.15.92:34104) 2024-09-10T10:28:00.375 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa1ad6af640 1 -- 172.21.15.92:0/837274668 learned_addr learned my addr 172.21.15.92:0/837274668 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa1ad6af640 1 -- 172.21.15.92:0/837274668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a819bc00 con 0x7fa1a8107620 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa1ad6af640 1 --2- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a819b6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4030560 tx=0x7fa1a4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa19e7fc640 1 -- 172.21.15.92:0/837274668 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a4037040 con 0x7fa1a8107620 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa19e7fc640 1 -- 172.21.15.92:0/837274668 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a4040070 con 0x7fa1a8107620 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a819be90 con 0x7fa1a8107620 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa19e7fc640 1 -- 172.21.15.92:0/837274668 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1a403a6d0 con 0x7fa1a8107620 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.610+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a819eb80 con 0x7fa1a8107620 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.611+0000 7fa19e7fc640 1 -- 172.21.15.92:0/837274668 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa1a403a940 con 0x7fa1a8107620 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.611+0000 7fa19e7fc640 1 --2- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa194038fc0 0x7fa19403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.611+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a810bd50 con 0x7fa1a8107620 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.611+0000 7fa19e7fc640 1 -- 172.21.15.92:0/837274668 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa1a406c800 con 0x7fa1a8107620 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.611+0000 7fa1aceae640 1 --2- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa194038fc0 0x7fa19403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.612+0000 7fa1aceae640 1 --2- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa194038fc0 0x7fa19403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa1980098c0 tx=0x7fa198006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.616+0000 7fa19e7fc640 1 -- 172.21.15.92:0/837274668 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1a4044c70 con 0x7fa1a8107620 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.781+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fa1a819ed50 con 0x7fa1a8107620 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.781+0000 7fa19e7fc640 1 -- 172.21.15.92:0/837274668 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fa1a4040cc0 con 0x7fa1a8107620 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.783+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa194038fc0 msgr2=0x7fa19403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.783+0000 7fa1af913640 1 --2- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa194038fc0 0x7fa19403b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa1980098c0 tx=0x7fa198006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.783+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 msgr2=0x7fa1a819b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.783+0000 7fa1af913640 1 --2- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a819b6c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4030560 tx=0x7fa1a4032670 comp rx=0 tx=0).stop 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.783+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 shutdown_connections 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.784+0000 7fa1af913640 1 --2- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa194038fc0 0x7fa19403b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.784+0000 7fa1af913640 1 --2- 172.21.15.92:0/837274668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a8107620 0x7fa1a819b6c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.784+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 >> 172.21.15.92:0/837274668 conn(0x7fa1a8102db0 msgr2=0x7fa1a8103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.784+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 shutdown_connections 2024-09-10T10:28:00.377 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:27:59.784+0000 7fa1af913640 1 -- 172.21.15.92:0/837274668 wait complete. 2024-09-10T10:28:00.380 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T10:28:00.381 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-09-10T10:28:00.388 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T10:28:00.388 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-09-10T10:28:00.388 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-09-10T10:28:00.388 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph Dashboard is now available at: 2024-09-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi092.stdout: URL: https://smithi092.front.sepia.ceph.com:8443/ 2024-09-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi092.stdout: User: admin 2024-09-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi092.stdout: Password: wxfnmyi0qo 2024-09-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:00.390 INFO:teuthology.orchestra.run.smithi092.stdout:Saving cluster configuration to /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config directory 2024-09-10T10:28:01.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:01 smithi092 ceph-mon[30834]: mgrmap e13: x(active, since 6s) 2024-09-10T10:28:01.322 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:01 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/816295703' entity='client.admin' 2024-09-10T10:28:01.588 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.754+0000 7f0de15a6640 1 Processor -- start 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.754+0000 7f0de15a6640 1 -- start start 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.754+0000 7f0de15a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.754+0000 7f0de15a6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc106ee0 con 0x7f0ddc106510 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.754+0000 7f0ddaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.755+0000 7f0ddaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34110/0 (socket says 172.21.15.92:34110) 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.755+0000 7f0ddaffd640 1 -- 172.21.15.92:0/507184527 learned_addr learned my addr 172.21.15.92:0/507184527 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.755+0000 7f0ddaffd640 1 -- 172.21.15.92:0/507184527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc1076c0 con 0x7f0ddc106510 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.755+0000 7f0ddaffd640 1 --2- 172.21.15.92:0/507184527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc106910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009820 tx=0x7f0dcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2abab2fbe3c7476 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0dda7fc640 1 -- 172.21.15.92:0/507184527 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc037070 con 0x7f0ddc106510 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0dda7fc640 1 -- 172.21.15.92:0/507184527 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dcc032920 con 0x7f0ddc106510 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0dda7fc640 1 -- 172.21.15.92:0/507184527 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc030810 con 0x7f0ddc106510 2024-09-10T10:28:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0de15a6640 1 -- 172.21.15.92:0/507184527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 msgr2=0x7f0ddc106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0de15a6640 1 --2- 172.21.15.92:0/507184527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc106910 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009820 tx=0x7f0dcc02a270 comp rx=0 tx=0).stop 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0de15a6640 1 -- 172.21.15.92:0/507184527 shutdown_connections 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0de15a6640 1 --2- 172.21.15.92:0/507184527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc106910 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0de15a6640 1 -- 172.21.15.92:0/507184527 >> 172.21.15.92:0/507184527 conn(0x7f0ddc101ca0 msgr2=0x7f0ddc1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0de15a6640 1 -- 172.21.15.92:0/507184527 shutdown_connections 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.756+0000 7f0de15a6640 1 -- 172.21.15.92:0/507184527 wait complete. 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.757+0000 7f0de15a6640 1 Processor -- start 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.757+0000 7f0de15a6640 1 -- start start 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.757+0000 7f0de15a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.757+0000 7f0de15a6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc10aa70 con 0x7f0ddc106510 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.757+0000 7f0ddaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.757+0000 7f0ddaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc19a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34124/0 (socket says 172.21.15.92:34124) 2024-09-10T10:28:01.590 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.757+0000 7f0ddaffd640 1 -- 172.21.15.92:0/816295703 learned_addr learned my addr 172.21.15.92:0/816295703 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.757+0000 7f0ddaffd640 1 -- 172.21.15.92:0/816295703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc19aa70 con 0x7f0ddc106510 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.758+0000 7f0ddaffd640 1 --2- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc19a530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc030560 tx=0x7f0dcc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.758+0000 7f0dd8ff9640 1 -- 172.21.15.92:0/816295703 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc037040 con 0x7f0ddc106510 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.758+0000 7f0dd8ff9640 1 -- 172.21.15.92:0/816295703 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dcc040070 con 0x7f0ddc106510 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.758+0000 7f0dd8ff9640 1 -- 172.21.15.92:0/816295703 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dcc03a6d0 con 0x7f0ddc106510 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.758+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ddc19ad00 con 0x7f0ddc106510 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.758+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ddc19d9f0 con 0x7f0ddc106510 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.759+0000 7f0dd8ff9640 1 -- 172.21.15.92:0/816295703 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0dcc03a870 con 0x7f0ddc106510 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.759+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ddc10abf0 con 0x7f0ddc106510 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.759+0000 7f0dd8ff9640 1 --2- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0dc80390c0 0x7f0dc803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.759+0000 7f0dd8ff9640 1 -- 172.21.15.92:0/816295703 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0dcc06c830 con 0x7f0ddc106510 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.759+0000 7f0dd27fc640 1 --2- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0dc80390c0 0x7f0dc803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:01.591 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.760+0000 7f0dd27fc640 1 --2- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0dc80390c0 0x7f0dc803b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40098c0 tx=0x7f0dc4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:00.764+0000 7f0dd8ff9640 1 -- 172.21.15.92:0/816295703 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0dcc0313a0 con 0x7f0ddc106510 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.015+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f0ddc19dbc0 con 0x7f0ddc106510 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.018+0000 7f0dd8ff9640 1 -- 172.21.15.92:0/816295703 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f0dcc043e10 con 0x7f0ddc106510 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0dc80390c0 msgr2=0x7f0dc803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 --2- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0dc80390c0 0x7f0dc803b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40098c0 tx=0x7f0dc4006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 msgr2=0x7f0ddc19a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 --2- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc19a530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc030560 tx=0x7f0dcc032670 comp rx=0 tx=0).stop 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 shutdown_connections 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 --2- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0dc80390c0 0x7f0dc803b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 --2- 172.21.15.92:0/816295703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ddc106510 0x7f0ddc19a530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 >> 172.21.15.92:0/816295703 conn(0x7f0ddc101ca0 msgr2=0x7f0ddc102850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 shutdown_connections 2024-09-10T10:28:01.592 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-09-10T10:28:01.020+0000 7f0de15a6640 1 -- 172.21.15.92:0/816295703 wait complete. 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: ceph telemetry on 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout:For more information see: 2024-09-10T10:28:01.593 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:01.594 INFO:teuthology.orchestra.run.smithi092.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T10:28:01.594 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:01.594 INFO:teuthology.orchestra.run.smithi092.stdout:Bootstrap complete. 2024-09-10T10:28:01.629 INFO:tasks.cephadm:Fetching config... 2024-09-10T10:28:01.629 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:28:01.629 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T10:28:01.645 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T10:28:01.646 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:28:01.646 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T10:28:01.702 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T10:28:01.702 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:28:01.702 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T10:28:01.766 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T10:28:01.766 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:28:01.767 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T10:28:01.821 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T10:28:01.822 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA6GhyAhnrgEkR0CdQ4aH2IyqsYbH1EaLz6r10hBwALI/vdWOe/GsJIgK/m6FHWPKoqU2mePky5yMhCvQ8JMrBVBdbv/woNj4z7wB1h4j77lUUtjwOkzGtYGWS29zYF7TBoZL4nJNVDU3Z16zfnCHu59POj6LVMGYMN1L9n2AvQWPbXv0wocD/NOohd/IFP6l/CCwOOfpx9Vhztf0RIxbSXX8zj6kaGWQ1X/dPpDWGUaWWWwxn4lnzphOJg+8akgsXyqQb3YnxpG0x26B1hbCSiBysQ40twx3/VPa4jhHwnIKnqSZOWORH+kIcG3mXABr5yLg3VurUTGvNwgutYaDjHIUlZoj1cjmF4XuoXTKvSibbXpJf9F0W778p5gssXy7I1V1YlCmxCgYvj2+FhezlBdwXxO3dNwHXt/0R8dRRgMDr37uPwSFg07AawAtR082K9Wk/q2jRYStakFFKex/S5IhsxaVnMCklUTGRz+C7IDNaFtC6NMqkwQV8yArI6NM= ceph-0df4af84-6f5f-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T10:28:01.895 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA6GhyAhnrgEkR0CdQ4aH2IyqsYbH1EaLz6r10hBwALI/vdWOe/GsJIgK/m6FHWPKoqU2mePky5yMhCvQ8JMrBVBdbv/woNj4z7wB1h4j77lUUtjwOkzGtYGWS29zYF7TBoZL4nJNVDU3Z16zfnCHu59POj6LVMGYMN1L9n2AvQWPbXv0wocD/NOohd/IFP6l/CCwOOfpx9Vhztf0RIxbSXX8zj6kaGWQ1X/dPpDWGUaWWWwxn4lnzphOJg+8akgsXyqQb3YnxpG0x26B1hbCSiBysQ40twx3/VPa4jhHwnIKnqSZOWORH+kIcG3mXABr5yLg3VurUTGvNwgutYaDjHIUlZoj1cjmF4XuoXTKvSibbXpJf9F0W778p5gssXy7I1V1YlCmxCgYvj2+FhezlBdwXxO3dNwHXt/0R8dRRgMDr37uPwSFg07AawAtR082K9Wk/q2jRYStakFFKex/S5IhsxaVnMCklUTGRz+C7IDNaFtC6NMqkwQV8yArI6NM= ceph-0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:01.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA6GhyAhnrgEkR0CdQ4aH2IyqsYbH1EaLz6r10hBwALI/vdWOe/GsJIgK/m6FHWPKoqU2mePky5yMhCvQ8JMrBVBdbv/woNj4z7wB1h4j77lUUtjwOkzGtYGWS29zYF7TBoZL4nJNVDU3Z16zfnCHu59POj6LVMGYMN1L9n2AvQWPbXv0wocD/NOohd/IFP6l/CCwOOfpx9Vhztf0RIxbSXX8zj6kaGWQ1X/dPpDWGUaWWWwxn4lnzphOJg+8akgsXyqQb3YnxpG0x26B1hbCSiBysQ40twx3/VPa4jhHwnIKnqSZOWORH+kIcG3mXABr5yLg3VurUTGvNwgutYaDjHIUlZoj1cjmF4XuoXTKvSibbXpJf9F0W778p5gssXy7I1V1YlCmxCgYvj2+FhezlBdwXxO3dNwHXt/0R8dRRgMDr37uPwSFg07AawAtR082K9Wk/q2jRYStakFFKex/S5IhsxaVnMCklUTGRz+C7IDNaFtC6NMqkwQV8yArI6NM= ceph-0df4af84-6f5f-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T10:28:01.949 INFO:teuthology.orchestra.run.smithi097.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA6GhyAhnrgEkR0CdQ4aH2IyqsYbH1EaLz6r10hBwALI/vdWOe/GsJIgK/m6FHWPKoqU2mePky5yMhCvQ8JMrBVBdbv/woNj4z7wB1h4j77lUUtjwOkzGtYGWS29zYF7TBoZL4nJNVDU3Z16zfnCHu59POj6LVMGYMN1L9n2AvQWPbXv0wocD/NOohd/IFP6l/CCwOOfpx9Vhztf0RIxbSXX8zj6kaGWQ1X/dPpDWGUaWWWwxn4lnzphOJg+8akgsXyqQb3YnxpG0x26B1hbCSiBysQ40twx3/VPa4jhHwnIKnqSZOWORH+kIcG3mXABr5yLg3VurUTGvNwgutYaDjHIUlZoj1cjmF4XuoXTKvSibbXpJf9F0W778p5gssXy7I1V1YlCmxCgYvj2+FhezlBdwXxO3dNwHXt/0R8dRRgMDr37uPwSFg07AawAtR082K9Wk/q2jRYStakFFKex/S5IhsxaVnMCklUTGRz+C7IDNaFtC6NMqkwQV8yArI6NM= ceph-0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:01.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA6GhyAhnrgEkR0CdQ4aH2IyqsYbH1EaLz6r10hBwALI/vdWOe/GsJIgK/m6FHWPKoqU2mePky5yMhCvQ8JMrBVBdbv/woNj4z7wB1h4j77lUUtjwOkzGtYGWS29zYF7TBoZL4nJNVDU3Z16zfnCHu59POj6LVMGYMN1L9n2AvQWPbXv0wocD/NOohd/IFP6l/CCwOOfpx9Vhztf0RIxbSXX8zj6kaGWQ1X/dPpDWGUaWWWwxn4lnzphOJg+8akgsXyqQb3YnxpG0x26B1hbCSiBysQ40twx3/VPa4jhHwnIKnqSZOWORH+kIcG3mXABr5yLg3VurUTGvNwgutYaDjHIUlZoj1cjmF4XuoXTKvSibbXpJf9F0W778p5gssXy7I1V1YlCmxCgYvj2+FhezlBdwXxO3dNwHXt/0R8dRRgMDr37uPwSFg07AawAtR082K9Wk/q2jRYStakFFKex/S5IhsxaVnMCklUTGRz+C7IDNaFtC6NMqkwQV8yArI6NM= ceph-0df4af84-6f5f-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T10:28:02.006 INFO:teuthology.orchestra.run.smithi121.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDA6GhyAhnrgEkR0CdQ4aH2IyqsYbH1EaLz6r10hBwALI/vdWOe/GsJIgK/m6FHWPKoqU2mePky5yMhCvQ8JMrBVBdbv/woNj4z7wB1h4j77lUUtjwOkzGtYGWS29zYF7TBoZL4nJNVDU3Z16zfnCHu59POj6LVMGYMN1L9n2AvQWPbXv0wocD/NOohd/IFP6l/CCwOOfpx9Vhztf0RIxbSXX8zj6kaGWQ1X/dPpDWGUaWWWwxn4lnzphOJg+8akgsXyqQb3YnxpG0x26B1hbCSiBysQ40twx3/VPa4jhHwnIKnqSZOWORH+kIcG3mXABr5yLg3VurUTGvNwgutYaDjHIUlZoj1cjmF4XuoXTKvSibbXpJf9F0W778p5gssXy7I1V1YlCmxCgYvj2+FhezlBdwXxO3dNwHXt/0R8dRRgMDr37uPwSFg07AawAtR082K9Wk/q2jRYStakFFKex/S5IhsxaVnMCklUTGRz+C7IDNaFtC6NMqkwQV8yArI6NM= ceph-0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:02.019 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T10:28:02.263 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.734+0000 7f40b48b5640 1 -- 172.21.15.92:0/4183087066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 msgr2=0x7f40b0100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.734+0000 7f40b48b5640 1 --2- 172.21.15.92:0/4183087066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 0x7f40b0100910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009880 tx=0x7f40a002a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:02.763 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.735+0000 7f40b48b5640 1 -- 172.21.15.92:0/4183087066 shutdown_connections 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.735+0000 7f40b48b5640 1 --2- 172.21.15.92:0/4183087066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 0x7f40b0100910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.735+0000 7f40b48b5640 1 -- 172.21.15.92:0/4183087066 >> 172.21.15.92:0/4183087066 conn(0x7f40b00fbc80 msgr2=0x7f40b00fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.735+0000 7f40b48b5640 1 -- 172.21.15.92:0/4183087066 shutdown_connections 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.735+0000 7f40b48b5640 1 -- 172.21.15.92:0/4183087066 wait complete. 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.735+0000 7f40b48b5640 1 Processor -- start 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.735+0000 7f40b48b5640 1 -- start start 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f40b48b5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 0x7f40b0196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f40b48b5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f40b0106620 con 0x7f40b0100510 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f40ae59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 0x7f40b0196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f40ae59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 0x7f40b0196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36900/0 (socket says 172.21.15.92:36900) 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f40ae59c640 1 -- 172.21.15.92:0/2020194544 learned_addr learned my addr 172.21.15.92:0/2020194544 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f40ae59c640 1 -- 172.21.15.92:0/2020194544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b01972e0 con 0x7f40b0100510 2024-09-10T10:28:02.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f40ae59c640 1 --2- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 0x7f40b0196da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40a0004f60 tx=0x7f40a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f409f7fe640 1 -- 172.21.15.92:0/2020194544 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a003f070 con 0x7f40b0100510 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f409f7fe640 1 -- 172.21.15.92:0/2020194544 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40a0004d40 con 0x7f40b0100510 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f409f7fe640 1 -- 172.21.15.92:0/2020194544 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a0035030 con 0x7f40b0100510 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b0197570 con 0x7f40b0100510 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.736+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b019a220 con 0x7f40b0100510 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.737+0000 7f409f7fe640 1 -- 172.21.15.92:0/2020194544 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f40a0042070 con 0x7f40b0100510 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.737+0000 7f409f7fe640 1 --2- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4098039060 0x7f409803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.737+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b0106da0 con 0x7f40b0100510 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.737+0000 7f409f7fe640 1 -- 172.21.15.92:0/2020194544 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f40a006cd10 con 0x7f40b0100510 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.737+0000 7f40add9b640 1 --2- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4098039060 0x7f409803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.738+0000 7f40add9b640 1 --2- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4098039060 0x7f409803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f40a40098c0 tx=0x7f40a4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:02.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.742+0000 7f409f7fe640 1 -- 172.21.15.92:0/2020194544 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40a004a260 con 0x7f40b0100510 2024-09-10T10:28:02.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.910+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f40b002d8d0 con 0x7f40b0100510 2024-09-10T10:28:02.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.912+0000 7f409f7fe640 1 -- 172.21.15.92:0/2020194544 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f40a006b6e0 con 0x7f40b0100510 2024-09-10T10:28:02.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4098039060 msgr2=0x7f409803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:02.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 --2- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4098039060 0x7f409803b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f40a40098c0 tx=0x7f40a4006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:02.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 msgr2=0x7f40b0196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:02.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 --2- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 0x7f40b0196da0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40a0004f60 tx=0x7f40a00048f0 comp rx=0 tx=0).stop 2024-09-10T10:28:02.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 shutdown_connections 2024-09-10T10:28:02.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 --2- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4098039060 0x7f409803b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:02.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 --2- 172.21.15.92:0/2020194544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40b0100510 0x7f40b0196da0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:02.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 >> 172.21.15.92:0/2020194544 conn(0x7f40b00fbc80 msgr2=0x7f40b006a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:02.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 shutdown_connections 2024-09-10T10:28:02.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:02.915+0000 7f40b48b5640 1 -- 172.21.15.92:0/2020194544 wait complete. 2024-09-10T10:28:03.934 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T10:28:03.934 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T10:28:04.157 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:03 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2020194544' entity='client.admin' 2024-09-10T10:28:04.383 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:04.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.830+0000 7f001412a640 1 -- 172.21.15.92:0/2845000675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 msgr2=0x7f000c104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.830+0000 7f001412a640 1 --2- 172.21.15.92:0/2845000675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 0x7f000c104520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0008009c20 tx=0x7f000802aa90 comp rx=0 tx=0).stop 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.830+0000 7f001412a640 1 -- 172.21.15.92:0/2845000675 shutdown_connections 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.830+0000 7f001412a640 1 --2- 172.21.15.92:0/2845000675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 0x7f000c104520 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.830+0000 7f001412a640 1 -- 172.21.15.92:0/2845000675 >> 172.21.15.92:0/2845000675 conn(0x7f000c0fbc90 msgr2=0x7f000c0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.830+0000 7f001412a640 1 -- 172.21.15.92:0/2845000675 shutdown_connections 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.830+0000 7f001412a640 1 -- 172.21.15.92:0/2845000675 wait complete. 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.831+0000 7f001412a640 1 Processor -- start 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.831+0000 7f001412a640 1 -- start start 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.831+0000 7f001412a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 0x7f000c196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.831+0000 7f001412a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f000c107700 con 0x7f000c102130 2024-09-10T10:28:04.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.831+0000 7f0011ec6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 0x7f000c196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.831+0000 7f0011ec6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 0x7f000c196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36920/0 (socket says 172.21.15.92:36920) 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.831+0000 7f0011ec6640 1 -- 172.21.15.92:0/359169584 learned_addr learned my addr 172.21.15.92:0/359169584 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.831+0000 7f0011ec6640 1 -- 172.21.15.92:0/359169584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c197290 con 0x7f000c102130 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.832+0000 7f0011ec6640 1 --2- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 0x7f000c196d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0008006010 tx=0x7f000802e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.832+0000 7f0002ffd640 1 -- 172.21.15.92:0/359169584 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0008047070 con 0x7f000c102130 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.832+0000 7f0002ffd640 1 -- 172.21.15.92:0/359169584 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0008003e50 con 0x7f000c102130 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.832+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c197520 con 0x7f000c102130 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.832+0000 7f0002ffd640 1 -- 172.21.15.92:0/359169584 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0008033050 con 0x7f000c102130 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.832+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c19a210 con 0x7f000c102130 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.833+0000 7f0002ffd640 1 -- 172.21.15.92:0/359169584 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f000804a070 con 0x7f000c102130 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.833+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c107e80 con 0x7f000c102130 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.833+0000 7f0002ffd640 1 --2- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efff8039060 0x7efff803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:04.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.833+0000 7f0002ffd640 1 -- 172.21.15.92:0/359169584 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f000803e030 con 0x7f000c102130 2024-09-10T10:28:04.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.833+0000 7f00116c5640 1 --2- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efff8039060 0x7efff803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:04.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.834+0000 7f00116c5640 1 --2- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efff8039060 0x7efff803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efffc0098c0 tx=0x7efffc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:04.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:04.838+0000 7f0002ffd640 1 -- 172.21.15.92:0/359169584 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00080373b0 con 0x7f000c102130 2024-09-10T10:28:05.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.020+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f000c02d8a0 con 0x7efff8039060 2024-09-10T10:28:05.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.024+0000 7f0002ffd640 1 -- 172.21.15.92:0/359169584 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f000c02d8a0 con 0x7efff8039060 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efff8039060 msgr2=0x7efff803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 --2- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efff8039060 0x7efff803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efffc0098c0 tx=0x7efffc006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 msgr2=0x7f000c196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 --2- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 0x7f000c196d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0008006010 tx=0x7f000802e3c0 comp rx=0 tx=0).stop 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 shutdown_connections 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 --2- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efff8039060 0x7efff803b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 --2- 172.21.15.92:0/359169584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f000c102130 0x7f000c196d50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 >> 172.21.15.92:0/359169584 conn(0x7f000c0fbc90 msgr2=0x7f000c0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 shutdown_connections 2024-09-10T10:28:05.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:05.026+0000 7f001412a640 1 -- 172.21.15.92:0/359169584 wait complete. 2024-09-10T10:28:05.652 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi097 2024-09-10T10:28:05.652 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:28:05.652 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/etc/ceph/ceph.conf 2024-09-10T10:28:05.672 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:28:05.672 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:05.731 INFO:tasks.cephadm:Adding host smithi097 to orchestrator... 2024-09-10T10:28:05.731 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch host add smithi097 2024-09-10T10:28:06.056 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:06.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:06 smithi092 ceph-mon[30834]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:06.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:06 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:06.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 -- 172.21.15.92:0/958698728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 msgr2=0x7f0e20104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 --2- 172.21.15.92:0/958698728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 0x7f0e20104520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009880 tx=0x7f0e1c02a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 -- 172.21.15.92:0/958698728 shutdown_connections 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 --2- 172.21.15.92:0/958698728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 0x7f0e20104520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 -- 172.21.15.92:0/958698728 >> 172.21.15.92:0/958698728 conn(0x7f0e200fbcd0 msgr2=0x7f0e200fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 -- 172.21.15.92:0/958698728 shutdown_connections 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 -- 172.21.15.92:0/958698728 wait complete. 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 Processor -- start 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 -- start start 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 0x7f0e20196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.583+0000 7f0e28430640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201076e0 con 0x7f0e20102130 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e261cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 0x7f0e20196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:06.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e261cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 0x7f0e20196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36926/0 (socket says 172.21.15.92:36926) 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e261cc640 1 -- 172.21.15.92:0/4180613759 learned_addr learned my addr 172.21.15.92:0/4180613759 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e261cc640 1 -- 172.21.15.92:0/4180613759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e201972e0 con 0x7f0e20102130 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e261cc640 1 --2- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 0x7f0e20196da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c004f60 tx=0x7f0e1c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e177fe640 1 -- 172.21.15.92:0/4180613759 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e1c03f070 con 0x7f0e20102130 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e177fe640 1 -- 172.21.15.92:0/4180613759 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1c003ad0 con 0x7f0e20102130 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e20197570 con 0x7f0e20102130 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e177fe640 1 -- 172.21.15.92:0/4180613759 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e1c035030 con 0x7f0e20102130 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.584+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2019a220 con 0x7f0e20102130 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.585+0000 7f0e177fe640 1 -- 172.21.15.92:0/4180613759 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f0e1c042070 con 0x7f0e20102130 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.585+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e20107e60 con 0x7f0e20102130 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.585+0000 7f0e177fe640 1 --2- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0e0c0390c0 0x7f0e0c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.585+0000 7f0e177fe640 1 -- 172.21.15.92:0/4180613759 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0e1c06cda0 con 0x7f0e20102130 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.586+0000 7f0e259cb640 1 --2- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0e0c0390c0 0x7f0e0c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:06.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.586+0000 7f0e259cb640 1 --2- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0e0c0390c0 0x7f0e0c03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e100098c0 tx=0x7f0e10006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:06.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.591+0000 7f0e177fe640 1 -- 172.21.15.92:0/4180613759 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e1c04c350 con 0x7f0e20102130 2024-09-10T10:28:06.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:06.771+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi097", "target": ["mon-mgr", ""]}) -- 0x7f0e2002d8a0 con 0x7f0e0c0390c0 2024-09-10T10:28:07.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:07.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:08.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:08 smithi092 ceph-mon[30834]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:08.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:08 smithi092 ceph-mon[30834]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:28:08.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:08 smithi092 ceph-mon[30834]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi097", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:09.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:09 smithi092 ceph-mon[30834]: Deploying cephadm binary to smithi097 2024-09-10T10:28:09.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.987+0000 7f0e177fe640 1 -- 172.21.15.92:0/4180613759 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f0e2002d8a0 con 0x7f0e0c0390c0 2024-09-10T10:28:09.989 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi097' with addr '172.21.15.97' 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0e0c0390c0 msgr2=0x7f0e0c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 --2- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0e0c0390c0 0x7f0e0c03b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e100098c0 tx=0x7f0e10006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 msgr2=0x7f0e20196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 --2- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 0x7f0e20196da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c004f60 tx=0x7f0e1c0048f0 comp rx=0 tx=0).stop 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 shutdown_connections 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 --2- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0e0c0390c0 0x7f0e0c03b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 --2- 172.21.15.92:0/4180613759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e20102130 0x7f0e20196da0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 >> 172.21.15.92:0/4180613759 conn(0x7f0e200fbcd0 msgr2=0x7f0e200fc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 shutdown_connections 2024-09-10T10:28:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:09.989+0000 7f0e28430640 1 -- 172.21.15.92:0/4180613759 wait complete. 2024-09-10T10:28:10.605 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T10:28:10.841 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:11.272 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:11.272 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:10 smithi092 ceph-mon[30834]: Added host smithi097 2024-09-10T10:28:11.272 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:11.272 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:11.272 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:11.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.274+0000 7f91eb09b640 1 -- 172.21.15.92:0/647641215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 msgr2=0x7f91e4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:11.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.274+0000 7f91eb09b640 1 --2- 172.21.15.92:0/647641215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 0x7f91e4107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009880 tx=0x7f91d402a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:11.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.274+0000 7f91eb09b640 1 -- 172.21.15.92:0/647641215 shutdown_connections 2024-09-10T10:28:11.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.274+0000 7f91eb09b640 1 --2- 172.21.15.92:0/647641215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 0x7f91e4107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:11.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.274+0000 7f91eb09b640 1 -- 172.21.15.92:0/647641215 >> 172.21.15.92:0/647641215 conn(0x7f91e40fd290 msgr2=0x7f91e40ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:11.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.274+0000 7f91eb09b640 1 -- 172.21.15.92:0/647641215 shutdown_connections 2024-09-10T10:28:11.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.274+0000 7f91eb09b640 1 -- 172.21.15.92:0/647641215 wait complete. 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.275+0000 7f91eb09b640 1 Processor -- start 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.275+0000 7f91eb09b640 1 -- start start 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.275+0000 7f91eb09b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 0x7f91e41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.275+0000 7f91eb09b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f91e410bc90 con 0x7f91e4107660 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.275+0000 7f91e8e37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 0x7f91e41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.275+0000 7f91e8e37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 0x7f91e41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36940/0 (socket says 172.21.15.92:36940) 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.275+0000 7f91e8e37640 1 -- 172.21.15.92:0/1898968800 learned_addr learned my addr 172.21.15.92:0/1898968800 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.276+0000 7f91e8e37640 1 -- 172.21.15.92:0/1898968800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e4199830 con 0x7f91e4107660 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.276+0000 7f91e8e37640 1 --2- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 0x7f91e41992f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009230 tx=0x7f91d4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.276+0000 7f91e1ffb640 1 -- 172.21.15.92:0/1898968800 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91d403f070 con 0x7f91e4107660 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.276+0000 7f91e1ffb640 1 -- 172.21.15.92:0/1898968800 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d403bc80 con 0x7f91e4107660 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.276+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e4199ac0 con 0x7f91e4107660 2024-09-10T10:28:11.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.276+0000 7f91e1ffb640 1 -- 172.21.15.92:0/1898968800 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91d4035030 con 0x7f91e4107660 2024-09-10T10:28:11.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.276+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e419dbc0 con 0x7f91e4107660 2024-09-10T10:28:11.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.277+0000 7f91e1ffb640 1 -- 172.21.15.92:0/1898968800 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f91d4042070 con 0x7f91e4107660 2024-09-10T10:28:11.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.277+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e4102cd0 con 0x7f91e4107660 2024-09-10T10:28:11.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.277+0000 7f91e1ffb640 1 --2- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91cc039060 0x7f91cc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:11.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.277+0000 7f91e1ffb640 1 -- 172.21.15.92:0/1898968800 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f91d406cce0 con 0x7f91e4107660 2024-09-10T10:28:11.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.277+0000 7f91e3fff640 1 --2- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91cc039060 0x7f91cc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:11.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.278+0000 7f91e3fff640 1 --2- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91cc039060 0x7f91cc03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f91d80098c0 tx=0x7f91d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:11.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.282+0000 7f91e1ffb640 1 -- 172.21.15.92:0/1898968800 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f91d4031e20 con 0x7f91e4107660 2024-09-10T10:28:11.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.455+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91e419a650 con 0x7f91cc039060 2024-09-10T10:28:11.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.456+0000 7f91e1ffb640 1 -- 172.21.15.92:0/1898968800 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f91e419a650 con 0x7f91cc039060 2024-09-10T10:28:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:11.458 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.97", "hostname": "smithi097", "labels": [], "status": ""}] 2024-09-10T10:28:11.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.458+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91cc039060 msgr2=0x7f91cc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:11.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.458+0000 7f91eb09b640 1 --2- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91cc039060 0x7f91cc03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f91d80098c0 tx=0x7f91d8006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:11.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.458+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 msgr2=0x7f91e41992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:11.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.458+0000 7f91eb09b640 1 --2- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 0x7f91e41992f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009230 tx=0x7f91d4003d40 comp rx=0 tx=0).stop 2024-09-10T10:28:11.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.458+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 shutdown_connections 2024-09-10T10:28:11.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.458+0000 7f91eb09b640 1 --2- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91cc039060 0x7f91cc03b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:11.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.458+0000 7f91eb09b640 1 --2- 172.21.15.92:0/1898968800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91e4107660 0x7f91e41992f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:11.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.458+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 >> 172.21.15.92:0/1898968800 conn(0x7f91e40fd290 msgr2=0x7f91e4075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:11.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.459+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 shutdown_connections 2024-09-10T10:28:11.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:11.459+0000 7f91eb09b640 1 -- 172.21.15.92:0/1898968800 wait complete. 2024-09-10T10:28:12.028 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi121 2024-09-10T10:28:12.029 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:28:12.029 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.conf 2024-09-10T10:28:12.047 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:28:12.048 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:12.105 INFO:tasks.cephadm:Adding host smithi121 to orchestrator... 2024-09-10T10:28:12.106 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch host add smithi121 2024-09-10T10:28:12.343 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:12.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:12 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:12.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:12 smithi092 ceph-mon[30834]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:28:12.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.766+0000 7f32b59f2640 1 -- 172.21.15.92:0/288810991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 msgr2=0x7f32b0106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:12.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.766+0000 7f32b59f2640 1 --2- 172.21.15.92:0/288810991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 0x7f32b0106940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009880 tx=0x7f32a002a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:12.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.766+0000 7f32b59f2640 1 -- 172.21.15.92:0/288810991 shutdown_connections 2024-09-10T10:28:12.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.766+0000 7f32b59f2640 1 --2- 172.21.15.92:0/288810991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 0x7f32b0106940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:12.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.766+0000 7f32b59f2640 1 -- 172.21.15.92:0/288810991 >> 172.21.15.92:0/288810991 conn(0x7f32b00fc1b0 msgr2=0x7f32b00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:12.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.766+0000 7f32b59f2640 1 -- 172.21.15.92:0/288810991 shutdown_connections 2024-09-10T10:28:12.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.766+0000 7f32b59f2640 1 -- 172.21.15.92:0/288810991 wait complete. 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.766+0000 7f32b59f2640 1 Processor -- start 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.766+0000 7f32b59f2640 1 -- start start 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32b59f2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 0x7f32b0197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32b59f2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32b010ab90 con 0x7f32b0106560 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32aeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 0x7f32b0197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32aeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 0x7f32b0197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34862/0 (socket says 172.21.15.92:34862) 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32aeffd640 1 -- 172.21.15.92:0/3374761499 learned_addr learned my addr 172.21.15.92:0/3374761499 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32aeffd640 1 -- 172.21.15.92:0/3374761499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b0198500 con 0x7f32b0106560 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32aeffd640 1 --2- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 0x7f32b0197fc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009230 tx=0x7f32a0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32b49f0640 1 -- 172.21.15.92:0/3374761499 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a003f070 con 0x7f32b0106560 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32b49f0640 1 -- 172.21.15.92:0/3374761499 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32a003bc80 con 0x7f32b0106560 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.767+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b0198790 con 0x7f32b0106560 2024-09-10T10:28:12.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.768+0000 7f32b49f0640 1 -- 172.21.15.92:0/3374761499 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32a0035030 con 0x7f32b0106560 2024-09-10T10:28:12.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.768+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b0198bf0 con 0x7f32b0106560 2024-09-10T10:28:12.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.768+0000 7f32b49f0640 1 -- 172.21.15.92:0/3374761499 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f32a0042070 con 0x7f32b0106560 2024-09-10T10:28:12.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.769+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b0101bd0 con 0x7f32b0106560 2024-09-10T10:28:12.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.769+0000 7f32b49f0640 1 --2- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f329c0390c0 0x7f329c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:12.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.769+0000 7f32b49f0640 1 -- 172.21.15.92:0/3374761499 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f32a006cd50 con 0x7f32b0106560 2024-09-10T10:28:12.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.769+0000 7f32a67fc640 1 --2- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f329c0390c0 0x7f329c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:12.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.769+0000 7f32a67fc640 1 --2- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f329c0390c0 0x7f329c03b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f32980098c0 tx=0x7f3298006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:12.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.773+0000 7f32b49f0640 1 -- 172.21.15.92:0/3374761499 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32a0042bf0 con 0x7f32b0106560 2024-09-10T10:28:12.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:12.946+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}) -- 0x7f32b01069c0 con 0x7f329c0390c0 2024-09-10T10:28:13.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:13 smithi092 ceph-mon[30834]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:15.353 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: Deploying cephadm binary to smithi121 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi097", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: Updating smithi097:/etc/ceph/ceph.conf 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:15.354 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:14 smithi092 ceph-mon[30834]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:16.105 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi121' with addr '172.21.15.121' 2024-09-10T10:28:16.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.103+0000 7f32b49f0640 1 -- 172.21.15.92:0/3374761499 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f32b01069c0 con 0x7f329c0390c0 2024-09-10T10:28:16.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f329c0390c0 msgr2=0x7f329c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:16.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 --2- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f329c0390c0 0x7f329c03b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f32980098c0 tx=0x7f3298006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:16.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 msgr2=0x7f32b0197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:16.107 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 --2- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 0x7f32b0197fc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009230 tx=0x7f32a0003d40 comp rx=0 tx=0).stop 2024-09-10T10:28:16.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 shutdown_connections 2024-09-10T10:28:16.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 --2- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f329c0390c0 0x7f329c03b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:16.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 --2- 172.21.15.92:0/3374761499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32b0106560 0x7f32b0197fc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:16.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 >> 172.21.15.92:0/3374761499 conn(0x7f32b00fc1b0 msgr2=0x7f32b00fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:16.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 shutdown_connections 2024-09-10T10:28:16.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:16.106+0000 7f32b59f2640 1 -- 172.21.15.92:0/3374761499 wait complete. 2024-09-10T10:28:16.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:15 smithi092 ceph-mon[30834]: Updating smithi097:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:16.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:15 smithi092 ceph-mon[30834]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:28:16.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:15 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:16.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:15 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:16.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:15 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:16.724 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T10:28:16.963 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:17.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:17 smithi092 ceph-mon[30834]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:17.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:17.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:17 smithi092 ceph-mon[30834]: Added host smithi121 2024-09-10T10:28:17.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:17.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:17.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.420+0000 7f11951e3640 1 -- 172.21.15.92:0/3184545182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 msgr2=0x7f1190102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.420+0000 7f11951e3640 1 --2- 172.21.15.92:0/3184545182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 0x7f1190102bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1180009810 tx=0x7f118002a540 comp rx=0 tx=0).stop 2024-09-10T10:28:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.421+0000 7f11951e3640 1 -- 172.21.15.92:0/3184545182 shutdown_connections 2024-09-10T10:28:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.421+0000 7f11951e3640 1 --2- 172.21.15.92:0/3184545182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 0x7f1190102bd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.421+0000 7f11951e3640 1 -- 172.21.15.92:0/3184545182 >> 172.21.15.92:0/3184545182 conn(0x7f1190077310 msgr2=0x7f11900fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:17.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.421+0000 7f11951e3640 1 -- 172.21.15.92:0/3184545182 shutdown_connections 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.421+0000 7f11951e3640 1 -- 172.21.15.92:0/3184545182 wait complete. 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.421+0000 7f11951e3640 1 Processor -- start 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.421+0000 7f11951e3640 1 -- start start 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f11951e3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 0x7f1190100450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f11951e3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f119010bc80 con 0x7f11901027f0 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f118ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 0x7f1190100450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f118ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 0x7f1190100450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34878/0 (socket says 172.21.15.92:34878) 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f118ed9d640 1 -- 172.21.15.92:0/2100436981 learned_addr learned my addr 172.21.15.92:0/2100436981 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f118ed9d640 1 -- 172.21.15.92:0/2100436981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1190102340 con 0x7f11901027f0 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f118ed9d640 1 --2- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 0x7f1190100450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1180009930 tx=0x7f1180004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f118cd99640 1 -- 172.21.15.92:0/2100436981 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1180031400 con 0x7f11901027f0 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1190100990 con 0x7f11901027f0 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f118cd99640 1 -- 172.21.15.92:0/2100436981 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11800035f0 con 0x7f11901027f0 2024-09-10T10:28:17.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f118cd99640 1 -- 172.21.15.92:0/2100436981 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f118003c440 con 0x7f11901027f0 2024-09-10T10:28:17.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.422+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1190100e50 con 0x7f11901027f0 2024-09-10T10:28:17.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.423+0000 7f118cd99640 1 -- 172.21.15.92:0/2100436981 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1180039040 con 0x7f11901027f0 2024-09-10T10:28:17.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.424+0000 7f118cd99640 1 --2- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f117c039060 0x7f117c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:17.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.424+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1190069ed0 con 0x7f11901027f0 2024-09-10T10:28:17.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.424+0000 7f118cd99640 1 -- 172.21.15.92:0/2100436981 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f118006d690 con 0x7f11901027f0 2024-09-10T10:28:17.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.424+0000 7f118659c640 1 --2- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f117c039060 0x7f117c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:17.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.424+0000 7f118659c640 1 --2- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f117c039060 0x7f117c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f11780098c0 tx=0x7f1178006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:17.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.428+0000 7f118cd99640 1 -- 172.21.15.92:0/2100436981 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1180040030 con 0x7f11901027f0 2024-09-10T10:28:17.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.601+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1190101980 con 0x7f117c039060 2024-09-10T10:28:17.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.602+0000 7f118cd99640 1 -- 172.21.15.92:0/2100436981 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f1190101980 con 0x7f117c039060 2024-09-10T10:28:17.604 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:17.604 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.97", "hostname": "smithi097", "labels": [], "status": ""}, {"addr": "172.21.15.121", "hostname": "smithi121", "labels": [], "status": ""}] 2024-09-10T10:28:17.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f117c039060 msgr2=0x7f117c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:17.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 --2- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f117c039060 0x7f117c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f11780098c0 tx=0x7f1178006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:17.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 msgr2=0x7f1190100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:17.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 --2- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 0x7f1190100450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1180009930 tx=0x7f1180004570 comp rx=0 tx=0).stop 2024-09-10T10:28:17.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 shutdown_connections 2024-09-10T10:28:17.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 --2- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f117c039060 0x7f117c03b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:17.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 --2- 172.21.15.92:0/2100436981 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11901027f0 0x7f1190100450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:17.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 >> 172.21.15.92:0/2100436981 conn(0x7f1190077310 msgr2=0x7f1190105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:17.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 shutdown_connections 2024-09-10T10:28:17.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:17.605+0000 7f11951e3640 1 -- 172.21.15.92:0/2100436981 wait complete. 2024-09-10T10:28:18.174 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T10:28:18.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T10:28:18.420 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:18.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:18 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:18.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:18 smithi092 ceph-mon[30834]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:28:18.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:18 smithi092 ceph-mon[30834]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:18.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.864+0000 7efd68698640 1 -- 172.21.15.92:0/220396279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 msgr2=0x7efd60107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:18.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.864+0000 7efd68698640 1 --2- 172.21.15.92:0/220396279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 0x7efd60107a30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009880 tx=0x7efd5c02a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:18.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.864+0000 7efd68698640 1 -- 172.21.15.92:0/220396279 shutdown_connections 2024-09-10T10:28:18.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.864+0000 7efd68698640 1 --2- 172.21.15.92:0/220396279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 0x7efd60107a30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:18.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.864+0000 7efd68698640 1 -- 172.21.15.92:0/220396279 >> 172.21.15.92:0/220396279 conn(0x7efd600fd2a0 msgr2=0x7efd600ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:18.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.865+0000 7efd68698640 1 -- 172.21.15.92:0/220396279 shutdown_connections 2024-09-10T10:28:18.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.865+0000 7efd68698640 1 -- 172.21.15.92:0/220396279 wait complete. 2024-09-10T10:28:18.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.866+0000 7efd68698640 1 Processor -- start 2024-09-10T10:28:18.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.866+0000 7efd68698640 1 -- start start 2024-09-10T10:28:18.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.866+0000 7efd68698640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 0x7efd601970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:18.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.866+0000 7efd68698640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd6010bc60 con 0x7efd60107650 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.866+0000 7efd66434640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 0x7efd601970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.866+0000 7efd66434640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 0x7efd601970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34894/0 (socket says 172.21.15.92:34894) 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.866+0000 7efd66434640 1 -- 172.21.15.92:0/673474912 learned_addr learned my addr 172.21.15.92:0/673474912 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.867+0000 7efd66434640 1 -- 172.21.15.92:0/673474912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd601975f0 con 0x7efd60107650 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.867+0000 7efd66434640 1 --2- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 0x7efd601970b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009230 tx=0x7efd5c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.867+0000 7efd577fe640 1 -- 172.21.15.92:0/673474912 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd5c03f070 con 0x7efd60107650 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.867+0000 7efd577fe640 1 -- 172.21.15.92:0/673474912 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd5c03bc80 con 0x7efd60107650 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.867+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd601978e0 con 0x7efd60107650 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.867+0000 7efd577fe640 1 -- 172.21.15.92:0/673474912 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd5c035030 con 0x7efd60107650 2024-09-10T10:28:18.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.867+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd6019b980 con 0x7efd60107650 2024-09-10T10:28:18.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.868+0000 7efd577fe640 1 -- 172.21.15.92:0/673474912 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efd5c042070 con 0x7efd60107650 2024-09-10T10:28:18.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.868+0000 7efd577fe640 1 --2- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd4c039060 0x7efd4c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:18.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.868+0000 7efd577fe640 1 -- 172.21.15.92:0/673474912 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efd5c06dbc0 con 0x7efd60107650 2024-09-10T10:28:18.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.868+0000 7efd65c33640 1 --2- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd4c039060 0x7efd4c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:18.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.868+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd60102d00 con 0x7efd60107650 2024-09-10T10:28:18.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.869+0000 7efd65c33640 1 --2- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd4c039060 0x7efd4c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efd500098c0 tx=0x7efd50006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:18.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:18.873+0000 7efd577fe640 1 -- 172.21.15.92:0/673474912 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd5c04c350 con 0x7efd60107650 2024-09-10T10:28:19.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.049+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7efd60198410 con 0x7efd60107650 2024-09-10T10:28:19.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.454+0000 7efd577fe640 1 -- 172.21.15.92:0/673474912 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7efd5c0314c0 con 0x7efd60107650 2024-09-10T10:28:19.455 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd4c039060 msgr2=0x7efd4c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 --2- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd4c039060 0x7efd4c03b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efd500098c0 tx=0x7efd50006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 msgr2=0x7efd601970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 --2- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 0x7efd601970b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009230 tx=0x7efd5c003d40 comp rx=0 tx=0).stop 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 shutdown_connections 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 --2- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd4c039060 0x7efd4c03b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 --2- 172.21.15.92:0/673474912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd60107650 0x7efd601970b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 >> 172.21.15.92:0/673474912 conn(0x7efd600fd2a0 msgr2=0x7efd600feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 shutdown_connections 2024-09-10T10:28:19.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:19.456+0000 7efd68698640 1 -- 172.21.15.92:0/673474912 wait complete. 2024-09-10T10:28:19.761 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:19 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/673474912' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T10:28:20.060 INFO:tasks.cephadm:Adding mon.a on smithi092 2024-09-10T10:28:20.060 INFO:tasks.cephadm:Adding mon.b on smithi097 2024-09-10T10:28:20.060 INFO:tasks.cephadm:Adding mon.c on smithi121 2024-09-10T10:28:20.060 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi092:172.21.15.92=a;smithi097:172.21.15.97=b;smithi121:172.21.15.121=c' 2024-09-10T10:28:20.332 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T10:28:20.378 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T10:28:20.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.831+0000 7f29c5866640 1 -- 172.21.15.121:0/997644372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 msgr2=0x7f29c0100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:20.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.831+0000 7f29c5866640 1 --2- 172.21.15.121:0/997644372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 0x7f29c0100910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009880 tx=0x7f29b002a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:20.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.831+0000 7f29c5866640 1 -- 172.21.15.121:0/997644372 shutdown_connections 2024-09-10T10:28:20.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.831+0000 7f29c5866640 1 --2- 172.21.15.121:0/997644372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 0x7f29c0100910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:20.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.831+0000 7f29c5866640 1 -- 172.21.15.121:0/997644372 >> 172.21.15.121:0/997644372 conn(0x7f29c00fbca0 msgr2=0x7f29c00fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:20.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.831+0000 7f29c5866640 1 -- 172.21.15.121:0/997644372 shutdown_connections 2024-09-10T10:28:20.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.831+0000 7f29c5866640 1 -- 172.21.15.121:0/997644372 wait complete. 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.832+0000 7f29c5866640 1 Processor -- start 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.832+0000 7f29c5866640 1 -- start start 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.832+0000 7f29c5866640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 0x7f29c0195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.832+0000 7f29c5866640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0106620 con 0x7f29c0100510 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.832+0000 7f29beffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 0x7f29c0195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.833+0000 7f29beffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 0x7f29c0195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.121:38680/0 (socket says 172.21.15.121:38680) 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.833+0000 7f29beffd640 1 -- 172.21.15.121:0/1733108977 learned_addr learned my addr 172.21.15.121:0/1733108977 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.833+0000 7f29beffd640 1 -- 172.21.15.121:0/1733108977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c01961b0 con 0x7f29c0100510 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.833+0000 7f29beffd640 1 --2- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 0x7f29c0195c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f29b0004f60 tx=0x7f29b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.833+0000 7f29c4864640 1 -- 172.21.15.121:0/1733108977 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b003f070 con 0x7f29c0100510 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.833+0000 7f29c4864640 1 -- 172.21.15.121:0/1733108977 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29b0004d40 con 0x7f29c0100510 2024-09-10T10:28:20.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.833+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c0196440 con 0x7f29c0100510 2024-09-10T10:28:20.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.833+0000 7f29c4864640 1 -- 172.21.15.121:0/1733108977 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b0035030 con 0x7f29c0100510 2024-09-10T10:28:20.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.833+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c0199130 con 0x7f29c0100510 2024-09-10T10:28:20.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.834+0000 7f29c4864640 1 -- 172.21.15.121:0/1733108977 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f29b0042070 con 0x7f29c0100510 2024-09-10T10:28:20.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.834+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c0106da0 con 0x7f29c0100510 2024-09-10T10:28:20.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.834+0000 7f29c4864640 1 --2- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29a8039060 0x7f29a803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:20.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.834+0000 7f29c4864640 1 -- 172.21.15.121:0/1733108977 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f29b006cdd0 con 0x7f29c0100510 2024-09-10T10:28:20.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.835+0000 7f29be7fc640 1 --2- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29a8039060 0x7f29a803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:20.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.835+0000 7f29be7fc640 1 --2- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29a8039060 0x7f29a803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29b40098c0 tx=0x7f29b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:20.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:20.839+0000 7f29c4864640 1 -- 172.21.15.121:0/1733108977 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29b004a260 con 0x7f29c0100510 2024-09-10T10:28:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/673474912' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T10:28:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:20.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:20.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:20.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:28:20.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:20.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:20.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:20 smithi092 ceph-mon[30834]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-10T10:28:21.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.023+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi097:172.21.15.97=b;smithi121:172.21.15.121=c", "target": ["mon-mgr", ""]}) -- 0x7f29c002d830 con 0x7f29a8039060 2024-09-10T10:28:21.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.028+0000 7f29c4864640 1 -- 172.21.15.121:0/1733108977 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f29c002d830 con 0x7f29a8039060 2024-09-10T10:28:21.030 INFO:teuthology.orchestra.run.smithi121.stdout:Scheduled mon update... 2024-09-10T10:28:21.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.030+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29a8039060 msgr2=0x7f29a803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:21.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.030+0000 7f29c5866640 1 --2- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29a8039060 0x7f29a803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29b40098c0 tx=0x7f29b4006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:21.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.030+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 msgr2=0x7f29c0195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:21.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.030+0000 7f29c5866640 1 --2- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 0x7f29c0195c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f29b0004f60 tx=0x7f29b00048f0 comp rx=0 tx=0).stop 2024-09-10T10:28:21.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.031+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 shutdown_connections 2024-09-10T10:28:21.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.031+0000 7f29c5866640 1 --2- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29a8039060 0x7f29a803b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:21.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.031+0000 7f29c5866640 1 --2- 172.21.15.121:0/1733108977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29c0100510 0x7f29c0195c70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:21.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.031+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 >> 172.21.15.121:0/1733108977 conn(0x7f29c00fbca0 msgr2=0x7f29c00fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:21.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.031+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 shutdown_connections 2024-09-10T10:28:21.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:21.031+0000 7f29c5866640 1 -- 172.21.15.121:0/1733108977 wait complete. 2024-09-10T10:28:21.638 DEBUG:teuthology.orchestra.run.smithi097:mon.b> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T10:28:21.641 DEBUG:teuthology.orchestra.run.smithi121:mon.c> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T10:28:21.643 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:28:21.644 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:28:21.914 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:22.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi097:172.21.15.97=b;smithi121:172.21.15.121=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi097:172.21.15.97=b;smithi121:172.21.15.121=c;count:3 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:22.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T10:28:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:22.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:21 smithi092 ceph-mon[30834]: Reconfiguring daemon mon.a on smithi092 2024-09-10T10:28:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.320+0000 7fd50f8b0640 1 -- 172.21.15.121:0/645619503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 msgr2=0x7fd508106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.320+0000 7fd50f8b0640 1 --2- 172.21.15.121:0/645619503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 0x7fd508106940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd504009880 tx=0x7fd50402a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.320+0000 7fd50f8b0640 1 -- 172.21.15.121:0/645619503 shutdown_connections 2024-09-10T10:28:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.320+0000 7fd50f8b0640 1 --2- 172.21.15.121:0/645619503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 0x7fd508106940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.320+0000 7fd50f8b0640 1 -- 172.21.15.121:0/645619503 >> 172.21.15.121:0/645619503 conn(0x7fd5080fc1b0 msgr2=0x7fd5080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.320+0000 7fd50f8b0640 1 -- 172.21.15.121:0/645619503 shutdown_connections 2024-09-10T10:28:22.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.320+0000 7fd50f8b0640 1 -- 172.21.15.121:0/645619503 wait complete. 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.321+0000 7fd50f8b0640 1 Processor -- start 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.321+0000 7fd50f8b0640 1 -- start start 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.321+0000 7fd50f8b0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 0x7fd508197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.321+0000 7fd50f8b0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd50810ab90 con 0x7fd508106560 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.321+0000 7fd50d64c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 0x7fd508197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.321+0000 7fd50d64c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 0x7fd508197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.121:44282/0 (socket says 172.21.15.121:44282) 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.321+0000 7fd50d64c640 1 -- 172.21.15.121:0/575640894 learned_addr learned my addr 172.21.15.121:0/575640894 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.322+0000 7fd50d64c640 1 -- 172.21.15.121:0/575640894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd508198490 con 0x7fd508106560 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.322+0000 7fd50d64c640 1 --2- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 0x7fd508197f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd504009230 tx=0x7fd504003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.322+0000 7fd4fe7fc640 1 -- 172.21.15.121:0/575640894 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50403f070 con 0x7fd508106560 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.322+0000 7fd4fe7fc640 1 -- 172.21.15.121:0/575640894 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd50403bc80 con 0x7fd508106560 2024-09-10T10:28:22.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.322+0000 7fd4fe7fc640 1 -- 172.21.15.121:0/575640894 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd504035030 con 0x7fd508106560 2024-09-10T10:28:22.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.322+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd508198720 con 0x7fd508106560 2024-09-10T10:28:22.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.322+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd508198b80 con 0x7fd508106560 2024-09-10T10:28:22.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.323+0000 7fd4fe7fc640 1 -- 172.21.15.121:0/575640894 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd504042070 con 0x7fd508106560 2024-09-10T10:28:22.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.323+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd508101bd0 con 0x7fd508106560 2024-09-10T10:28:22.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.323+0000 7fd4fe7fc640 1 --2- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd4f4039060 0x7fd4f403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:22.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.323+0000 7fd4fe7fc640 1 -- 172.21.15.121:0/575640894 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd50406cda0 con 0x7fd508106560 2024-09-10T10:28:22.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.324+0000 7fd50ce4b640 1 --2- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd4f4039060 0x7fd4f403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:22.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.324+0000 7fd50ce4b640 1 --2- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd4f4039060 0x7fd4f403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80098c0 tx=0x7fd4f8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:22.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.328+0000 7fd4fe7fc640 1 -- 172.21.15.121:0/575640894 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd504031e20 con 0x7fd508106560 2024-09-10T10:28:22.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.564+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd5081069c0 con 0x7fd508106560 2024-09-10T10:28:22.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.564+0000 7fd4fe7fc640 1 -- 172.21.15.121:0/575640894 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fd5040372d0 con 0x7fd508106560 2024-09-10T10:28:22.567 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:28:22.567 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":1,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","modified":"2024-09-10T10:27:05.038412Z","created":"2024-09-10T10:27:05.038412Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T10:28:22.567 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 1 2024-09-10T10:28:22.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd4f4039060 msgr2=0x7fd4f403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:22.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 --2- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd4f4039060 0x7fd4f403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80098c0 tx=0x7fd4f8006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:22.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 msgr2=0x7fd508197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:22.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 --2- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 0x7fd508197f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd504009230 tx=0x7fd504003d40 comp rx=0 tx=0).stop 2024-09-10T10:28:22.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 shutdown_connections 2024-09-10T10:28:22.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 --2- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd4f4039060 0x7fd4f403b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:22.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 --2- 172.21.15.121:0/575640894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd508106560 0x7fd508197f50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:22.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 >> 172.21.15.121:0/575640894 conn(0x7fd5080fc1b0 msgr2=0x7fd5080fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:22.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 shutdown_connections 2024-09-10T10:28:22.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:22.567+0000 7fd50f8b0640 1 -- 172.21.15.121:0/575640894 wait complete. 2024-09-10T10:28:23.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:22 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/575640894' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:24.157 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:28:24.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:28:24.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:23 smithi092 ceph-mon[30834]: Deploying daemon mon.c on smithi121 2024-09-10T10:28:25.229 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:28:25.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:24 smithi092 ceph-mon[30834]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:25.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.817+0000 7fb449850640 1 -- 172.21.15.121:0/336138587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 msgr2=0x7fb444106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:25.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.817+0000 7fb449850640 1 --2- 172.21.15.121:0/336138587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 0x7fb444106a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb434009880 tx=0x7fb43402a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:25.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.817+0000 7fb449850640 1 -- 172.21.15.121:0/336138587 shutdown_connections 2024-09-10T10:28:25.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.817+0000 7fb449850640 1 --2- 172.21.15.121:0/336138587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 0x7fb444106a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:25.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.817+0000 7fb449850640 1 -- 172.21.15.121:0/336138587 >> 172.21.15.121:0/336138587 conn(0x7fb4440fc250 msgr2=0x7fb4440fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:25.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.817+0000 7fb449850640 1 -- 172.21.15.121:0/336138587 shutdown_connections 2024-09-10T10:28:25.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.817+0000 7fb449850640 1 -- 172.21.15.121:0/336138587 wait complete. 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.817+0000 7fb449850640 1 Processor -- start 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.818+0000 7fb449850640 1 -- start start 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.818+0000 7fb449850640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 0x7fb444196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.818+0000 7fb449850640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb44410ac90 con 0x7fb444106660 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.818+0000 7fb442ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 0x7fb444196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.818+0000 7fb442ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 0x7fb444196140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.121:44308/0 (socket says 172.21.15.121:44308) 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.818+0000 7fb442ffd640 1 -- 172.21.15.121:0/3910798718 learned_addr learned my addr 172.21.15.121:0/3910798718 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.819+0000 7fb442ffd640 1 -- 172.21.15.121:0/3910798718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb444196680 con 0x7fb444106660 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.819+0000 7fb442ffd640 1 --2- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 0x7fb444196140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb434009230 tx=0x7fb434003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.819+0000 7fb44884e640 1 -- 172.21.15.121:0/3910798718 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb43403f070 con 0x7fb444106660 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.819+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb444196910 con 0x7fb444106660 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.819+0000 7fb44884e640 1 -- 172.21.15.121:0/3910798718 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb43403bc80 con 0x7fb444106660 2024-09-10T10:28:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.819+0000 7fb44884e640 1 -- 172.21.15.121:0/3910798718 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb434035030 con 0x7fb444106660 2024-09-10T10:28:25.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.819+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44419aa10 con 0x7fb444106660 2024-09-10T10:28:25.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.820+0000 7fb44884e640 1 -- 172.21.15.121:0/3910798718 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb434042070 con 0x7fb444106660 2024-09-10T10:28:25.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.820+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb444101cd0 con 0x7fb444106660 2024-09-10T10:28:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.820+0000 7fb44884e640 1 --2- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb42c039060 0x7fb42c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.820+0000 7fb44884e640 1 -- 172.21.15.121:0/3910798718 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb43406ccc0 con 0x7fb444106660 2024-09-10T10:28:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.821+0000 7fb4427fc640 1 --2- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb42c039060 0x7fb42c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.821+0000 7fb4427fc640 1 --2- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb42c039060 0x7fb42c03b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb4380098c0 tx=0x7fb438006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:25.826+0000 7fb44884e640 1 -- 172.21.15.121:0/3910798718 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb43404c350 con 0x7fb444106660 2024-09-10T10:28:26.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.076+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb4441974a0 con 0x7fb444106660 2024-09-10T10:28:26.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.077+0000 7fb44884e640 1 -- 172.21.15.121:0/3910798718 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fb434031e20 con 0x7fb444106660 2024-09-10T10:28:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:28:26.080 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":1,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","modified":"2024-09-10T10:27:05.038412Z","created":"2024-09-10T10:27:05.038412Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T10:28:26.080 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 1 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb42c039060 msgr2=0x7fb42c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 --2- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb42c039060 0x7fb42c03b520 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb4380098c0 tx=0x7fb438006db0 comp rx=0 tx=0).stop 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 msgr2=0x7fb444196140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 --2- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 0x7fb444196140 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb434009230 tx=0x7fb434003d40 comp rx=0 tx=0).stop 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 shutdown_connections 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 --2- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb42c039060 0x7fb42c03b520 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 --2- 172.21.15.121:0/3910798718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb444106660 0x7fb444196140 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 >> 172.21.15.121:0/3910798718 conn(0x7fb4440fc250 msgr2=0x7fb4440fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 shutdown_connections 2024-09-10T10:28:26.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:26.079+0000 7fb449850640 1 -- 172.21.15.121:0/3910798718 wait complete. 2024-09-10T10:28:26.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:26 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/3910798718' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:27.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:27 smithi121 systemd[1]: Started Ceph mon.c for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:28:27.687 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:28:27.687 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:28:27.941 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:28:32.396 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:28:32.396 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: mon.a calling monitor election 2024-09-10T10:28:32.396 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.396 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:32.396 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.396 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.396 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: mon.c calling monitor election 2024-09-10T10:28:32.396 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: monmap epoch 2 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: last_changed 2024-09-10T10:28:27.059839+0000 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: min_mon_release 19 (squid) 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: election_strategy: 1 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-10T10:28:32.397 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: fsmap 2024-09-10T10:28:32.398 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:32.398 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: mgrmap e13: x(active, since 38s) 2024-09-10T10:28:32.398 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: overall HEALTH_OK 2024-09-10T10:28:32.398 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:32.398 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:32.398 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:32.398 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:32.398 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: mon.a calling monitor election 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: mon.c calling monitor election 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: monmap epoch 2 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: last_changed 2024-09-10T10:28:27.059839+0000 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: min_mon_release 19 (squid) 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: election_strategy: 1 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: fsmap 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: mgrmap e13: x(active, since 38s) 2024-09-10T10:28:32.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: overall HEALTH_OK 2024-09-10T10:28:32.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:32.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:32.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:32.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:32.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:32.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.781+0000 7fea96dd6640 1 -- 172.21.15.121:0/3275610399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea90102820 msgr2=0x7fea80005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:32.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.781+0000 7fea96dd6640 1 --2- 172.21.15.121:0/3275610399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea90102820 0x7fea80005580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fea84012c60 tx=0x7fea8402c620 comp rx=0 tx=0).stop 2024-09-10T10:28:32.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.781+0000 7fea96dd6640 1 -- 172.21.15.121:0/3275610399 shutdown_connections 2024-09-10T10:28:32.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.781+0000 7fea96dd6640 1 --2- 172.21.15.121:0/3275610399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea90102820 0x7fea80005580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:32.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.781+0000 7fea96dd6640 1 -- 172.21.15.121:0/3275610399 >> 172.21.15.121:0/3275610399 conn(0x7fea900fc220 msgr2=0x7fea900fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:32.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.782+0000 7fea96dd6640 1 -- 172.21.15.121:0/3275610399 shutdown_connections 2024-09-10T10:28:32.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.782+0000 7fea96dd6640 1 -- 172.21.15.121:0/3275610399 wait complete. 2024-09-10T10:28:32.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea96dd6640 1 Processor -- start 2024-09-10T10:28:32.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea96dd6640 1 -- start start 2024-09-10T10:28:32.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea96dd6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 0x7fea90197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:32.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea96dd6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea90197750 0x7fea9019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:32.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea96dd6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fea90109780 con 0x7fea90197750 2024-09-10T10:28:32.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea96dd6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fea90109600 con 0x7fea90102820 2024-09-10T10:28:32.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea94b72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 0x7fea90197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea94b72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 0x7fea90197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59488/0 (socket says 172.21.15.121:59488) 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea94b72640 1 -- 172.21.15.121:0/3409595253 learned_addr learned my addr 172.21.15.121:0/3409595253 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea8ffff640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea90197750 0x7fea9019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea94b72640 1 -- 172.21.15.121:0/3409595253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 msgr2=0x7fea90197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea94b72640 1 -- 172.21.15.121:0/3409595253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 msgr2=0x7fea90197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea94b72640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 0x7fea90197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.783+0000 7fea94b72640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 0x7fea90197210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.784+0000 7fea8ffff640 1 -- 172.21.15.121:0/3409595253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 msgr2=0x7fea90197210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.784+0000 7fea8ffff640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 0x7fea90197210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.784+0000 7fea8ffff640 1 -- 172.21.15.121:0/3409595253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea90197d70 con 0x7fea90197750 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.784+0000 7fea8ffff640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea90197750 0x7fea9019bae0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00b3d0 tx=0x7fea7c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.784+0000 7fea8dffb640 1 -- 172.21.15.121:0/3409595253 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fea7c011630 con 0x7fea90197750 2024-09-10T10:28:32.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.784+0000 7fea8dffb640 1 -- 172.21.15.121:0/3409595253 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea7c011cb0 con 0x7fea90197750 2024-09-10T10:28:32.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.784+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9019c020 con 0x7fea90197750 2024-09-10T10:28:32.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.784+0000 7fea8dffb640 1 -- 172.21.15.121:0/3409595253 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fea7c010df0 con 0x7fea90197750 2024-09-10T10:28:32.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.784+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9019c560 con 0x7fea90197750 2024-09-10T10:28:32.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.785+0000 7fea8dffb640 1 -- 172.21.15.121:0/3409595253 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fea7c018020 con 0x7fea90197750 2024-09-10T10:28:32.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.785+0000 7fea8dffb640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fea74038e50 0x7fea7403b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:32.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.786+0000 7fea8dffb640 1 -- 172.21.15.121:0/3409595253 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fea7c04bcf0 con 0x7fea90197750 2024-09-10T10:28:32.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.786+0000 7fea94b72640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fea74038e50 0x7fea7403b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:32.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.786+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9006ad10 con 0x7fea90197750 2024-09-10T10:28:32.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.786+0000 7fea94b72640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fea74038e50 0x7fea7403b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fea84035040 tx=0x7fea84033660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:32.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:32.791+0000 7fea8dffb640 1 -- 172.21.15.121:0/3409595253 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea7c01f020 con 0x7fea90197750 2024-09-10T10:28:33.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.027+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fea9019c870 con 0x7fea90197750 2024-09-10T10:28:33.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.028+0000 7fea8dffb640 1 -- 172.21.15.121:0/3409595253 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fea7c018310 con 0x7fea90197750 2024-09-10T10:28:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:28:33.029 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":2,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","modified":"2024-09-10T10:28:27.059839Z","created":"2024-09-10T10:27:05.038412Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T10:28:33.030 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 2 2024-09-10T10:28:33.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fea74038e50 msgr2=0x7fea7403b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:33.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fea74038e50 0x7fea7403b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fea84035040 tx=0x7fea84033660 comp rx=0 tx=0).stop 2024-09-10T10:28:33.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea90197750 msgr2=0x7fea9019bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:33.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea90197750 0x7fea9019bae0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00b3d0 tx=0x7fea7c00b890 comp rx=0 tx=0).stop 2024-09-10T10:28:33.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 shutdown_connections 2024-09-10T10:28:33.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fea74038e50 0x7fea7403b310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:33.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fea90197750 0x7fea9019bae0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:33.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 --2- 172.21.15.121:0/3409595253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea90102820 0x7fea90197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:33.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 >> 172.21.15.121:0/3409595253 conn(0x7fea900fc220 msgr2=0x7fea900fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:33.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 shutdown_connections 2024-09-10T10:28:33.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:33.030+0000 7fea96dd6640 1 -- 172.21.15.121:0/3409595253 wait complete. 2024-09-10T10:28:33.374 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:33 smithi121 ceph-mon[35231]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:33.375 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:33 smithi121 ceph-mon[35231]: Deploying daemon mon.b on smithi097 2024-09-10T10:28:33.375 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:33 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/3409595253' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:33.375 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:33.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:33 smithi092 ceph-mon[30834]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:33.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:33 smithi092 ceph-mon[30834]: Deploying daemon mon.b on smithi097 2024-09-10T10:28:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:33 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/3409595253' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:34.612 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:28:34.613 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:28:34.863 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:28:35.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.248+0000 7ff6a39be640 1 -- 172.21.15.121:0/3814509875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff69c106630 msgr2=0x7ff69c106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:35.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.248+0000 7ff6a39be640 1 --2- 172.21.15.121:0/3814509875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff69c106630 0x7ff69c106a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff694009880 tx=0x7ff69402a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:35.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.248+0000 7ff6a39be640 1 -- 172.21.15.121:0/3814509875 shutdown_connections 2024-09-10T10:28:35.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.248+0000 7ff6a39be640 1 --2- 172.21.15.121:0/3814509875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff69c106630 0x7ff69c106a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:35.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.248+0000 7ff6a39be640 1 -- 172.21.15.121:0/3814509875 >> 172.21.15.121:0/3814509875 conn(0x7ff69c0fc220 msgr2=0x7ff69c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:35.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.248+0000 7ff6a39be640 1 -- 172.21.15.121:0/3814509875 shutdown_connections 2024-09-10T10:28:35.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.248+0000 7ff6a39be640 1 -- 172.21.15.121:0/3814509875 wait complete. 2024-09-10T10:28:35.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:35 smithi121 ceph-mon[35231]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:35.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.249+0000 7ff6a39be640 1 Processor -- start 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.249+0000 7ff6a39be640 1 -- start start 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.249+0000 7ff6a39be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 0x7ff69c197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.249+0000 7ff6a39be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff69c197870 0x7ff69c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.249+0000 7ff6a39be640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10ac60 con 0x7ff69c197870 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.249+0000 7ff6a39be640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff69c10aae0 con 0x7ff69c106630 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a175a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 0x7ff69c197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a175a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 0x7ff69c197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59502/0 (socket says 172.21.15.121:59502) 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a175a640 1 -- 172.21.15.121:0/199908469 learned_addr learned my addr 172.21.15.121:0/199908469 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a0f59640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff69c197870 0x7ff69c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a175a640 1 -- 172.21.15.121:0/199908469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 msgr2=0x7ff69c197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-10T10:28:35.254 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a175a640 1 -- 172.21.15.121:0/199908469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 msgr2=0x7ff69c197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T10:28:35.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a175a640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 0x7ff69c197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T10:28:35.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a175a640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 0x7ff69c197330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:28:35.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a0f59640 1 -- 172.21.15.121:0/199908469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 msgr2=0x7ff69c197330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:28:35.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a0f59640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 0x7ff69c197330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:35.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a0f59640 1 -- 172.21.15.121:0/199908469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c197e90 con 0x7ff69c197870 2024-09-10T10:28:35.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff6a0f59640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff69c197870 0x7ff69c19bc00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff69000b3d0 tx=0x7ff69000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:35.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.250+0000 7ff69a7fc640 1 -- 172.21.15.121:0/199908469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff690011630 con 0x7ff69c197870 2024-09-10T10:28:35.255 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.251+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c19c140 con 0x7ff69c197870 2024-09-10T10:28:35.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.251+0000 7ff69a7fc640 1 -- 172.21.15.121:0/199908469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff690011cb0 con 0x7ff69c197870 2024-09-10T10:28:35.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.251+0000 7ff69a7fc640 1 -- 172.21.15.121:0/199908469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7ff690010df0 con 0x7ff69c197870 2024-09-10T10:28:35.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.251+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69c19c700 con 0x7ff69c197870 2024-09-10T10:28:35.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.251+0000 7ff69a7fc640 1 -- 172.21.15.121:0/199908469 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff690018020 con 0x7ff69c197870 2024-09-10T10:28:35.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.252+0000 7ff69a7fc640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff684038e00 0x7ff68403b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:35.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.252+0000 7ff69a7fc640 1 -- 172.21.15.121:0/199908469 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff69004bdc0 con 0x7ff69c197870 2024-09-10T10:28:35.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.252+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c19ca10 con 0x7ff69c197870 2024-09-10T10:28:35.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.252+0000 7ff6a175a640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff684038e00 0x7ff68403b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:35.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.252+0000 7ff6a175a640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff684038e00 0x7ff68403b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6940096c0 tx=0x7ff694031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:35.258 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.257+0000 7ff69a7fc640 1 -- 172.21.15.121:0/199908469 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff69001f020 con 0x7ff69c197870 2024-09-10T10:28:35.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.486+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff69c198690 con 0x7ff69c197870 2024-09-10T10:28:35.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.486+0000 7ff69a7fc640 1 -- 172.21.15.121:0/199908469 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7ff690022350 con 0x7ff69c197870 2024-09-10T10:28:35.488 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:28:35.488 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":2,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","modified":"2024-09-10T10:28:27.059839Z","created":"2024-09-10T10:27:05.038412Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T10:28:35.488 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 2 2024-09-10T10:28:35.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff684038e00 msgr2=0x7ff68403b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:35.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff684038e00 0x7ff68403b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6940096c0 tx=0x7ff694031400 comp rx=0 tx=0).stop 2024-09-10T10:28:35.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff69c197870 msgr2=0x7ff69c19bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:35.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff69c197870 0x7ff69c19bc00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff69000b3d0 tx=0x7ff69000b890 comp rx=0 tx=0).stop 2024-09-10T10:28:35.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 shutdown_connections 2024-09-10T10:28:35.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff684038e00 0x7ff68403b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:35.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff69c197870 0x7ff69c19bc00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:35.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 --2- 172.21.15.121:0/199908469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff69c106630 0x7ff69c197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:35.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 >> 172.21.15.121:0/199908469 conn(0x7ff69c0fc220 msgr2=0x7ff69c104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:35.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 shutdown_connections 2024-09-10T10:28:35.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:35.488+0000 7ff6a39be640 1 -- 172.21.15.121:0/199908469 wait complete. 2024-09-10T10:28:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:35 smithi092 ceph-mon[30834]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:35.982 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T10:28:36.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T10:28:36.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Updating smithi097:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Added host smithi121 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/673474912' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/673474912' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:36.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi097:172.21.15.97=b;smithi121:172.21.15.121=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi097:172.21.15.97=b;smithi121:172.21.15.121=c;count:3 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Reconfiguring daemon mon.a on smithi092 2024-09-10T10:28:36.324 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/575640894' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Deploying daemon mon.c on smithi121 2024-09-10T10:28:36.325 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/3910798718' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.a calling monitor election 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.c calling monitor election 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:36.326 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: monmap epoch 2 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: last_changed 2024-09-10T10:28:27.059839+0000 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: min_mon_release 19 (squid) 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: election_strategy: 1 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: fsmap 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mgrmap e13: x(active, since 38s) 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: overall HEALTH_OK 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.327 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: Deploying daemon mon.b on smithi097 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/3409595253' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:35 smithi097 ceph-mon[35213]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:36 smithi097 bash[35194]: 530a778e5ad08cc8425b470bab903d9d0abff37d92c46c2c908bf4f9e2ecd82f 2024-09-10T10:28:36.328 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:36 smithi097 systemd[1]: Started Ceph mon.b for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:28:37.035 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T10:28:37.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T10:28:37.287 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:28:41.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.331+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3835532191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a84003530 msgr2=0x7f8a840059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:41.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.331+0000 7f8a9eba1640 1 --2- 172.21.15.121:0/3835532191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a84003530 0x7f8a840059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a981016a0 tx=0x7f8a9002c3f0 comp rx=0 tx=0).stop 2024-09-10T10:28:41.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.331+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3835532191 shutdown_connections 2024-09-10T10:28:41.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.331+0000 7f8a9eba1640 1 --2- 172.21.15.121:0/3835532191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a84003530 0x7f8a840059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:41.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.331+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3835532191 >> 172.21.15.121:0/3835532191 conn(0x7f8a980fc220 msgr2=0x7f8a980fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:41.334 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:28:41.334 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: mon.c calling monitor election 2024-09-10T10:28:41.334 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: mon.a calling monitor election 2024-09-10T10:28:41.334 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.334 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:41.334 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:41.334 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.334 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: monmap epoch 3 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: last_changed 2024-09-10T10:28:35.986714+0000 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: min_mon_release 19 (squid) 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: election_strategy: 1 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:28:41.335 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-10T10:28:41.336 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: 2: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-10T10:28:41.336 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: fsmap 2024-09-10T10:28:41.336 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:41.336 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: mgrmap e13: x(active, since 46s) 2024-09-10T10:28:41.336 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: overall HEALTH_OK 2024-09-10T10:28:41.336 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:41.336 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:41.336 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:41.336 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.331+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3835532191 shutdown_connections 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.331+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3835532191 wait complete. 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.332+0000 7f8a9eba1640 1 Processor -- start 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9eba1640 1 -- start start 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9eba1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a84003530 0x7f8a9806a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9eba1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 0x7f8a9806add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9eba1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a981a9940 0x7f8a981abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9eba1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98108670 con 0x7f8a981a9940 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9eba1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981084f0 con 0x7f8a84003530 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9eba1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981087f0 con 0x7f8a9806a970 2024-09-10T10:28:41.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a97fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 0x7f8a9806add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a97fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 0x7f8a9806add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36654/0 (socket says 172.21.15.121:36654) 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a97fff640 1 -- 172.21.15.121:0/3381405818 learned_addr learned my addr 172.21.15.121:0/3381405818 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9c93d640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a84003530 0x7f8a9806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9d13e640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a981a9940 0x7f8a981abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a97fff640 1 -- 172.21.15.121:0/3381405818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 msgr2=0x7f8a9806add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a97fff640 1 -- 172.21.15.121:0/3381405818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 msgr2=0x7f8a9806add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a97fff640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 0x7f8a9806add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a97fff640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 0x7f8a9806add0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9c93d640 1 -- 172.21.15.121:0/3381405818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a84003530 msgr2=0x7f8a9806a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9c93d640 1 -- 172.21.15.121:0/3381405818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a84003530 msgr2=0x7f8a9806a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9c93d640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a84003530 0x7f8a9806a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T10:28:41.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.333+0000 7f8a9c93d640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a84003530 0x7f8a9806a430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a9d13e640 1 -- 172.21.15.121:0/3381405818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 msgr2=0x7f8a9806add0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a9d13e640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 0x7f8a9806add0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a9d13e640 1 -- 172.21.15.121:0/3381405818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a84003530 msgr2=0x7f8a9806a430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a9d13e640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a84003530 0x7f8a9806a430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a9d13e640 1 -- 172.21.15.121:0/3381405818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a981ac5a0 con 0x7f8a981a9940 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a9d13e640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a981a9940 0x7f8a981abd30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800bd50 tx=0x7f8a8800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a95ffb640 1 -- 172.21.15.121:0/3381405818 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88019070 con 0x7f8a981a9940 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a95ffb640 1 -- 172.21.15.121:0/3381405818 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a88014920 con 0x7f8a981a9940 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a95ffb640 1 -- 172.21.15.121:0/3381405818 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88012990 con 0x7f8a981a9940 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a981ac890 con 0x7f8a981a9940 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.334+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a981acdd0 con 0x7f8a981a9940 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.335+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a981097a0 con 0x7f8a981a9940 2024-09-10T10:28:41.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.335+0000 7f8a95ffb640 1 -- 172.21.15.121:0/3381405818 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8a8801c070 con 0x7f8a981a9940 2024-09-10T10:28:41.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.336+0000 7f8a95ffb640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f8a780394f0 0x7f8a7803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:41.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.336+0000 7f8a95ffb640 1 -- 172.21.15.121:0/3381405818 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8a8804bed0 con 0x7f8a981a9940 2024-09-10T10:28:41.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.336+0000 7f8a9c93d640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f8a780394f0 0x7f8a7803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:41.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.336+0000 7f8a9c93d640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f8a780394f0 0x7f8a7803b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a90014cc0 tx=0x7f8a90005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:41.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.341+0000 7f8a95ffb640 1 -- 172.21.15.121:0/3381405818 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a88011df0 con 0x7f8a981a9940 2024-09-10T10:28:41.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:28:41.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: mon.c calling monitor election 2024-09-10T10:28:41.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: mon.a calling monitor election 2024-09-10T10:28:41.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:41.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:41.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: monmap epoch 3 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: last_changed 2024-09-10T10:28:35.986714+0000 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: min_mon_release 19 (squid) 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: election_strategy: 1 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-10T10:28:41.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: 2: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-10T10:28:41.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: fsmap 2024-09-10T10:28:41.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:41.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: mgrmap e13: x(active, since 46s) 2024-09-10T10:28:41.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: overall HEALTH_OK 2024-09-10T10:28:41.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:41.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:41.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:41.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:41.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.601+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8a981ad190 con 0x7f8a981a9940 2024-09-10T10:28:41.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.602+0000 7f8a95ffb640 1 -- 172.21.15.121:0/3381405818 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f8a88014b40 con 0x7f8a981a9940 2024-09-10T10:28:41.603 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:28:41.604 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":3,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","modified":"2024-09-10T10:28:35.986714Z","created":"2024-09-10T10:27:05.038412Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:3300","nonce":0},{"type":"v1","addr":"172.21.15.97:6789","nonce":0}]},"addr":"172.21.15.97:6789/0","public_addr":"172.21.15.97:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T10:28:41.604 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 3 2024-09-10T10:28:41.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f8a780394f0 msgr2=0x7f8a7803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f8a780394f0 0x7f8a7803b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a90014cc0 tx=0x7f8a90005f60 comp rx=0 tx=0).stop 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a981a9940 msgr2=0x7f8a981abd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a981a9940 0x7f8a981abd30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800bd50 tx=0x7f8a8800be40 comp rx=0 tx=0).stop 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 shutdown_connections 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f8a780394f0 0x7f8a7803b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a981a9940 0x7f8a981abd30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a9806a970 0x7f8a9806add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 --2- 172.21.15.121:0/3381405818 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8a84003530 0x7f8a9806a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 >> 172.21.15.121:0/3381405818 conn(0x7f8a980fc220 msgr2=0x7f8a980fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 shutdown_connections 2024-09-10T10:28:41.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:41.604+0000 7f8a9eba1640 1 -- 172.21.15.121:0/3381405818 wait complete. 2024-09-10T10:28:42.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:42 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:42.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:42 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/3381405818' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:42.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:42 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:42.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:42 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:42.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:42 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/3381405818' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:42.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:42 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:42.821 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T10:28:42.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T10:28:43.070 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:43.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:28:43.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: mon.c calling monitor election 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: mon.a calling monitor election 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: monmap epoch 3 2024-09-10T10:28:43.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: last_changed 2024-09-10T10:28:35.986714+0000 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: min_mon_release 19 (squid) 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: election_strategy: 1 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: 2: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: fsmap 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: mgrmap e13: x(active, since 46s) 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: overall HEALTH_OK 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:43.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:43.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:43.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/3381405818' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T10:28:43.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:43.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.514+0000 7f941898e640 1 -- 172.21.15.92:0/540382857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9414102870 msgr2=0x7f9414102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:43.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.514+0000 7f941898e640 1 --2- 172.21.15.92:0/540382857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9414102870 0x7f9414102c50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9408009880 tx=0x7f940802a670 comp rx=0 tx=0).stop 2024-09-10T10:28:43.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.514+0000 7f941898e640 1 -- 172.21.15.92:0/540382857 shutdown_connections 2024-09-10T10:28:43.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.514+0000 7f941898e640 1 --2- 172.21.15.92:0/540382857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9414102870 0x7f9414102c50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:43.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.514+0000 7f941898e640 1 -- 172.21.15.92:0/540382857 >> 172.21.15.92:0/540382857 conn(0x7f94140fc290 msgr2=0x7f94140fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:43.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.514+0000 7f941898e640 1 -- 172.21.15.92:0/540382857 shutdown_connections 2024-09-10T10:28:43.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.514+0000 7f941898e640 1 -- 172.21.15.92:0/540382857 wait complete. 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f941898e640 1 Processor -- start 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f941898e640 1 -- start start 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f941898e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9414102870 0x7f94141004d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f941898e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9414100a10 0x7f9414100e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f941898e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94141a36e0 0x7f94141a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f941898e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f941410bd90 con 0x7f94141a36e0 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f941898e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f941410bc10 con 0x7f9414102870 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f941898e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f941410bf10 con 0x7f9414100a10 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f9412d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94141a36e0 0x7f94141a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f9412d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94141a36e0 0x7f94141a5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41832/0 (socket says 172.21.15.92:41832) 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f9412d9d640 1 -- 172.21.15.92:0/940764779 learned_addr learned my addr 172.21.15.92:0/940764779 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:43.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f941259c640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9414102870 0x7f94141004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f9411d9b640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9414100a10 0x7f9414100e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f9412d9d640 1 -- 172.21.15.92:0/940764779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9414100a10 msgr2=0x7f9414100e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f9412d9d640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9414100a10 0x7f9414100e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f9412d9d640 1 -- 172.21.15.92:0/940764779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9414102870 msgr2=0x7f94141004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f9412d9d640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9414102870 0x7f94141004d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.515+0000 7f9412d9d640 1 -- 172.21.15.92:0/940764779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94141a61a0 con 0x7f94141a36e0 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.516+0000 7f9412d9d640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94141a36e0 0x7f94141a5ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f940c00ba50 tx=0x7f940c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.516+0000 7f94037fe640 1 -- 172.21.15.92:0/940764779 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c019070 con 0x7f94141a36e0 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.516+0000 7f94037fe640 1 -- 172.21.15.92:0/940764779 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f940c00cbe0 con 0x7f94141a36e0 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.516+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94141a6490 con 0x7f94141a36e0 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.516+0000 7f94037fe640 1 -- 172.21.15.92:0/940764779 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c0076a0 con 0x7f94141a36e0 2024-09-10T10:28:43.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.516+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94141a69d0 con 0x7f94141a36e0 2024-09-10T10:28:43.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.517+0000 7f94037fe640 1 -- 172.21.15.92:0/940764779 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f940c01c070 con 0x7f94141a36e0 2024-09-10T10:28:43.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.517+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9414102cd0 con 0x7f94141a36e0 2024-09-10T10:28:43.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.517+0000 7f94037fe640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f93fc0394f0 0x7f93fc03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:43.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.517+0000 7f94037fe640 1 -- 172.21.15.92:0/940764779 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f940c04ba70 con 0x7f94141a36e0 2024-09-10T10:28:43.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.517+0000 7f941259c640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f93fc0394f0 0x7f93fc03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:43.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.517+0000 7f941259c640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f93fc0394f0 0x7f93fc03b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9408009230 tx=0x7f9408005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:43.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.522+0000 7f94037fe640 1 -- 172.21.15.92:0/940764779 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f940c0112a0 con 0x7f94141a36e0 2024-09-10T10:28:43.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.697+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f94141a6c90 con 0x7f94141a36e0 2024-09-10T10:28:43.699 INFO:teuthology.orchestra.run.smithi092.stdout:# minimal ceph.conf for 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:43.700 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2024-09-10T10:28:43.700 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:43.700 INFO:teuthology.orchestra.run.smithi092.stdout: mon_host = [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-10T10:28:43.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.697+0000 7f94037fe640 1 -- 172.21.15.92:0/940764779 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f940c00e090 con 0x7f94141a36e0 2024-09-10T10:28:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.699+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f93fc0394f0 msgr2=0x7f93fc03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.699+0000 7f941898e640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f93fc0394f0 0x7f93fc03b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9408009230 tx=0x7f9408005a40 comp rx=0 tx=0).stop 2024-09-10T10:28:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.699+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94141a36e0 msgr2=0x7f94141a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:43.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.699+0000 7f941898e640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94141a36e0 0x7f94141a5ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f940c00ba50 tx=0x7f940c00bf10 comp rx=0 tx=0).stop 2024-09-10T10:28:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.700+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 shutdown_connections 2024-09-10T10:28:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.700+0000 7f941898e640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f93fc0394f0 0x7f93fc03b9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.700+0000 7f941898e640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94141a36e0 0x7f94141a5ad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.700+0000 7f941898e640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9414100a10 0x7f9414100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.700+0000 7f941898e640 1 --2- 172.21.15.92:0/940764779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9414102870 0x7f94141004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.700+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 >> 172.21.15.92:0/940764779 conn(0x7f94140fc290 msgr2=0x7f9414105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.700+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 shutdown_connections 2024-09-10T10:28:43.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:43.700+0000 7f941898e640 1 -- 172.21.15.92:0/940764779 wait complete. 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: mon.b calling monitor election 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: Updating smithi097:/etc/ceph/ceph.conf 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: mon.b calling monitor election 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: Reconfiguring mon.a (monmap changed)... 2024-09-10T10:28:44.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: mon.c calling monitor election 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: mon.a calling monitor election 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: monmap epoch 3 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: last_changed 2024-09-10T10:28:35.986714+0000 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: min_mon_release 19 (squid) 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: election_strategy: 1 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: 2: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: fsmap 2024-09-10T10:28:44.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:44.059 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: mgrmap e13: x(active, since 48s) 2024-09-10T10:28:44.059 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: overall HEALTH_OK 2024-09-10T10:28:44.059 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:44.059 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:44.059 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: Reconfiguring daemon mon.a on smithi092 2024-09-10T10:28:44.059 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:43 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/940764779' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:44.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: mon.b calling monitor election 2024-09-10T10:28:44.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-10T10:28:44.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: Updating smithi097:/etc/ceph/ceph.conf 2024-09-10T10:28:44.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-10T10:28:44.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:44.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:44.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: mon.b calling monitor election 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: Reconfiguring mon.a (monmap changed)... 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: mon.c calling monitor election 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: mon.a calling monitor election 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: monmap epoch 3 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: last_changed 2024-09-10T10:28:35.986714+0000 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: min_mon_release 19 (squid) 2024-09-10T10:28:44.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: election_strategy: 1 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: 2: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: fsmap 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: mgrmap e13: x(active, since 48s) 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: overall HEALTH_OK 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: Reconfiguring daemon mon.a on smithi092 2024-09-10T10:28:44.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:43 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/940764779' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:44.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: mon.b calling monitor election 2024-09-10T10:28:44.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-10T10:28:44.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: Updating smithi097:/etc/ceph/ceph.conf 2024-09-10T10:28:44.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-10T10:28:44.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: mon.b calling monitor election 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: Reconfiguring mon.a (monmap changed)... 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: mon.c calling monitor election 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: mon.a calling monitor election 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: monmap epoch 3 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: last_changed 2024-09-10T10:28:35.986714+0000 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: created 2024-09-10T10:27:05.038412+0000 2024-09-10T10:28:44.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: min_mon_release 19 (squid) 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: election_strategy: 1 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: 2: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.b 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: fsmap 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: mgrmap e13: x(active, since 48s) 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: overall HEALTH_OK 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: Reconfiguring daemon mon.a on smithi092 2024-09-10T10:28:44.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:43 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/940764779' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:44.757 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T10:28:44.758 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:28:44.758 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T10:28:44.784 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:28:44.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:44.851 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:28:44.851 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T10:28:44.880 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:28:44.880 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:44.946 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:28:44.946 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T10:28:44.979 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:28:44.979 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:28:45.048 INFO:tasks.cephadm:Adding mgr.x on smithi092 2024-09-10T10:28:45.048 INFO:tasks.cephadm:Adding mgr.y on smithi097 2024-09-10T10:28:45.048 INFO:tasks.cephadm:Adding mgr.z on smithi121 2024-09-10T10:28:45.048 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi092=x;smithi097=y;smithi121=z' 2024-09-10T10:28:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:44 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:44 smithi097 ceph-mon[35213]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:44 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:45.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:44 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:45.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:44 smithi092 ceph-mon[30834]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:45.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:44 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:45.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:44 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:28:45.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:44 smithi121 ceph-mon[35231]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:45.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:44 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:45.330 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:28:45.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.733+0000 7f4cd64b3640 1 -- 172.21.15.121:0/1426155841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cd01005e0 msgr2=0x7f4cd01009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:45.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.733+0000 7f4cd64b3640 1 --2- 172.21.15.121:0/1426155841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cd01005e0 0x7f4cd01009e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009880 tx=0x7f4cc002a5d0 comp rx=0 tx=0).stop 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.733+0000 7f4cd64b3640 1 -- 172.21.15.121:0/1426155841 shutdown_connections 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.733+0000 7f4cd64b3640 1 --2- 172.21.15.121:0/1426155841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cd01005e0 0x7f4cd01009e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.733+0000 7f4cd64b3640 1 -- 172.21.15.121:0/1426155841 >> 172.21.15.121:0/1426155841 conn(0x7f4cd00fbdb0 msgr2=0x7f4cd00fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.733+0000 7f4cd64b3640 1 -- 172.21.15.121:0/1426155841 shutdown_connections 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.733+0000 7f4cd64b3640 1 -- 172.21.15.121:0/1426155841 wait complete. 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cd64b3640 1 Processor -- start 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cd64b3640 1 -- start start 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cd64b3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cd01005e0 0x7f4cd006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cd64b3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0199d20 0x7f4cd019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cd64b3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cd019c650 0x7f4cd019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:45.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cd64b3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd01066d0 con 0x7f4cd01005e0 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cd64b3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0106550 con 0x7f4cd019c650 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cd64b3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd0106850 con 0x7f4cd0199d20 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4ccffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cd01005e0 0x7f4cd006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cc7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0199d20 0x7f4cd019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4ccffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cd01005e0 0x7f4cd006a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.121:45762/0 (socket says 172.21.15.121:45762) 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4ccffff640 1 -- 172.21.15.121:0/489460783 learned_addr learned my addr 172.21.15.121:0/489460783 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.734+0000 7f4cd4a50640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cd019c650 0x7f4cd019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4cc7fff640 1 -- 172.21.15.121:0/489460783 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cd019c650 msgr2=0x7f4cd019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4cc7fff640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cd019c650 0x7f4cd019eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:45.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4cc7fff640 1 -- 172.21.15.121:0/489460783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cd01005e0 msgr2=0x7f4cd006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:45.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4cc7fff640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cd01005e0 0x7f4cd006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:45.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4cc7fff640 1 -- 172.21.15.121:0/489460783 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd019f420 con 0x7f4cd0199d20 2024-09-10T10:28:45.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4cc7fff640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0199d20 0x7f4cd019c110 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800b450 tx=0x7f4cb800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:45.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4ccdffb640 1 -- 172.21.15.121:0/489460783 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8004230 con 0x7f4cd0199d20 2024-09-10T10:28:45.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4ccdffb640 1 -- 172.21.15.121:0/489460783 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb80043d0 con 0x7f4cd0199d20 2024-09-10T10:28:45.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd019f6b0 con 0x7f4cd0199d20 2024-09-10T10:28:45.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4ccdffb640 1 -- 172.21.15.121:0/489460783 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8003cb0 con 0x7f4cd0199d20 2024-09-10T10:28:45.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.735+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd019fc70 con 0x7f4cd0199d20 2024-09-10T10:28:45.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.736+0000 7f4ccdffb640 1 -- 172.21.15.121:0/489460783 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4cb800f050 con 0x7f4cd0199d20 2024-09-10T10:28:45.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.736+0000 7f4ccdffb640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4cbc0394f0 0x7f4cbc03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:45.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.736+0000 7f4ccdffb640 1 -- 172.21.15.121:0/489460783 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4cb804bdd0 con 0x7f4cd0199d20 2024-09-10T10:28:45.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.736+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd018f490 con 0x7f4cd0199d20 2024-09-10T10:28:45.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.736+0000 7f4ccffff640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4cbc0394f0 0x7f4cbc03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:45.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.737+0000 7f4ccffff640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4cbc0394f0 0x7f4cbc03b9b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009230 tx=0x7f4cc00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:45.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.741+0000 7f4ccdffb640 1 -- 172.21.15.121:0/489460783 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4cb800d040 con 0x7f4cd0199d20 2024-09-10T10:28:45.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.915+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi097=y;smithi121=z", "target": ["mon-mgr", ""]}) -- 0x7f4cd00626c0 con 0x7f4cbc0394f0 2024-09-10T10:28:45.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.921+0000 7f4ccdffb640 1 -- 172.21.15.121:0/489460783 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4cd00626c0 con 0x7f4cbc0394f0 2024-09-10T10:28:45.922 INFO:teuthology.orchestra.run.smithi121.stdout:Scheduled mgr update... 2024-09-10T10:28:45.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4cbc0394f0 msgr2=0x7f4cbc03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:45.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4cbc0394f0 0x7f4cbc03b9b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009230 tx=0x7f4cc00058d0 comp rx=0 tx=0).stop 2024-09-10T10:28:45.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0199d20 msgr2=0x7f4cd019c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:45.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0199d20 0x7f4cd019c110 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800b450 tx=0x7f4cb800b910 comp rx=0 tx=0).stop 2024-09-10T10:28:45.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 shutdown_connections 2024-09-10T10:28:45.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f4cbc0394f0 0x7f4cbc03b9b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:45.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4cd019c650 0x7f4cd019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:45.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cd0199d20 0x7f4cd019c110 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:45.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 --2- 172.21.15.121:0/489460783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cd01005e0 0x7f4cd006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:45.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 >> 172.21.15.121:0/489460783 conn(0x7f4cd00fbdb0 msgr2=0x7f4cd00fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:45.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 shutdown_connections 2024-09-10T10:28:45.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:28:45.923+0000 7f4cd64b3640 1 -- 172.21.15.121:0/489460783 wait complete. 2024-09-10T10:28:46.476 DEBUG:teuthology.orchestra.run.smithi097:mgr.y> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T10:28:46.478 DEBUG:teuthology.orchestra.run.smithi121:mgr.z> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T10:28:46.481 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T10:28:46.481 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:28:46.481 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T10:28:46.499 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:46.499 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:46.499 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:46 smithi097 ceph-mon[35213]: Reconfiguring mon.b (monmap changed)... 2024-09-10T10:28:46.499 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:46.500 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:46.500 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:46.500 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:46 smithi097 ceph-mon[35213]: Reconfiguring daemon mon.b on smithi097 2024-09-10T10:28:46.500 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:46.501 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T10:28:46.501 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-09-10T10:28:46.511 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:46.511 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:46.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:46 smithi092 ceph-mon[30834]: Reconfiguring mon.b (monmap changed)... 2024-09-10T10:28:46.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:46.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:46.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:46.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:46 smithi092 ceph-mon[30834]: Reconfiguring daemon mon.b on smithi097 2024-09-10T10:28:46.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:46.530 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T10:28:46.530 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:46.530 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T10:28:46.530 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:46.530 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:46.530 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-10 10:28:04.702094187 +0000 2024-09-10T10:28:46.530 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-10 10:22:59.806804440 +0000 2024-09-10T10:28:46.530 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-10 10:22:59.806804440 +0000 2024-09-10T10:28:46.530 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-10 10:22:59.806804440 +0000 2024-09-10T10:28:46.531 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T10:28:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:46 smithi121 ceph-mon[35231]: Reconfiguring mon.b (monmap changed)... 2024-09-10T10:28:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:46 smithi121 ceph-mon[35231]: Reconfiguring daemon mon.b on smithi097 2024-09-10T10:28:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:46.600 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-10T10:28:46.600 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-10T10:28:46.600 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000359665 s, 1.4 MB/s 2024-09-10T10:28:46.602 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T10:28:46.661 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-09-10T10:28:46.720 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T10:28:46.720 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:46.720 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T10:28:46.720 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:46.720 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:46.720 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-10 10:28:04.736093224 +0000 2024-09-10T10:28:46.721 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-10 10:23:00.134794981 +0000 2024-09-10T10:28:46.721 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-10 10:23:00.134794981 +0000 2024-09-10T10:28:46.721 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-10 10:23:00.134794981 +0000 2024-09-10T10:28:46.721 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T10:28:46.787 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-10T10:28:46.788 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-10T10:28:46.788 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00021579 s, 2.4 MB/s 2024-09-10T10:28:46.789 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T10:28:46.848 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-09-10T10:28:46.906 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T10:28:46.906 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:46.906 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T10:28:46.906 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:46.906 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:46.906 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-10 10:28:04.774092147 +0000 2024-09-10T10:28:46.906 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-10 10:23:00.465785435 +0000 2024-09-10T10:28:46.906 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-10 10:23:00.465785435 +0000 2024-09-10T10:28:46.906 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-10 10:23:00.465785435 +0000 2024-09-10T10:28:46.906 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T10:28:46.974 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-10T10:28:46.974 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-10T10:28:46.974 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000229236 s, 2.2 MB/s 2024-09-10T10:28:46.975 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T10:28:47.034 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-09-10T10:28:47.092 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T10:28:47.092 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:47.092 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T10:28:47.092 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:47.092 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:47.092 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-10 10:28:04.815090985 +0000 2024-09-10T10:28:47.092 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-10 10:23:00.785776207 +0000 2024-09-10T10:28:47.092 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-10 10:23:00.785776207 +0000 2024-09-10T10:28:47.093 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-10 10:23:00.785776207 +0000 2024-09-10T10:28:47.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T10:28:47.160 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-10T10:28:47.160 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-10T10:28:47.160 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000246396 s, 2.1 MB/s 2024-09-10T10:28:47.161 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T10:28:47.220 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-09-10T10:28:47.220 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T10:28:47.238 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T10:28:47.238 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-09-10T10:28:47.294 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T10:28:47.294 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:47.294 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T10:28:47.294 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:47.295 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:47.295 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-10 10:28:35.428273390 +0000 2024-09-10T10:28:47.295 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-10 10:23:24.444903665 +0000 2024-09-10T10:28:47.295 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-10 10:23:24.444903665 +0000 2024-09-10T10:28:47.295 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-10 10:23:24.444903665 +0000 2024-09-10T10:28:47.295 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T10:28:47.360 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-10T10:28:47.360 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-10T10:28:47.360 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000290438 s, 1.8 MB/s 2024-09-10T10:28:47.362 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T10:28:47.418 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-09-10T10:28:47.474 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T10:28:47.474 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:47.474 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T10:28:47.474 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:47.474 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:47.474 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-10 10:28:35.428273390 +0000 2024-09-10T10:28:47.474 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-10 10:23:24.769897850 +0000 2024-09-10T10:28:47.475 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-10 10:23:24.769897850 +0000 2024-09-10T10:28:47.475 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-10 10:23:24.769897850 +0000 2024-09-10T10:28:47.475 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T10:28:47.535 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:47 smithi097 ceph-mon[35213]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi097=y;smithi121=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:47.535 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:47 smithi097 ceph-mon[35213]: Saving service mgr spec with placement smithi092=x;smithi097=y;smithi121=z;count:3 2024-09-10T10:28:47.535 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:47 smithi097 ceph-mon[35213]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:47.535 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:47.535 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:47.535 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:47.535 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:47.535 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:47.537 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-10T10:28:47.537 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-10T10:28:47.537 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000190653 s, 2.7 MB/s 2024-09-10T10:28:47.538 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T10:28:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:47 smithi121 ceph-mon[35231]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi097=y;smithi121=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:47 smithi121 ceph-mon[35231]: Saving service mgr spec with placement smithi092=x;smithi097=y;smithi121=z;count:3 2024-09-10T10:28:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:47 smithi121 ceph-mon[35231]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:47.596 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-09-10T10:28:47.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:47 smithi092 ceph-mon[30834]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi097=y;smithi121=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:47.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:47 smithi092 ceph-mon[30834]: Saving service mgr spec with placement smithi092=x;smithi097=y;smithi121=z;count:3 2024-09-10T10:28:47.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:47 smithi092 ceph-mon[30834]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:47.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:47.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:47.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T10:28:47.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T10:28:47.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T10:28:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:47.651 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T10:28:47.651 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:47.651 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:47.652 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-10 10:28:35.428273390 +0000 2024-09-10T10:28:47.652 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-10 10:23:25.121891551 +0000 2024-09-10T10:28:47.652 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-10 10:23:25.121891551 +0000 2024-09-10T10:28:47.652 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-10 10:23:25.121891551 +0000 2024-09-10T10:28:47.652 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T10:28:47.714 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-10T10:28:47.714 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-10T10:28:47.714 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000206967 s, 2.5 MB/s 2024-09-10T10:28:47.715 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T10:28:47.772 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-09-10T10:28:47.827 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T10:28:47.827 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:47.827 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-10T10:28:47.827 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:47.827 INFO:teuthology.orchestra.run.smithi097.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:47.827 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-09-10 10:28:35.428273390 +0000 2024-09-10T10:28:47.827 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-09-10 10:23:25.452885629 +0000 2024-09-10T10:28:47.827 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-09-10 10:23:25.452885629 +0000 2024-09-10T10:28:47.827 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: 2024-09-10 10:23:25.452885629 +0000 2024-09-10T10:28:47.828 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T10:28:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-09-10T10:28:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-09-10T10:28:47.890 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000177667 s, 2.9 MB/s 2024-09-10T10:28:47.891 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T10:28:47.947 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-10T10:28:47.947 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T10:28:47.963 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T10:28:47.963 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-09-10T10:28:48.018 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T10:28:48.019 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:48.019 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-10T10:28:48.019 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:48.019 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:48.019 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-10 10:28:26.172944263 +0000 2024-09-10T10:28:48.019 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-10 10:23:21.218117706 +0000 2024-09-10T10:28:48.019 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-10 10:23:21.218117706 +0000 2024-09-10T10:28:48.019 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-10 10:23:21.218117706 +0000 2024-09-10T10:28:48.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T10:28:48.083 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-10T10:28:48.084 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-10T10:28:48.084 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000217831 s, 2.4 MB/s 2024-09-10T10:28:48.085 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T10:28:48.142 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-09-10T10:28:48.197 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T10:28:48.197 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:48.198 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-10T10:28:48.198 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:48.198 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:48.198 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-10 10:28:26.172944263 +0000 2024-09-10T10:28:48.198 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-10 10:23:21.545113749 +0000 2024-09-10T10:28:48.198 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-10 10:23:21.545113749 +0000 2024-09-10T10:28:48.198 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-10 10:23:21.545113749 +0000 2024-09-10T10:28:48.198 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T10:28:48.262 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-10T10:28:48.262 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-10T10:28:48.262 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000173959 s, 2.9 MB/s 2024-09-10T10:28:48.263 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T10:28:48.319 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: Reconfiguring mon.c (monmap changed)... 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: Reconfiguring daemon mon.c on smithi121 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:28:48.347 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:28:48.348 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:28:48.348 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:48.362 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T10:28:48.362 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:48.362 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 707 Links: 1 2024-09-10T10:28:48.362 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:48.362 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:48.362 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-10 10:28:26.173944251 +0000 2024-09-10T10:28:48.363 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-10 10:23:21.882109669 +0000 2024-09-10T10:28:48.363 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-10 10:23:21.882109669 +0000 2024-09-10T10:28:48.363 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-10 10:23:21.882109669 +0000 2024-09-10T10:28:48.363 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T10:28:48.425 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-10T10:28:48.425 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-10T10:28:48.425 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000191463 s, 2.7 MB/s 2024-09-10T10:28:48.427 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T10:28:48.483 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-09-10T10:28:48.538 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T10:28:48.539 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T10:28:48.539 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 726 Links: 1 2024-09-10T10:28:48.539 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T10:28:48.539 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T10:28:48.539 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-10 10:28:26.173944251 +0000 2024-09-10T10:28:48.539 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-10 10:23:22.206105747 +0000 2024-09-10T10:28:48.539 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-10 10:23:22.206105747 +0000 2024-09-10T10:28:48.539 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-10 10:23:22.206105747 +0000 2024-09-10T10:28:48.539 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: Reconfiguring mon.c (monmap changed)... 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: Reconfiguring daemon mon.c on smithi121 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:28:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:28:48.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:48.603 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-10T10:28:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-10T10:28:48.604 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000253464 s, 2.0 MB/s 2024-09-10T10:28:48.605 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T10:28:48.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: Reconfiguring mon.c (monmap changed)... 2024-09-10T10:28:48.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: Reconfiguring daemon mon.c on smithi121 2024-09-10T10:28:48.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:48.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:48.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:48.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:48.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:48.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:48.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:28:48.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:28:48.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:28:48.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:48.661 INFO:tasks.cephadm:Deploying osd.0 on smithi092 with /dev/vg_nvme/lv_4... 2024-09-10T10:28:48.661 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T10:28:48.909 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:49.349 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:49 smithi092 ceph-mon[30834]: Deploying daemon mgr.z on smithi121 2024-09-10T10:28:49.349 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:49 smithi092 ceph-mon[30834]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:49.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:49 smithi121 ceph-mon[35231]: Deploying daemon mgr.z on smithi121 2024-09-10T10:28:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:49 smithi121 ceph-mon[35231]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:49.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:49 smithi097 ceph-mon[35213]: Deploying daemon mgr.z on smithi121 2024-09-10T10:28:49.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:49 smithi097 ceph-mon[35213]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:49.921 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:49 smithi121 systemd[1]: Starting Ceph mgr.z for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:28:50.215 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:49 smithi121 podman[37014]: 2024-09-10 10:28:49.920666979 +0000 UTC m=+0.106747336 container create 3fa7b94a051c0c7de7c0f09b2b7bfda54d2cb8ec5b2caa9126c1d92b4903861a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:28:50.215 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:49 smithi121 podman[37014]: 2024-09-10 10:28:49.829803139 +0000 UTC m=+0.015883450 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:28:50.216 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 podman[37014]: 2024-09-10 10:28:50.139820438 +0000 UTC m=+0.325900764 container init 3fa7b94a051c0c7de7c0f09b2b7bfda54d2cb8ec5b2caa9126c1d92b4903861a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T10:28:50.216 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 podman[37014]: 2024-09-10 10:28:50.143579652 +0000 UTC m=+0.329659964 container start 3fa7b94a051c0c7de7c0f09b2b7bfda54d2cb8ec5b2caa9126c1d92b4903861a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T10:28:50.216 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 ceph-mgr[37033]: -- 172.21.15.121:0/2119195304 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c22abd0e0 con 0x558c22a9b400 2024-09-10T10:28:50.216 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 bash[37014]: 3fa7b94a051c0c7de7c0f09b2b7bfda54d2cb8ec5b2caa9126c1d92b4903861a 2024-09-10T10:28:50.473 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 systemd[1]: Started Ceph mgr.z for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:28:50.473 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:50.266+0000 7f519fdbc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:28:50.473 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:50.325+0000 7f519fdbc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:28:50.473 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:50.472+0000 7f519fdbc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:28:50.790 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:50.537+0000 7f519fdbc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:28:50.791 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:50.683+0000 7f519fdbc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:28:51.138 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:50.823+0000 7f519fdbc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:28:51.138 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:51.136+0000 7f519fdbc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:28:51.355 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:28:51.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:51.197+0000 7f519fdbc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:51.381+0000 7f519fdbc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-mon[35231]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:28:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:51 smithi097 ceph-mon[35213]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:28:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:28:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:28:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:51 smithi092 ceph-mon[30834]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:28:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T10:28:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:28:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:51.619 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:28:52.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 -- 172.21.15.92:0/2508474514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 msgr2=0x7fce24109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 --2- 172.21.15.92:0/2508474514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 0x7fce24109d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce1c009ca0 tx=0x7fce1c02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:28:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 -- 172.21.15.92:0/2508474514 shutdown_connections 2024-09-10T10:28:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 --2- 172.21.15.92:0/2508474514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 0x7fce24109d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 --2- 172.21.15.92:0/2508474514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce24104ff0 0x7fce241073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 --2- 172.21.15.92:0/2508474514 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce241026c0 0x7fce24104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 -- 172.21.15.92:0/2508474514 >> 172.21.15.92:0/2508474514 conn(0x7fce240fc280 msgr2=0x7fce240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:28:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 -- 172.21.15.92:0/2508474514 shutdown_connections 2024-09-10T10:28:52.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 -- 172.21.15.92:0/2508474514 wait complete. 2024-09-10T10:28:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.045+0000 7fce2b018640 1 Processor -- start 2024-09-10T10:28:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce2b018640 1 -- start start 2024-09-10T10:28:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce2b018640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce241026c0 0x7fce24197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce2b018640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce24104ff0 0x7fce241984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce2b018640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 0x7fce2419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce2b018640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce2410d900 con 0x7fce24107920 2024-09-10T10:28:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce2b018640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fce2410d780 con 0x7fce24104ff0 2024-09-10T10:28:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce2b018640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce2410da80 con 0x7fce241026c0 2024-09-10T10:28:52.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce295b5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 0x7fce2419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce28db4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce241026c0 0x7fce24197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce295b5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 0x7fce2419f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41848/0 (socket says 172.21.15.92:41848) 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce295b5640 1 -- 172.21.15.92:0/2222472822 learned_addr learned my addr 172.21.15.92:0/2222472822 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce23fff640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce24104ff0 0x7fce241984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce295b5640 1 -- 172.21.15.92:0/2222472822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce241026c0 msgr2=0x7fce24197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce295b5640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce241026c0 0x7fce24197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce295b5640 1 -- 172.21.15.92:0/2222472822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce24104ff0 msgr2=0x7fce241984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce295b5640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce24104ff0 0x7fce241984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce295b5640 1 -- 172.21.15.92:0/2222472822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2419fb90 con 0x7fce24107920 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.046+0000 7fce295b5640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 0x7fce2419f520 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce1c005e30 tx=0x7fce1c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:52.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.047+0000 7fce21ffb640 1 -- 172.21.15.92:0/2222472822 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c003b70 con 0x7fce24107920 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.047+0000 7fce21ffb640 1 -- 172.21.15.92:0/2222472822 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce1c003d10 con 0x7fce24107920 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.047+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2419fe20 con 0x7fce24107920 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.047+0000 7fce21ffb640 1 -- 172.21.15.92:0/2222472822 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1c02fd30 con 0x7fce24107920 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.047+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce241a03a0 con 0x7fce24107920 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.048+0000 7fce21ffb640 1 -- 172.21.15.92:0/2222472822 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fce1c0305c0 con 0x7fce24107920 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.048+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce240fdd70 con 0x7fce24107920 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.048+0000 7fce21ffb640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce140392c0 0x7fce1403b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.048+0000 7fce21ffb640 1 -- 172.21.15.92:0/2222472822 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fce1c06d5e0 con 0x7fce24107920 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.048+0000 7fce28db4640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce140392c0 0x7fce1403b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:28:52.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.048+0000 7fce28db4640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce140392c0 0x7fce1403b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce18009990 tx=0x7fce18009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:28:52.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.053+0000 7fce21ffb640 1 -- 172.21.15.92:0/2222472822 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce1c039380 con 0x7fce24107920 2024-09-10T10:28:52.225 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 systemd[1]: Starting Ceph mgr.y for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:28:52.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:52.231+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fce24062630 con 0x7fce140392c0 2024-09-10T10:28:52.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:52 smithi092 ceph-mon[30834]: Deploying daemon mgr.y on smithi097 2024-09-10T10:28:52.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:52 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:28:52.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:52 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:28:52.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:52 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:52.501 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:52 smithi097 ceph-mon[35213]: Deploying daemon mgr.y on smithi097 2024-09-10T10:28:52.502 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:52 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:28:52.502 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:52 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:28:52.502 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:52 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:52.502 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 podman[36562]: 2024-09-10 10:28:52.126476111 +0000 UTC m=+0.015739719 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:28:52.502 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 podman[36562]: 2024-09-10 10:28:52.232454016 +0000 UTC m=+0.121717614 container create 0932454f55264bea4a7e3ca17f96f1f2dd5826abe7da1bfc8fe8e3a334e33cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:28:52.502 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 podman[36562]: 2024-09-10 10:28:52.44305415 +0000 UTC m=+0.332317751 container init 0932454f55264bea4a7e3ca17f96f1f2dd5826abe7da1bfc8fe8e3a334e33cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:28:52.503 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 podman[36562]: 2024-09-10 10:28:52.446573215 +0000 UTC m=+0.335836815 container start 0932454f55264bea4a7e3ca17f96f1f2dd5826abe7da1bfc8fe8e3a334e33cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:28:52.503 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 ceph-mgr[36581]: -- 172.21.15.97:0/2107716905 <== mon.2 v2:172.21.15.97:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5596231750e0 con 0x559623152800 2024-09-10T10:28:52.503 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 bash[36562]: 0932454f55264bea4a7e3ca17f96f1f2dd5826abe7da1bfc8fe8e3a334e33cc5 2024-09-10T10:28:52.540 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:52.265+0000 7f519fdbc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:28:52.541 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:52.332+0000 7f519fdbc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:28:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:52 smithi121 ceph-mon[35231]: Deploying daemon mgr.y on smithi097 2024-09-10T10:28:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:52 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:28:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:52 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:28:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:52 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:52.787 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 systemd[1]: Started Ceph mgr.y for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:28:52.787 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:52.569+0000 7f8284ccc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:28:52.787 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:52.627+0000 7f8284ccc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:28:52.787 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:52.784+0000 7f8284ccc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:28:53.038 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:52 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:52.853+0000 7f8284ccc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:28:53.039 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:53.036+0000 7f8284ccc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:28:53.320 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:53.188+0000 7f8284ccc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:28:53.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-mon[35213]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:53.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-mon[35213]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:53.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:53.342 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.083+0000 7f519fdbc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:28:53.342 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.199+0000 7f519fdbc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:28:53.342 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.340+0000 7f519fdbc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:28:53.342 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-mon[35231]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:53.343 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-mon[35231]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:53.343 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.343 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.343 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.343 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.343 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:53.601 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.406+0000 7f519fdbc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:28:53.601 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.564+0000 7f519fdbc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:28:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:53 smithi092 ceph-mon[30834]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:53 smithi092 ceph-mon[30834]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:28:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:28:53.785 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:53.513+0000 7f8284ccc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:28:53.786 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:53.574+0000 7f8284ccc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:28:53.786 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:53.783+0000 7f8284ccc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:28:53.858 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.633+0000 7f519fdbc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:28:53.858 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.693+0000 7f519fdbc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:28:53.858 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.857+0000 7f519fdbc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:28:54.137 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.924+0000 7f519fdbc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:28:54.138 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:53.993+0000 7f519fdbc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:28:54.138 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:54.077+0000 7f519fdbc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:28:54.540 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:54.136+0000 7f519fdbc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:28:54.541 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:54.194+0000 7f519fdbc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:28:54.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:54.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:54.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:54.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: Reconfiguring daemon mgr.x on smithi092 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2860700678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1c3ff3a-9a5b-4d65-83f1-22fda2993201"}]: dispatch 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2860700678' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1c3ff3a-9a5b-4d65-83f1-22fda2993201"}]': finished 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T10:28:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:28:55.041 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:28:54.978+0000 7f519fdbc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:28:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: Reconfiguring daemon mgr.x on smithi092 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2860700678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1c3ff3a-9a5b-4d65-83f1-22fda2993201"}]: dispatch 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2860700678' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1c3ff3a-9a5b-4d65-83f1-22fda2993201"}]': finished 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T10:28:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:28:55.070 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:54.671+0000 7f8284ccc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:28:55.070 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:54.739+0000 7f8284ccc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:28:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: Reconfiguring daemon mgr.x on smithi092 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2860700678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1c3ff3a-9a5b-4d65-83f1-22fda2993201"}]: dispatch 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2860700678' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1c3ff3a-9a5b-4d65-83f1-22fda2993201"}]': finished 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T10:28:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:28:55.707 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:55.452+0000 7f8284ccc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:28:55.707 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:55.565+0000 7f8284ccc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:28:55.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:55.898+0000 7fce21ffb640 1 -- 172.21.15.92:0/2222472822 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7fce1c043cf0 con 0x7fce24107920 2024-09-10T10:28:55.983 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/640366285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:28:55.983 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-mon[35213]: Standby manager daemon z started 2024-09-10T10:28:55.983 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:28:55.983 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:28:55.983 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:28:55.983 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:28:55.983 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:55.705+0000 7f8284ccc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:28:55.983 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:55.766+0000 7f8284ccc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:28:55.984 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:55.914+0000 7f8284ccc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:28:55.984 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:55.981+0000 7f8284ccc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:28:56.262 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:56.040+0000 7f8284ccc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:28:56.262 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:56.197+0000 7f8284ccc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:28:56.262 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:56.261+0000 7f8284ccc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:28:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:55 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/640366285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:28:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:55 smithi121 ceph-mon[35231]: Standby manager daemon z started 2024-09-10T10:28:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:55 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:28:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:55 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:28:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:55 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:28:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:55 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:28:56.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:55 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/640366285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:28:56.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:55 smithi092 ceph-mon[30834]: Standby manager daemon z started 2024-09-10T10:28:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:55 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:28:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:55 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:28:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:55 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:28:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:55 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.121:0/1969388891' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:28:56.525 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:56.326+0000 7f8284ccc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:28:56.525 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:56.407+0000 7f8284ccc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:28:56.525 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:56.466+0000 7f8284ccc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:28:56.525 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:56.524+0000 7f8284ccc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:28:57.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:56 smithi121 ceph-mon[35231]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-10T10:28:57.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:56 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:28:57.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:56 smithi121 ceph-mon[35231]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:57.303 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-mon[35213]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-10T10:28:57.303 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:28:57.303 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:56 smithi097 ceph-mon[35213]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:57.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:56 smithi092 ceph-mon[30834]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-10T10:28:57.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:56 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:28:57.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:56 smithi092 ceph-mon[30834]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:57.570 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:28:57 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:28:57.301+0000 7f8284ccc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:28:57.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:28:57.908+0000 7fce21ffb640 1 -- 172.21.15.92:0/2222472822 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fce1c030c80 con 0x7fce24107920 2024-09-10T10:28:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:57 smithi121 ceph-mon[35231]: Standby manager daemon y started 2024-09-10T10:28:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:57 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:28:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:57 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:28:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:57 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:28:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:57 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:28:58.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:57 smithi097 ceph-mon[35213]: Standby manager daemon y started 2024-09-10T10:28:58.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:57 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:28:58.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:57 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:28:58.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:57 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:28:58.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:57 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:28:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:57 smithi092 ceph-mon[30834]: Standby manager daemon y started 2024-09-10T10:28:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:57 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:28:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:57 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:28:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:57 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:28:58.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:57 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.97:0/3408556057' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:28:59.193 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:58 smithi092 ceph-mon[30834]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-10T10:28:59.193 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:28:59.193 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:28:58 smithi092 ceph-mon[30834]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:59.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:58 smithi121 ceph-mon[35231]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-10T10:28:59.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:58 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:28:59.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:28:58 smithi121 ceph-mon[35231]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:28:59.319 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:58 smithi097 ceph-mon[35213]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-10T10:28:59.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:58 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:28:59.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:28:58 smithi097 ceph-mon[35213]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:01.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:01 smithi092 ceph-mon[30834]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:01.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:01.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:01.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:01.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:01 smithi121 ceph-mon[35231]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:01.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:01.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:01.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:01.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:01 smithi097 ceph-mon[35213]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:01.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:01.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:01.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:02.268 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:02.268 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:02.268 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:02.442 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:02.443 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:02.443 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:02.471 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:02.471 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:02.471 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:03.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:03 smithi092 ceph-mon[30834]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:03.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:29:03.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:03.455 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:03 smithi121 ceph-mon[35231]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:03.455 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:29:03.456 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:03.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:03 smithi097 ceph-mon[35213]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:03.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T10:29:03.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:04.407 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:04 smithi092 ceph-mon[30834]: Deploying daemon osd.0 on smithi092 2024-09-10T10:29:04.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:04 smithi121 ceph-mon[35231]: Deploying daemon osd.0 on smithi092 2024-09-10T10:29:04.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:04 smithi097 ceph-mon[35213]: Deploying daemon osd.0 on smithi092 2024-09-10T10:29:05.407 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:05 smithi092 ceph-mon[30834]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:05.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:05 smithi121 ceph-mon[35231]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:05.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:05 smithi097 ceph-mon[35213]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:07.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:07 smithi121 ceph-mon[35231]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:07.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:07 smithi097 ceph-mon[35213]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:07.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:07 smithi092 ceph-mon[30834]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:09.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:09 smithi092 ceph-mon[30834]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:09.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:09 smithi121 ceph-mon[35231]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:09.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:09 smithi097 ceph-mon[35213]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:10.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:10.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:10.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:10.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:10.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:10.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:10.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:10.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:10.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:11.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:11 smithi092 ceph-mon[30834]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:11.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:11 smithi121 ceph-mon[35231]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:11 smithi097 ceph-mon[35213]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:12.845 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:12 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:12.846 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:12 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:12.846 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:12 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:12.846 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:12 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:12.846 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:12 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:12.846 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:12 smithi092 ceph-mon[30834]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:13.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:12 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:13.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:12 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:13.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:12 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:13.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:12 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:13.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:12 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:13.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:12 smithi121 ceph-mon[35231]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:13.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:12 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:13.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:12 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:13.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:12 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:13.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:12 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:13.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:12 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:13.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:12 smithi097 ceph-mon[35213]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:13.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.137+0000 7fce21ffb640 1 -- 172.21.15.92:0/2222472822 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fce24062630 con 0x7fce140392c0 2024-09-10T10:29:13.139 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 0 on host 'smithi092' 2024-09-10T10:29:13.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce140392c0 msgr2=0x7fce1403b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:13.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce140392c0 0x7fce1403b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce18009990 tx=0x7fce18009110 comp rx=0 tx=0).stop 2024-09-10T10:29:13.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 msgr2=0x7fce2419f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:13.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 0x7fce2419f520 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fce1c005e30 tx=0x7fce1c031ee0 comp rx=0 tx=0).stop 2024-09-10T10:29:13.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 shutdown_connections 2024-09-10T10:29:13.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce140392c0 0x7fce1403b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:13.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce24107920 0x7fce2419f520 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:13.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce24104ff0 0x7fce241984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:13.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 --2- 172.21.15.92:0/2222472822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce241026c0 0x7fce24197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:13.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 >> 172.21.15.92:0/2222472822 conn(0x7fce240fc280 msgr2=0x7fce24102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:29:13.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 shutdown_connections 2024-09-10T10:29:13.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:29:13.139+0000 7fce2b018640 1 -- 172.21.15.92:0/2222472822 wait complete. 2024-09-10T10:29:13.708 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:13.708 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:13.708 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:13.710 DEBUG:teuthology.orchestra.run.smithi092:osd.0> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T10:29:13.712 INFO:tasks.cephadm:Deploying osd.1 on smithi097 with /dev/vg_nvme/lv_4... 2024-09-10T10:29:13.712 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T10:29:13.955 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:29:14.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:14.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:14.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:14.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:14.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:14.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:14.890 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:14 smithi092 ceph-mon[30834]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:14.952 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:14 smithi097 ceph-mon[35213]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:15.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:14 smithi121 ceph-mon[35231]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:15.611 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:29:15 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0[44642]: 2024-09-10T10:29:15.268+0000 7f0101e98640 -1 osd.0 0 log_to_monitors true 2024-09-10T10:29:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:15 smithi097 ceph-mon[35213]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:29:15.954 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:15 smithi092 ceph-mon[30834]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:29:16.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:15 smithi121 ceph-mon[35231]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T10:29:16.203 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:29:16.228 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi097:vg_nvme/lv_4 2024-09-10T10:29:16.476 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:29:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:29:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T10:29:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:29:16.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:16.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:16.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:16.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:16.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:29:16.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:16.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:16.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:16.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:16.860 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0[44642]: 2024-09-10T10:29:16.638+0000 7f00fde1b640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T10:29:16.861 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0[44642]: 2024-09-10T10:29:16.641+0000 7f00f9c43640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:29:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:29:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T10:29:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:29:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:29:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:16.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/3735448903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 msgr2=0x7fbb38109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:16.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/3735448903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 0x7fbb38109d10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009ca0 tx=0x7fbb3002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:29:16.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/3735448903 shutdown_connections 2024-09-10T10:29:16.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/3735448903 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 0x7fbb38109d10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:16.915 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/3735448903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb38104f90 0x7fbb38107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/3735448903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38102660 0x7fbb38104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/3735448903 >> 172.21.15.97:0/3735448903 conn(0x7fbb380fc280 msgr2=0x7fbb380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/3735448903 shutdown_connections 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/3735448903 wait complete. 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 Processor -- start 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.912+0000 7fbb3ea6b640 1 -- start start 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3ea6b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38102660 0x7fbb38197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3ea6b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb38104f90 0x7fbb38198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3ea6b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 0x7fbb3819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3ea6b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810d860 con 0x7fbb38104f90 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3ea6b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810d6e0 con 0x7fbb381078c0 2024-09-10T10:29:16.916 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3ea6b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3810d9e0 con 0x7fbb38102660 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3d008640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 0x7fbb3819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3d008640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 0x7fbb3819f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:60230/0 (socket says 172.21.15.97:60230) 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3d008640 1 -- 172.21.15.97:0/186587881 learned_addr learned my addr 172.21.15.97:0/186587881 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb37fff640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb38104f90 0x7fbb38198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3c807640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38102660 0x7fbb38197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3d008640 1 -- 172.21.15.97:0/186587881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38102660 msgr2=0x7fbb38197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3d008640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38102660 0x7fbb38197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3d008640 1 -- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb38104f90 msgr2=0x7fbb38198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3d008640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb38104f90 0x7fbb38198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3d008640 1 -- 172.21.15.97:0/186587881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3819faf0 con 0x7fbb381078c0 2024-09-10T10:29:16.917 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb37fff640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb38104f90 0x7fbb38198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:29:16.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3d008640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 0x7fbb3819f480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbb30031ae0 tx=0x7fbb30031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:29:16.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb35ffb640 1 -- 172.21.15.97:0/186587881 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30003c30 con 0x7fbb381078c0 2024-09-10T10:29:16.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb35ffb640 1 -- 172.21.15.97:0/186587881 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb30003dd0 con 0x7fbb381078c0 2024-09-10T10:29:16.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3819fd80 con 0x7fbb381078c0 2024-09-10T10:29:16.918 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.913+0000 7fbb35ffb640 1 -- 172.21.15.97:0/186587881 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3002fcb0 con 0x7fbb381078c0 2024-09-10T10:29:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.914+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb381a0290 con 0x7fbb381078c0 2024-09-10T10:29:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.915+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb380fdd70 con 0x7fbb381078c0 2024-09-10T10:29:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.916+0000 7fbb35ffb640 1 -- 172.21.15.97:0/186587881 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fbb30004050 con 0x7fbb381078c0 2024-09-10T10:29:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.916+0000 7fbb35ffb640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbb280a2ba0 0x7fbb280a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:29:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.917+0000 7fbb35ffb640 1 -- 172.21.15.97:0/186587881 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fbb300ee850 con 0x7fbb381078c0 2024-09-10T10:29:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.917+0000 7fbb3c807640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbb280a2ba0 0x7fbb280a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:29:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.917+0000 7fbb3c807640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbb280a2ba0 0x7fbb280a5060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c005d00 tx=0x7fbb2c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:29:16.921 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:16.920+0000 7fbb35ffb640 1 -- 172.21.15.97:0/186587881 <== mon.2 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb300bd340 con 0x7fbb381078c0 2024-09-10T10:29:17.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T10:29:17.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T10:29:17.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:29:17.044 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:17.044 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T10:29:17.044 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:17.044 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:17.044 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:29:17.044 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:17.044 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:17.044 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:17.044 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:17.103 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:17.102+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbb38062630 con 0x7fbb280a2ba0 2024-09-10T10:29:17.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi092 2024-09-10T10:29:17.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-10T10:29:17.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:29:17.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T10:29:17.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:17.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:17.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:29:17.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:29:17.789 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:29:17.789 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:17.798 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi092 2024-09-10T10:29:17.798 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-10T10:29:17.798 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:29:17.798 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T10:29:17.798 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:17.798 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:17.799 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:29:17.799 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:29:17.799 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:29:17.799 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi092 2024-09-10T10:29:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-10T10:29:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: from='osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:29:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T10:29:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:29:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:29:18.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:29:18.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:18.978 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:18 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:29:18.979 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:18 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:29:18.979 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:18 smithi097 ceph-mon[35213]: osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] boot 2024-09-10T10:29:18.979 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:18 smithi097 ceph-mon[35213]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T10:29:18.979 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:18 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:18.979 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:18 smithi097 ceph-mon[35213]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:19.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:18 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:29:19.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:18 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:29:19.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:18 smithi121 ceph-mon[35231]: osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] boot 2024-09-10T10:29:19.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:18 smithi121 ceph-mon[35231]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T10:29:19.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:18 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:19.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:18 smithi121 ceph-mon[35231]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:19.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:18 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:29:19.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:18 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:29:19.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:18 smithi092 ceph-mon[30834]: osd.0 [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] boot 2024-09-10T10:29:19.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:18 smithi092 ceph-mon[30834]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T10:29:19.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:18 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:29:19.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:18 smithi092 ceph-mon[30834]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:19 smithi097 ceph-mon[35213]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T10:29:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:19 smithi097 ceph-mon[35213]: from='client.? 172.21.15.97:0/1781973286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618212b8-db9b-4682-8a6b-f021f814c0e0"}]: dispatch 2024-09-10T10:29:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:19 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618212b8-db9b-4682-8a6b-f021f814c0e0"}]: dispatch 2024-09-10T10:29:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:19 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "618212b8-db9b-4682-8a6b-f021f814c0e0"}]': finished 2024-09-10T10:29:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:19 smithi097 ceph-mon[35213]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T10:29:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:20.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:19 smithi121 ceph-mon[35231]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T10:29:20.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:19 smithi121 ceph-mon[35231]: from='client.? 172.21.15.97:0/1781973286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618212b8-db9b-4682-8a6b-f021f814c0e0"}]: dispatch 2024-09-10T10:29:20.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:19 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618212b8-db9b-4682-8a6b-f021f814c0e0"}]: dispatch 2024-09-10T10:29:20.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:19 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "618212b8-db9b-4682-8a6b-f021f814c0e0"}]': finished 2024-09-10T10:29:20.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:19 smithi121 ceph-mon[35231]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T10:29:20.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:20.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:19 smithi092 ceph-mon[30834]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T10:29:20.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:19 smithi092 ceph-mon[30834]: from='client.? 172.21.15.97:0/1781973286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618212b8-db9b-4682-8a6b-f021f814c0e0"}]: dispatch 2024-09-10T10:29:20.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:19 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "618212b8-db9b-4682-8a6b-f021f814c0e0"}]: dispatch 2024-09-10T10:29:20.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:19 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "618212b8-db9b-4682-8a6b-f021f814c0e0"}]': finished 2024-09-10T10:29:20.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:19 smithi092 ceph-mon[30834]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T10:29:20.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:21.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:20 smithi121 ceph-mon[35231]: from='client.? 172.21.15.97:0/3494874045' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:29:21.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:20 smithi121 ceph-mon[35231]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:21.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:20 smithi097 ceph-mon[35213]: from='client.? 172.21.15.97:0/3494874045' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:29:21.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:20 smithi097 ceph-mon[35213]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:21.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:20 smithi092 ceph-mon[30834]: from='client.? 172.21.15.97:0/3494874045' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:29:21.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:20 smithi092 ceph-mon[30834]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:23.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:23 smithi121 ceph-mon[35231]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:23.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:23 smithi097 ceph-mon[35213]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:23.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:23 smithi092 ceph-mon[30834]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:25.236 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:25 smithi097 ceph-mon[35213]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:25.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:25 smithi121 ceph-mon[35231]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:25.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:25 smithi092 ceph-mon[30834]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:27.254 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:27 smithi097 ceph-mon[35213]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:27.254 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:29:27.254 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:27.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:27 smithi121 ceph-mon[35231]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:27.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:29:27.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:27.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:27 smithi092 ceph-mon[30834]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:27.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T10:29:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:28.439 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:28 smithi097 ceph-mon[35213]: Deploying daemon osd.1 on smithi097 2024-09-10T10:29:28.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:28 smithi121 ceph-mon[35231]: Deploying daemon osd.1 on smithi097 2024-09-10T10:29:28.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:28 smithi092 ceph-mon[30834]: Deploying daemon osd.1 on smithi097 2024-09-10T10:29:29.513 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:29 smithi097 ceph-mon[35213]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:29.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:29 smithi121 ceph-mon[35231]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:29.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:29 smithi092 ceph-mon[30834]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:31.526 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:31 smithi097 ceph-mon[35213]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:31.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:31 smithi121 ceph-mon[35231]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:31 smithi092 ceph-mon[30834]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:33.459 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:33 smithi097 ceph-mon[35213]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:33.459 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:33.460 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:33.460 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:33.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:33 smithi121 ceph-mon[35231]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:33 smithi092 ceph-mon[30834]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:35.299 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:35 smithi097 ceph-mon[35213]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:35.300 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:35.300 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:35.300 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:35.300 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:35.300 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:35 smithi121 ceph-mon[35231]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:35 smithi092 ceph-mon[30834]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:35.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:35.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:35.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:36.965 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.964+0000 7fbb35ffb640 1 -- 172.21.15.97:0/186587881 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbb38062630 con 0x7fbb280a2ba0 2024-09-10T10:29:36.965 INFO:teuthology.orchestra.run.smithi097.stdout:Created osd(s) 1 on host 'smithi097' 2024-09-10T10:29:36.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbb280a2ba0 msgr2=0x7fbb280a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:36.967 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbb280a2ba0 0x7fbb280a5060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c005d00 tx=0x7fbb2c00b410 comp rx=0 tx=0).stop 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 msgr2=0x7fbb3819f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 0x7fbb3819f480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbb30031ae0 tx=0x7fbb30031ee0 comp rx=0 tx=0).stop 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 shutdown_connections 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbb280a2ba0 0x7fbb280a5060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb381078c0 0x7fbb3819f480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb38104f90 0x7fbb38198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 --2- 172.21.15.97:0/186587881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38102660 0x7fbb38197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 >> 172.21.15.97:0/186587881 conn(0x7fbb380fc280 msgr2=0x7fbb38102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 shutdown_connections 2024-09-10T10:29:36.968 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:29:36.966+0000 7fbb3ea6b640 1 -- 172.21.15.97:0/186587881 wait complete. 2024-09-10T10:29:37.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:37 smithi097 ceph-mon[35213]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:37.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:37.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:37.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:37.490 DEBUG:teuthology.orchestra.run.smithi097:osd.1> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T10:29:37.493 INFO:tasks.cephadm:Deploying osd.2 on smithi121 with /dev/vg_nvme/lv_4... 2024-09-10T10:29:37.493 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T10:29:37.521 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:37 smithi121 ceph-mon[35231]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:37.521 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:37.521 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:37.521 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:37.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:37 smithi092 ceph-mon[30834]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:37.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:37.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:37.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:37.745 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:29:39.151 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:29:38 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1[39656]: 2024-09-10T10:29:38.975+0000 7fa55e869640 -1 osd.1 0 log_to_monitors true 2024-09-10T10:29:39.506 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:39 smithi121 ceph-mon[35231]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:39.506 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:39 smithi121 ceph-mon[35231]: from='osd.1 [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:29:39.506 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:39 smithi121 ceph-mon[35231]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:29:39.538 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:39 smithi097 ceph-mon[35213]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:39.538 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:39 smithi097 ceph-mon[35213]: from='osd.1 [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:29:39.538 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:39 smithi097 ceph-mon[35213]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:29:39.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:39 smithi092 ceph-mon[30834]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:39.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:39 smithi092 ceph-mon[30834]: from='osd.1 [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:29:39.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:39 smithi092 ceph-mon[30834]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T10:29:40.194 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:29:40.202 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:40 smithi097 ceph-mon[35213]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:29:40.202 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:40 smithi097 ceph-mon[35213]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T10:29:40.202 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:40 smithi097 ceph-mon[35213]: from='osd.1 [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:29:40.203 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:40 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:40.203 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:40 smithi097 ceph-mon[35213]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:29:40.203 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:40 smithi097 ceph-mon[35213]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:29:40.217 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:40 smithi121 ceph-mon[35231]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:29:40.217 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:40 smithi121 ceph-mon[35231]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T10:29:40.217 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:40 smithi121 ceph-mon[35231]: from='osd.1 [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:29:40.217 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:40 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:40.217 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:40 smithi121 ceph-mon[35231]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:29:40.217 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:40 smithi121 ceph-mon[35231]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:29:40.218 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_4 2024-09-10T10:29:40.505 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:29:40.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:40 smithi092 ceph-mon[30834]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T10:29:40.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:40 smithi092 ceph-mon[30834]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T10:29:40.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:40 smithi092 ceph-mon[30834]: from='osd.1 [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:29:40.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:40 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:40.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:40 smithi092 ceph-mon[30834]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:29:40.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:40 smithi092 ceph-mon[30834]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:29:40.820 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:29:40 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1[39656]: 2024-09-10T10:29:40.564+0000 7fa55a7ec640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T10:29:40.820 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:29:40 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1[39656]: 2024-09-10T10:29:40.567+0000 7fa55260c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:29:40.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.903+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3096909826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0100b10 msgr2=0x7f31e0100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:40.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.903+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3096909826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0100b10 0x7f31e0100f10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009900 tx=0x7f31d402a410 comp rx=0 tx=0).stop 2024-09-10T10:29:40.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.903+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3096909826 shutdown_connections 2024-09-10T10:29:40.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.903+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3096909826 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31e01026d0 0x7f31e0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:40.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.903+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3096909826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e0101d10 0x7f31e0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:40.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.903+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3096909826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0100b10 0x7f31e0100f10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:40.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.903+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3096909826 >> 172.21.15.121:0/3096909826 conn(0x7f31e00fc2a0 msgr2=0x7f31e00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:29:40.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.903+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3096909826 shutdown_connections 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.903+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3096909826 wait complete. 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31e6eb9640 1 Processor -- start 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31e6eb9640 1 -- start start 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31e6eb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31e0100b10 0x7f31e006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31e6eb9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0101d10 0x7f31e019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31e6eb9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e01026d0 0x7f31e019f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31e6eb9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f31e010c7f0 con 0x7f31e01026d0 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31e6eb9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f31e010c670 con 0x7f31e0100b10 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31e6eb9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f31e010c970 con 0x7f31e0101d10 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31dffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0101d10 0x7f31e019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:29:40.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31e4c55640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31e0100b10 0x7f31e006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31dffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0101d10 0x7f31e019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43454/0 (socket says 172.21.15.121:43454) 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.904+0000 7f31dffff640 1 -- 172.21.15.121:0/3375921067 learned_addr learned my addr 172.21.15.121:0/3375921067 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31e5456640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e01026d0 0x7f31e019f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31dffff640 1 -- 172.21.15.121:0/3375921067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31e0100b10 msgr2=0x7f31e006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31dffff640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31e0100b10 0x7f31e006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31dffff640 1 -- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e01026d0 msgr2=0x7f31e019f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31dffff640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e01026d0 0x7f31e019f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31dffff640 1 -- 172.21.15.121:0/3375921067 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e019fc40 con 0x7f31e0101d10 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31e5456640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e01026d0 0x7f31e019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31e4c55640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31e0100b10 0x7f31e006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31dffff640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0101d10 0x7f31e019cd10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00b4a0 tx=0x7f31cc00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:29:40.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31ddffb640 1 -- 172.21.15.121:0/3375921067 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc014070 con 0x7f31e0101d10 2024-09-10T10:29:40.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31ddffb640 1 -- 172.21.15.121:0/3375921067 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31cc010af0 con 0x7f31e0101d10 2024-09-10T10:29:40.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e0196b40 con 0x7f31e0101d10 2024-09-10T10:29:40.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31ddffb640 1 -- 172.21.15.121:0/3375921067 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc017d10 con 0x7f31e0101d10 2024-09-10T10:29:40.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.905+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e0197080 con 0x7f31e0101d10 2024-09-10T10:29:40.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.906+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e0107f60 con 0x7f31e0101d10 2024-09-10T10:29:40.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.907+0000 7f31ddffb640 1 -- 172.21.15.121:0/3375921067 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f31cc017070 con 0x7f31e0101d10 2024-09-10T10:29:40.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.908+0000 7f31ddffb640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31d00a2af0 0x7f31d00a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:29:40.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.908+0000 7f31ddffb640 1 -- 172.21.15.121:0/3375921067 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f31cc0cca90 con 0x7f31e0101d10 2024-09-10T10:29:40.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.908+0000 7f31e4c55640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31d00a2af0 0x7f31d00a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:29:40.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.909+0000 7f31e4c55640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31d00a2af0 0x7f31d00a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f31d4005ab0 tx=0x7f31d403c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:29:40.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:40.913+0000 7f31ddffb640 1 -- 172.21.15.121:0/3375921067 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31cc09b340 con 0x7f31e0101d10 2024-09-10T10:29:41.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:29:41.095+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f31e0062630 con 0x7f31d00a2af0 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi097 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi097 to 17088M 2024-09-10T10:29:41.481 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:41.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:41.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='osd.1 ' entity='osd.1' 2024-09-10T10:29:41.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:29:41.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:29:41.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:41.482 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T10:29:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:41.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi097 2024-09-10T10:29:41.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:29:41.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi097 to 17088M 2024-09-10T10:29:41.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:41.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:41.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='osd.1 ' entity='osd.1' 2024-09-10T10:29:41.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:29:41.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:29:41.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:41.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:41.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi097 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi097 to 17088M 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='osd.1 ' entity='osd.1' 2024-09-10T10:29:41.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:29:41.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:29:41.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:41.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:42.441 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:42 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:29:42.442 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:42 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:29:42.442 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:42 smithi121 ceph-mon[35231]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:29:42.442 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:42 smithi121 ceph-mon[35231]: osd.1 [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] boot 2024-09-10T10:29:42.442 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:42 smithi121 ceph-mon[35231]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T10:29:42.442 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:42 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:42.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:42 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:29:42.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:42 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:29:42.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:42 smithi097 ceph-mon[35213]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:29:42.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:42 smithi097 ceph-mon[35213]: osd.1 [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] boot 2024-09-10T10:29:42.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:42 smithi097 ceph-mon[35213]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T10:29:42.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:42.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:42 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:29:42.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:42 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:29:42.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:42 smithi092 ceph-mon[30834]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:29:42.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:42 smithi092 ceph-mon[30834]: osd.1 [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] boot 2024-09-10T10:29:42.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:42 smithi092 ceph-mon[30834]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T10:29:42.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:42 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:29:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:43 smithi121 ceph-mon[35231]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:43 smithi121 ceph-mon[35231]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T10:29:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:43 smithi097 ceph-mon[35213]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:43 smithi097 ceph-mon[35213]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T10:29:43.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:43 smithi092 ceph-mon[30834]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T10:29:43.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:43 smithi092 ceph-mon[30834]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T10:29:44.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:44 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/2128629781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a872b862-b9b4-48e9-8130-87c1c7e5ef36"}]: dispatch 2024-09-10T10:29:44.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:44 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a872b862-b9b4-48e9-8130-87c1c7e5ef36"}]: dispatch 2024-09-10T10:29:44.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:44 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a872b862-b9b4-48e9-8130-87c1c7e5ef36"}]': finished 2024-09-10T10:29:44.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:44 smithi121 ceph-mon[35231]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T10:29:44.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:44 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:29:44.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:44 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/221445545' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:29:44.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:44 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/2128629781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a872b862-b9b4-48e9-8130-87c1c7e5ef36"}]: dispatch 2024-09-10T10:29:44.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:44 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a872b862-b9b4-48e9-8130-87c1c7e5ef36"}]: dispatch 2024-09-10T10:29:44.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:44 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a872b862-b9b4-48e9-8130-87c1c7e5ef36"}]': finished 2024-09-10T10:29:44.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:44 smithi097 ceph-mon[35213]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T10:29:44.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:44 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:29:44.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:44 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/221445545' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:29:44.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:44 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/2128629781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a872b862-b9b4-48e9-8130-87c1c7e5ef36"}]: dispatch 2024-09-10T10:29:44.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:44 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a872b862-b9b4-48e9-8130-87c1c7e5ef36"}]: dispatch 2024-09-10T10:29:44.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:44 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a872b862-b9b4-48e9-8130-87c1c7e5ef36"}]': finished 2024-09-10T10:29:44.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:44 smithi092 ceph-mon[30834]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T10:29:44.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:44 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:29:44.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:44 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/221445545' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:29:45.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:45 smithi121 ceph-mon[35231]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:45 smithi097 ceph-mon[35213]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:45.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:45 smithi092 ceph-mon[30834]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:47.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:47 smithi121 ceph-mon[35231]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:47.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:47 smithi097 ceph-mon[35213]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:47.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:47 smithi092 ceph-mon[30834]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:49.462 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:49 smithi121 ceph-mon[35231]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:49.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:49 smithi097 ceph-mon[35213]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:49.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:49 smithi092 ceph-mon[30834]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:51.288 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:51 smithi121 ceph-mon[35231]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:51 smithi097 ceph-mon[35213]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:51 smithi092 ceph-mon[30834]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:52 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:29:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:52 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:52.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:52 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:29:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:52 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:52.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:52 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T10:29:52.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:52 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:29:53.204 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:53 smithi121 ceph-mon[35231]: Deploying daemon osd.2 on smithi121 2024-09-10T10:29:53.204 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:53 smithi121 ceph-mon[35231]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:53 smithi097 ceph-mon[35213]: Deploying daemon osd.2 on smithi121 2024-09-10T10:29:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:53 smithi097 ceph-mon[35213]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:53 smithi092 ceph-mon[30834]: Deploying daemon osd.2 on smithi121 2024-09-10T10:29:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:53 smithi092 ceph-mon[30834]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:55 smithi121 ceph-mon[35231]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:55 smithi097 ceph-mon[35213]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:55.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:55 smithi092 ceph-mon[30834]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:57.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:57 smithi121 ceph-mon[35231]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:57 smithi097 ceph-mon[35213]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:57.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:57 smithi092 ceph-mon[30834]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:58.388 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:58 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:58.389 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:58 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:58.389 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:58 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:58 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:58 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:58 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:29:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:58.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:29:59.353 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:29:59 smithi121 ceph-mon[35231]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:59.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:29:59 smithi097 ceph-mon[35213]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:29:59.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:29:59 smithi092 ceph-mon[30834]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:01.167 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:00 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:01.168 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:00 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:01.168 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:00 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:01.168 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:00 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:01.168 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:00 smithi121 ceph-mon[35231]: overall HEALTH_OK 2024-09-10T10:30:01.168 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:00 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:01.168 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:00 smithi121 ceph-mon[35231]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:01.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:00 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:01.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:00 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:01.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:00 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:01.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:00 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:01.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:00 smithi097 ceph-mon[35213]: overall HEALTH_OK 2024-09-10T10:30:01.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:00 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:01.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:00 smithi097 ceph-mon[35213]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:01.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:00 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:01.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:00 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:01.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:00 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:01.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:00 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:01.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:00 smithi092 ceph-mon[30834]: overall HEALTH_OK 2024-09-10T10:30:01.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:00 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:01.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:00 smithi092 ceph-mon[30834]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:01.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.534+0000 7f31ddffb640 1 -- 172.21.15.121:0/3375921067 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f31e0062630 con 0x7f31d00a2af0 2024-09-10T10:30:01.537 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 2 on host 'smithi121' 2024-09-10T10:30:01.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31d00a2af0 msgr2=0x7f31d00a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:01.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31d00a2af0 0x7f31d00a4fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f31d4005ab0 tx=0x7f31d403c040 comp rx=0 tx=0).stop 2024-09-10T10:30:01.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0101d10 msgr2=0x7f31e019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:01.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0101d10 0x7f31e019cd10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00b4a0 tx=0x7f31cc00b960 comp rx=0 tx=0).stop 2024-09-10T10:30:01.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 shutdown_connections 2024-09-10T10:30:01.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31d00a2af0 0x7f31d00a4fb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:01.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31e01026d0 0x7f31e019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:01.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31e0101d10 0x7f31e019cd10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:01.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 --2- 172.21.15.121:0/3375921067 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f31e0100b10 0x7f31e006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:01.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 >> 172.21.15.121:0/3375921067 conn(0x7f31e00fc2a0 msgr2=0x7f31e0105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:30:01.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 shutdown_connections 2024-09-10T10:30:01.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:01.537+0000 7f31e6eb9640 1 -- 172.21.15.121:0/3375921067 wait complete. 2024-09-10T10:30:02.147 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:02.147 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:02.147 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:02.173 DEBUG:teuthology.orchestra.run.smithi121:osd.2> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T10:30:02.175 INFO:tasks.cephadm:Deploying osd.3 on smithi092 with /dev/vg_nvme/lv_3... 2024-09-10T10:30:02.176 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T10:30:02.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:02.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:02.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:02.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:02.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:02.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:02.417 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:30:03.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:03 smithi092 ceph-mon[30834]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:03.285 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:03 smithi121 ceph-mon[35231]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:03.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:03 smithi097 ceph-mon[35213]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:04.019 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2[40193]: 2024-09-10T10:30:03.667+0000 7f0f9a9fa640 -1 osd.2 0 log_to_monitors true 2024-09-10T10:30:04.274 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:04 smithi121 ceph-mon[35231]: from='osd.2 [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:30:04.274 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:04 smithi121 ceph-mon[35231]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:30:04.289 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:04 smithi092 ceph-mon[30834]: from='osd.2 [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:30:04.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:04 smithi092 ceph-mon[30834]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:30:04.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:04 smithi097 ceph-mon[35213]: from='osd.2 [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:30:04.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:04 smithi097 ceph-mon[35213]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T10:30:04.758 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:30:04.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2024-09-10T10:30:05.036 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:30:05.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:30:05.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T10:30:05.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:05.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='osd.2 [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:30:05.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:30:05.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:05.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:05.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:05.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:05.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:05.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:05.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:05 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:05.290 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2[40193]: 2024-09-10T10:30:05.035+0000 7f0f9697d640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T10:30:05.290 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2[40193]: 2024-09-10T10:30:05.038+0000 7f0f927a5640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='osd.2 [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:05.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:05.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:05 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='osd.2 [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:05.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:05.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:05.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:05 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:05.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 -- 172.21.15.92:0/3761463227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 msgr2=0x7fa33c103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 --2- 172.21.15.92:0/3761463227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 0x7fa33c103290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009900 tx=0x7fa32c02a410 comp rx=0 tx=0).stop 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 -- 172.21.15.92:0/3761463227 shutdown_connections 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 --2- 172.21.15.92:0/3761463227 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c1037d0 0x7fa33c10a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 --2- 172.21.15.92:0/3761463227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 0x7fa33c103290 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 --2- 172.21.15.92:0/3761463227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa33c101c10 0x7fa33c102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 -- 172.21.15.92:0/3761463227 >> 172.21.15.92:0/3761463227 conn(0x7fa33c0fd3c0 msgr2=0x7fa33c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 -- 172.21.15.92:0/3761463227 shutdown_connections 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 -- 172.21.15.92:0/3761463227 wait complete. 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.483+0000 7fa34365b640 1 Processor -- start 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa34365b640 1 -- start start 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa34365b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa33c101c10 0x7fa33c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:05.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa34365b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 0x7fa33c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa34365b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c1037d0 0x7fa33c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa34365b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c10d910 con 0x7fa33c102e10 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa34365b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c10d790 con 0x7fa33c1037d0 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa34365b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c10da90 con 0x7fa33c101c10 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa340bf6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 0x7fa33c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa340bf6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 0x7fa33c1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38154/0 (socket says 172.21.15.92:38154) 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa340bf6640 1 -- 172.21.15.92:0/109293527 learned_addr learned my addr 172.21.15.92:0/109293527 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa3413f7640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa33c101c10 0x7fa33c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa341bf8640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c1037d0 0x7fa33c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa340bf6640 1 -- 172.21.15.92:0/109293527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa33c101c10 msgr2=0x7fa33c197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa340bf6640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa33c101c10 0x7fa33c197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa340bf6640 1 -- 172.21.15.92:0/109293527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c1037d0 msgr2=0x7fa33c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:05.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa340bf6640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c1037d0 0x7fa33c19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:05.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa340bf6640 1 -- 172.21.15.92:0/109293527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c19fb90 con 0x7fa33c102e10 2024-09-10T10:30:05.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa341bf8640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c1037d0 0x7fa33c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:30:05.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa340bf6640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 0x7fa33c1984a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009230 tx=0x7fa32c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:30:05.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.484+0000 7fa3327fc640 1 -- 172.21.15.92:0/109293527 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c03f030 con 0x7fa33c102e10 2024-09-10T10:30:05.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.485+0000 7fa3327fc640 1 -- 172.21.15.92:0/109293527 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa32c003ce0 con 0x7fa33c102e10 2024-09-10T10:30:05.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.485+0000 7fa3327fc640 1 -- 172.21.15.92:0/109293527 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c035070 con 0x7fa33c102e10 2024-09-10T10:30:05.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.485+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33c19fe20 con 0x7fa33c102e10 2024-09-10T10:30:05.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.485+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33c1a02f0 con 0x7fa33c102e10 2024-09-10T10:30:05.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.486+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa33c109060 con 0x7fa33c102e10 2024-09-10T10:30:05.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.487+0000 7fa3327fc640 1 -- 172.21.15.92:0/109293527 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fa32c042030 con 0x7fa33c102e10 2024-09-10T10:30:05.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.487+0000 7fa3327fc640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa3280a2b20 0x7fa3280a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:05.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.487+0000 7fa3413f7640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa3280a2b20 0x7fa3280a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:05.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.487+0000 7fa3327fc640 1 -- 172.21.15.92:0/109293527 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7fa32c0ee2c0 con 0x7fa33c102e10 2024-09-10T10:30:05.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.488+0000 7fa3413f7640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa3280a2b20 0x7fa3280a4fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa33c102c70 tx=0x7fa338009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:30:05.492 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.491+0000 7fa3327fc640 1 -- 172.21.15.92:0/109293527 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa32c0bc970 con 0x7fa33c102e10 2024-09-10T10:30:05.669 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:05.667+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa33c062630 con 0x7fa3280a2b20 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi121 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi121 to 17087M 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:30:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:06 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi121 2024-09-10T10:30:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi121 to 17087M 2024-09-10T10:30:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:30:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T10:30:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:30:06.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:30:06.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:06 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi121 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi121 to 17087M 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:30:06.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:06 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:07.193 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:07 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:30:07.194 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:07 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:30:07.194 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:07 smithi092 ceph-mon[30834]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:30:07.194 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:07 smithi092 ceph-mon[30834]: osd.2 [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] boot 2024-09-10T10:30:07.194 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:07 smithi092 ceph-mon[30834]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T10:30:07.194 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:07.194 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:07 smithi092 ceph-mon[30834]: pgmap v74: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:07.194 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:30:07.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:07 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:30:07.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:07 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:30:07.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:07 smithi097 ceph-mon[35213]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:30:07.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:07 smithi097 ceph-mon[35213]: osd.2 [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] boot 2024-09-10T10:30:07.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:07 smithi097 ceph-mon[35213]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T10:30:07.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:07.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:07 smithi097 ceph-mon[35213]: pgmap v74: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:07.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:30:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:07 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:30:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:07 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:30:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:07 smithi121 ceph-mon[35231]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:30:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:07 smithi121 ceph-mon[35231]: osd.2 [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] boot 2024-09-10T10:30:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:07 smithi121 ceph-mon[35231]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T10:30:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:30:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:07 smithi121 ceph-mon[35231]: pgmap v74: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:30:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:08 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T10:30:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:08 smithi097 ceph-mon[35213]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T10:30:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:08 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:30:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:08 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1488762095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1315d40-d449-4284-901e-5526d9ea4bd1"}]: dispatch 2024-09-10T10:30:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:08 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:30:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:08 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1488762095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1315d40-d449-4284-901e-5526d9ea4bd1"}]': finished 2024-09-10T10:30:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:08 smithi097 ceph-mon[35213]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T10:30:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:08 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:08.360 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:30:08 smithi092 sudo[49185]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:30:08.361 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:30:08 smithi092 sudo[49185]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:08.361 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:30:08 smithi092 sudo[49185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:08.361 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:30:08 smithi092 sudo[49185]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:08.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:08 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T10:30:08.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:08 smithi092 ceph-mon[30834]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T10:30:08.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:08 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:30:08.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:08 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1488762095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1315d40-d449-4284-901e-5526d9ea4bd1"}]: dispatch 2024-09-10T10:30:08.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:08 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:30:08.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:08 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1488762095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1315d40-d449-4284-901e-5526d9ea4bd1"}]': finished 2024-09-10T10:30:08.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:08 smithi092 ceph-mon[30834]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T10:30:08.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:08 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:08 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T10:30:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:08 smithi121 ceph-mon[35231]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T10:30:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:08 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:30:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:08 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1488762095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1315d40-d449-4284-901e-5526d9ea4bd1"}]: dispatch 2024-09-10T10:30:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:08 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:30:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:08 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1488762095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1315d40-d449-4284-901e-5526d9ea4bd1"}]': finished 2024-09-10T10:30:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:08 smithi121 ceph-mon[35231]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T10:30:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:08 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:08.860 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:30:08 smithi092 sudo[49210]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:30:08.861 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:30:08 smithi092 sudo[49210]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:08.861 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:30:08 smithi092 sudo[49210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:08.861 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:30:08 smithi092 sudo[49210]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:09.012 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:30:08 smithi097 sudo[43692]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:30:09.012 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:30:08 smithi097 sudo[43692]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:09.012 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:30:08 smithi097 sudo[43692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:09.012 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:30:08 smithi097 sudo[43692]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:09.053+0000 7fa3327fc640 1 -- 172.21.15.92:0/109293527 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa32c0b88e0 con 0x7fa33c102e10 2024-09-10T10:30:09.300 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:09 smithi121 sudo[43816]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:30:09.300 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:09 smithi121 sudo[43816]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:09.300 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:09 smithi121 sudo[43816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:09.300 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:09 smithi121 sudo[43816]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:09.301 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:09 smithi121 ceph-mon[35231]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:09.301 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:09 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/316808206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:30:09.301 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:09 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:09.301 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:09 smithi121 ceph-mon[35231]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T10:30:09.301 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:09 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:09.320 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:30:09 smithi097 sudo[43695]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:30:09.320 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:30:09 smithi097 sudo[43695]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:09.320 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:30:09 smithi097 sudo[43695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:09.320 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:30:09 smithi097 sudo[43695]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:09.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:09 smithi097 ceph-mon[35213]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:09.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:09 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/316808206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:30:09.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:09 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:09.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:09 smithi097 ceph-mon[35213]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T10:30:09.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:09 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:09.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:09 smithi092 ceph-mon[30834]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:09.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:09 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/316808206' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:30:09.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:09 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:09.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:09 smithi092 ceph-mon[30834]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T10:30:09.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:09 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:09.791 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:09 smithi121 sudo[43819]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:30:09.791 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:09 smithi121 sudo[43819]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:09.791 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:09 smithi121 sudo[43819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:09.791 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:30:09 smithi121 sudo[43819]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:10.070 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:09 smithi092 sudo[49607]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:30:10.070 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:09 smithi092 sudo[49607]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:10.070 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:09 smithi092 sudo[49607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:10.070 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:09 smithi092 sudo[49607]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:10.332 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:10.332 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 ceph-mon[35231]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T10:30:10.332 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:10.332 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 ceph-mon[35231]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:30:10.332 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 sudo[43822]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:30:10.332 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 sudo[43822]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:10.333 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 sudo[43822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:10.333 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 sudo[43822]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:10.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:10 smithi092 sudo[49611]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:30:10.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:10 smithi092 sudo[49611]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:10.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:10 smithi092 sudo[49611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:10.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:10 smithi092 sudo[49611]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:10.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:10.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:10 smithi092 ceph-mon[30834]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T10:30:10.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:10.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:10 smithi092 ceph-mon[30834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:30:10.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:10.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:10 smithi097 ceph-mon[35213]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T10:30:10.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:10.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:10 smithi097 ceph-mon[35213]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:30:10.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 sudo[43825]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:30:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 sudo[43825]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 sudo[43825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:10 smithi121 sudo[43825]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:11.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:10 smithi097 sudo[43698]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T10:30:11.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:10 smithi097 sudo[43698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:11.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:10 smithi097 sudo[43698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:11.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:10 smithi097 sudo[43698]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:11.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:11.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:30:11.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:30:11.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:30:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:30:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:30:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:30:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:30:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:30:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:30:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:30:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:30:11.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:30:11.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:30:11.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:30:11.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:30:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 sudo[43701]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T10:30:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 sudo[43701]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T10:30:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 sudo[43701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T10:30:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 sudo[43701]: pam_unix(sudo:session): session closed for user root 2024-09-10T10:30:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:30:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:30:12.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:12 smithi092 ceph-mon[30834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:30:12.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:12 smithi092 ceph-mon[30834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:30:12.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:12 smithi121 ceph-mon[35231]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:30:12.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:12 smithi121 ceph-mon[35231]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:30:12.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:12 smithi097 ceph-mon[35213]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T10:30:12.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:12 smithi097 ceph-mon[35213]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T10:30:13.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:13 smithi097 ceph-mon[35213]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:13.331 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:13 smithi092 ceph-mon[30834]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:13.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:13 smithi121 ceph-mon[35231]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:15.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:15 smithi121 ceph-mon[35231]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:15.349 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:15 smithi092 ceph-mon[30834]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:15.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:15 smithi097 ceph-mon[35213]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:17.338 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:17 smithi092 ceph-mon[30834]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:17.338 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:30:17.338 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:17.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:17 smithi121 ceph-mon[35231]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:17.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:30:17.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:17.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:17 smithi097 ceph-mon[35213]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:17.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T10:30:17.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:18.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:18 smithi092 ceph-mon[30834]: Deploying daemon osd.3 on smithi092 2024-09-10T10:30:18.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:18 smithi121 ceph-mon[35231]: Deploying daemon osd.3 on smithi092 2024-09-10T10:30:18.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:18 smithi097 ceph-mon[35213]: Deploying daemon osd.3 on smithi092 2024-09-10T10:30:19.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:19 smithi092 ceph-mon[30834]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:19.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:19 smithi121 ceph-mon[35231]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:19.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:19 smithi097 ceph-mon[35213]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:21.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:21 smithi092 ceph-mon[30834]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:21.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:21 smithi121 ceph-mon[35231]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:21.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:21 smithi097 ceph-mon[35213]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:23.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:23 smithi092 ceph-mon[30834]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:23.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:23 smithi121 ceph-mon[35231]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:23.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:23.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:23.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:23.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:23 smithi097 ceph-mon[35213]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:23.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:23.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:23.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:25.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:25 smithi092 ceph-mon[30834]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:25.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:25 smithi121 ceph-mon[35231]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:25.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:25 smithi097 ceph-mon[35213]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:25.943 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.942+0000 7fa3327fc640 1 -- 172.21.15.92:0/109293527 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa33c062630 con 0x7fa3280a2b20 2024-09-10T10:30:25.943 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 3 on host 'smithi092' 2024-09-10T10:30:25.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa3280a2b20 msgr2=0x7fa3280a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:25.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa3280a2b20 0x7fa3280a4fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa33c102c70 tx=0x7fa338009680 comp rx=0 tx=0).stop 2024-09-10T10:30:25.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 msgr2=0x7fa33c1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:25.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 0x7fa33c1984a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009230 tx=0x7fa32c004360 comp rx=0 tx=0).stop 2024-09-10T10:30:25.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 shutdown_connections 2024-09-10T10:30:25.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa3280a2b20 0x7fa3280a4fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:25.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa33c1037d0 0x7fa33c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:25.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa33c102e10 0x7fa33c1984a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:25.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 --2- 172.21.15.92:0/109293527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa33c101c10 0x7fa33c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:25.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 >> 172.21.15.92:0/109293527 conn(0x7fa33c0fd3c0 msgr2=0x7fa33c106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:30:25.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.944+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 shutdown_connections 2024-09-10T10:30:25.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:30:25.945+0000 7fa34365b640 1 -- 172.21.15.92:0/109293527 wait complete. 2024-09-10T10:30:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:26 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:26 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:26 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:26 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:26 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:26 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:26 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:26 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.552 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:26 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.552 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:26 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.553 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:26 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:26.553 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:26 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:26.553 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:26 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.553 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:26 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:26.553 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:26 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.553 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:26 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:26 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:26 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:26 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:26 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:26 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:26 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:26 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:26 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:26.579 DEBUG:teuthology.orchestra.run.smithi092:osd.3> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T10:30:26.582 INFO:tasks.cephadm:Deploying osd.4 on smithi097 with /dev/vg_nvme/lv_3... 2024-09-10T10:30:26.582 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T10:30:26.833 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:30:27.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:27 smithi121 ceph-mon[35231]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:27.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:27 smithi092 ceph-mon[30834]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:27.980 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:27 smithi097 ceph-mon[35213]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:28.610 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:30:28 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:30:28.313+0000 7f84327fd640 -1 osd.3 0 log_to_monitors true 2024-09-10T10:30:29.175 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:30:29.200 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi097:vg_nvme/lv_3 2024-09-10T10:30:29.293 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:29 smithi092 ceph-mon[30834]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:29.293 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:29 smithi092 ceph-mon[30834]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:30:29.451 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:30:29.489 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:29 smithi097 ceph-mon[35213]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:29.489 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:29 smithi097 ceph-mon[35213]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:30:29.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:29 smithi121 ceph-mon[35231]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:29.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:29 smithi121 ceph-mon[35231]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T10:30:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.938+0000 7f2640813640 1 -- 172.21.15.97:0/1167086022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 msgr2=0x7f263c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.938+0000 7f2640813640 1 --2- 172.21.15.97:0/1167086022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 0x7f263c103280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2630009ca0 tx=0x7f263002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:30:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.938+0000 7f2640813640 1 -- 172.21.15.97:0/1167086022 shutdown_connections 2024-09-10T10:30:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.938+0000 7f2640813640 1 --2- 172.21.15.97:0/1167086022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c1037c0 0x7f263c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.938+0000 7f2640813640 1 --2- 172.21.15.97:0/1167086022 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 0x7f263c103280 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:29.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.938+0000 7f2640813640 1 --2- 172.21.15.97:0/1167086022 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f263c101c00 0x7f263c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.938+0000 7f2640813640 1 -- 172.21.15.97:0/1167086022 >> 172.21.15.97:0/1167086022 conn(0x7f263c0fd3b0 msgr2=0x7f263c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.938+0000 7f2640813640 1 -- 172.21.15.97:0/1167086022 shutdown_connections 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.938+0000 7f2640813640 1 -- 172.21.15.97:0/1167086022 wait complete. 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2640813640 1 Processor -- start 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2640813640 1 -- start start 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2640813640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c101c00 0x7f263c197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2640813640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 0x7f263c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2640813640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f263c1037c0 0x7f263c19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2640813640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10d880 con 0x7f263c101c00 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2640813640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10d700 con 0x7f263c102e00 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2640813640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10da00 con 0x7f263c1037c0 2024-09-10T10:30:29.942 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2639d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 0x7f263c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2639d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 0x7f263c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:56446/0 (socket says 172.21.15.97:56446) 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2639d9b640 1 -- 172.21.15.97:0/271820784 learned_addr learned my addr 172.21.15.97:0/271820784 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f263a59c640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c101c00 0x7f263c197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f263ad9d640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f263c1037c0 0x7f263c19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2639d9b640 1 -- 172.21.15.97:0/271820784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f263c1037c0 msgr2=0x7f263c19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2639d9b640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f263c1037c0 0x7f263c19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2639d9b640 1 -- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c101c00 msgr2=0x7f263c197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2639d9b640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c101c00 0x7f263c197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f2639d9b640 1 -- 172.21.15.97:0/271820784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c19fb30 con 0x7f263c102e00 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.939+0000 7f263ad9d640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f263c1037c0 0x7f263c19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.940+0000 7f2639d9b640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 0x7f263c198440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2630000f80 tx=0x7f2630031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:30:29.943 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.940+0000 7f262b7fe640 1 -- 172.21.15.97:0/271820784 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263002fa20 con 0x7f263c102e00 2024-09-10T10:30:29.944 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.940+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c19fdc0 con 0x7f263c102e00 2024-09-10T10:30:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.940+0000 7f262b7fe640 1 -- 172.21.15.97:0/271820784 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f263002fbc0 con 0x7f263c102e00 2024-09-10T10:30:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.940+0000 7f262b7fe640 1 -- 172.21.15.97:0/271820784 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263003a6f0 con 0x7f263c102e00 2024-09-10T10:30:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.940+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c1a0270 con 0x7f263c102e00 2024-09-10T10:30:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.941+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263c108fd0 con 0x7f263c102e00 2024-09-10T10:30:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.942+0000 7f262b7fe640 1 -- 172.21.15.97:0/271820784 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f263003a890 con 0x7f263c102e00 2024-09-10T10:30:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.943+0000 7f262b7fe640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f26240a2bb0 0x7f26240a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.943+0000 7f262b7fe640 1 -- 172.21.15.97:0/271820784 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3373+0+0 (secure 0 0 0) 0x7f26300ef230 con 0x7f263c102e00 2024-09-10T10:30:29.945 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.943+0000 7f263a59c640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f26240a2bb0 0x7f26240a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:29.946 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.943+0000 7f263a59c640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f26240a2bb0 0x7f26240a5070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f263c102c60 tx=0x7f2634005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:30:29.949 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:29.948+0000 7f262b7fe640 1 -- 172.21.15.97:0/271820784 <== mon.2 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26300bd570 con 0x7f263c102e00 2024-09-10T10:30:30.130 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:30.128+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f263c062630 con 0x7f26240a2bb0 2024-09-10T10:30:30.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:30:30.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T10:30:30.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:30:30.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:30.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:30.480 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:30.480 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.480 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:30.480 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:30.480 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.480 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:30:30.480 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:30:30.480 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:30.480 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:30 smithi097 ceph-mon[35213]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:30:30.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:30:30.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T10:30:30.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:30:30.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:30.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:30.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:30.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:30.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:30.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:30:30.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:30:30.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:30.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:30 smithi121 ceph-mon[35231]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:30:30.610 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:30:30.259+0000 7f842e780640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T10:30:30.611 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:30:30.263+0000 7f842a5a8640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:30:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T10:30:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T10:30:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:30:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:30:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:30:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:30.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:30 smithi092 ceph-mon[30834]: from='osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:30:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:31 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi092 2024-09-10T10:30:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:31 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-10T10:30:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:31 smithi121 ceph-mon[35231]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:31 smithi121 ceph-mon[35231]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:30:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:31 smithi121 ceph-mon[35231]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T10:30:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:31 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:31 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:31.567 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:31 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi092 2024-09-10T10:30:31.567 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:31 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-10T10:30:31.567 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:31 smithi097 ceph-mon[35213]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:31.568 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:31 smithi097 ceph-mon[35213]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:30:31.568 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:31 smithi097 ceph-mon[35213]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T10:30:31.568 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:31 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:31.568 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:31 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:31 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi092 2024-09-10T10:30:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:31 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-10T10:30:31.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:31 smithi092 ceph-mon[30834]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:31.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:31 smithi092 ceph-mon[30834]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:30:31.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:31 smithi092 ceph-mon[30834]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T10:30:31.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:31 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:31.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:31 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:32 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:30:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:32 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:30:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:32 smithi121 ceph-mon[35231]: osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] boot 2024-09-10T10:30:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:32 smithi121 ceph-mon[35231]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T10:30:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:32.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:32 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:30:32.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:32 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:30:32.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:32 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:32.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:32 smithi097 ceph-mon[35213]: osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] boot 2024-09-10T10:30:32.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:32 smithi097 ceph-mon[35213]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T10:30:32.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:32 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:32.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:32 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:30:32.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:32 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:30:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:32 smithi092 ceph-mon[30834]: osd.3 [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] boot 2024-09-10T10:30:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:32 smithi092 ceph-mon[30834]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T10:30:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:30:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:33 smithi121 ceph-mon[35231]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:33 smithi121 ceph-mon[35231]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T10:30:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:33 smithi121 ceph-mon[35231]: from='client.? 172.21.15.97:0/1702579915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e"}]: dispatch 2024-09-10T10:30:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:33 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e"}]: dispatch 2024-09-10T10:30:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:33 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e"}]': finished 2024-09-10T10:30:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:33 smithi121 ceph-mon[35231]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T10:30:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:33 smithi121 ceph-mon[35231]: from='client.? 172.21.15.97:0/1948625990' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:30:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:33 smithi097 ceph-mon[35213]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:33 smithi097 ceph-mon[35213]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T10:30:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:33 smithi097 ceph-mon[35213]: from='client.? 172.21.15.97:0/1702579915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e"}]: dispatch 2024-09-10T10:30:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:33 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e"}]: dispatch 2024-09-10T10:30:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:33 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e"}]': finished 2024-09-10T10:30:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:33 smithi097 ceph-mon[35213]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T10:30:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:33 smithi097 ceph-mon[35213]: from='client.? 172.21.15.97:0/1948625990' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:30:33.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:33 smithi092 ceph-mon[30834]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T10:30:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:33 smithi092 ceph-mon[30834]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T10:30:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:33 smithi092 ceph-mon[30834]: from='client.? 172.21.15.97:0/1702579915' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e"}]: dispatch 2024-09-10T10:30:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:33 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e"}]: dispatch 2024-09-10T10:30:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:33 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e"}]': finished 2024-09-10T10:30:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:33 smithi092 ceph-mon[30834]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T10:30:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:33.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:33 smithi092 ceph-mon[30834]: from='client.? 172.21.15.97:0/1948625990' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:30:34.713 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:34 smithi121 ceph-mon[35231]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T10:30:34.713 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:34 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:34.714 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:34 smithi121 ceph-mon[35231]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:34.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:34 smithi097 ceph-mon[35213]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T10:30:34.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:34 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:34.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:34 smithi097 ceph-mon[35213]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:34.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:34 smithi092 ceph-mon[30834]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T10:30:34.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:34 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:34.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:34 smithi092 ceph-mon[30834]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:35.679 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:35 smithi121 ceph-mon[35231]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T10:30:35.680 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:35.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:35 smithi097 ceph-mon[35213]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T10:30:35.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:35.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:35 smithi092 ceph-mon[30834]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T10:30:35.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:36.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:36 smithi121 ceph-mon[35231]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:36.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:36 smithi097 ceph-mon[35213]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:36.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:36 smithi092 ceph-mon[30834]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:39.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:39 smithi097 ceph-mon[35213]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-10T10:30:39.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:39 smithi121 ceph-mon[35231]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-10T10:30:39.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:39 smithi092 ceph-mon[30834]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-10T10:30:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:41 smithi121 ceph-mon[35231]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T10:30:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:30:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:41 smithi097 ceph-mon[35213]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T10:30:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:30:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:41.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:41 smithi092 ceph-mon[30834]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T10:30:41.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T10:30:41.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:42.270 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:42 smithi097 ceph-mon[35213]: Deploying daemon osd.4 on smithi097 2024-09-10T10:30:42.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:42 smithi121 ceph-mon[35231]: Deploying daemon osd.4 on smithi097 2024-09-10T10:30:42.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:42 smithi092 ceph-mon[30834]: Deploying daemon osd.4 on smithi097 2024-09-10T10:30:43.417 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:43 smithi097 ceph-mon[35213]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T10:30:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:43 smithi121 ceph-mon[35231]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T10:30:43.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:43 smithi092 ceph-mon[30834]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T10:30:45.444 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:45 smithi097 ceph-mon[35213]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:30:45.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:45 smithi121 ceph-mon[35231]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:30:45.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:45 smithi092 ceph-mon[30834]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:30:47.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:47 smithi097 ceph-mon[35213]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T10:30:47.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:47.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:47.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:47.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:47 smithi092 ceph-mon[30834]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T10:30:47.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:47.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:47.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:47.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:47 smithi121 ceph-mon[35231]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T10:30:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:49.225 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:49 smithi097 ceph-mon[35213]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:30:49.225 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:49.225 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:49.225 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:49.225 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:49.225 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:49.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:49 smithi121 ceph-mon[35231]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:30:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:49.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:49 smithi092 ceph-mon[30834]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:30:49.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:49.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:49.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:49.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:49.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:50.681 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.679+0000 7f262b7fe640 1 -- 172.21.15.97:0/271820784 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f263c062630 con 0x7f26240a2bb0 2024-09-10T10:30:50.681 INFO:teuthology.orchestra.run.smithi097.stdout:Created osd(s) 4 on host 'smithi097' 2024-09-10T10:30:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.681+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f26240a2bb0 msgr2=0x7f26240a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.681+0000 7f2640813640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f26240a2bb0 0x7f26240a5070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f263c102c60 tx=0x7f2634005f90 comp rx=0 tx=0).stop 2024-09-10T10:30:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.681+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 msgr2=0x7f263c198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.681+0000 7f2640813640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 0x7f263c198440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2630000f80 tx=0x7f2630031ee0 comp rx=0 tx=0).stop 2024-09-10T10:30:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.681+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 shutdown_connections 2024-09-10T10:30:50.683 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.681+0000 7f2640813640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f26240a2bb0 0x7f26240a5070 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.682+0000 7f2640813640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f263c1037c0 0x7f263c19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.682+0000 7f2640813640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f263c102e00 0x7f263c198440 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.682+0000 7f2640813640 1 --2- 172.21.15.97:0/271820784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c101c00 0x7f263c197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.682+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 >> 172.21.15.97:0/271820784 conn(0x7f263c0fd3b0 msgr2=0x7f263c1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:30:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.682+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 shutdown_connections 2024-09-10T10:30:50.684 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:30:50.682+0000 7f2640813640 1 -- 172.21.15.97:0/271820784 wait complete. 2024-09-10T10:30:51.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:51 smithi097 ceph-mon[35213]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:51.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:51.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:51.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:51 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:51.351 DEBUG:teuthology.orchestra.run.smithi097:osd.4> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T10:30:51.354 INFO:tasks.cephadm:Deploying osd.5 on smithi121 with /dev/vg_nvme/lv_3... 2024-09-10T10:30:51.354 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T10:30:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:51 smithi121 ceph-mon[35231]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:51.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:51 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:51.609 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:30:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:51 smithi092 ceph-mon[30834]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:30:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:51 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:52.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:52 smithi097 ceph-mon[35213]: from='osd.4 [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:30:52.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:52 smithi097 ceph-mon[35213]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:30:52.320 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:30:51 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:30:51.969+0000 7f3d001c3640 -1 osd.4 0 log_to_monitors true 2024-09-10T10:30:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:52 smithi121 ceph-mon[35231]: from='osd.4 [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:30:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:52 smithi121 ceph-mon[35231]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:30:52.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:52 smithi092 ceph-mon[30834]: from='osd.4 [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:30:52.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:52 smithi092 ceph-mon[30834]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T10:30:53.529 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:53 smithi121 ceph-mon[35231]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:53.530 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:53 smithi121 ceph-mon[35231]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:30:53.530 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:53 smithi121 ceph-mon[35231]: from='osd.4 [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:30:53.530 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:53 smithi121 ceph-mon[35231]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T10:30:53.530 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:53.530 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:53 smithi121 ceph-mon[35231]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:30:53.560 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:53 smithi097 ceph-mon[35213]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:53.560 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:53 smithi097 ceph-mon[35213]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:30:53.560 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:53 smithi097 ceph-mon[35213]: from='osd.4 [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:30:53.560 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:53 smithi097 ceph-mon[35213]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T10:30:53.561 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:53.561 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:53 smithi097 ceph-mon[35213]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:30:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:53 smithi092 ceph-mon[30834]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:53 smithi092 ceph-mon[30834]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T10:30:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:53 smithi092 ceph-mon[30834]: from='osd.4 [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:30:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:53 smithi092 ceph-mon[30834]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T10:30:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:53 smithi092 ceph-mon[30834]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:30:53.820 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:30:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:30:53.574+0000 7f3cfc146640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T10:30:53.820 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:30:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:30:53.582+0000 7f3cf3f66640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:30:54.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:54 smithi121 ceph-mon[35231]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:30:54.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:54 smithi121 ceph-mon[35231]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T10:30:54.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:54.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:54.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:54 smithi121 ceph-mon[35231]: from='osd.4 ' entity='osd.4' 2024-09-10T10:30:54.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:54.404 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:30:54.432 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_3 2024-09-10T10:30:54.448 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:54 smithi097 ceph-mon[35213]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:30:54.448 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:54 smithi097 ceph-mon[35213]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T10:30:54.448 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:54.448 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:54.448 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:54 smithi097 ceph-mon[35213]: from='osd.4 ' entity='osd.4' 2024-09-10T10:30:54.448 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:54 smithi092 ceph-mon[30834]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:30:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:54 smithi092 ceph-mon[30834]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T10:30:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:54 smithi092 ceph-mon[30834]: from='osd.4 ' entity='osd.4' 2024-09-10T10:30:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:54.690 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:30:55.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 -- 172.21.15.121:0/502633358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0107920 msgr2=0x7f40d0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:55.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 --2- 172.21.15.121:0/502633358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0107920 0x7f40d0109d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009ca0 tx=0x7f40c802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:30:55.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 -- 172.21.15.121:0/502633358 shutdown_connections 2024-09-10T10:30:55.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 --2- 172.21.15.121:0/502633358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0107920 0x7f40d0109d10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 --2- 172.21.15.121:0/502633358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d0104ff0 0x7f40d01073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 --2- 172.21.15.121:0/502633358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40d01026c0 0x7f40d0104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 -- 172.21.15.121:0/502633358 >> 172.21.15.121:0/502633358 conn(0x7f40d00fc280 msgr2=0x7f40d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 -- 172.21.15.121:0/502633358 shutdown_connections 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 -- 172.21.15.121:0/502633358 wait complete. 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 Processor -- start 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.139+0000 7f40d529c640 1 -- start start 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40d529c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40d01026c0 0x7f40d0198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40d529c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0104ff0 0x7f40d0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40d529c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d0107920 0x7f40d019f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40d529c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f40d010d950 con 0x7f40d0107920 2024-09-10T10:30:55.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40d529c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f40d010d7d0 con 0x7f40d01026c0 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40d529c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40d010dad0 con 0x7f40d0104ff0 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ce7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0104ff0 0x7f40d0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ce7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0104ff0 0x7f40d0198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60382/0 (socket says 172.21.15.121:60382) 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ce7fc640 1 -- 172.21.15.121:0/1744032458 learned_addr learned my addr 172.21.15.121:0/1744032458 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ceffd640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40d01026c0 0x7f40d0198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40cf7fe640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d0107920 0x7f40d019f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ce7fc640 1 -- 172.21.15.121:0/1744032458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40d01026c0 msgr2=0x7f40d0198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ce7fc640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40d01026c0 0x7f40d0198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ce7fc640 1 -- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d0107920 msgr2=0x7f40d019f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ce7fc640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d0107920 0x7f40d019f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ce7fc640 1 -- 172.21.15.121:0/1744032458 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d019fc70 con 0x7f40d0104ff0 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40cf7fe640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d0107920 0x7f40d019f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:30:55.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40ce7fc640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0104ff0 0x7f40d0198580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f40c400b450 tx=0x7f40c400b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:30:55.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.140+0000 7f40b7fff640 1 -- 172.21.15.121:0/1744032458 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4015020 con 0x7f40d0104ff0 2024-09-10T10:30:55.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.141+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d019ff60 con 0x7f40d0104ff0 2024-09-10T10:30:55.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.141+0000 7f40b7fff640 1 -- 172.21.15.121:0/1744032458 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40c4011d10 con 0x7f40d0104ff0 2024-09-10T10:30:55.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.141+0000 7f40b7fff640 1 -- 172.21.15.121:0/1744032458 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c400f2e0 con 0x7f40d0104ff0 2024-09-10T10:30:55.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.141+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d01a0490 con 0x7f40d0104ff0 2024-09-10T10:30:55.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.142+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d00fdd70 con 0x7f40d0104ff0 2024-09-10T10:30:55.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.143+0000 7f40b7fff640 1 -- 172.21.15.121:0/1744032458 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f40c4018020 con 0x7f40d0104ff0 2024-09-10T10:30:55.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.143+0000 7f40b7fff640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40b80a2bb0 0x7f40b80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:30:55.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.143+0000 7f40b7fff640 1 -- 172.21.15.121:0/1744032458 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4101+0+0 (secure 0 0 0) 0x7f40c40cd8a0 con 0x7f40d0104ff0 2024-09-10T10:30:55.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.144+0000 7f40ceffd640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40b80a2bb0 0x7f40b80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:30:55.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.144+0000 7f40ceffd640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40b80a2bb0 0x7f40b80a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009990 tx=0x7f40c0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:30:55.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.148+0000 7f40b7fff640 1 -- 172.21.15.121:0/1744032458 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40c401f020 con 0x7f40d0104ff0 2024-09-10T10:30:55.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: osd.4 [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] boot 2024-09-10T10:30:55.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T10:30:55.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:55.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:30:55.330+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f40d0062630 con 0x7f40b80a2bb0 2024-09-10T10:30:55.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:30:55.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:30:55.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:55.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:55.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:55.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:55.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:55.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: osd.4 [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] boot 2024-09-10T10:30:55.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T10:30:55.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:55.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:30:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: osd.4 [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] boot 2024-09-10T10:30:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T10:30:55.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:30:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:56 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi097 2024-09-10T10:30:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:56 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi097 to 8544M 2024-09-10T10:30:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:56 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:30:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:56 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:30:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:56 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:56 smithi121 ceph-mon[35231]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T10:30:56.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:56 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi097 2024-09-10T10:30:56.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:56 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi097 to 8544M 2024-09-10T10:30:56.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:56 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:30:56.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:56 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:30:56.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:56 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:56.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:56 smithi097 ceph-mon[35213]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T10:30:56.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:56 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi097 2024-09-10T10:30:56.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:56 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi097 to 8544M 2024-09-10T10:30:56.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:56 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:30:56.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:56 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:30:56.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:56 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:30:56.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:56 smithi092 ceph-mon[30834]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T10:30:57.500 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:57 smithi121 ceph-mon[35231]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:30:57.500 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:57 smithi121 ceph-mon[35231]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:30:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:57 smithi097 ceph-mon[35213]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:30:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:57 smithi097 ceph-mon[35213]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:30:57.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:57 smithi092 ceph-mon[30834]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:30:57.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:57 smithi092 ceph-mon[30834]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:30:58.384 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:58 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/2977836073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f4ef1d2-3f17-44ca-8abe-d0f137a688ad"}]: dispatch 2024-09-10T10:30:58.384 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:58 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f4ef1d2-3f17-44ca-8abe-d0f137a688ad"}]: dispatch 2024-09-10T10:30:58.384 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:58 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f4ef1d2-3f17-44ca-8abe-d0f137a688ad"}]': finished 2024-09-10T10:30:58.384 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:58 smithi121 ceph-mon[35231]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T10:30:58.384 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:58 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:30:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:58 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/2977836073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f4ef1d2-3f17-44ca-8abe-d0f137a688ad"}]: dispatch 2024-09-10T10:30:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:58 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f4ef1d2-3f17-44ca-8abe-d0f137a688ad"}]: dispatch 2024-09-10T10:30:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:58 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f4ef1d2-3f17-44ca-8abe-d0f137a688ad"}]': finished 2024-09-10T10:30:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:58 smithi097 ceph-mon[35213]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T10:30:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:58 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:30:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:58 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/2977836073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f4ef1d2-3f17-44ca-8abe-d0f137a688ad"}]: dispatch 2024-09-10T10:30:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:58 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f4ef1d2-3f17-44ca-8abe-d0f137a688ad"}]: dispatch 2024-09-10T10:30:58.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:58 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f4ef1d2-3f17-44ca-8abe-d0f137a688ad"}]': finished 2024-09-10T10:30:58.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:58 smithi092 ceph-mon[30834]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T10:30:58.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:30:59.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:59 smithi121 ceph-mon[35231]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:30:59.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:30:59 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/4040723833' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:30:59.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:59 smithi097 ceph-mon[35213]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:30:59.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:30:59 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/4040723833' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:30:59.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:59 smithi092 ceph-mon[30834]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:30:59.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:30:59 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/4040723833' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:31:01.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:01 smithi121 ceph-mon[35231]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:01.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:01 smithi097 ceph-mon[35213]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:01.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:01 smithi092 ceph-mon[30834]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:03.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:03 smithi121 ceph-mon[35231]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:03.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:03 smithi097 ceph-mon[35213]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:03.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:03 smithi092 ceph-mon[30834]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:05.374 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:05 smithi121 ceph-mon[35231]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:05.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:05 smithi097 ceph-mon[35213]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:05.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:05 smithi092 ceph-mon[30834]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:07.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:07 smithi121 ceph-mon[35231]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:07.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:31:07.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:07 smithi097 ceph-mon[35213]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:31:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:07.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:07 smithi092 ceph-mon[30834]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:07.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T10:31:07.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:08.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:08 smithi121 ceph-mon[35231]: Deploying daemon osd.5 on smithi121 2024-09-10T10:31:08.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:08 smithi097 ceph-mon[35213]: Deploying daemon osd.5 on smithi121 2024-09-10T10:31:08.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:08 smithi092 ceph-mon[30834]: Deploying daemon osd.5 on smithi121 2024-09-10T10:31:09.466 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:09 smithi121 ceph-mon[35231]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:09.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:09 smithi097 ceph-mon[35213]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:09.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:09 smithi092 ceph-mon[30834]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:11.355 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:11 smithi121 ceph-mon[35231]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:11 smithi097 ceph-mon[35213]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:11.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:11 smithi092 ceph-mon[30834]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:13.428 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:13 smithi121 ceph-mon[35231]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:13.428 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:13.428 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:13.428 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:13 smithi097 ceph-mon[35213]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:13.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:13 smithi092 ceph-mon[30834]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:13.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:13.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:13.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:15.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:15 smithi121 ceph-mon[35231]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:15.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:15 smithi097 ceph-mon[35213]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:15.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:15 smithi092 ceph-mon[30834]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:16.583 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:16.583 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:16.583 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:16.583 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:16.583 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:16.584 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:16 smithi121 ceph-mon[35231]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:16.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:16.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:16.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:16.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:16.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:16.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:16 smithi092 ceph-mon[30834]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.625+0000 7f40b7fff640 1 -- 172.21.15.121:0/1744032458 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f40d0062630 con 0x7f40b80a2bb0 2024-09-10T10:31:16.627 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 5 on host 'smithi121' 2024-09-10T10:31:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40b80a2bb0 msgr2=0x7f40b80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40b80a2bb0 0x7f40b80a5070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009990 tx=0x7f40c0009110 comp rx=0 tx=0).stop 2024-09-10T10:31:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0104ff0 msgr2=0x7f40d0198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0104ff0 0x7f40d0198580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f40c400b450 tx=0x7f40c400b850 comp rx=0 tx=0).stop 2024-09-10T10:31:16.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 shutdown_connections 2024-09-10T10:31:16.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40b80a2bb0 0x7f40b80a5070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:16.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40d0107920 0x7f40d019f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:16.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f40d0104ff0 0x7f40d0198580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:16.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 --2- 172.21.15.121:0/1744032458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40d01026c0 0x7f40d0198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:16.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 >> 172.21.15.121:0/1744032458 conn(0x7f40d00fc280 msgr2=0x7f40d0103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:31:16.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 shutdown_connections 2024-09-10T10:31:16.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:31:16.627+0000 7f40d529c640 1 -- 172.21.15.121:0/1744032458 wait complete. 2024-09-10T10:31:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:16 smithi097 ceph-mon[35213]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:17.323 DEBUG:teuthology.orchestra.run.smithi121:osd.5> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T10:31:17.326 INFO:tasks.cephadm:Deploying osd.6 on smithi092 with /dev/vg_nvme/lv_2... 2024-09-10T10:31:17.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T10:31:17.585 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:31:17.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:17.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:17.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:17 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:17.620 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:17.620 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:17.620 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:17 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:17.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:17.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:17.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:17 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:18.701 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:18 smithi121 ceph-mon[35231]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:18 smithi092 ceph-mon[30834]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:18.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:18 smithi097 ceph-mon[35213]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:19.041 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:31:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:31:18.736+0000 7fbd25576640 -1 osd.5 0 log_to_monitors true 2024-09-10T10:31:19.742 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:19 smithi121 ceph-mon[35231]: from='osd.5 [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:31:19.742 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:19 smithi121 ceph-mon[35231]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:31:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:19 smithi097 ceph-mon[35213]: from='osd.5 [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:31:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:19 smithi097 ceph-mon[35213]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:31:19.843 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:19 smithi092 ceph-mon[30834]: from='osd.5 [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:31:19.843 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:19 smithi092 ceph-mon[30834]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T10:31:20.139 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:31:20.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2024-09-10T10:31:20.412 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:31:20.664 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='osd.5 [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi121 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:20.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:20.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi121 to 8543M 2024-09-10T10:31:20.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:20.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:20.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:20 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:31:20.386+0000 7fbd214f9640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T10:31:20.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:31:20.392+0000 7fbd1d321640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:31:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:31:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T10:31:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='osd.5 [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:31:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:31:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi121 2024-09-10T10:31:20.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:20.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:20.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi121 to 8543M 2024-09-10T10:31:20.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:20.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:20.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:20 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T10:31:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T10:31:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='osd.5 [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:31:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:31:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-10T10:31:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi121 2024-09-10T10:31:20.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:20.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:20.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi121 to 8543M 2024-09-10T10:31:20.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:20.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:20.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:20 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:20.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.871+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/1807713136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f981026d0 msgr2=0x7f7f98108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:20.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.871+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/1807713136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f981026d0 0x7f7f98108f60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009ca0 tx=0x7f7f9002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:31:20.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.871+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/1807713136 shutdown_connections 2024-09-10T10:31:20.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.871+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/1807713136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f981026d0 0x7f7f98108f60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:20.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.871+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/1807713136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f98101d10 0x7f7f98102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:20.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.871+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/1807713136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f98100b10 0x7f7f98100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:20.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.871+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/1807713136 >> 172.21.15.92:0/1807713136 conn(0x7f7f980fc2a0 msgr2=0x7f7f980fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:31:20.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.871+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/1807713136 shutdown_connections 2024-09-10T10:31:20.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.871+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/1807713136 wait complete. 2024-09-10T10:31:20.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f9d5cf640 1 Processor -- start 2024-09-10T10:31:20.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f9d5cf640 1 -- start start 2024-09-10T10:31:20.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f9d5cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f98100b10 0x7f7f98197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f9d5cf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f98101d10 0x7f7f981983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f9d5cf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f981026d0 0x7f7f9819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f9d5cf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9810c810 con 0x7f7f98100b10 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f9d5cf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9810c690 con 0x7f7f98101d10 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f9d5cf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9810c990 con 0x7f7f981026d0 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f96ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f98100b10 0x7f7f98197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f96ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f98100b10 0x7f7f98197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47560/0 (socket says 172.21.15.92:47560) 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.872+0000 7f7f96ffd640 1 -- 172.21.15.92:0/3081369466 learned_addr learned my addr 172.21.15.92:0/3081369466 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f967fc640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f98101d10 0x7f7f981983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f977fe640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f981026d0 0x7f7f9819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:31:20.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f96ffd640 1 -- 172.21.15.92:0/3081369466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f981026d0 msgr2=0x7f7f9819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f96ffd640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f981026d0 0x7f7f9819f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f96ffd640 1 -- 172.21.15.92:0/3081369466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f98101d10 msgr2=0x7f7f981983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f96ffd640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f98101d10 0x7f7f981983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f96ffd640 1 -- 172.21.15.92:0/3081369466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9819fa90 con 0x7f7f98100b10 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f977fe640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f981026d0 0x7f7f9819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f96ffd640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f98100b10 0x7f7f98197e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800b450 tx=0x7f7f8800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3081369466 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f88015020 con 0x7f7f98100b10 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3081369466 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f88011d70 con 0x7f7f98100b10 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9819fd80 con 0x7f7f98100b10 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3081369466 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800f340 con 0x7f7f98100b10 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.873+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f981a0230 con 0x7f7f98100b10 2024-09-10T10:31:20.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.874+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f981a0520 con 0x7f7f98100b10 2024-09-10T10:31:20.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.875+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3081369466 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7f88018020 con 0x7f7f98100b10 2024-09-10T10:31:20.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.876+0000 7f7f8ffff640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7f840a2bb0 0x7f7f840a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:31:20.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.876+0000 7f7f967fc640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7f840a2bb0 0x7f7f840a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:31:20.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.876+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3081369466 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4253+0+0 (secure 0 0 0) 0x7f7f880ce110 con 0x7f7f98100b10 2024-09-10T10:31:20.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.877+0000 7f7f967fc640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7f840a2bb0 0x7f7f840a5070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f80005e10 tx=0x7f7f80005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:31:20.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:20.880+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3081369466 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f8801f020 con 0x7f7f98100b10 2024-09-10T10:31:21.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:21.055+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7f981a06f0 con 0x7f7f840a2bb0 2024-09-10T10:31:21.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:31:21.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T10:31:21.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:21.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:21.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: from='client.14382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:31:21.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:31:21.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:31:21.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:21.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: osd.5 [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] boot 2024-09-10T10:31:21.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T10:31:21.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:21.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: from='client.14382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: osd.5 [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] boot 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T10:31:21.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:21.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:31:21.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T10:31:21.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:21.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:21.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: from='client.14382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:31:21.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:31:21.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:31:21.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:21.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: osd.5 [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] boot 2024-09-10T10:31:21.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T10:31:21.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:31:22.446 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:22 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:31:22.446 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:22 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:31:22.447 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:22 smithi092 ceph-mon[30834]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:22.447 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:22 smithi092 ceph-mon[30834]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T10:31:22.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:22 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:31:22.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:22 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:31:22.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:22 smithi121 ceph-mon[35231]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:22.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:22 smithi121 ceph-mon[35231]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T10:31:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:22 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:31:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:22 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:31:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:22 smithi097 ceph-mon[35213]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:22 smithi097 ceph-mon[35213]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T10:31:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:24 smithi121 ceph-mon[35231]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T10:31:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:24 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/4127531489' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e1ea615-df4a-4948-b6a9-39323edfed2c"}]: dispatch 2024-09-10T10:31:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:24 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/4127531489' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e1ea615-df4a-4948-b6a9-39323edfed2c"}]': finished 2024-09-10T10:31:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:24 smithi121 ceph-mon[35231]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T10:31:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:24 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:24 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3218596023' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:31:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:24 smithi121 ceph-mon[35231]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:24 smithi121 ceph-mon[35231]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T10:31:24.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:24 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:24 smithi097 ceph-mon[35213]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T10:31:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:24 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/4127531489' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e1ea615-df4a-4948-b6a9-39323edfed2c"}]: dispatch 2024-09-10T10:31:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:24 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/4127531489' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e1ea615-df4a-4948-b6a9-39323edfed2c"}]': finished 2024-09-10T10:31:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:24 smithi097 ceph-mon[35213]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T10:31:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:24 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:24 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3218596023' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:31:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:24 smithi097 ceph-mon[35213]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:24 smithi097 ceph-mon[35213]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T10:31:24.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:24 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:24.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:24 smithi092 ceph-mon[30834]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T10:31:24.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:24 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/4127531489' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e1ea615-df4a-4948-b6a9-39323edfed2c"}]: dispatch 2024-09-10T10:31:24.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:24 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/4127531489' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e1ea615-df4a-4948-b6a9-39323edfed2c"}]': finished 2024-09-10T10:31:24.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:24 smithi092 ceph-mon[30834]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T10:31:24.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:24 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:24.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:24 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3218596023' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:31:24.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:24 smithi092 ceph-mon[30834]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:24.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:24 smithi092 ceph-mon[30834]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T10:31:24.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:24 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:26 smithi121 ceph-mon[35231]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T10:31:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:26 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:26 smithi097 ceph-mon[35213]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T10:31:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:26 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:26.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:26 smithi092 ceph-mon[30834]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T10:31:26.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:26 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:27.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:27 smithi121 ceph-mon[35231]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:27 smithi097 ceph-mon[35213]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:27.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:27 smithi092 ceph-mon[30834]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:29.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:29 smithi121 ceph-mon[35231]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-10T10:31:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:29 smithi097 ceph-mon[35213]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-10T10:31:29.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:29 smithi092 ceph-mon[30834]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-10T10:31:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:31 smithi121 ceph-mon[35231]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T10:31:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:31 smithi097 ceph-mon[35213]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T10:31:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:31 smithi092 ceph-mon[30834]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-10T10:31:32.530 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T10:31:32.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T10:31:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:32.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:32 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T10:31:32.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:32 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:33 smithi092 ceph-mon[30834]: Deploying daemon osd.6 on smithi092 2024-09-10T10:31:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:33 smithi092 ceph-mon[30834]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:31:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:33 smithi121 ceph-mon[35231]: Deploying daemon osd.6 on smithi092 2024-09-10T10:31:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:33 smithi121 ceph-mon[35231]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:31:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:33 smithi097 ceph-mon[35213]: Deploying daemon osd.6 on smithi092 2024-09-10T10:31:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:33 smithi097 ceph-mon[35213]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:31:35.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:35 smithi092 ceph-mon[30834]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:31:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:35 smithi121 ceph-mon[35231]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:31:35.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:35 smithi097 ceph-mon[35213]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:31:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:37 smithi121 ceph-mon[35231]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T10:31:37.559 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:37 smithi092 ceph-mon[30834]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T10:31:37.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:37 smithi097 ceph-mon[35213]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T10:31:38.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:38 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:38.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:38 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:38.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:38 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:38.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:38 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:38.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:38 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:38.545 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:38 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:38.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:38 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:38.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:38 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:38.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:38 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:39.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:39 smithi121 ceph-mon[35231]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:31:39.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:39 smithi097 ceph-mon[35213]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:31:39.580 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:39 smithi092 ceph-mon[30834]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:31:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:41 smithi092 ceph-mon[30834]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:41.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:41.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.538+0000 7f7f8ffff640 1 -- 172.21.15.92:0/3081369466 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7f981a06f0 con 0x7f7f840a2bb0 2024-09-10T10:31:41.539 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 6 on host 'smithi092' 2024-09-10T10:31:41.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:41 smithi121 ceph-mon[35231]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7f840a2bb0 msgr2=0x7f7f840a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7f840a2bb0 0x7f7f840a5070 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f80005e10 tx=0x7f7f80005da0 comp rx=0 tx=0).stop 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f98100b10 msgr2=0x7f7f98197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f98100b10 0x7f7f98197e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800b450 tx=0x7f7f8800b910 comp rx=0 tx=0).stop 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 shutdown_connections 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7f840a2bb0 0x7f7f840a5070 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f981026d0 0x7f7f9819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f98101d10 0x7f7f981983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 --2- 172.21.15.92:0/3081369466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f98100b10 0x7f7f98197e60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 >> 172.21.15.92:0/3081369466 conn(0x7f7f980fc2a0 msgr2=0x7f7f980fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:31:41.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 shutdown_connections 2024-09-10T10:31:41.543 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:31:41.540+0000 7f7f9d5cf640 1 -- 172.21.15.92:0/3081369466 wait complete. 2024-09-10T10:31:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:41 smithi097 ceph-mon[35213]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:42.225 DEBUG:teuthology.orchestra.run.smithi092:osd.6> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T10:31:42.228 INFO:tasks.cephadm:Deploying osd.7 on smithi097 with /dev/vg_nvme/lv_2... 2024-09-10T10:31:42.228 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T10:31:42.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:42 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:42.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:42 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:42.464 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:42 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:42.479 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:31:42.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:42 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:42.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:42 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:42.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:42 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:42.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:31:42.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:42.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:42 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:43.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:43 smithi121 ceph-mon[35231]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:43.552 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:43 smithi097 ceph-mon[35213]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:43.567 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:43 smithi092 ceph-mon[30834]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:44.111 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:31:43 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:31:43.870+0000 7fadcfbb8640 -1 osd.6 0 log_to_monitors true 2024-09-10T10:31:44.471 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:44 smithi097 ceph-mon[35213]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:31:44.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:44 smithi121 ceph-mon[35231]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:31:44.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:44 smithi092 ceph-mon[30834]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T10:31:44.896 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:31:44.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi097:vg_nvme/lv_2 2024-09-10T10:31:45.179 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:45.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:45.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:45.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T10:31:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T10:31:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:45.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:31:45.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:31:45.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.682+0000 7f9305a6e640 1 -- 172.21.15.97:0/2245132766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9300100b10 msgr2=0x7f9300100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:45.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.682+0000 7f9305a6e640 1 --2- 172.21.15.97:0/2245132766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9300100b10 0x7f9300100f10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009900 tx=0x7f92f002a410 comp rx=0 tx=0).stop 2024-09-10T10:31:45.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.682+0000 7f9305a6e640 1 -- 172.21.15.97:0/2245132766 shutdown_connections 2024-09-10T10:31:45.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.682+0000 7f9305a6e640 1 --2- 172.21.15.97:0/2245132766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93001026d0 0x7f9300108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:45.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.682+0000 7f9305a6e640 1 --2- 172.21.15.97:0/2245132766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9300101d10 0x7f9300102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:45.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.682+0000 7f9305a6e640 1 --2- 172.21.15.97:0/2245132766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9300100b10 0x7f9300100f10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:45.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.682+0000 7f9305a6e640 1 -- 172.21.15.97:0/2245132766 >> 172.21.15.97:0/2245132766 conn(0x7f93000fc2a0 msgr2=0x7f93000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:31:45.689 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.682+0000 7f9305a6e640 1 -- 172.21.15.97:0/2245132766 shutdown_connections 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.682+0000 7f9305a6e640 1 -- 172.21.15.97:0/2245132766 wait complete. 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f9305a6e640 1 Processor -- start 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f9305a6e640 1 -- start start 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f9305a6e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9300100b10 0x7f930019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f9305a6e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9300101d10 0x7f930019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f9305a6e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93001026d0 0x7f93001a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f9305a6e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f930010c770 con 0x7f9300101d10 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f9305a6e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f930010c5f0 con 0x7f93001026d0 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f9305a6e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f930010c8f0 con 0x7f9300100b10 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f92feffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9300101d10 0x7f930019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f92feffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9300101d10 0x7f930019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.97:44328/0 (socket says 172.21.15.97:44328) 2024-09-10T10:31:45.690 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f92feffd640 1 -- 172.21.15.97:0/3629196501 learned_addr learned my addr 172.21.15.97:0/3629196501 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.683+0000 7f92fffff640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93001026d0 0x7f93001a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92ff7fe640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9300100b10 0x7f930019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92feffd640 1 -- 172.21.15.97:0/3629196501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9300100b10 msgr2=0x7f930019a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92feffd640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9300100b10 0x7f930019a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92feffd640 1 -- 172.21.15.97:0/3629196501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93001026d0 msgr2=0x7f93001a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92feffd640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93001026d0 0x7f93001a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92feffd640 1 -- 172.21.15.97:0/3629196501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93001a1d20 con 0x7f9300101d10 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92fffff640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93001026d0 0x7f93001a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92feffd640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9300101d10 0x7f930019a630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92f400d950 tx=0x7f92f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92fcff9640 1 -- 172.21.15.97:0/3629196501 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4017030 con 0x7f9300101d10 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92fcff9640 1 -- 172.21.15.97:0/3629196501 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f4004020 con 0x7f9300101d10 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93001a1fb0 con 0x7f9300101d10 2024-09-10T10:31:45.691 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f92fcff9640 1 -- 172.21.15.97:0/3629196501 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f40047a0 con 0x7f9300101d10 2024-09-10T10:31:45.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.684+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93001a24c0 con 0x7f9300101d10 2024-09-10T10:31:45.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.685+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93001a2750 con 0x7f9300101d10 2024-09-10T10:31:45.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.686+0000 7f92fcff9640 1 -- 172.21.15.97:0/3629196501 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f92f40041d0 con 0x7f9300101d10 2024-09-10T10:31:45.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.687+0000 7f92fcff9640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92e80a2bb0 0x7f92e80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:31:45.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.687+0000 7f92fcff9640 1 -- 172.21.15.97:0/3629196501 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4685+0+0 (secure 0 0 0) 0x7f92f40ce280 con 0x7f9300101d10 2024-09-10T10:31:45.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.687+0000 7f92ff7fe640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92e80a2bb0 0x7f92e80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:31:45.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.688+0000 7f92ff7fe640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92e80a2bb0 0x7f92e80a5070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92f0005ab0 tx=0x7f92f0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:31:45.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.690+0000 7f92fcff9640 1 -- 172.21.15.97:0/3629196501 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92f409bf70 con 0x7f9300101d10 2024-09-10T10:31:45.867 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:31:45.865+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f93001a2920 con 0x7f92e80a2bb0 2024-09-10T10:31:46.110 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:31:45.698+0000 7fadcbb3b640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T10:31:46.110 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:31:45 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:31:45.706+0000 7fadc395b640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:31:46.533 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi092 2024-09-10T10:31:46.533 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-10T10:31:46.533 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:31:46.533 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T10:31:46.533 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:46.534 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:46.534 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' 2024-09-10T10:31:46.534 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:31:46.534 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:31:46.534 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:46 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:46.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi092 2024-09-10T10:31:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-10T10:31:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:31:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T10:31:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' 2024-09-10T10:31:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:31:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:31:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:46 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:46.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi092 2024-09-10T10:31:46.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-10T10:31:46.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:31:46.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T10:31:46.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:46.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:46.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: from='osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316]' entity='osd.6' 2024-09-10T10:31:46.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:31:46.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:31:46.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:46 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:47.478 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:47 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:31:47.478 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:47 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:31:47.478 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:47 smithi097 ceph-mon[35213]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:31:47.478 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:47 smithi097 ceph-mon[35213]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:47.478 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:47.478 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:47 smithi097 ceph-mon[35213]: osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] boot 2024-09-10T10:31:47.478 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:47 smithi097 ceph-mon[35213]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T10:31:47.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:47 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:47.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:47 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:31:47.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:47 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:31:47.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:47 smithi092 ceph-mon[30834]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:31:47.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:47 smithi092 ceph-mon[30834]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:47.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:47.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:47 smithi092 ceph-mon[30834]: osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] boot 2024-09-10T10:31:47.513 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:47 smithi092 ceph-mon[30834]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T10:31:47.513 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:47 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:47.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:47 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:31:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:47 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:31:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:47 smithi121 ceph-mon[35231]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:31:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:47 smithi121 ceph-mon[35231]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-10T10:31:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:47 smithi121 ceph-mon[35231]: osd.6 [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] boot 2024-09-10T10:31:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:47 smithi121 ceph-mon[35231]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T10:31:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:47 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:31:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:48 smithi121 ceph-mon[35231]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T10:31:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:48 smithi121 ceph-mon[35231]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:48 smithi121 ceph-mon[35231]: from='client.? 172.21.15.97:0/1639417239' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62e6ec88-d78d-4759-b4b9-37a846ef4a46"}]: dispatch 2024-09-10T10:31:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:48 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62e6ec88-d78d-4759-b4b9-37a846ef4a46"}]: dispatch 2024-09-10T10:31:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:48 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62e6ec88-d78d-4759-b4b9-37a846ef4a46"}]': finished 2024-09-10T10:31:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:48 smithi121 ceph-mon[35231]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T10:31:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:48 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:31:49.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:48 smithi097 ceph-mon[35213]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T10:31:49.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:48 smithi097 ceph-mon[35213]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:49.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:48 smithi097 ceph-mon[35213]: from='client.? 172.21.15.97:0/1639417239' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62e6ec88-d78d-4759-b4b9-37a846ef4a46"}]: dispatch 2024-09-10T10:31:49.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:48 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62e6ec88-d78d-4759-b4b9-37a846ef4a46"}]: dispatch 2024-09-10T10:31:49.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:48 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62e6ec88-d78d-4759-b4b9-37a846ef4a46"}]': finished 2024-09-10T10:31:49.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:48 smithi097 ceph-mon[35213]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T10:31:49.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:48 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:31:49.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:48 smithi092 ceph-mon[30834]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T10:31:49.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:48 smithi092 ceph-mon[30834]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:49.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:48 smithi092 ceph-mon[30834]: from='client.? 172.21.15.97:0/1639417239' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62e6ec88-d78d-4759-b4b9-37a846ef4a46"}]: dispatch 2024-09-10T10:31:49.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:48 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62e6ec88-d78d-4759-b4b9-37a846ef4a46"}]: dispatch 2024-09-10T10:31:49.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:48 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62e6ec88-d78d-4759-b4b9-37a846ef4a46"}]': finished 2024-09-10T10:31:49.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:48 smithi092 ceph-mon[30834]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T10:31:49.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:48 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:31:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:49 smithi121 ceph-mon[35231]: from='client.? 172.21.15.97:0/2034288079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:31:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:49 smithi097 ceph-mon[35213]: from='client.? 172.21.15.97:0/2034288079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:31:50.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:49 smithi092 ceph-mon[30834]: from='client.? 172.21.15.97:0/2034288079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:31:51.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:50 smithi121 ceph-mon[35231]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:51.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:50 smithi097 ceph-mon[35213]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:51.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:50 smithi092 ceph-mon[30834]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:53.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:53 smithi097 ceph-mon[35213]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:53.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:53 smithi121 ceph-mon[35231]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:53 smithi092 ceph-mon[30834]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:55.428 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:55 smithi097 ceph-mon[35213]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:55 smithi121 ceph-mon[35231]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:55 smithi092 ceph-mon[30834]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:57.335 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:57 smithi097 ceph-mon[35213]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:57.335 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:57 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T10:31:57.335 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:57 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:57.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:57 smithi121 ceph-mon[35231]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:57.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:57 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T10:31:57.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:57 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:57.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:57 smithi092 ceph-mon[30834]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:57.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T10:31:57.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:31:58.420 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:58 smithi097 ceph-mon[35213]: Deploying daemon osd.7 on smithi097 2024-09-10T10:31:58.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:58 smithi121 ceph-mon[35231]: Deploying daemon osd.7 on smithi097 2024-09-10T10:31:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:58 smithi092 ceph-mon[30834]: Deploying daemon osd.7 on smithi097 2024-09-10T10:31:59.407 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:31:59 smithi097 ceph-mon[35213]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:59.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:31:59 smithi121 ceph-mon[35231]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:31:59.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:31:59 smithi092 ceph-mon[30834]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:01.416 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:01 smithi097 ceph-mon[35213]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:01.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:01 smithi121 ceph-mon[35231]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:01.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:01 smithi092 ceph-mon[30834]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:03.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:03 smithi097 ceph-mon[35213]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:03.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:03.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:03.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:03.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:03 smithi121 ceph-mon[35231]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:03.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:03.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:03.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:03 smithi092 ceph-mon[30834]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:05.438 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:05 smithi097 ceph-mon[35213]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:05.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:05 smithi121 ceph-mon[35231]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:05.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:05 smithi092 ceph-mon[30834]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:06.037 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.035+0000 7f92fcff9640 1 -- 172.21.15.97:0/3629196501 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f93001a2920 con 0x7f92e80a2bb0 2024-09-10T10:32:06.037 INFO:teuthology.orchestra.run.smithi097.stdout:Created osd(s) 7 on host 'smithi097' 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.037+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92e80a2bb0 msgr2=0x7f92e80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.037+0000 7f9305a6e640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92e80a2bb0 0x7f92e80a5070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92f0005ab0 tx=0x7f92f0000bc0 comp rx=0 tx=0).stop 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.037+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9300101d10 msgr2=0x7f930019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.037+0000 7f9305a6e640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9300101d10 0x7f930019a630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92f400d950 tx=0x7f92f400de10 comp rx=0 tx=0).stop 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.037+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 shutdown_connections 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.037+0000 7f9305a6e640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92e80a2bb0 0x7f92e80a5070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.037+0000 7f9305a6e640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f93001026d0 0x7f93001a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.037+0000 7f9305a6e640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9300101d10 0x7f930019a630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.037+0000 7f9305a6e640 1 --2- 172.21.15.97:0/3629196501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9300100b10 0x7f930019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:06.039 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.038+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 >> 172.21.15.97:0/3629196501 conn(0x7f93000fc2a0 msgr2=0x7f930006a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:32:06.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.038+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 shutdown_connections 2024-09-10T10:32:06.040 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:32:06.038+0000 7f9305a6e640 1 -- 172.21.15.97:0/3629196501 wait complete. 2024-09-10T10:32:06.655 DEBUG:teuthology.orchestra.run.smithi097:osd.7> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T10:32:06.659 INFO:tasks.cephadm:Deploying osd.8 on smithi121 with /dev/vg_nvme/lv_2... 2024-09-10T10:32:06.659 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T10:32:06.920 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:32:07.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:07 smithi121 ceph-mon[35231]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:07.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.293 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.293 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.293 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:07 smithi097 ceph-mon[35213]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:07.293 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.293 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:07 smithi092 ceph-mon[30834]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:07.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:09.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:32:08 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:32:08.679+0000 7ff781959640 -1 osd.7 0 log_to_monitors true 2024-09-10T10:32:09.400 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:09 smithi097 ceph-mon[35213]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:09.400 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:09 smithi097 ceph-mon[35213]: from='osd.7 [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:32:09.400 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:09 smithi097 ceph-mon[35213]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:32:09.494 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:09 smithi121 ceph-mon[35231]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:09.494 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:09 smithi121 ceph-mon[35231]: from='osd.7 [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:32:09.494 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:09 smithi121 ceph-mon[35231]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:32:09.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:09 smithi092 ceph-mon[30834]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:09.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:09 smithi092 ceph-mon[30834]: from='osd.7 [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:32:09.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:09 smithi092 ceph-mon[30834]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T10:32:09.815 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:32:09.840 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_2 2024-09-10T10:32:10.099 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:32:10.515 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T10:32:10.515 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='osd.7 [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:10.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.517 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:10.517 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:10.517 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:10.517 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.543 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='osd.7 [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:10.544 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.545 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:10.545 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:10.545 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.545 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:10.545 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:10.545 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:10.545 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T10:32:10.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='osd.7 [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:10.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:10.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:10.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:10.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:10.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 -- 172.21.15.121:0/2494679150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c100b10 msgr2=0x7f0f5c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:10.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 --2- 172.21.15.121:0/2494679150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c100b10 0x7f0f5c100f10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009900 tx=0x7f0f4c02a410 comp rx=0 tx=0).stop 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 -- 172.21.15.121:0/2494679150 shutdown_connections 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 --2- 172.21.15.121:0/2494679150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f5c1026d0 0x7f0f5c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 --2- 172.21.15.121:0/2494679150 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5c101d10 0x7f0f5c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 --2- 172.21.15.121:0/2494679150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c100b10 0x7f0f5c100f10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 -- 172.21.15.121:0/2494679150 >> 172.21.15.121:0/2494679150 conn(0x7f0f5c0fc2a0 msgr2=0x7f0f5c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 -- 172.21.15.121:0/2494679150 shutdown_connections 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 -- 172.21.15.121:0/2494679150 wait complete. 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 Processor -- start 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.598+0000 7f0f63819640 1 -- start start 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f63819640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5c100b10 0x7f0f5c10b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:32:10.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f63819640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c101d10 0x7f0f5c109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f63819640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f5c1026d0 0x7f0f5c10a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f63819640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10d8c0 con 0x7f0f5c1026d0 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f63819640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10d740 con 0x7f0f5c100b10 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f63819640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10da40 con 0x7f0f5c101d10 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f60db4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c101d10 0x7f0f5c109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f60db4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c101d10 0x7f0f5c109ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:40780/0 (socket says 172.21.15.121:40780) 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f60db4640 1 -- 172.21.15.121:0/757907977 learned_addr learned my addr 172.21.15.121:0/757907977 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f615b5640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5c100b10 0x7f0f5c10b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f61db6640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f5c1026d0 0x7f0f5c10a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f60db4640 1 -- 172.21.15.121:0/757907977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5c100b10 msgr2=0x7f0f5c10b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f60db4640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5c100b10 0x7f0f5c10b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:10.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f60db4640 1 -- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f5c1026d0 msgr2=0x7f0f5c10a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f60db4640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f5c1026d0 0x7f0f5c10a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f60db4640 1 -- 172.21.15.121:0/757907977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c10a8e0 con 0x7f0f5c101d10 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f60db4640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c101d10 0x7f0f5c109ae0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800d950 tx=0x7f0f5800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f527fc640 1 -- 172.21.15.121:0/757907977 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58017030 con 0x7f0f5c101d10 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f527fc640 1 -- 172.21.15.121:0/757907977 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f58004020 con 0x7f0f5c101d10 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c1a20d0 con 0x7f0f5c101d10 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f527fc640 1 -- 172.21.15.121:0/757907977 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f580047a0 con 0x7f0f5c101d10 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.599+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c1a25e0 con 0x7f0f5c101d10 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.600+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c107f60 con 0x7f0f5c101d10 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.601+0000 7f0f527fc640 1 -- 172.21.15.121:0/757907977 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f0f580041d0 con 0x7f0f5c101d10 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.602+0000 7f0f527fc640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f480a2b80 0x7f0f480a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.602+0000 7f0f527fc640 1 -- 172.21.15.121:0/757907977 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5117+0+0 (secure 0 0 0) 0x7f0f580cde00 con 0x7f0f5c101d10 2024-09-10T10:32:10.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.603+0000 7f0f615b5640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f480a2b80 0x7f0f480a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:32:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.603+0000 7f0f615b5640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f480a2b80 0x7f0f480a5040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c005ab0 tx=0x7f0f4c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:32:10.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.607+0000 7f0f527fc640 1 -- 172.21.15.121:0/757907977 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f5809b9e0 con 0x7f0f5c101d10 2024-09-10T10:32:10.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:10.783+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0f5c062630 con 0x7f0f480a2b80 2024-09-10T10:32:10.820 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:32:10.541+0000 7ff77d8dc640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T10:32:10.820 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:32:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:32:10.552+0000 7ff7756fc640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:32:11.418 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi097 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi097 to 5696M 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: from='osd.7 ' entity='osd.7' 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:32:11.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:11 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi097 2024-09-10T10:32:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi097 to 5696M 2024-09-10T10:32:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:32:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T10:32:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: from='osd.7 ' entity='osd.7' 2024-09-10T10:32:11.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:32:11.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:32:11.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:11 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:11.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi097 2024-09-10T10:32:11.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi097 to 5696M 2024-09-10T10:32:11.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:11.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:32:11.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T10:32:11.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:11.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:11.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: from='osd.7 ' entity='osd.7' 2024-09-10T10:32:11.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:32:11.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:32:11.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:11 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:12.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:12 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:32:12.479 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:12 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:32:12.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:12 smithi121 ceph-mon[35231]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:32:12.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:12 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:12.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:12 smithi121 ceph-mon[35231]: osd.7 [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] boot 2024-09-10T10:32:12.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:12 smithi121 ceph-mon[35231]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T10:32:12.480 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:12 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:12.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:12 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:32:12.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:12 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:32:12.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:12 smithi097 ceph-mon[35213]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:32:12.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:12 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:12.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:12 smithi097 ceph-mon[35213]: osd.7 [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] boot 2024-09-10T10:32:12.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:12 smithi097 ceph-mon[35213]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T10:32:12.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:12 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:12.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:12 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:32:12.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:12 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:32:12.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:12 smithi092 ceph-mon[30834]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:32:12.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:12 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:12.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:12 smithi092 ceph-mon[30834]: osd.7 [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] boot 2024-09-10T10:32:12.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:12 smithi092 ceph-mon[30834]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T10:32:12.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:12 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:32:13.450 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:13 smithi121 ceph-mon[35231]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:13.450 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:13 smithi121 ceph-mon[35231]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T10:32:13.450 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:13 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/1372152484' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2925118a-dd87-43bb-b3a2-43938fa103e1"}]: dispatch 2024-09-10T10:32:13.450 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:13 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2925118a-dd87-43bb-b3a2-43938fa103e1"}]: dispatch 2024-09-10T10:32:13.450 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:13 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2925118a-dd87-43bb-b3a2-43938fa103e1"}]': finished 2024-09-10T10:32:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:13 smithi097 ceph-mon[35213]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:13 smithi097 ceph-mon[35213]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T10:32:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:13 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/1372152484' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2925118a-dd87-43bb-b3a2-43938fa103e1"}]: dispatch 2024-09-10T10:32:13.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:13 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2925118a-dd87-43bb-b3a2-43938fa103e1"}]: dispatch 2024-09-10T10:32:13.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:13 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2925118a-dd87-43bb-b3a2-43938fa103e1"}]': finished 2024-09-10T10:32:13.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:13 smithi092 ceph-mon[30834]: pgmap v168: 1 pgs: 1 remapped; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-09-10T10:32:13.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:13 smithi092 ceph-mon[30834]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T10:32:13.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:13 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/1372152484' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2925118a-dd87-43bb-b3a2-43938fa103e1"}]: dispatch 2024-09-10T10:32:13.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:13 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2925118a-dd87-43bb-b3a2-43938fa103e1"}]: dispatch 2024-09-10T10:32:13.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:13 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2925118a-dd87-43bb-b3a2-43938fa103e1"}]': finished 2024-09-10T10:32:14.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:14 smithi097 ceph-mon[35213]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T10:32:14.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:14 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:14.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:14 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/6336354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:32:14.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:14 smithi121 ceph-mon[35231]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T10:32:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:14 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:14 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/6336354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:32:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:14 smithi092 ceph-mon[30834]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T10:32:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:14.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:14 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/6336354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:32:15.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:15 smithi121 ceph-mon[35231]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:15.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:15 smithi121 ceph-mon[35231]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T10:32:15.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:15 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:15.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:15 smithi097 ceph-mon[35213]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:15.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:15 smithi097 ceph-mon[35213]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T10:32:15.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:15 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:15.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:15 smithi092 ceph-mon[30834]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:15.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:15 smithi092 ceph-mon[30834]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T10:32:15.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:15 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:16.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:16 smithi121 ceph-mon[35231]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T10:32:16.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:16.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:16 smithi097 ceph-mon[35213]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T10:32:16.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:16.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:16 smithi092 ceph-mon[30834]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T10:32:16.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:17.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:17 smithi092 ceph-mon[30834]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:17.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:17 smithi121 ceph-mon[35231]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:17.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:17 smithi097 ceph-mon[35213]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:19.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:19 smithi121 ceph-mon[35231]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:19.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:19 smithi097 ceph-mon[35213]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:19.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:19 smithi092 ceph-mon[30834]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:21.427 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:21 smithi121 ceph-mon[35231]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:21.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:21 smithi097 ceph-mon[35213]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:21.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:21 smithi092 ceph-mon[30834]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:22.436 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:22 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T10:32:22.436 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:22 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:22.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:22 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T10:32:22.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:22 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:22.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T10:32:22.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:23.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:23 smithi121 ceph-mon[35231]: Deploying daemon osd.8 on smithi121 2024-09-10T10:32:23.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:23 smithi121 ceph-mon[35231]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:23.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:23 smithi097 ceph-mon[35213]: Deploying daemon osd.8 on smithi121 2024-09-10T10:32:23.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:23 smithi097 ceph-mon[35213]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:23.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:23 smithi092 ceph-mon[30834]: Deploying daemon osd.8 on smithi121 2024-09-10T10:32:23.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:23 smithi092 ceph-mon[30834]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:25.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:25 smithi121 ceph-mon[35231]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:25.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:25 smithi097 ceph-mon[35213]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:25.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:25 smithi092 ceph-mon[30834]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:27.454 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:27 smithi121 ceph-mon[35231]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:27 smithi097 ceph-mon[35213]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:27.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:27 smithi092 ceph-mon[30834]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:28.490 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:28 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:28.491 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:28 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:28.491 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:28 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:28.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:28 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:28.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:28 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:28.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:28 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:28.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:28 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:28.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:28 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:28.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:28 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:29.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:29 smithi121 ceph-mon[35231]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:29 smithi097 ceph-mon[35213]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:29.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:29 smithi092 ceph-mon[30834]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:31 smithi121 ceph-mon[35231]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:31 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:31 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:31 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:31 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:31 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:31 smithi097 ceph-mon[35213]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:31 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:31 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:31 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:31 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:31 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:31 smithi092 ceph-mon[30834]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:31 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:31.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:31 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:31.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:31 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:31.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:31 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:31.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:31 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:31.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.956+0000 7f0f527fc640 1 -- 172.21.15.121:0/757907977 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0f5c062630 con 0x7f0f480a2b80 2024-09-10T10:32:31.958 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 8 on host 'smithi121' 2024-09-10T10:32:31.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f480a2b80 msgr2=0x7f0f480a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:31.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f480a2b80 0x7f0f480a5040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c005ab0 tx=0x7f0f4c000bc0 comp rx=0 tx=0).stop 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c101d10 msgr2=0x7f0f5c109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c101d10 0x7f0f5c109ae0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0f5800d950 tx=0x7f0f5800de10 comp rx=0 tx=0).stop 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 shutdown_connections 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f480a2b80 0x7f0f480a5040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f5c1026d0 0x7f0f5c10a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f5c101d10 0x7f0f5c109ae0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 --2- 172.21.15.121:0/757907977 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f5c100b10 0x7f0f5c10b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 >> 172.21.15.121:0/757907977 conn(0x7f0f5c0fc2a0 msgr2=0x7f0f5c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 shutdown_connections 2024-09-10T10:32:31.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:32:31.958+0000 7f0f63819640 1 -- 172.21.15.121:0/757907977 wait complete. 2024-09-10T10:32:32.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:32.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:32 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:32.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:32 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:32.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:32 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:32.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:32.617 DEBUG:teuthology.orchestra.run.smithi121:osd.8> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T10:32:33.048 INFO:tasks.cephadm:Deploying osd.9 on smithi092 with /dev/vg_nvme/lv_1... 2024-09-10T10:32:33.048 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T10:32:33.313 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:32:33.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:33 smithi092 ceph-mon[30834]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:33 smithi121 ceph-mon[35231]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:33 smithi097 ceph-mon[35213]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:33.993 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:32:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:32:33.600+0000 7f4130a59640 -1 osd.8 0 log_to_monitors true 2024-09-10T10:32:34.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:34 smithi121 ceph-mon[35231]: from='osd.8 [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:32:34.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:34 smithi121 ceph-mon[35231]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:32:34.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:34 smithi097 ceph-mon[35213]: from='osd.8 [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:32:34.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:34 smithi097 ceph-mon[35213]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:32:34.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:34 smithi092 ceph-mon[30834]: from='osd.8 [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:32:34.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:34 smithi092 ceph-mon[30834]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T10:32:35.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:35 smithi121 ceph-mon[35231]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:35 smithi121 ceph-mon[35231]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T10:32:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:35 smithi121 ceph-mon[35231]: from='osd.8 [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:32:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:35 smithi121 ceph-mon[35231]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T10:32:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:35 smithi121 ceph-mon[35231]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:32:35.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:35 smithi097 ceph-mon[35213]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:35.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:35 smithi097 ceph-mon[35213]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T10:32:35.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:35 smithi097 ceph-mon[35213]: from='osd.8 [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:32:35.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:35 smithi097 ceph-mon[35213]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T10:32:35.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:35.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:35 smithi097 ceph-mon[35213]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:32:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:35 smithi092 ceph-mon[30834]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:35.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:35 smithi092 ceph-mon[30834]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T10:32:35.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:35 smithi092 ceph-mon[30834]: from='osd.8 [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:32:35.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:35 smithi092 ceph-mon[30834]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T10:32:35.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:35.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:35 smithi092 ceph-mon[30834]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:32:35.927 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:32:35 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:32:35.631+0000 7f412d1f0640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T10:32:35.927 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:32:35 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:32:35.641+0000 7f41247fc640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:32:36.115 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:32:36.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_1 2024-09-10T10:32:36.393 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:32:36.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:32:36.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T10:32:36.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:36.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:36.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='osd.8 ' entity='osd.8' 2024-09-10T10:32:36.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:36.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:36.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:36.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:36.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:36.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='osd.8 ' entity='osd.8' 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:36.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:36.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:32:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T10:32:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='osd.8 ' entity='osd.8' 2024-09-10T10:32:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:36.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:32:36.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:36.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:36.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.881+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/1273903348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f081037c0 msgr2=0x7f5f0810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.881+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/1273903348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f081037c0 0x7f5f0810a050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009ca0 tx=0x7f5f0002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.881+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/1273903348 shutdown_connections 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.881+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/1273903348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f081037c0 0x7f5f0810a050 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.881+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/1273903348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f08102e00 0x7f5f08103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.881+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/1273903348 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f08101c00 0x7f5f08102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.881+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/1273903348 >> 172.21.15.92:0/1273903348 conn(0x7f5f080fd390 msgr2=0x7f5f080ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.881+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/1273903348 shutdown_connections 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.881+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/1273903348 wait complete. 2024-09-10T10:32:36.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0cf2c640 1 Processor -- start 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0cf2c640 1 -- start start 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0cf2c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f08101c00 0x7f5f08197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0cf2c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f08102e00 0x7f5f081983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0cf2c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f081037c0 0x7f5f0819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0cf2c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0810d880 con 0x7f5f08101c00 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0cf2c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0810d700 con 0x7f5f08102e00 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0cf2c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0810da00 con 0x7f5f081037c0 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f08101c00 0x7f5f08197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f08101c00 0x7f5f08197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54386/0 (socket says 172.21.15.92:54386) 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f0659c640 1 -- 172.21.15.92:0/809154029 learned_addr learned my addr 172.21.15.92:0/809154029 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5f06d9d640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f081037c0 0x7f5f0819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:32:36.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.882+0000 7f5efffff640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f08102e00 0x7f5f081983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5f0659c640 1 -- 172.21.15.92:0/809154029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f081037c0 msgr2=0x7f5f0819f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5f0659c640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f081037c0 0x7f5f0819f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5f0659c640 1 -- 172.21.15.92:0/809154029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f08102e00 msgr2=0x7f5f081983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5f0659c640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f08102e00 0x7f5f081983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5f0659c640 1 -- 172.21.15.92:0/809154029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0819fad0 con 0x7f5f08101c00 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5f0659c640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f08101c00 0x7f5f08197ea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800c970 tx=0x7f5ef800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5eff7fe640 1 -- 172.21.15.92:0/809154029 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8004220 con 0x7f5f08101c00 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5eff7fe640 1 -- 172.21.15.92:0/809154029 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ef80043c0 con 0x7f5f08101c00 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f0819fdc0 con 0x7f5f08101c00 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5eff7fe640 1 -- 172.21.15.92:0/809154029 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800f450 con 0x7f5f08101c00 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.883+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f081a0220 con 0x7f5f08101c00 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.884+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f08108f80 con 0x7f5f08101c00 2024-09-10T10:32:36.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.885+0000 7f5eff7fe640 1 -- 172.21.15.92:0/809154029 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5ef80079b0 con 0x7f5f08101c00 2024-09-10T10:32:36.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.886+0000 7f5eff7fe640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f5ef40a2bb0 0x7f5ef40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:32:36.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.886+0000 7f5efffff640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f5ef40a2bb0 0x7f5ef40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:32:36.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.886+0000 7f5eff7fe640 1 -- 172.21.15.92:0/809154029 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5862+0+0 (secure 0 0 0) 0x7f5ef80ce400 con 0x7f5f08101c00 2024-09-10T10:32:36.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.886+0000 7f5efffff640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f5ef40a2bb0 0x7f5ef40a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5f081993c0 tx=0x7f5ef0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:32:36.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:36.890+0000 7f5eff7fe640 1 -- 172.21.15.92:0/809154029 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ef8014030 con 0x7f5f08101c00 2024-09-10T10:32:37.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:37.062+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5f08062630 con 0x7f5ef40a2bb0 2024-09-10T10:32:37.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:32:37.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:32:37.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi121 2024-09-10T10:32:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi121 to 5695M 2024-09-10T10:32:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: osd.8 [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] boot 2024-09-10T10:32:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T10:32:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:32:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:32:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi121 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi121 to 5695M 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: osd.8 [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] boot 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:32:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi121 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi121 to 5695M 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: osd.8 [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] boot 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:32:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:38.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:38 smithi092 ceph-mon[30834]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:32:38.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:38 smithi092 ceph-mon[30834]: osdmap e57: 9 total, 9 up, 9 in 2024-09-10T10:32:38.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:38 smithi121 ceph-mon[35231]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:32:38.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:38 smithi121 ceph-mon[35231]: osdmap e57: 9 total, 9 up, 9 in 2024-09-10T10:32:38.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:38 smithi097 ceph-mon[35213]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:32:38.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:38 smithi097 ceph-mon[35213]: osdmap e57: 9 total, 9 up, 9 in 2024-09-10T10:32:39.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:39 smithi121 ceph-mon[35231]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:39.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:39 smithi121 ceph-mon[35231]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T10:32:39.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:39 smithi121 ceph-mon[35231]: osdmap e59: 9 total, 9 up, 9 in 2024-09-10T10:32:39.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:39 smithi097 ceph-mon[35213]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:39.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:39 smithi097 ceph-mon[35213]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T10:32:39.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:39 smithi097 ceph-mon[35213]: osdmap e59: 9 total, 9 up, 9 in 2024-09-10T10:32:39.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:39 smithi092 ceph-mon[30834]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:39.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:39 smithi092 ceph-mon[30834]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T10:32:39.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:39 smithi092 ceph-mon[30834]: osdmap e59: 9 total, 9 up, 9 in 2024-09-10T10:32:40.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:40 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3361916939' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "478185a7-99a3-4808-8a0a-5ebf8e201b37"}]: dispatch 2024-09-10T10:32:40.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:40 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3361916939' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "478185a7-99a3-4808-8a0a-5ebf8e201b37"}]': finished 2024-09-10T10:32:40.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:40 smithi092 ceph-mon[30834]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T10:32:40.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:40 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:32:40.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:40 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2380209533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:32:40.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:40 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3361916939' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "478185a7-99a3-4808-8a0a-5ebf8e201b37"}]: dispatch 2024-09-10T10:32:40.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:40 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3361916939' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "478185a7-99a3-4808-8a0a-5ebf8e201b37"}]': finished 2024-09-10T10:32:40.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:40 smithi121 ceph-mon[35231]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T10:32:40.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:40 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:32:40.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:40 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2380209533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:32:40.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:40 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3361916939' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "478185a7-99a3-4808-8a0a-5ebf8e201b37"}]: dispatch 2024-09-10T10:32:40.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:40 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3361916939' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "478185a7-99a3-4808-8a0a-5ebf8e201b37"}]': finished 2024-09-10T10:32:40.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:40 smithi097 ceph-mon[35213]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T10:32:40.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:40 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:32:40.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:40 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2380209533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:32:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:41 smithi121 ceph-mon[35231]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:41 smithi097 ceph-mon[35213]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:41.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:41 smithi092 ceph-mon[30834]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 299 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:43.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:43 smithi121 ceph-mon[35231]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:43 smithi097 ceph-mon[35213]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:43.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:43 smithi092 ceph-mon[30834]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:45.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:45 smithi092 ceph-mon[30834]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:32:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:45 smithi121 ceph-mon[35231]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:32:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:45 smithi097 ceph-mon[35213]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T10:32:47.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:47 smithi121 ceph-mon[35231]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-10T10:32:47.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:47 smithi097 ceph-mon[35213]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-10T10:32:47.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:47 smithi092 ceph-mon[30834]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-10T10:32:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:49 smithi121 ceph-mon[35231]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-10T10:32:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T10:32:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:49.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:49 smithi097 ceph-mon[35213]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-10T10:32:49.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T10:32:49.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:49.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:49 smithi092 ceph-mon[30834]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-10T10:32:49.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T10:32:49.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:50.507 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:50 smithi092 ceph-mon[30834]: Deploying daemon osd.9 on smithi092 2024-09-10T10:32:50.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:50 smithi121 ceph-mon[35231]: Deploying daemon osd.9 on smithi092 2024-09-10T10:32:50.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:50 smithi097 ceph-mon[35213]: Deploying daemon osd.9 on smithi092 2024-09-10T10:32:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:51 smithi097 ceph-mon[35213]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-10T10:32:51.591 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:51 smithi092 ceph-mon[30834]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-10T10:32:51.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:51 smithi121 ceph-mon[35231]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-10T10:32:53.456 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:53 smithi092 ceph-mon[30834]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:32:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:53 smithi097 ceph-mon[35213]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:32:53.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:53 smithi121 ceph-mon[35231]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:32:55.567 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:55 smithi092 ceph-mon[30834]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:32:55.567 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:55.567 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:55.567 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:55 smithi097 ceph-mon[35213]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:32:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:55.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:55 smithi121 ceph-mon[35231]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T10:32:55.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:55.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:55.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:57 smithi097 ceph-mon[35213]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:57 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:57 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:57 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:57 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:57 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:57 smithi092 ceph-mon[30834]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:57.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:57.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:57.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:57 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:57 smithi121 ceph-mon[35231]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:57.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:57 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:57 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:57 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:32:57.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:57 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:32:57.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:57 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:57.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.877+0000 7f5eff7fe640 1 -- 172.21.15.92:0/809154029 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5f08062630 con 0x7f5ef40a2bb0 2024-09-10T10:32:57.879 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 9 on host 'smithi092' 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f5ef40a2bb0 msgr2=0x7f5ef40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f5ef40a2bb0 0x7f5ef40a5070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5f081993c0 tx=0x7f5ef0005f90 comp rx=0 tx=0).stop 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f08101c00 msgr2=0x7f5f08197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f08101c00 0x7f5f08197ea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800c970 tx=0x7f5ef800ce30 comp rx=0 tx=0).stop 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 shutdown_connections 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f5ef40a2bb0 0x7f5ef40a5070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f081037c0 0x7f5f0819f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5f08102e00 0x7f5f081983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 --2- 172.21.15.92:0/809154029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f08101c00 0x7f5f08197ea0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 >> 172.21.15.92:0/809154029 conn(0x7f5f080fd390 msgr2=0x7f5f08106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:32:57.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 shutdown_connections 2024-09-10T10:32:57.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:32:57.879+0000 7f5f0cf2c640 1 -- 172.21.15.92:0/809154029 wait complete. 2024-09-10T10:32:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:58 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:58 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:58 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:58 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:58.640 DEBUG:teuthology.orchestra.run.smithi092:osd.9> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T10:32:58.642 INFO:tasks.cephadm:Deploying osd.10 on smithi097 with /dev/vg_nvme/lv_1... 2024-09-10T10:32:58.642 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T10:32:58.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:58 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:32:58.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:58 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:58.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:58 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:32:58.894 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:32:59.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:32:59 smithi097 ceph-mon[35213]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:59.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:32:59 smithi092 ceph-mon[30834]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:32:59.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:32:59 smithi121 ceph-mon[35231]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:33:00.073 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:32:59 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:32:59.849+0000 7f79790a2640 -1 osd.9 0 log_to_monitors true 2024-09-10T10:33:00.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:00 smithi092 ceph-mon[30834]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:33:00.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:00 smithi097 ceph-mon[35213]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:33:00.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:00 smithi121 ceph-mon[35231]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T10:33:01.399 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:01 smithi097 ceph-mon[35213]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:33:01.399 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:01 smithi097 ceph-mon[35213]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T10:33:01.399 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:01 smithi097 ceph-mon[35213]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T10:33:01.399 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:01 smithi097 ceph-mon[35213]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:33:01.400 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:01.402 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-09-10T10:33:01.433 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi097:vg_nvme/lv_1 2024-09-10T10:33:01.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:01 smithi092 ceph-mon[30834]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:33:01.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:01 smithi092 ceph-mon[30834]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T10:33:01.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:01 smithi092 ceph-mon[30834]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T10:33:01.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:01 smithi092 ceph-mon[30834]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:33:01.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:01.677 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:33:01.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:01 smithi121 ceph-mon[35231]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:33:01.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:01 smithi121 ceph-mon[35231]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T10:33:01.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:01 smithi121 ceph-mon[35231]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T10:33:01.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:01 smithi121 ceph-mon[35231]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-10T10:33:01.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:02.110 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:33:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:33:01.734+0000 7f7975025640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T10:33:02.110 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:33:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:33:01.747+0000 7f796ce45640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:33:02.202 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.183+0000 7fb4377c9640 1 -- 172.21.15.97:0/683998426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4301037c0 msgr2=0x7fb43010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:02.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.183+0000 7fb4377c9640 1 --2- 172.21.15.97:0/683998426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4301037c0 0x7fb43010a050 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb428009ca0 tx=0x7fb42802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:33:02.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.183+0000 7fb4377c9640 1 -- 172.21.15.97:0/683998426 shutdown_connections 2024-09-10T10:33:02.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.183+0000 7fb4377c9640 1 --2- 172.21.15.97:0/683998426 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb4301037c0 0x7fb43010a050 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:02.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.183+0000 7fb4377c9640 1 --2- 172.21.15.97:0/683998426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430102e00 0x7fb430103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:02.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.183+0000 7fb4377c9640 1 --2- 172.21.15.97:0/683998426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb430101c00 0x7fb430102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:02.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.183+0000 7fb4377c9640 1 -- 172.21.15.97:0/683998426 >> 172.21.15.97:0/683998426 conn(0x7fb4300fd390 msgr2=0x7fb4300ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:02.203 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.183+0000 7fb4377c9640 1 -- 172.21.15.97:0/683998426 shutdown_connections 2024-09-10T10:33:02.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.183+0000 7fb4377c9640 1 -- 172.21.15.97:0/683998426 wait complete. 2024-09-10T10:33:02.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.184+0000 7fb4377c9640 1 Processor -- start 2024-09-10T10:33:02.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.184+0000 7fb4377c9640 1 -- start start 2024-09-10T10:33:02.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.184+0000 7fb4377c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb430101c00 0x7fb430197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:02.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.184+0000 7fb4377c9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb430102e00 0x7fb4301983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:02.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.184+0000 7fb4377c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4301037c0 0x7fb43019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:02.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.184+0000 7fb4377c9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb43010d880 con 0x7fb4301037c0 2024-09-10T10:33:02.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.184+0000 7fb4377c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb43010d700 con 0x7fb430101c00 2024-09-10T10:33:02.204 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.184+0000 7fb4377c9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb43010da00 con 0x7fb430102e00 2024-09-10T10:33:02.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435565640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb430101c00 0x7fb430197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:02.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435565640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb430101c00 0x7fb430197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.97:34172/0 (socket says 172.21.15.97:34172) 2024-09-10T10:33:02.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435565640 1 -- 172.21.15.97:0/3178600251 learned_addr learned my addr 172.21.15.97:0/3178600251 (peer_addr_for_me v2:172.21.15.97:0/0) 2024-09-10T10:33:02.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435d66640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4301037c0 0x7fb43019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:02.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb434d64640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb430102e00 0x7fb4301983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:02.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435565640 1 -- 172.21.15.97:0/3178600251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb430102e00 msgr2=0x7fb4301983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:02.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435565640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb430102e00 0x7fb4301983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:02.205 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435565640 1 -- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4301037c0 msgr2=0x7fb43019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:02.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435565640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4301037c0 0x7fb43019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:02.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435565640 1 -- 172.21.15.97:0/3178600251 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43019fad0 con 0x7fb430101c00 2024-09-10T10:33:02.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb435565640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb430101c00 0x7fb430197ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00d950 tx=0x7fb42c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:02.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb4267fc640 1 -- 172.21.15.97:0/3178600251 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c017070 con 0x7fb430101c00 2024-09-10T10:33:02.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb4267fc640 1 -- 172.21.15.97:0/3178600251 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb42c009c30 con 0x7fb430101c00 2024-09-10T10:33:02.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43019fdc0 con 0x7fb430101c00 2024-09-10T10:33:02.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb4267fc640 1 -- 172.21.15.97:0/3178600251 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00f600 con 0x7fb430101c00 2024-09-10T10:33:02.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.185+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4301a0220 con 0x7fb430101c00 2024-09-10T10:33:02.206 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.186+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb430109000 con 0x7fb430101c00 2024-09-10T10:33:02.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.187+0000 7fb4267fc640 1 -- 172.21.15.97:0/3178600251 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb42c01a070 con 0x7fb430101c00 2024-09-10T10:33:02.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.188+0000 7fb4267fc640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb41c0a2bb0 0x7fb41c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:02.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.188+0000 7fb4267fc640 1 -- 172.21.15.97:0/3178600251 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7fb42c0ce0a0 con 0x7fb430101c00 2024-09-10T10:33:02.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.188+0000 7fb434d64640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb41c0a2bb0 0x7fb41c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:02.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.189+0000 7fb434d64640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb41c0a2bb0 0x7fb41c0a5070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4301993c0 tx=0x7fb42000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:02.207 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.192+0000 7fb4267fc640 1 -- 172.21.15.97:0/3178600251 <== mon.2 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb42c09b2d0 con 0x7fb430101c00 2024-09-10T10:33:02.370 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:02.368+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb430062630 con 0x7fb41c0a2bb0 2024-09-10T10:33:02.370 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:33:02.370 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T10:33:02.370 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi092 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:02.371 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.372 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' 2024-09-10T10:33:02.372 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:02 smithi097 ceph-mon[35213]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:33:02.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:33:02.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T10:33:02.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:02.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:02.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi092 2024-09-10T10:33:02.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' 2024-09-10T10:33:02.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:02 smithi092 ceph-mon[30834]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:33:02.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-10T10:33:02.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T10:33:02.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:02.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:02.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi092 2024-09-10T10:33:02.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:02.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-10T10:33:02.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:02.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:02.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:02.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: from='osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922]' entity='osd.9' 2024-09-10T10:33:02.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:02 smithi121 ceph-mon[35231]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T10:33:03.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:33:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:33:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:33:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:33:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:33:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] boot 2024-09-10T10:33:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T10:33:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:03 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:03.692 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:33:03.692 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:33:03.692 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:03.692 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:33:03.693 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:33:03.693 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:33:03.693 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:03.693 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] boot 2024-09-10T10:33:03.693 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T10:33:03.693 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:03 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:03.710 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:33:03.710 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:33:03.710 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:03.710 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi097:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:33:03.710 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:33:03.710 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:33:03.710 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:03.711 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: osd.9 [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] boot 2024-09-10T10:33:03.711 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T10:33:03.711 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:03 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:33:04.964 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:04 smithi121 ceph-mon[35231]: osdmap e64: 10 total, 10 up, 10 in 2024-09-10T10:33:04.965 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:04 smithi121 ceph-mon[35231]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:04.965 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:04 smithi121 ceph-mon[35231]: from='client.? 172.21.15.97:0/3178918307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7573d9e2-f7cd-4c9c-8939-54e13784e11e"}]: dispatch 2024-09-10T10:33:04.965 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:04 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7573d9e2-f7cd-4c9c-8939-54e13784e11e"}]: dispatch 2024-09-10T10:33:04.965 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:04 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7573d9e2-f7cd-4c9c-8939-54e13784e11e"}]': finished 2024-09-10T10:33:04.965 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:04 smithi121 ceph-mon[35231]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T10:33:04.966 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:04 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:05.030 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:04 smithi097 ceph-mon[35213]: osdmap e64: 10 total, 10 up, 10 in 2024-09-10T10:33:05.030 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:04 smithi097 ceph-mon[35213]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:05.031 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:04 smithi097 ceph-mon[35213]: from='client.? 172.21.15.97:0/3178918307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7573d9e2-f7cd-4c9c-8939-54e13784e11e"}]: dispatch 2024-09-10T10:33:05.031 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:04 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7573d9e2-f7cd-4c9c-8939-54e13784e11e"}]: dispatch 2024-09-10T10:33:05.031 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:04 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7573d9e2-f7cd-4c9c-8939-54e13784e11e"}]': finished 2024-09-10T10:33:05.031 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:04 smithi097 ceph-mon[35213]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T10:33:05.031 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:04 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:05.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:04 smithi092 ceph-mon[30834]: osdmap e64: 10 total, 10 up, 10 in 2024-09-10T10:33:05.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:04 smithi092 ceph-mon[30834]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:05.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:04 smithi092 ceph-mon[30834]: from='client.? 172.21.15.97:0/3178918307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7573d9e2-f7cd-4c9c-8939-54e13784e11e"}]: dispatch 2024-09-10T10:33:05.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:04 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7573d9e2-f7cd-4c9c-8939-54e13784e11e"}]: dispatch 2024-09-10T10:33:05.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:04 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7573d9e2-f7cd-4c9c-8939-54e13784e11e"}]': finished 2024-09-10T10:33:05.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:04 smithi092 ceph-mon[30834]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T10:33:05.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:04 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:06.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:05 smithi121 ceph-mon[35231]: from='client.? 172.21.15.97:0/3482537331' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:33:06.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:05 smithi097 ceph-mon[35213]: from='client.? 172.21.15.97:0/3482537331' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:33:06.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:05 smithi092 ceph-mon[30834]: from='client.? 172.21.15.97:0/3482537331' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:33:07.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:06 smithi121 ceph-mon[35231]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:07.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:06 smithi097 ceph-mon[35213]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:07.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:06 smithi092 ceph-mon[30834]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:09.515 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:09 smithi097 ceph-mon[35213]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:09.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:09 smithi121 ceph-mon[35231]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:09.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:09 smithi092 ceph-mon[30834]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:11.298 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:11 smithi097 ceph-mon[35213]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:11.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:11 smithi121 ceph-mon[35231]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:11.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:11 smithi092 ceph-mon[30834]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:13.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:13 smithi097 ceph-mon[35213]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:13 smithi121 ceph-mon[35231]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:13.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:13 smithi092 ceph-mon[30834]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:14.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:14 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T10:33:14.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:14 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:14 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T10:33:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:14 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T10:33:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:15.271 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:15 smithi097 ceph-mon[35213]: Deploying daemon osd.10 on smithi097 2024-09-10T10:33:15.271 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:15 smithi097 ceph-mon[35213]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:15.437 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:15 smithi121 ceph-mon[35231]: Deploying daemon osd.10 on smithi097 2024-09-10T10:33:15.437 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:15 smithi121 ceph-mon[35231]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:15.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:15 smithi092 ceph-mon[30834]: Deploying daemon osd.10 on smithi097 2024-09-10T10:33:15.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:15 smithi092 ceph-mon[30834]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:17.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:17 smithi121 ceph-mon[35231]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:17.563 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:17 smithi097 ceph-mon[35213]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:17.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:17 smithi092 ceph-mon[30834]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:19.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:19 smithi121 ceph-mon[35231]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:19.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:19.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:19.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:19.577 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:19 smithi097 ceph-mon[35213]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:19.577 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:19.577 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:19.577 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:19.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:19 smithi092 ceph-mon[30834]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:19.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:19.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:19.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:21.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:21 smithi121 ceph-mon[35231]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:21.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:21 smithi097 ceph-mon[35213]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:21.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:21 smithi092 ceph-mon[30834]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:22.692 INFO:teuthology.orchestra.run.smithi097.stdout:Created osd(s) 10 on host 'smithi097' 2024-09-10T10:33:22.692 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.690+0000 7fb4267fc640 1 -- 172.21.15.97:0/3178600251 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb430062630 con 0x7fb41c0a2bb0 2024-09-10T10:33:22.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb41c0a2bb0 msgr2=0x7fb41c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:22.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb41c0a2bb0 0x7fb41c0a5070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4301993c0 tx=0x7fb42000b390 comp rx=0 tx=0).stop 2024-09-10T10:33:22.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb430101c00 msgr2=0x7fb430197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:22.694 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb430101c00 0x7fb430197ea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00d950 tx=0x7fb42c00de10 comp rx=0 tx=0).stop 2024-09-10T10:33:22.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 shutdown_connections 2024-09-10T10:33:22.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb41c0a2bb0 0x7fb41c0a5070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:22.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4301037c0 0x7fb43019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:22.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb430102e00 0x7fb4301983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:22.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 --2- 172.21.15.97:0/3178600251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb430101c00 0x7fb430197ea0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:22.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 >> 172.21.15.97:0/3178600251 conn(0x7fb4300fd390 msgr2=0x7fb4301061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:22.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 shutdown_connections 2024-09-10T10:33:22.695 INFO:teuthology.orchestra.run.smithi097.stderr:2024-09-10T10:33:22.693+0000 7fb4377c9640 1 -- 172.21.15.97:0/3178600251 wait complete. 2024-09-10T10:33:23.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:23.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:23.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:23 smithi121 ceph-mon[35231]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:23.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:23.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:23 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.296 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.296 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.296 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:23.296 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:23.296 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.297 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:23 smithi097 ceph-mon[35213]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:23.297 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:23.297 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.297 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:23 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.325 DEBUG:teuthology.orchestra.run.smithi097:osd.10> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T10:33:23.328 INFO:tasks.cephadm:Deploying osd.11 on smithi121 with /dev/vg_nvme/lv_1... 2024-09-10T10:33:23.328 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T10:33:23.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:23 smithi092 ceph-mon[30834]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:23 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:23.583 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:33:25.259 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:25 smithi121 ceph-mon[35231]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:25.499 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:25 smithi097 ceph-mon[35213]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:25.499 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:33:25 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:33:25.180+0000 7f20abf69640 -1 osd.10 0 log_to_monitors true 2024-09-10T10:33:25.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:25 smithi092 ceph-mon[30834]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:26.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:26 smithi121 ceph-mon[35231]: from='osd.10 [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:33:26.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:26 smithi121 ceph-mon[35231]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:33:26.564 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-10T10:33:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:26 smithi097 ceph-mon[35213]: from='osd.10 [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:33:26.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:26 smithi097 ceph-mon[35213]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:33:26.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_1 2024-09-10T10:33:26.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:26 smithi092 ceph-mon[30834]: from='osd.10 [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:33:26.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:26 smithi092 ceph-mon[30834]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T10:33:26.841 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='osd.10 [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi097 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.249 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi097 to 4272M 2024-09-10T10:33:27.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:27.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:27.250 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 -- 172.21.15.121:0/1822344026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d81079a0 msgr2=0x7fa8d8109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:27.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 --2- 172.21.15.121:0/1822344026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d81079a0 0x7fa8d8109d90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009ca0 tx=0x7fa8d002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:33:27.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 -- 172.21.15.121:0/1822344026 shutdown_connections 2024-09-10T10:33:27.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 --2- 172.21.15.121:0/1822344026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d81079a0 0x7fa8d8109d90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:27.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 --2- 172.21.15.121:0/1822344026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8d8105070 0x7fa8d8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 --2- 172.21.15.121:0/1822344026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d8102740 0x7fa8d8104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 -- 172.21.15.121:0/1822344026 >> 172.21.15.121:0/1822344026 conn(0x7fa8d80fc2a0 msgr2=0x7fa8d80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 -- 172.21.15.121:0/1822344026 shutdown_connections 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 -- 172.21.15.121:0/1822344026 wait complete. 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 Processor -- start 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.330+0000 7fa8df385640 1 -- start start 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8df385640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8d8102740 0x7fa8d8197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8df385640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d8105070 0x7fa8d8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8df385640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d81079a0 0x7fa8d819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8df385640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d810d8c0 con 0x7fa8d81079a0 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8df385640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d810d740 con 0x7fa8d8102740 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8df385640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d810da40 con 0x7fa8d8105070 2024-09-10T10:33:27.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dc920640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d8105070 0x7fa8d8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dc920640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d8105070 0x7fa8d8198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46714/0 (socket says 172.21.15.121:46714) 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dd121640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8d8102740 0x7fa8d8197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dc920640 1 -- 172.21.15.121:0/3445133862 learned_addr learned my addr 172.21.15.121:0/3445133862 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dd922640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d81079a0 0x7fa8d819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dd121640 1 -- 172.21.15.121:0/3445133862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d8105070 msgr2=0x7fa8d8198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dd121640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d8105070 0x7fa8d8198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dd121640 1 -- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d81079a0 msgr2=0x7fa8d819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dd121640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d81079a0 0x7fa8d819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dd121640 1 -- 172.21.15.121:0/3445133862 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d819faf0 con 0x7fa8d8102740 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dc920640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d8105070 0x7fa8d8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:33:27.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8dd121640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8d8102740 0x7fa8d8197ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800d6d0 tx=0x7fa8c800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8ce7fc640 1 -- 172.21.15.121:0/3445133862 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8017070 con 0x7fa8d8102740 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d819fde0 con 0x7fa8d8102740 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8ce7fc640 1 -- 172.21.15.121:0/3445133862 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8c8009820 con 0x7fa8d8102740 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8ce7fc640 1 -- 172.21.15.121:0/3445133862 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8020060 con 0x7fa8d8102740 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.331+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d81a0290 con 0x7fa8d8102740 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.333+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d80fdd90 con 0x7fa8d8102740 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.334+0000 7fa8ce7fc640 1 -- 172.21.15.121:0/3445133862 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa8c80099d0 con 0x7fa8d8102740 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.334+0000 7fa8ce7fc640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa8c40a2bb0 0x7fa8c40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.335+0000 7fa8ce7fc640 1 -- 172.21.15.121:0/3445133862 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6414+0+0 (secure 0 0 0) 0x7fa8c80cec90 con 0x7fa8d8102740 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.335+0000 7fa8dc920640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa8c40a2bb0 0x7fa8c40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.335+0000 7fa8dc920640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa8c40a2bb0 0x7fa8c40a5070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa8d81993e0 tx=0x7fa8d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:27.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.341+0000 7fa8ce7fc640 1 -- 172.21.15.121:0/3445133862 <== mon.2 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8c809c2c0 con 0x7fa8d8102740 2024-09-10T10:33:27.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:27.517+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa8d8062630 con 0x7fa8c40a2bb0 2024-09-10T10:33:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T10:33:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='osd.10 [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:33:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi097 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi097 to 4272M 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='osd.10 [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]: dispatch 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi097 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:27.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi097 to 4272M 2024-09-10T10:33:27.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:27.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:27.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:27.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:28.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:33:27.573+0000 7f20a7eec640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T10:33:28.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:33:27 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:33:27.583+0000 7f209fd0c640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:33:28.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:28 smithi121 ceph-mon[35231]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:33:28.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:28 smithi121 ceph-mon[35231]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T10:33:28.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:28 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:28.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:28 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:28.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:28 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:33:28.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:28 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:33:28.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:28 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:28.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:28 smithi121 ceph-mon[35231]: from='osd.10 ' entity='osd.10' 2024-09-10T10:33:28.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:28 smithi097 ceph-mon[35213]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:33:28.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:28 smithi097 ceph-mon[35213]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T10:33:28.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:28 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:28.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:28 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:28.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:28 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:33:28.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:28 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:33:28.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:28 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:28.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:28 smithi097 ceph-mon[35213]: from='osd.10 ' entity='osd.10' 2024-09-10T10:33:28.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:28 smithi092 ceph-mon[30834]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi097", "root=default"]}]': finished 2024-09-10T10:33:28.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:28 smithi092 ceph-mon[30834]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T10:33:28.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:28 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:28.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:28 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:28.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:28 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T10:33:28.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:28 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T10:33:28.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:28 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:28.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:28 smithi092 ceph-mon[30834]: from='osd.10 ' entity='osd.10' 2024-09-10T10:33:29.271 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:29 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:33:29.271 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:29 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:33:29.271 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:29 smithi121 ceph-mon[35231]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:33:29.271 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:29 smithi121 ceph-mon[35231]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:29.271 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:29 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:29.271 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:29 smithi121 ceph-mon[35231]: osd.10 [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] boot 2024-09-10T10:33:29.272 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:29 smithi121 ceph-mon[35231]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T10:33:29.272 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:29 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:29 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:33:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:29 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:33:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:29 smithi097 ceph-mon[35213]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:33:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:29 smithi097 ceph-mon[35213]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:29 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:29 smithi097 ceph-mon[35213]: osd.10 [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] boot 2024-09-10T10:33:29.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:29 smithi097 ceph-mon[35213]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T10:33:29.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:29 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:29.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:29 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:33:29.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:29 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:33:29.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:29 smithi092 ceph-mon[30834]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:33:29.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:29 smithi092 ceph-mon[30834]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-10T10:33:29.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:29 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:29.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:29 smithi092 ceph-mon[30834]: osd.10 [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] boot 2024-09-10T10:33:29.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:29 smithi092 ceph-mon[30834]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T10:33:29.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:29 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:33:30.498 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:30 smithi121 ceph-mon[35231]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T10:33:30.499 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:30 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/2370398950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e24d820-116a-48eb-a6de-fbe19ab78cf7"}]: dispatch 2024-09-10T10:33:30.499 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:30 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e24d820-116a-48eb-a6de-fbe19ab78cf7"}]: dispatch 2024-09-10T10:33:30.499 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:30 smithi121 ceph-mon[35231]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e24d820-116a-48eb-a6de-fbe19ab78cf7"}]': finished 2024-09-10T10:33:30.499 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:30 smithi121 ceph-mon[35231]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T10:33:30.499 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:30.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:30 smithi097 ceph-mon[35213]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T10:33:30.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:30 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/2370398950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e24d820-116a-48eb-a6de-fbe19ab78cf7"}]: dispatch 2024-09-10T10:33:30.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:30 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e24d820-116a-48eb-a6de-fbe19ab78cf7"}]: dispatch 2024-09-10T10:33:30.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:30 smithi097 ceph-mon[35213]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e24d820-116a-48eb-a6de-fbe19ab78cf7"}]': finished 2024-09-10T10:33:30.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:30 smithi097 ceph-mon[35213]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T10:33:30.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:30.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:30 smithi092 ceph-mon[30834]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T10:33:30.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:30 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/2370398950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e24d820-116a-48eb-a6de-fbe19ab78cf7"}]: dispatch 2024-09-10T10:33:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:30 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e24d820-116a-48eb-a6de-fbe19ab78cf7"}]: dispatch 2024-09-10T10:33:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:30 smithi092 ceph-mon[30834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e24d820-116a-48eb-a6de-fbe19ab78cf7"}]': finished 2024-09-10T10:33:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:30 smithi092 ceph-mon[30834]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T10:33:30.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:31.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:31 smithi121 ceph-mon[35231]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:31.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:31 smithi121 ceph-mon[35231]: from='client.? 172.21.15.121:0/2963215887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:33:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:31 smithi097 ceph-mon[35213]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:31 smithi097 ceph-mon[35213]: from='client.? 172.21.15.121:0/2963215887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:33:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:31 smithi092 ceph-mon[30834]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:31 smithi092 ceph-mon[30834]: from='client.? 172.21.15.121:0/2963215887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T10:33:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:32 smithi121 ceph-mon[35231]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T10:33:32.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:32 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:32.574 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:32 smithi097 ceph-mon[35213]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T10:33:32.574 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:32 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:32 smithi092 ceph-mon[30834]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T10:33:32.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:32 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:33.471 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:33 smithi097 ceph-mon[35213]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:33.471 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:33 smithi097 ceph-mon[35213]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T10:33:33.471 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:33.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:33 smithi121 ceph-mon[35231]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:33 smithi121 ceph-mon[35231]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T10:33:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:33.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:33 smithi092 ceph-mon[30834]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:33.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:33 smithi092 ceph-mon[30834]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T10:33:33.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:35 smithi121 ceph-mon[35231]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-10T10:33:35.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:35 smithi097 ceph-mon[35213]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-10T10:33:35.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:35 smithi092 ceph-mon[30834]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-09-10T10:33:37.524 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:37 smithi121 ceph-mon[35231]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-10T10:33:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:37 smithi097 ceph-mon[35213]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-10T10:33:37.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:37 smithi092 ceph-mon[30834]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-10T10:33:39.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:39 smithi121 ceph-mon[35231]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:33:39.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:39 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T10:33:39.516 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:39 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:39.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:39 smithi097 ceph-mon[35213]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:33:39.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:39 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T10:33:39.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:39 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:39.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:39 smithi092 ceph-mon[30834]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T10:33:39.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:39 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T10:33:39.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:39 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:40.423 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:40 smithi121 ceph-mon[35231]: Deploying daemon osd.11 on smithi121 2024-09-10T10:33:40.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:40 smithi097 ceph-mon[35213]: Deploying daemon osd.11 on smithi121 2024-09-10T10:33:40.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:40 smithi092 ceph-mon[30834]: Deploying daemon osd.11 on smithi121 2024-09-10T10:33:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:41 smithi121 ceph-mon[35231]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-10T10:33:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:41 smithi097 ceph-mon[35213]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-10T10:33:41.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:41 smithi092 ceph-mon[30834]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-10T10:33:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:43 smithi121 ceph-mon[35231]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:33:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:43 smithi097 ceph-mon[35213]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:33:43.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:43 smithi092 ceph-mon[30834]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T10:33:45.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:45 smithi121 ceph-mon[35231]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:45 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:45 smithi097 ceph-mon[35213]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:45 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:45.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:45 smithi092 ceph-mon[30834]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:45.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:45.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:45.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:45 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:47.401 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:47 smithi121 ceph-mon[35231]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:47.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:47 smithi097 ceph-mon[35213]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:47.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:47 smithi092 ceph-mon[30834]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:48.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.784+0000 7fa8ce7fc640 1 -- 172.21.15.121:0/3445133862 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa8d8062630 con 0x7fa8c40a2bb0 2024-09-10T10:33:48.786 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 11 on host 'smithi121' 2024-09-10T10:33:48.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.786+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa8c40a2bb0 msgr2=0x7fa8c40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:48.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.786+0000 7fa8df385640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa8c40a2bb0 0x7fa8c40a5070 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa8d81993e0 tx=0x7fa8d4005f90 comp rx=0 tx=0).stop 2024-09-10T10:33:48.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8d8102740 msgr2=0x7fa8d8197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:48.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8d8102740 0x7fa8d8197ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800d6d0 tx=0x7fa8c800db90 comp rx=0 tx=0).stop 2024-09-10T10:33:48.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 shutdown_connections 2024-09-10T10:33:48.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa8c40a2bb0 0x7fa8c40a5070 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:48.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8d81079a0 0x7fa8d819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:48.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8d8105070 0x7fa8d8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:48.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 --2- 172.21.15.121:0/3445133862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa8d8102740 0x7fa8d8197ec0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:48.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 >> 172.21.15.121:0/3445133862 conn(0x7fa8d80fc2a0 msgr2=0x7fa8d81030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:48.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 shutdown_connections 2024-09-10T10:33:48.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:33:48.787+0000 7fa8df385640 1 -- 172.21.15.121:0/3445133862 wait complete. 2024-09-10T10:33:49.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:49.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:49.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:49 smithi092 ceph-mon[30834]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:49.278 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:49.278 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.278 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:49 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:49.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:49.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:49 smithi121 ceph-mon[35231]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:49.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:49.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:49 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:49.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:49.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:49 smithi097 ceph-mon[35213]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:49.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:33:49.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:49 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:49.501 DEBUG:teuthology.orchestra.run.smithi121:osd.11> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T10:33:49.503 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T10:33:49.504 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:33:49.743 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:33:50.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.205+0000 7f29dbc86640 1 -- 172.21.15.92:0/4144677637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d4102e00 msgr2=0x7f29d4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.205+0000 7f29dbc86640 1 --2- 172.21.15.92:0/4144677637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d4102e00 0x7f29d4103280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009ca0 tx=0x7f29c802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.205+0000 7f29dbc86640 1 -- 172.21.15.92:0/4144677637 shutdown_connections 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.205+0000 7f29dbc86640 1 --2- 172.21.15.92:0/4144677637 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d41037c0 0x7f29d410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.205+0000 7f29dbc86640 1 --2- 172.21.15.92:0/4144677637 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d4102e00 0x7f29d4103280 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.205+0000 7f29dbc86640 1 --2- 172.21.15.92:0/4144677637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29d4101c00 0x7f29d4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.205+0000 7f29dbc86640 1 -- 172.21.15.92:0/4144677637 >> 172.21.15.92:0/4144677637 conn(0x7f29d40fd390 msgr2=0x7f29d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.205+0000 7f29dbc86640 1 -- 172.21.15.92:0/4144677637 shutdown_connections 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.205+0000 7f29dbc86640 1 -- 172.21.15.92:0/4144677637 wait complete. 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29dbc86640 1 Processor -- start 2024-09-10T10:33:50.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29dbc86640 1 -- start start 2024-09-10T10:33:50.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29dbc86640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29d4101c00 0x7f29d4197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:50.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29dbc86640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d4102e00 0x7f29d4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:50.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29dbc86640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d41037c0 0x7f29d419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:50.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29dbc86640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29d410d900 con 0x7f29d41037c0 2024-09-10T10:33:50.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29dbc86640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f29d410d780 con 0x7f29d4102e00 2024-09-10T10:33:50.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29dbc86640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f29d410da80 con 0x7f29d4101c00 2024-09-10T10:33:50.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29da223640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d41037c0 0x7f29d419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:50.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29da223640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d41037c0 0x7f29d419f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48164/0 (socket says 172.21.15.92:48164) 2024-09-10T10:33:50.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29da223640 1 -- 172.21.15.92:0/71120371 learned_addr learned my addr 172.21.15.92:0/71120371 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:33:50.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29d9a22640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29d4101c00 0x7f29d4197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:50.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29d9221640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d4102e00 0x7f29d4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:50.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29da223640 1 -- 172.21.15.92:0/71120371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29d4101c00 msgr2=0x7f29d4197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:50.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29da223640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29d4101c00 0x7f29d4197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29da223640 1 -- 172.21.15.92:0/71120371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d4102e00 msgr2=0x7f29d4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:50.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29da223640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d4102e00 0x7f29d4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29da223640 1 -- 172.21.15.92:0/71120371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d419fb60 con 0x7f29d41037c0 2024-09-10T10:33:50.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29da223640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d41037c0 0x7f29d419f4f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009fd0 tx=0x7f29c400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:50.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.206+0000 7f29d2ffd640 1 -- 172.21.15.92:0/71120371 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4011830 con 0x7f29d41037c0 2024-09-10T10:33:50.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.207+0000 7f29d2ffd640 1 -- 172.21.15.92:0/71120371 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29c4016070 con 0x7f29d41037c0 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.207+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d419fe50 con 0x7f29d41037c0 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.207+0000 7f29d2ffd640 1 -- 172.21.15.92:0/71120371 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c400f2e0 con 0x7f29d41037c0 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.207+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d41a0330 con 0x7f29d41037c0 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.208+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d4109050 con 0x7f29d41037c0 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.209+0000 7f29d2ffd640 1 -- 172.21.15.92:0/71120371 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f29c40119d0 con 0x7f29d41037c0 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.209+0000 7f29d2ffd640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29bc0a2bb0 0x7f29bc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.209+0000 7f29d9a22640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29bc0a2bb0 0x7f29bc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.209+0000 7f29d2ffd640 1 -- 172.21.15.92:0/71120371 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7f29c40ce150 con 0x7f29d41037c0 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.210+0000 7f29d9a22640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29bc0a2bb0 0x7f29bc0a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29d4102c60 tx=0x7f29cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:50.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.214+0000 7f29d2ffd640 1 -- 172.21.15.92:0/71120371 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29c409b690 con 0x7f29d41037c0 2024-09-10T10:33:50.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.381+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f29d402d970 con 0x7f29d41037c0 2024-09-10T10:33:50.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.381+0000 7f29d2ffd640 1 -- 172.21.15.92:0/71120371 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f29c409af90 con 0x7f29d41037c0 2024-09-10T10:33:50.383 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29bc0a2bb0 msgr2=0x7f29bc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29bc0a2bb0 0x7f29bc0a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29d4102c60 tx=0x7f29cc005f90 comp rx=0 tx=0).stop 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d41037c0 msgr2=0x7f29d419f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d41037c0 0x7f29d419f4f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009fd0 tx=0x7f29c400b8e0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 shutdown_connections 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f29bc0a2bb0 0x7f29bc0a5070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d41037c0 0x7f29d419f4f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f29d4102e00 0x7f29d4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 --2- 172.21.15.92:0/71120371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29d4101c00 0x7f29d4197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 >> 172.21.15.92:0/71120371 conn(0x7f29d40fd390 msgr2=0x7f29d4106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:50.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 shutdown_connections 2024-09-10T10:33:50.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:50.384+0000 7f29dbc86640 1 -- 172.21.15.92:0/71120371 wait complete. 2024-09-10T10:33:51.158 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1725964408,"num_in_osds":12,"osd_in_since":1725964409,"num_remapped_pgs":0} 2024-09-10T10:33:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:51 smithi121 ceph-mon[35231]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:51 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/71120371' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:33:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:51 smithi121 ceph-mon[35231]: from='osd.11 [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:33:51.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:51 smithi121 ceph-mon[35231]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:33:51.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:33:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:33:51.037+0000 7f9ac0eaf640 -1 osd.11 0 log_to_monitors true 2024-09-10T10:33:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:51 smithi097 ceph-mon[35213]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:51 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/71120371' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:33:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:51 smithi097 ceph-mon[35213]: from='osd.11 [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:33:51.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:51 smithi097 ceph-mon[35213]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:33:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:51 smithi092 ceph-mon[30834]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:51 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/71120371' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:33:51.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:51 smithi092 ceph-mon[30834]: from='osd.11 [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:33:51.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:51 smithi092 ceph-mon[30834]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T10:33:52.159 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:33:52.406 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:52 smithi121 ceph-mon[35231]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T10:33:52.406 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:52 smithi121 ceph-mon[35231]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T10:33:52.406 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:52 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:52.406 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:52 smithi121 ceph-mon[35231]: from='osd.11 [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:33:52.406 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:52 smithi121 ceph-mon[35231]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:33:52.415 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:33:52.535 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:52 smithi092 ceph-mon[30834]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T10:33:52.535 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:52 smithi092 ceph-mon[30834]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T10:33:52.535 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:52 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:52.536 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:52 smithi092 ceph-mon[30834]: from='osd.11 [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:33:52.536 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:52 smithi092 ceph-mon[30834]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:33:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:52 smithi097 ceph-mon[35213]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T10:33:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:52 smithi097 ceph-mon[35213]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T10:33:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:52 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:52 smithi097 ceph-mon[35213]: from='osd.11 [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:33:52.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:52 smithi097 ceph-mon[35213]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-10T10:33:52.791 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:33:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:33:52.562+0000 7f9abce32640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T10:33:52.791 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:33:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:33:52.574+0000 7f9ab4c52640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T10:33:53.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 -- 172.21.15.92:0/1146730619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 msgr2=0x7eff58104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:53.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 --2- 172.21.15.92:0/1146730619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 0x7eff58104a50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7eff50009ca0 tx=0x7eff5002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.050 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 -- 172.21.15.92:0/1146730619 shutdown_connections 2024-09-10T10:33:53.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 --2- 172.21.15.92:0/1146730619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff581078c0 0x7eff58109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 --2- 172.21.15.92:0/1146730619 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff58104f90 0x7eff58107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 --2- 172.21.15.92:0/1146730619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 0x7eff58104a50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 -- 172.21.15.92:0/1146730619 >> 172.21.15.92:0/1146730619 conn(0x7eff580fc280 msgr2=0x7eff580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:53.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 -- 172.21.15.92:0/1146730619 shutdown_connections 2024-09-10T10:33:53.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 -- 172.21.15.92:0/1146730619 wait complete. 2024-09-10T10:33:53.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.043+0000 7eff60673640 1 Processor -- start 2024-09-10T10:33:53.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff60673640 1 -- start start 2024-09-10T10:33:53.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff60673640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 0x7eff58197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:53.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff60673640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff58104f90 0x7eff58198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:53.052 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff60673640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff581078c0 0x7eff5819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:53.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff60673640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff5810d8e0 con 0x7eff58102660 2024-09-10T10:33:53.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff60673640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7eff5810d760 con 0x7eff58104f90 2024-09-10T10:33:53.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff60673640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7eff5810da60 con 0x7eff581078c0 2024-09-10T10:33:53.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5e40f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 0x7eff58197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:53.053 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5e40f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 0x7eff58197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55654/0 (socket says 172.21.15.92:55654) 2024-09-10T10:33:53.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5e40f640 1 -- 172.21.15.92:0/706939275 learned_addr learned my addr 172.21.15.92:0/706939275 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:33:53.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5ec10640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff581078c0 0x7eff5819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:53.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5dc0e640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff58104f90 0x7eff58198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:53.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5e40f640 1 -- 172.21.15.92:0/706939275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff581078c0 msgr2=0x7eff5819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:53.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5e40f640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff581078c0 0x7eff5819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5e40f640 1 -- 172.21.15.92:0/706939275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff58104f90 msgr2=0x7eff58198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:53.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5e40f640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff58104f90 0x7eff58198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5e40f640 1 -- 172.21.15.92:0/706939275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5819fb40 con 0x7eff58102660 2024-09-10T10:33:53.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5dc0e640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff58104f90 0x7eff58198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:33:53.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5ec10640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff581078c0 0x7eff5819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:33:53.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.044+0000 7eff5e40f640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 0x7eff58197f10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff50031a40 tx=0x7eff5002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:53.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.045+0000 7eff4f7fe640 1 -- 172.21.15.92:0/706939275 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5002fdc0 con 0x7eff58102660 2024-09-10T10:33:53.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.045+0000 7eff4f7fe640 1 -- 172.21.15.92:0/706939275 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff50030aa0 con 0x7eff58102660 2024-09-10T10:33:53.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.045+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5819fdd0 con 0x7eff58102660 2024-09-10T10:33:53.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.045+0000 7eff4f7fe640 1 -- 172.21.15.92:0/706939275 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50046a10 con 0x7eff58102660 2024-09-10T10:33:53.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.045+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff581a02a0 con 0x7eff58102660 2024-09-10T10:33:53.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.046+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff580fdd70 con 0x7eff58102660 2024-09-10T10:33:53.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.047+0000 7eff4f7fe640 1 -- 172.21.15.92:0/706939275 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7eff50030c50 con 0x7eff58102660 2024-09-10T10:33:53.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.047+0000 7eff4f7fe640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff440a2bb0 0x7eff440a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:53.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.048+0000 7eff5dc0e640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff440a2bb0 0x7eff440a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:53.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.048+0000 7eff4f7fe640 1 -- 172.21.15.92:0/706939275 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7eff500f0490 con 0x7eff58102660 2024-09-10T10:33:53.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.048+0000 7eff5dc0e640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff440a2bb0 0x7eff440a5070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff48006fd0 tx=0x7eff48008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:53.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.052+0000 7eff4f7fe640 1 -- 172.21.15.92:0/706939275 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff500bd9b0 con 0x7eff58102660 2024-09-10T10:33:53.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.219+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7eff5802da10 con 0x7eff58102660 2024-09-10T10:33:53.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.219+0000 7eff4f7fe640 1 -- 172.21.15.92:0/706939275 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7eff500b7e20 con 0x7eff58102660 2024-09-10T10:33:53.221 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.221+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff440a2bb0 msgr2=0x7eff440a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.221+0000 7eff60673640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff440a2bb0 0x7eff440a5070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7eff48006fd0 tx=0x7eff48008040 comp rx=0 tx=0).stop 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.221+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 msgr2=0x7eff58197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.221+0000 7eff60673640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 0x7eff58197f10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7eff50031a40 tx=0x7eff5002f840 comp rx=0 tx=0).stop 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.222+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 shutdown_connections 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.222+0000 7eff60673640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff440a2bb0 0x7eff440a5070 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.222+0000 7eff60673640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff581078c0 0x7eff5819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.222+0000 7eff60673640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff58104f90 0x7eff58198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.222+0000 7eff60673640 1 --2- 172.21.15.92:0/706939275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff58102660 0x7eff58197f10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:53.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.222+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 >> 172.21.15.92:0/706939275 conn(0x7eff580fc280 msgr2=0x7eff58102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:53.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.222+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 shutdown_connections 2024-09-10T10:33:53.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:53.222+0000 7eff60673640 1 -- 172.21.15.92:0/706939275 wait complete. 2024-09-10T10:33:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:33:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T10:33:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='osd.11 ' entity='osd.11' 2024-09-10T10:33:53.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:53 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:33:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T10:33:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='osd.11 ' entity='osd.11' 2024-09-10T10:33:53.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:53 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:53.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:53.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-10T10:33:53.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T10:33:53.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:53.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:53.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.587 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:33:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:33:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:33:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:33:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='osd.11 ' entity='osd.11' 2024-09-10T10:33:53.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:53 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:54.062 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1725964408,"num_in_osds":12,"osd_in_since":1725964409,"num_remapped_pgs":0} 2024-09-10T10:33:54.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:54 smithi092 ceph-mon[30834]: purged_snaps scrub starts 2024-09-10T10:33:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:54 smithi092 ceph-mon[30834]: purged_snaps scrub ok 2024-09-10T10:33:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:54 smithi092 ceph-mon[30834]: Detected new or changed devices on smithi121 2024-09-10T10:33:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:54 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi121 to 4271M 2024-09-10T10:33:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:54 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/706939275' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:33:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:54 smithi092 ceph-mon[30834]: osd.11 [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] boot 2024-09-10T10:33:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:54 smithi092 ceph-mon[30834]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T10:33:54.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:54 smithi121 ceph-mon[35231]: purged_snaps scrub starts 2024-09-10T10:33:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:54 smithi121 ceph-mon[35231]: purged_snaps scrub ok 2024-09-10T10:33:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:54 smithi121 ceph-mon[35231]: Detected new or changed devices on smithi121 2024-09-10T10:33:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:54 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi121 to 4271M 2024-09-10T10:33:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:54 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/706939275' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:33:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:54 smithi121 ceph-mon[35231]: osd.11 [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] boot 2024-09-10T10:33:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:54 smithi121 ceph-mon[35231]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T10:33:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:54 smithi097 ceph-mon[35213]: purged_snaps scrub starts 2024-09-10T10:33:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:54 smithi097 ceph-mon[35213]: purged_snaps scrub ok 2024-09-10T10:33:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:54 smithi097 ceph-mon[35213]: Detected new or changed devices on smithi121 2024-09-10T10:33:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:54 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi121 to 4271M 2024-09-10T10:33:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:54 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/706939275' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:33:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:54 smithi097 ceph-mon[35213]: osd.11 [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] boot 2024-09-10T10:33:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:54 smithi097 ceph-mon[35213]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T10:33:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:33:55.064 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T10:33:55.325 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:33:55.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:55 smithi092 ceph-mon[30834]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:55.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:55 smithi092 ceph-mon[30834]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T10:33:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:55 smithi121 ceph-mon[35231]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:55 smithi121 ceph-mon[35231]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T10:33:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:55 smithi097 ceph-mon[35213]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-10T10:33:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:55 smithi097 ceph-mon[35213]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T10:33:55.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 -- 172.21.15.92:0/267651650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd401026d0 msgr2=0x7fcd40108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:55.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 --2- 172.21.15.92:0/267651650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd401026d0 0x7fcd40108f60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009ca0 tx=0x7fcd3802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 -- 172.21.15.92:0/267651650 shutdown_connections 2024-09-10T10:33:55.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 --2- 172.21.15.92:0/267651650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd401026d0 0x7fcd40108f60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 --2- 172.21.15.92:0/267651650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd40101d10 0x7fcd40102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 --2- 172.21.15.92:0/267651650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd40100b10 0x7fcd40100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 -- 172.21.15.92:0/267651650 >> 172.21.15.92:0/267651650 conn(0x7fcd400fc2a0 msgr2=0x7fcd400fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 -- 172.21.15.92:0/267651650 shutdown_connections 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 -- 172.21.15.92:0/267651650 wait complete. 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 Processor -- start 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.779+0000 7fcd46362640 1 -- start start 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd46362640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd40100b10 0x7fcd40198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd46362640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd40101d10 0x7fcd401985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd46362640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd401026d0 0x7fcd4019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd46362640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4010d9a0 con 0x7fcd40101d10 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd46362640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4010d820 con 0x7fcd401026d0 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd46362640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4010db20 con 0x7fcd40100b10 2024-09-10T10:33:55.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd40101d10 0x7fcd401985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd40101d10 0x7fcd401985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55672/0 (socket says 172.21.15.92:55672) 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3f7fe640 1 -- 172.21.15.92:0/2348862530 learned_addr learned my addr 172.21.15.92:0/2348862530 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd448ff640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd401026d0 0x7fcd4019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3ffff640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd40100b10 0x7fcd40198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3f7fe640 1 -- 172.21.15.92:0/2348862530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd40100b10 msgr2=0x7fcd40198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3f7fe640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd40100b10 0x7fcd40198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3f7fe640 1 -- 172.21.15.92:0/2348862530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd401026d0 msgr2=0x7fcd4019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3f7fe640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd401026d0 0x7fcd4019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3f7fe640 1 -- 172.21.15.92:0/2348862530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4019fc90 con 0x7fcd40101d10 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd448ff640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd401026d0 0x7fcd4019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:33:55.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.780+0000 7fcd3f7fe640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd40101d10 0x7fcd401985a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b4a0 tx=0x7fcd3400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.781+0000 7fcd3d7fa640 1 -- 172.21.15.92:0/2348862530 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34014070 con 0x7fcd40101d10 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.781+0000 7fcd3d7fa640 1 -- 172.21.15.92:0/2348862530 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd34010af0 con 0x7fcd40101d10 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.781+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4019ff80 con 0x7fcd40101d10 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.781+0000 7fcd3d7fa640 1 -- 172.21.15.92:0/2348862530 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34017d10 con 0x7fcd40101d10 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.781+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd401a04b0 con 0x7fcd40101d10 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.782+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd40107f30 con 0x7fcd40101d10 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.783+0000 7fcd3d7fa640 1 -- 172.21.15.92:0/2348862530 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcd34017070 con 0x7fcd40101d10 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.783+0000 7fcd3d7fa640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcd280a2bb0 0x7fcd280a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.784+0000 7fcd3ffff640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcd280a2bb0 0x7fcd280a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.784+0000 7fcd3d7fa640 1 -- 172.21.15.92:0/2348862530 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fcd340cdfa0 con 0x7fcd40101d10 2024-09-10T10:33:55.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.784+0000 7fcd3ffff640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcd280a2bb0 0x7fcd280a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcd40101b70 tx=0x7fcd30008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:55.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.788+0000 7fcd3d7fa640 1 -- 172.21.15.92:0/2348862530 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd3409b3a0 con 0x7fcd40101d10 2024-09-10T10:33:55.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.952+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcd4002d940 con 0x7fcd40101d10 2024-09-10T10:33:55.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.953+0000 7fcd3d7fa640 1 -- 172.21.15.92:0/2348862530 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7fcd3409aca0 con 0x7fcd40101d10 2024-09-10T10:33:55.954 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:33:55.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcd280a2bb0 msgr2=0x7fcd280a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:55.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcd280a2bb0 0x7fcd280a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcd40101b70 tx=0x7fcd30008040 comp rx=0 tx=0).stop 2024-09-10T10:33:55.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd40101d10 msgr2=0x7fcd401985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:55.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd40101d10 0x7fcd401985a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400b4a0 tx=0x7fcd3400b960 comp rx=0 tx=0).stop 2024-09-10T10:33:55.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 shutdown_connections 2024-09-10T10:33:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcd280a2bb0 0x7fcd280a5070 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcd401026d0 0x7fcd4019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd40101d10 0x7fcd401985a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 --2- 172.21.15.92:0/2348862530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd40100b10 0x7fcd40198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 >> 172.21.15.92:0/2348862530 conn(0x7fcd400fc2a0 msgr2=0x7fcd40105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 shutdown_connections 2024-09-10T10:33:55.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:55.955+0000 7fcd46362640 1 -- 172.21.15.92:0/2348862530 wait complete. 2024-09-10T10:33:56.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:56 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2348862530' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:33:56.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:56 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2348862530' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:33:56.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:56 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2348862530' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T10:33:56.583 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1725964433,"num_in_osds":12,"osd_in_since":1725964409,"num_remapped_pgs":0} 2024-09-10T10:33:56.584 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:33:56.824 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:33:57.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.281+0000 7f785c863640 1 -- 172.21.15.92:0/1856642459 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858106a80 msgr2=0x7f7858106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:57.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.281+0000 7f785c863640 1 --2- 172.21.15.92:0/1856642459 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858106a80 0x7f7858106e60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7848009930 tx=0x7f784802a420 comp rx=0 tx=0).stop 2024-09-10T10:33:57.294 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.281+0000 7f785c863640 1 -- 172.21.15.92:0/1856642459 shutdown_connections 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.281+0000 7f785c863640 1 --2- 172.21.15.92:0/1856642459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7858101420 0x7f785810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.281+0000 7f785c863640 1 --2- 172.21.15.92:0/1856642459 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7858100a80 0x7f7858100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.281+0000 7f785c863640 1 --2- 172.21.15.92:0/1856642459 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858106a80 0x7f7858106e60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.281+0000 7f785c863640 1 -- 172.21.15.92:0/1856642459 >> 172.21.15.92:0/1856642459 conn(0x7f78580fc7a0 msgr2=0x7f78580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.281+0000 7f785c863640 1 -- 172.21.15.92:0/1856642459 shutdown_connections 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.281+0000 7f785c863640 1 -- 172.21.15.92:0/1856642459 wait complete. 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785c863640 1 Processor -- start 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785c863640 1 -- start start 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785c863640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858100a80 0x7f7858199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785c863640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7858101420 0x7f78581997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785c863640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7858106a80 0x7f78581a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785c863640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7858110e40 con 0x7f7858100a80 2024-09-10T10:33:57.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785c863640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7858110cc0 con 0x7f7858106a80 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785c863640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7858110fc0 con 0x7f7858101420 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858100a80 0x7f7858199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858100a80 0x7f7858199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55686/0 (socket says 172.21.15.92:55686) 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785659c640 1 -- 172.21.15.92:0/4032159434 learned_addr learned my addr 172.21.15.92:0/4032159434 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785659c640 1 -- 172.21.15.92:0/4032159434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7858101420 msgr2=0x7f78581997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785659c640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7858101420 0x7f78581997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785659c640 1 -- 172.21.15.92:0/4032159434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7858106a80 msgr2=0x7f78581a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785659c640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7858106a80 0x7f78581a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785659c640 1 -- 172.21.15.92:0/4032159434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78581a4830 con 0x7f7858100a80 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.282+0000 7f785659c640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858100a80 0x7f7858199270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7848009a50 tx=0x7f7848004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.283+0000 7f784f7fe640 1 -- 172.21.15.92:0/4032159434 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784803f030 con 0x7f7858100a80 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.283+0000 7f784f7fe640 1 -- 172.21.15.92:0/4032159434 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7848003ce0 con 0x7f7858100a80 2024-09-10T10:33:57.296 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.283+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78581a4a00 con 0x7f7858100a80 2024-09-10T10:33:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.283+0000 7f784f7fe640 1 -- 172.21.15.92:0/4032159434 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7848035070 con 0x7f7858100a80 2024-09-10T10:33:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.283+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78581a4eb0 con 0x7f7858100a80 2024-09-10T10:33:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.284+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7858100ee0 con 0x7f7858100a80 2024-09-10T10:33:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.285+0000 7f784f7fe640 1 -- 172.21.15.92:0/4032159434 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7848042030 con 0x7f7858100a80 2024-09-10T10:33:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.285+0000 7f784f7fe640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f78440a2c00 0x7f78440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.285+0000 7f7855d9b640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f78440a2c00 0x7f78440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.285+0000 7f784f7fe640 1 -- 172.21.15.92:0/4032159434 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f78480ef170 con 0x7f7858100a80 2024-09-10T10:33:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.286+0000 7f7855d9b640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f78440a2c00 0x7f78440a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f785806b2e0 tx=0x7f7840005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:57.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.289+0000 7f784f7fe640 1 -- 172.21.15.92:0/4032159434 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f78480bc570 con 0x7f7858100a80 2024-09-10T10:33:57.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.458+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7858108a60 con 0x7f7858100a80 2024-09-10T10:33:57.459 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:57 smithi092 ceph-mon[30834]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:33:57.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.460+0000 7f784f7fe640 1 -- 172.21.15.92:0/4032159434 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18444 (secure 0 0 0) 0x7f78480bbe70 con 0x7f7858100a80 2024-09-10T10:33:57.461 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:33:57.461 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":76,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:33:54.567565+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f78440a2c00 msgr2=0x7f78440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f78440a2c00 0x7f78440a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f785806b2e0 tx=0x7f7840005c70 comp rx=0 tx=0).stop 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858100a80 msgr2=0x7f7858199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858100a80 0x7f7858199270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7848009a50 tx=0x7f7848004270 comp rx=0 tx=0).stop 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 shutdown_connections 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f78440a2c00 0x7f78440a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7858106a80 0x7f78581a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7858101420 0x7f78581997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 --2- 172.21.15.92:0/4032159434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7858100a80 0x7f7858199270 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 >> 172.21.15.92:0/4032159434 conn(0x7f78580fc7a0 msgr2=0x7f78580fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 shutdown_connections 2024-09-10T10:33:57.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:57.462+0000 7f785c863640 1 -- 172.21.15.92:0/4032159434 wait complete. 2024-09-10T10:33:57.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:57 smithi121 ceph-mon[35231]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:33:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:57 smithi097 ceph-mon[35213]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:33:58.133 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T10:30:06.350576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T10:33:58.135 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T10:33:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:58 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/4032159434' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:33:58.388 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:33:58.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:58 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/4032159434' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:33:58.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:58 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/4032159434' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:33:58.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.851+0000 7fd74490a640 1 -- 172.21.15.92:0/3743484220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd740102d40 msgr2=0x7fd740103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.851+0000 7fd74490a640 1 --2- 172.21.15.92:0/3743484220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd740102d40 0x7fd740103120 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd730009ca0 tx=0x7fd73002a950 comp rx=0 tx=0).stop 2024-09-10T10:33:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.851+0000 7fd74490a640 1 -- 172.21.15.92:0/3743484220 shutdown_connections 2024-09-10T10:33:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.851+0000 7fd74490a640 1 --2- 172.21.15.92:0/3743484220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd74010c170 0x7fd74010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.851+0000 7fd74490a640 1 --2- 172.21.15.92:0/3743484220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd740103660 0x7fd74010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.851+0000 7fd74490a640 1 --2- 172.21.15.92:0/3743484220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd740102d40 0x7fd740103120 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.851+0000 7fd74490a640 1 -- 172.21.15.92:0/3743484220 >> 172.21.15.92:0/3743484220 conn(0x7fd7400fc7a0 msgr2=0x7fd7400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.851+0000 7fd74490a640 1 -- 172.21.15.92:0/3743484220 shutdown_connections 2024-09-10T10:33:58.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.851+0000 7fd74490a640 1 -- 172.21.15.92:0/3743484220 wait complete. 2024-09-10T10:33:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd74490a640 1 Processor -- start 2024-09-10T10:33:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd74490a640 1 -- start start 2024-09-10T10:33:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd74490a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd740102d40 0x7fd740198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd74490a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd740103660 0x7fd740198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd74490a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74010c170 0x7fd74019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:58.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd74490a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd740112030 con 0x7fd74010c170 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd74490a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd740111eb0 con 0x7fd740102d40 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd74490a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd7401121b0 con 0x7fd740103660 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74010c170 0x7fd74019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74010c170 0x7fd74019cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55704/0 (socket says 172.21.15.92:55704) 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73ed9d640 1 -- 172.21.15.92:0/697952605 learned_addr learned my addr 172.21.15.92:0/697952605 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73dd9b640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd740103660 0x7fd740198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73e59c640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd740102d40 0x7fd740198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73ed9d640 1 -- 172.21.15.92:0/697952605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd740103660 msgr2=0x7fd740198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73ed9d640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd740103660 0x7fd740198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73ed9d640 1 -- 172.21.15.92:0/697952605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd740102d40 msgr2=0x7fd740198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73ed9d640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd740102d40 0x7fd740198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73ed9d640 1 -- 172.21.15.92:0/697952605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74019d5c0 con 0x7fd74010c170 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73e59c640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd740102d40 0x7fd740198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:33:58.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.852+0000 7fd73ed9d640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74010c170 0x7fd74019cee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd738009fd0 tx=0x7fd73800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.853+0000 7fd72f7fe640 1 -- 172.21.15.92:0/697952605 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd738011830 con 0x7fd74010c170 2024-09-10T10:33:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.853+0000 7fd72f7fe640 1 -- 172.21.15.92:0/697952605 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd738016070 con 0x7fd74010c170 2024-09-10T10:33:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.853+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74019d8b0 con 0x7fd74010c170 2024-09-10T10:33:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.853+0000 7fd72f7fe640 1 -- 172.21.15.92:0/697952605 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73800f2e0 con 0x7fd74010c170 2024-09-10T10:33:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.853+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7401a5190 con 0x7fd74010c170 2024-09-10T10:33:58.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.854+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7401031a0 con 0x7fd74010c170 2024-09-10T10:33:58.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.855+0000 7fd72f7fe640 1 -- 172.21.15.92:0/697952605 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd7380119d0 con 0x7fd74010c170 2024-09-10T10:33:58.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.855+0000 7fd72f7fe640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd7280a2b80 0x7fd7280a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:33:58.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.856+0000 7fd73e59c640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd7280a2b80 0x7fd7280a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:33:58.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.856+0000 7fd72f7fe640 1 -- 172.21.15.92:0/697952605 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd7380ce940 con 0x7fd74010c170 2024-09-10T10:33:58.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.856+0000 7fd73e59c640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd7280a2b80 0x7fd7280a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd730006010 tx=0x7fd730005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:33:58.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:58.859+0000 7fd72f7fe640 1 -- 172.21.15.92:0/697952605 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd73809bd40 con 0x7fd74010c170 2024-09-10T10:33:59.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.023+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd740106c80 con 0x7fd74010c170 2024-09-10T10:33:59.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.023+0000 7fd72f7fe640 1 -- 172.21.15.92:0/697952605 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7fd738097030 con 0x7fd74010c170 2024-09-10T10:33:59.024 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-09-10T10:33:59.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd7280a2b80 msgr2=0x7fd7280a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd7280a2b80 0x7fd7280a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd730006010 tx=0x7fd730005f80 comp rx=0 tx=0).stop 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74010c170 msgr2=0x7fd74019cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74010c170 0x7fd74019cee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd738009fd0 tx=0x7fd73800b8e0 comp rx=0 tx=0).stop 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 shutdown_connections 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd7280a2b80 0x7fd7280a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd74010c170 0x7fd74019cee0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd740103660 0x7fd740198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 --2- 172.21.15.92:0/697952605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd740102d40 0x7fd740198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 >> 172.21.15.92:0/697952605 conn(0x7fd7400fc7a0 msgr2=0x7fd7400fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 shutdown_connections 2024-09-10T10:33:59.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:33:59.026+0000 7fd74490a640 1 -- 172.21.15.92:0/697952605 wait complete. 2024-09-10T10:33:59.332 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:59 smithi092 ceph-mon[30834]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:33:59.332 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:33:59 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/697952605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:33:59.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:59 smithi121 ceph-mon[35231]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:33:59.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:33:59 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/697952605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:33:59.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:59 smithi097 ceph-mon[35213]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:33:59.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:33:59 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/697952605' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:33:59.719 INFO:tasks.cephadm:Adding mds.a on smithi092 2024-09-10T10:33:59.719 INFO:tasks.cephadm:Adding mds.d on smithi092 2024-09-10T10:33:59.720 INFO:tasks.cephadm:Adding mds.g on smithi092 2024-09-10T10:33:59.720 INFO:tasks.cephadm:Adding mds.j on smithi092 2024-09-10T10:33:59.720 INFO:tasks.cephadm:Adding mds.b on smithi097 2024-09-10T10:33:59.720 INFO:tasks.cephadm:Adding mds.e on smithi097 2024-09-10T10:33:59.720 INFO:tasks.cephadm:Adding mds.h on smithi097 2024-09-10T10:33:59.720 INFO:tasks.cephadm:Adding mds.k on smithi097 2024-09-10T10:33:59.720 INFO:tasks.cephadm:Adding mds.c on smithi121 2024-09-10T10:33:59.720 INFO:tasks.cephadm:Adding mds.f on smithi121 2024-09-10T10:33:59.720 INFO:tasks.cephadm:Adding mds.i on smithi121 2024-09-10T10:33:59.721 INFO:tasks.cephadm:Adding mds.l on smithi121 2024-09-10T10:33:59.721 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi097=b;smithi097=e;smithi097=h;smithi097=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l' 2024-09-10T10:33:59.978 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:34:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.442+0000 7fab9248c640 1 -- 172.21.15.121:0/2522332433 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c100ad0 msgr2=0x7fab8c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.442+0000 7fab9248c640 1 --2- 172.21.15.121:0/2522332433 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c100ad0 0x7fab8c100ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009900 tx=0x7fab7c02a410 comp rx=0 tx=0).stop 2024-09-10T10:34:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.442+0000 7fab9248c640 1 -- 172.21.15.121:0/2522332433 shutdown_connections 2024-09-10T10:34:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.442+0000 7fab9248c640 1 --2- 172.21.15.121:0/2522332433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab8c102690 0x7fab8c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.442+0000 7fab9248c640 1 --2- 172.21.15.121:0/2522332433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8c101cd0 0x7fab8c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.442+0000 7fab9248c640 1 --2- 172.21.15.121:0/2522332433 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c100ad0 0x7fab8c100ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.442+0000 7fab9248c640 1 -- 172.21.15.121:0/2522332433 >> 172.21.15.121:0/2522332433 conn(0x7fab8c0fc280 msgr2=0x7fab8c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:00.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.442+0000 7fab9248c640 1 -- 172.21.15.121:0/2522332433 shutdown_connections 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.442+0000 7fab9248c640 1 -- 172.21.15.121:0/2522332433 wait complete. 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.443+0000 7fab9248c640 1 Processor -- start 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.443+0000 7fab9248c640 1 -- start start 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.443+0000 7fab9248c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab8c100ad0 0x7fab8c104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.443+0000 7fab9248c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8c101cd0 0x7fab8c1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.443+0000 7fab9248c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c102690 0x7fab8c1035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.443+0000 7fab9248c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c10c7b0 con 0x7fab8c101cd0 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.443+0000 7fab9248c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c10c630 con 0x7fab8c100ad0 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.443+0000 7fab9248c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c10c930 con 0x7fab8c102690 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.443+0000 7fab90a29640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c102690 0x7fab8c1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab90a29640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c102690 0x7fab8c1035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:33232/0 (socket says 172.21.15.121:33232) 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab90a29640 1 -- 172.21.15.121:0/2499442992 learned_addr learned my addr 172.21.15.121:0/2499442992 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-10T10:34:00.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab8bfff640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab8c100ad0 0x7fab8c104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab8b7fe640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8c101cd0 0x7fab8c1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab90a29640 1 -- 172.21.15.121:0/2499442992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab8c100ad0 msgr2=0x7fab8c104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab90a29640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab8c100ad0 0x7fab8c104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab90a29640 1 -- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8c101cd0 msgr2=0x7fab8c1030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab90a29640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8c101cd0 0x7fab8c1030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab90a29640 1 -- 172.21.15.121:0/2499442992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c103eb0 con 0x7fab8c102690 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab8b7fe640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8c101cd0 0x7fab8c1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab90a29640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c102690 0x7fab8c1035f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab8400eb10 tx=0x7fab8400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab897fa640 1 -- 172.21.15.121:0/2499442992 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84004b20 con 0x7fab8c102690 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab897fa640 1 -- 172.21.15.121:0/2499442992 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab84004cc0 con 0x7fab8c102690 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1a2080 con 0x7fab8c102690 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab897fa640 1 -- 172.21.15.121:0/2499442992 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84010760 con 0x7fab8c102690 2024-09-10T10:34:00.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.444+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a25e0 con 0x7fab8c102690 2024-09-10T10:34:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.446+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c1a2870 con 0x7fab8c102690 2024-09-10T10:34:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.447+0000 7fab897fa640 1 -- 172.21.15.121:0/2499442992 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fab84005020 con 0x7fab8c102690 2024-09-10T10:34:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.448+0000 7fab897fa640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fab740a2c00 0x7fab740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.448+0000 7fab897fa640 1 -- 172.21.15.121:0/2499442992 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fab840cf1c0 con 0x7fab8c102690 2024-09-10T10:34:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.448+0000 7fab8bfff640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fab740a2c00 0x7fab740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.449+0000 7fab8bfff640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fab740a2c00 0x7fab740a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab7c02aa00 tx=0x7fab7c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:00.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.453+0000 7fab897fa640 1 -- 172.21.15.121:0/2499442992 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab8409c5c0 con 0x7fab8c102690 2024-09-10T10:34:00.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.635+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi097=b;smithi097=e;smithi097=h;smithi097=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}) -- 0x7fab8c06a680 con 0x7fab740a2c00 2024-09-10T10:34:00.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.642+0000 7fab897fa640 1 -- 172.21.15.121:0/2499442992 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fab8c06a680 con 0x7fab740a2c00 2024-09-10T10:34:00.644 INFO:teuthology.orchestra.run.smithi121.stdout:Scheduled mds.all update... 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fab740a2c00 msgr2=0x7fab740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fab740a2c00 0x7fab740a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab7c02aa00 tx=0x7fab7c0315b0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c102690 msgr2=0x7fab8c1035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c102690 0x7fab8c1035f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab8400eb10 tx=0x7fab8400c2d0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 shutdown_connections 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fab740a2c00 0x7fab740a50c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab8c102690 0x7fab8c1035f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab8c101cd0 0x7fab8c1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 --2- 172.21.15.121:0/2499442992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fab8c100ad0 0x7fab8c104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:00.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.644+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 >> 172.21.15.121:0/2499442992 conn(0x7fab8c0fc280 msgr2=0x7fab8c069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:00.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.645+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 shutdown_connections 2024-09-10T10:34:00.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-10T10:34:00.645+0000 7fab9248c640 1 -- 172.21.15.121:0/2499442992 wait complete. 2024-09-10T10:34:01.373 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:01 smithi121 ceph-mon[35231]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:01.373 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:01.373 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:34:01.373 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:01.374 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:34:01.374 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:01.374 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:01.374 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:01.374 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:01 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:01.400 DEBUG:teuthology.orchestra.run.smithi092:mds.a> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T10:34:01.403 DEBUG:teuthology.orchestra.run.smithi092:mds.d> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T10:34:01.446 DEBUG:teuthology.orchestra.run.smithi092:mds.g> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T10:34:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:01 smithi092 ceph-mon[30834]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:34:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:34:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:01 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:01.469 DEBUG:teuthology.orchestra.run.smithi092:mds.j> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T10:34:01.512 DEBUG:teuthology.orchestra.run.smithi097:mds.b> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T10:34:01.515 DEBUG:teuthology.orchestra.run.smithi097:mds.e> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T10:34:01.536 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:01 smithi097 ceph-mon[35213]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:01.536 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:01.536 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:34:01.536 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:01.536 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:34:01.536 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:01.536 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:01.536 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:01.536 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:01 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:01.537 DEBUG:teuthology.orchestra.run.smithi097:mds.h> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T10:34:01.580 DEBUG:teuthology.orchestra.run.smithi097:mds.k> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T10:34:01.623 DEBUG:teuthology.orchestra.run.smithi121:mds.c> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T10:34:01.629 DEBUG:teuthology.orchestra.run.smithi121:mds.f> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T10:34:01.672 DEBUG:teuthology.orchestra.run.smithi121:mds.i> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T10:34:01.716 DEBUG:teuthology.orchestra.run.smithi121:mds.l> sudo journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T10:34:01.759 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T10:34:01.759 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:02.007 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:02.425 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:02 smithi092 ceph-mon[30834]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi097=b;smithi097=e;smithi097=h;smithi097=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:34:02.425 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:02 smithi092 ceph-mon[30834]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi097=b;smithi097=e;smithi097=h;smithi097=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-09-10T10:34:02.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:02 smithi092 ceph-mon[30834]: Deploying daemon mds.l on smithi121 2024-09-10T10:34:02.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.423+0000 7fce69aee640 1 -- 172.21.15.92:0/804898982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64100e20 msgr2=0x7fce64101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:02.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.423+0000 7fce69aee640 1 --2- 172.21.15.92:0/804898982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64100e20 0x7fce64101200 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009ca0 tx=0x7fce5c02a950 comp rx=0 tx=0).stop 2024-09-10T10:34:02.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.423+0000 7fce69aee640 1 -- 172.21.15.92:0/804898982 shutdown_connections 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.423+0000 7fce69aee640 1 --2- 172.21.15.92:0/804898982 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce64102ef0 0x7fce6410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.423+0000 7fce69aee640 1 --2- 172.21.15.92:0/804898982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce64102570 0x7fce641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.423+0000 7fce69aee640 1 --2- 172.21.15.92:0/804898982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64100e20 0x7fce64101200 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.424+0000 7fce69aee640 1 -- 172.21.15.92:0/804898982 >> 172.21.15.92:0/804898982 conn(0x7fce640fc7d0 msgr2=0x7fce640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.424+0000 7fce69aee640 1 -- 172.21.15.92:0/804898982 shutdown_connections 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.424+0000 7fce69aee640 1 -- 172.21.15.92:0/804898982 wait complete. 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.424+0000 7fce69aee640 1 Processor -- start 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce69aee640 1 -- start start 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce69aee640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce64100e20 0x7fce641a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce69aee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64102570 0x7fce641a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce69aee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce64102ef0 0x7fce6419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce69aee640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce64110fa0 con 0x7fce64102570 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce69aee640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fce64110e20 con 0x7fce64100e20 2024-09-10T10:34:02.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce69aee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce64111120 con 0x7fce64102ef0 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64102570 0x7fce641a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64102570 0x7fce641a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51862/0 (socket says 172.21.15.92:51862) 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce62ffd640 1 -- 172.21.15.92:0/4022148676 learned_addr learned my addr 172.21.15.92:0/4022148676 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce63fff640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce64102ef0 0x7fce6419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce637fe640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce64100e20 0x7fce641a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce62ffd640 1 -- 172.21.15.92:0/4022148676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce64102ef0 msgr2=0x7fce6419ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce62ffd640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce64102ef0 0x7fce6419ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce62ffd640 1 -- 172.21.15.92:0/4022148676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce64100e20 msgr2=0x7fce641a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce62ffd640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce64100e20 0x7fce641a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce62ffd640 1 -- 172.21.15.92:0/4022148676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6419f390 con 0x7fce64102570 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.425+0000 7fce62ffd640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64102570 0x7fce641a4c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c920 tx=0x7fce4c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.426+0000 7fce60ff9640 1 -- 172.21.15.92:0/4022148676 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c007c70 con 0x7fce64102570 2024-09-10T10:34:02.432 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.426+0000 7fce60ff9640 1 -- 172.21.15.92:0/4022148676 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce4c007e10 con 0x7fce64102570 2024-09-10T10:34:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.426+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6419f680 con 0x7fce64102570 2024-09-10T10:34:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.426+0000 7fce60ff9640 1 -- 172.21.15.92:0/4022148676 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c018890 con 0x7fce64102570 2024-09-10T10:34:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.426+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce641ab5d0 con 0x7fce64102570 2024-09-10T10:34:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.427+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce64101200 con 0x7fce64102570 2024-09-10T10:34:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.428+0000 7fce60ff9640 1 -- 172.21.15.92:0/4022148676 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fce4c018a70 con 0x7fce64102570 2024-09-10T10:34:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.429+0000 7fce60ff9640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce500a2b80 0x7fce500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.429+0000 7fce60ff9640 1 -- 172.21.15.92:0/4022148676 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fce4c0cec40 con 0x7fce64102570 2024-09-10T10:34:02.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.429+0000 7fce637fe640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce500a2b80 0x7fce500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:02.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.430+0000 7fce637fe640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce500a2b80 0x7fce500a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce5c02af40 tx=0x7fce5c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:02.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.433+0000 7fce60ff9640 1 -- 172.21.15.92:0/4022148676 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce4c014030 con 0x7fce64102570 2024-09-10T10:34:02.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:02 smithi121 ceph-mon[35231]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi097=b;smithi097=e;smithi097=h;smithi097=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:34:02.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:02 smithi121 ceph-mon[35231]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi097=b;smithi097=e;smithi097=h;smithi097=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-09-10T10:34:02.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:02 smithi121 ceph-mon[35231]: Deploying daemon mds.l on smithi121 2024-09-10T10:34:02.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:02 smithi097 ceph-mon[35213]: from='client.24415 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi097=b;smithi097=e;smithi097=h;smithi097=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:34:02.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:02 smithi097 ceph-mon[35213]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi097=b;smithi097=e;smithi097=h;smithi097=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-09-10T10:34:02.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:02 smithi097 ceph-mon[35213]: Deploying daemon mds.l on smithi121 2024-09-10T10:34:02.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.633+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce641ab800 con 0x7fce64102570 2024-09-10T10:34:02.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.634+0000 7fce60ff9640 1 -- 172.21.15.92:0/4022148676 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fce4c09c040 con 0x7fce64102570 2024-09-10T10:34:02.635 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:02.636 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"btime":"2024-09-10T10:27:09:104157+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T10:34:02.636 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 1 2024-09-10T10:34:02.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce500a2b80 msgr2=0x7fce500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:02.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce500a2b80 0x7fce500a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fce5c02af40 tx=0x7fce5c009800 comp rx=0 tx=0).stop 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64102570 msgr2=0x7fce641a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64102570 0x7fce641a4c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c920 tx=0x7fce4c00cde0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 shutdown_connections 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fce500a2b80 0x7fce500a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce64102ef0 0x7fce6419ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce64102570 0x7fce641a4c40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 --2- 172.21.15.92:0/4022148676 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fce64100e20 0x7fce641a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 >> 172.21.15.92:0/4022148676 conn(0x7fce640fc7d0 msgr2=0x7fce640ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 shutdown_connections 2024-09-10T10:34:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:02.636+0000 7fce69aee640 1 -- 172.21.15.92:0/4022148676 wait complete. 2024-09-10T10:34:03.219 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:34:03 smithi121 systemd[1]: Starting Ceph mds.l for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:03.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:03 smithi097 ceph-mon[35213]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:03.479 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:03 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/4022148676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:03.492 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:03 smithi121 ceph-mon[35231]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:03.492 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:03 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/4022148676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:03.493 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:34:03 smithi121 podman[64984]: 2024-09-10 10:34:03.238949216 +0000 UTC m=+0.016203595 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:03.493 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:34:03 smithi121 podman[64984]: 2024-09-10 10:34:03.367827969 +0000 UTC m=+0.145082345 container create 4a0a8c05093e0cdfd2ec955835a0fd3d3ce7a63c9b5791f94f264ee00751bc15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T10:34:03.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:03 smithi092 ceph-mon[30834]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:03.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:03 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/4022148676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:04.041 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:34:03 smithi121 podman[64984]: 2024-09-10 10:34:03.612493314 +0000 UTC m=+0.389747684 container init 4a0a8c05093e0cdfd2ec955835a0fd3d3ce7a63c9b5791f94f264ee00751bc15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T10:34:04.041 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:34:03 smithi121 podman[64984]: 2024-09-10 10:34:03.615397524 +0000 UTC m=+0.392651895 container start 4a0a8c05093e0cdfd2ec955835a0fd3d3ce7a63c9b5791f94f264ee00751bc15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T10:34:04.041 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:34:03 smithi121 ceph-mds[65003]: -- 172.21.15.121:0/2045564058 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b7d1d7d860 con 0x55b7d1d5b000 2024-09-10T10:34:04.042 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:34:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l[64999]: starting mds.l at 2024-09-10T10:34:04.042 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:34:03 smithi121 bash[64984]: 4a0a8c05093e0cdfd2ec955835a0fd3d3ce7a63c9b5791f94f264ee00751bc15 2024-09-10T10:34:04.042 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:34:03 smithi121 systemd[1]: Started Ceph mds.l for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:04.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] up:boot 2024-09-10T10:34:04.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: fsmap 1 up:standby 2024-09-10T10:34:04.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:34:04.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:04.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:04.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:04.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:04.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:04.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:04.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: Deploying daemon mds.k on smithi097 2024-09-10T10:34:04.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:04 smithi097 ceph-mon[35213]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:05.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] up:boot 2024-09-10T10:34:05.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: fsmap 1 up:standby 2024-09-10T10:34:05.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:34:05.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:05.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:05.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:05.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:05.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:05.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:05.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: Deploying daemon mds.k on smithi097 2024-09-10T10:34:05.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:04 smithi121 ceph-mon[35231]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:05.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] up:boot 2024-09-10T10:34:05.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: fsmap 1 up:standby 2024-09-10T10:34:05.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:34:05.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:05.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:05.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: Deploying daemon mds.k on smithi097 2024-09-10T10:34:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:04 smithi092 ceph-mon[30834]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:05.579 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:05.820 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:34:05 smithi097 systemd[1]: Starting Ceph mds.k for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:05.831 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:06.194 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:34:05 smithi097 podman[64538]: 2024-09-10 10:34:05.84566617 +0000 UTC m=+0.015372823 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:06.194 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:34:05 smithi097 podman[64538]: 2024-09-10 10:34:05.954770773 +0000 UTC m=+0.124477495 container create 1b0d84ec6d76647534f1d2eb2999d66692d1efa9d1789686c8bee472227abeb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-10T10:34:06.194 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:34:06 smithi097 podman[64538]: 2024-09-10 10:34:06.190834034 +0000 UTC m=+0.360540687 container init 1b0d84ec6d76647534f1d2eb2999d66692d1efa9d1789686c8bee472227abeb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T10:34:06.195 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:34:06 smithi097 podman[64538]: 2024-09-10 10:34:06.193814987 +0000 UTC m=+0.363521640 container start 1b0d84ec6d76647534f1d2eb2999d66692d1efa9d1789686c8bee472227abeb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T10:34:06.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.311+0000 7f1970c32640 1 -- 172.21.15.92:0/2361971344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 msgr2=0x7f196c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:06.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.311+0000 7f1970c32640 1 --2- 172.21.15.92:0/2361971344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 0x7f196c100ee0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1954009930 tx=0x7f195402a420 comp rx=0 tx=0).stop 2024-09-10T10:34:06.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.311+0000 7f1970c32640 1 -- 172.21.15.92:0/2361971344 shutdown_connections 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.311+0000 7f1970c32640 1 --2- 172.21.15.92:0/2361971344 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f196c101420 0x7f196c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.311+0000 7f1970c32640 1 --2- 172.21.15.92:0/2361971344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 0x7f196c100ee0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.311+0000 7f1970c32640 1 --2- 172.21.15.92:0/2361971344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f196c106a80 0x7f196c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.311+0000 7f1970c32640 1 -- 172.21.15.92:0/2361971344 >> 172.21.15.92:0/2361971344 conn(0x7f196c0fc7a0 msgr2=0x7f196c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.311+0000 7f1970c32640 1 -- 172.21.15.92:0/2361971344 shutdown_connections 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.311+0000 7f1970c32640 1 -- 172.21.15.92:0/2361971344 wait complete. 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f1970c32640 1 Processor -- start 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f1970c32640 1 -- start start 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f1970c32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 0x7f196c1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:06.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f1970c32640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f196c101420 0x7f196c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f1970c32640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f196c106a80 0x7f196c19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f1970c32640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f196c110e80 con 0x7f196c100a80 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f1970c32640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f196c110d00 con 0x7f196c106a80 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f1970c32640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f196c111000 con 0x7f196c101420 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 0x7f196c1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 0x7f196c1973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51874/0 (socket says 172.21.15.92:51874) 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196a59c640 1 -- 172.21.15.92:0/3908594516 learned_addr learned my addr 172.21.15.92:0/3908594516 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196ad9d640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f196c106a80 0x7f196c19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196a59c640 1 -- 172.21.15.92:0/3908594516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f196c101420 msgr2=0x7f196c1978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f1969d9b640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f196c101420 0x7f196c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196a59c640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f196c101420 0x7f196c1978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196a59c640 1 -- 172.21.15.92:0/3908594516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f196c106a80 msgr2=0x7f196c19bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:06.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196a59c640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f196c106a80 0x7f196c19bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196a59c640 1 -- 172.21.15.92:0/3908594516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196c19c350 con 0x7f196c100a80 2024-09-10T10:34:06.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.312+0000 7f196a59c640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 0x7f196c1973a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f195c00c970 tx=0x7f195c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:06.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.313+0000 7f19637fe640 1 -- 172.21.15.92:0/3908594516 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c007bb0 con 0x7f196c100a80 2024-09-10T10:34:06.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.313+0000 7f19637fe640 1 -- 172.21.15.92:0/3908594516 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f195c007d50 con 0x7f196c100a80 2024-09-10T10:34:06.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.313+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f196c19c640 con 0x7f196c100a80 2024-09-10T10:34:06.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.313+0000 7f19637fe640 1 -- 172.21.15.92:0/3908594516 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c00f450 con 0x7f196c100a80 2024-09-10T10:34:06.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.313+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f196c1a3f20 con 0x7f196c100a80 2024-09-10T10:34:06.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.314+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f196c100ee0 con 0x7f196c100a80 2024-09-10T10:34:06.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.315+0000 7f19637fe640 1 -- 172.21.15.92:0/3908594516 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f195c005020 con 0x7f196c100a80 2024-09-10T10:34:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.315+0000 7f19637fe640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f19580a2c00 0x7f19580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.316+0000 7f1969d9b640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f19580a2c00 0x7f19580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.316+0000 7f19637fe640 1 -- 172.21.15.92:0/3908594516 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f195c0ce8c0 con 0x7f196c100a80 2024-09-10T10:34:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.316+0000 7f1969d9b640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f19580a2c00 0x7f19580a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f19540096c0 tx=0x7f1954000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:06.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.320+0000 7f19637fe640 1 -- 172.21.15.92:0/3908594516 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f195c014030 con 0x7f196c100a80 2024-09-10T10:34:06.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.530+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f196c198700 con 0x7f196c100a80 2024-09-10T10:34:06.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.531+0000 7f19637fe640 1 -- 172.21.15.92:0/3908594516 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f195c09bcc0 con 0x7f196c100a80 2024-09-10T10:34:06.533 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:06.533 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":2,"btime":"2024-09-10T10:34:03:642716+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T10:34:06.537 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 2 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f19580a2c00 msgr2=0x7f19580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f19580a2c00 0x7f19580a50c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f19540096c0 tx=0x7f1954000bc0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 msgr2=0x7f196c1973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 0x7f196c1973a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f195c00c970 tx=0x7f195c00ce30 comp rx=0 tx=0).stop 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 shutdown_connections 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f19580a2c00 0x7f19580a50c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f196c106a80 0x7f196c19bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f196c101420 0x7f196c1978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 --2- 172.21.15.92:0/3908594516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f196c100a80 0x7f196c1973a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 >> 172.21.15.92:0/3908594516 conn(0x7f196c0fc7a0 msgr2=0x7f196c0fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 shutdown_connections 2024-09-10T10:34:06.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:06.533+0000 7f1970c32640 1 -- 172.21.15.92:0/3908594516 wait complete. 2024-09-10T10:34:06.570 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:34:06 smithi097 ceph-mds[64557]: -- 172.21.15.97:0/2107064204 <== mon.2 v2:172.21.15.97:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635939c3860 con 0x5635939a0800 2024-09-10T10:34:06.570 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:34:06 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k[64553]: starting mds.k at 2024-09-10T10:34:06.570 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:34:06 smithi097 bash[64538]: 1b0d84ec6d76647534f1d2eb2999d66692d1efa9d1789686c8bee472227abeb8 2024-09-10T10:34:06.570 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:34:06 smithi097 systemd[1]: Started Ceph mds.k for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:07 smithi092 ceph-mon[30834]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:07 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:07 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3908594516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:07 smithi121 ceph-mon[35231]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:07 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:07.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:07 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3908594516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:07 smithi097 ceph-mon[35213]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:07 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:07.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:07 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3908594516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:08.329 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:08 smithi092 ceph-mon[30834]: Deploying daemon mds.j on smithi092 2024-09-10T10:34:08.330 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:08 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6832/2610071582,v1:172.21.15.97:6833/2610071582] up:boot 2024-09-10T10:34:08.330 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:08 smithi092 ceph-mon[30834]: fsmap 2 up:standby 2024-09-10T10:34:08.330 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:08 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:34:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:08 smithi121 ceph-mon[35231]: Deploying daemon mds.j on smithi092 2024-09-10T10:34:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:08 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6832/2610071582,v1:172.21.15.97:6833/2610071582] up:boot 2024-09-10T10:34:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:08 smithi121 ceph-mon[35231]: fsmap 2 up:standby 2024-09-10T10:34:08.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:08 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:34:08.550 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:08 smithi097 ceph-mon[35213]: Deploying daemon mds.j on smithi092 2024-09-10T10:34:08.550 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:08 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6832/2610071582,v1:172.21.15.97:6833/2610071582] up:boot 2024-09-10T10:34:08.550 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:08 smithi097 ceph-mon[35213]: fsmap 2 up:standby 2024-09-10T10:34:08.551 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:08 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:34:09.017 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:34:08 smithi092 systemd[1]: Starting Ceph mds.j for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:09.251 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:09.275 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:09 smithi092 ceph-mon[30834]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:09.275 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:34:09 smithi092 podman[70053]: 2024-09-10 10:34:08.918618733 +0000 UTC m=+0.015778508 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:09.276 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:34:09 smithi092 podman[70053]: 2024-09-10 10:34:09.040179008 +0000 UTC m=+0.137338771 container create d21554bd25e8f57dc1ecd6f91a7a2a83dc387f1dc7331d6321b8c0c4b7c5dd0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-j, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:34:09.508 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:09.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:09 smithi121 ceph-mon[35231]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:09.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:09 smithi097 ceph-mon[35213]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:09.610 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:34:09 smithi092 podman[70053]: 2024-09-10 10:34:09.288124392 +0000 UTC m=+0.385284163 container init d21554bd25e8f57dc1ecd6f91a7a2a83dc387f1dc7331d6321b8c0c4b7c5dd0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:34:09.610 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:34:09 smithi092 podman[70053]: 2024-09-10 10:34:09.291804993 +0000 UTC m=+0.388964766 container start d21554bd25e8f57dc1ecd6f91a7a2a83dc387f1dc7331d6321b8c0c4b7c5dd0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T10:34:09.611 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:34:09 smithi092 ceph-mds[70090]: -- 172.21.15.92:0/920448750 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564838ee1860 con 0x564838ebf000 2024-09-10T10:34:09.611 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:34:09 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-j[70068]: starting mds.j at 2024-09-10T10:34:09.611 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:34:09 smithi092 bash[70053]: d21554bd25e8f57dc1ecd6f91a7a2a83dc387f1dc7331d6321b8c0c4b7c5dd0f 2024-09-10T10:34:09.611 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:34:09 smithi092 systemd[1]: Started Ceph mds.j for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.986+0000 7fd8c718f640 1 -- 172.21.15.92:0/1777893793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0105f40 msgr2=0x7fd8c01063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.986+0000 7fd8c718f640 1 --2- 172.21.15.92:0/1777893793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0105f40 0x7fd8c01063d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009ca0 tx=0x7fd8b802a940 comp rx=0 tx=0).stop 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 -- 172.21.15.92:0/1777893793 shutdown_connections 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 --2- 172.21.15.92:0/1777893793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0105f40 0x7fd8c01063d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 --2- 172.21.15.92:0/1777893793 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8c0101450 0x7fd8c0105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 --2- 172.21.15.92:0/1777893793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c0100b30 0x7fd8c0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 -- 172.21.15.92:0/1777893793 >> 172.21.15.92:0/1777893793 conn(0x7fd8c00fc7a0 msgr2=0x7fd8c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 -- 172.21.15.92:0/1777893793 shutdown_connections 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 -- 172.21.15.92:0/1777893793 wait complete. 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 Processor -- start 2024-09-10T10:34:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 -- start start 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0100b30 0x7fd8c01a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c0101450 0x7fd8c01a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8c0105f40 0x7fd8c019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c01185d0 con 0x7fd8c0100b30 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0118450 con 0x7fd8c0105f40 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c718f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c0118750 con 0x7fd8c0101450 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.987+0000 7fd8c4f2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0100b30 0x7fd8c01a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c4f2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0100b30 0x7fd8c01a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51906/0 (socket says 172.21.15.92:51906) 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c4f2b640 1 -- 172.21.15.92:0/2145502511 learned_addr learned my addr 172.21.15.92:0/2145502511 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8bffff640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c0101450 0x7fd8c01a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c572c640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8c0105f40 0x7fd8c019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c4f2b640 1 -- 172.21.15.92:0/2145502511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c0101450 msgr2=0x7fd8c01a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c4f2b640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c0101450 0x7fd8c01a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c4f2b640 1 -- 172.21.15.92:0/2145502511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8c0105f40 msgr2=0x7fd8c019e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c4f2b640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8c0105f40 0x7fd8c019e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c4f2b640 1 -- 172.21.15.92:0/2145502511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c019efc0 con 0x7fd8c0100b30 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c4f2b640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0100b30 0x7fd8c01a46a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400b4a0 tx=0x7fd8b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8bdffb640 1 -- 172.21.15.92:0/2145502511 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4014070 con 0x7fd8c0100b30 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8bdffb640 1 -- 172.21.15.92:0/2145502511 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8b4010af0 con 0x7fd8c0100b30 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c019f2b0 con 0x7fd8c0100b30 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8bdffb640 1 -- 172.21.15.92:0/2145502511 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4017d10 con 0x7fd8c0100b30 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.988+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c01ab500 con 0x7fd8c0100b30 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.989+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c006b070 con 0x7fd8c0100b30 2024-09-10T10:34:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.990+0000 7fd8bdffb640 1 -- 172.21.15.92:0/2145502511 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd8b4017070 con 0x7fd8c0100b30 2024-09-10T10:34:09.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.991+0000 7fd8bdffb640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd8b00a2b80 0x7fd8b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:09.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.991+0000 7fd8bffff640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd8b00a2b80 0x7fd8b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:09.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.991+0000 7fd8bdffb640 1 -- 172.21.15.92:0/2145502511 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd8b40cdec0 con 0x7fd8c0100b30 2024-09-10T10:34:09.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.991+0000 7fd8bffff640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd8b00a2b80 0x7fd8b00a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0106590 tx=0x7fd8ac00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:09.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:09.995+0000 7fd8bdffb640 1 -- 172.21.15.92:0/2145502511 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd8b409ac70 con 0x7fd8c0100b30 2024-09-10T10:34:10.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.207+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8c01ab730 con 0x7fd8c0100b30 2024-09-10T10:34:10.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.207+0000 7fd8bdffb640 1 -- 172.21.15.92:0/2145502511 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7fd8b409ef70 con 0x7fd8c0100b30 2024-09-10T10:34:10.209 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:10.209 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":4,"btime":"2024-09-10T10:34:10:184570+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24359,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T10:34:10.210 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 4 2024-09-10T10:34:10.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd8b00a2b80 msgr2=0x7fd8b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:10.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd8b00a2b80 0x7fd8b00a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0106590 tx=0x7fd8ac00a250 comp rx=0 tx=0).stop 2024-09-10T10:34:10.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0100b30 msgr2=0x7fd8c01a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:10.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0100b30 0x7fd8c01a46a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400b4a0 tx=0x7fd8b400b960 comp rx=0 tx=0).stop 2024-09-10T10:34:10.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 shutdown_connections 2024-09-10T10:34:10.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd8b00a2b80 0x7fd8b00a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:10.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd8c0105f40 0x7fd8c019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:10.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c0101450 0x7fd8c01a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:10.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 --2- 172.21.15.92:0/2145502511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8c0100b30 0x7fd8c01a46a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:10.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.210+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 >> 172.21.15.92:0/2145502511 conn(0x7fd8c00fc7a0 msgr2=0x7fd8c01038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:10.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.211+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 shutdown_connections 2024-09-10T10:34:10.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:10.211+0000 7fd8c718f640 1 -- 172.21.15.92:0/2145502511 wait complete. 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: Deploying daemon mds.d on smithi092 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.92:6834/3858072371,v1:172.21.15.92:6835/3858072371] up:boot 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: fsmap 3 up:standby 2024-09-10T10:34:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:34:10.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:10 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2145502511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: Deploying daemon mds.d on smithi092 2024-09-10T10:34:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.92:6834/3858072371,v1:172.21.15.92:6835/3858072371] up:boot 2024-09-10T10:34:10.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: fsmap 3 up:standby 2024-09-10T10:34:10.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:34:10.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:10 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2145502511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:10.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: Deploying daemon mds.d on smithi092 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.92:6834/3858072371,v1:172.21.15.92:6835/3858072371] up:boot 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: fsmap 3 up:standby 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:34:10.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:10 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2145502511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:12.547 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:34:12 smithi092 systemd[1]: Starting Ceph mds.d for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:12.803 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:34:12 smithi092 podman[70466]: 2024-09-10 10:34:12.449271547 +0000 UTC m=+0.015551391 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:12.803 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:34:12 smithi092 podman[70466]: 2024-09-10 10:34:12.549017949 +0000 UTC m=+0.115297822 container create e0172f59930c19e064d3474fae4348d4c17f1cd61f500b2a6ec1f39b13a14b12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:34:12.803 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:34:12 smithi092 podman[70466]: 2024-09-10 10:34:12.776575414 +0000 UTC m=+0.342855245 container init e0172f59930c19e064d3474fae4348d4c17f1cd61f500b2a6ec1f39b13a14b12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-d, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:34:12.803 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:34:12 smithi092 podman[70466]: 2024-09-10 10:34:12.779418325 +0000 UTC m=+0.345698157 container start e0172f59930c19e064d3474fae4348d4c17f1cd61f500b2a6ec1f39b13a14b12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T10:34:13.064 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:13.088 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:34:12 smithi092 ceph-mds[70485]: -- 172.21.15.92:0/2951709623 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eb659cb860 con 0x55eb659a9000 2024-09-10T10:34:13.088 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:34:12 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-d[70481]: starting mds.d at 2024-09-10T10:34:13.088 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:34:12 smithi092 bash[70466]: e0172f59930c19e064d3474fae4348d4c17f1cd61f500b2a6ec1f39b13a14b12 2024-09-10T10:34:13.088 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:34:12 smithi092 systemd[1]: Started Ceph mds.d for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:13.315 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:13.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:13 smithi092 ceph-mon[30834]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:13.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:13.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:13.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:13.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:13.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:13.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:13 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:13.516 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:13 smithi097 ceph-mon[35213]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:13.516 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:13.517 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:13.517 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:13.517 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:13.517 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:13.517 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:13 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:13 smithi121 ceph-mon[35231]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:13 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 -- 172.21.15.92:0/545334412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 msgr2=0x7f2d7410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/545334412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 0x7f2d7410bbb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009ca0 tx=0x7f2d6402a950 comp rx=0 tx=0).stop 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 -- 172.21.15.92:0/545334412 shutdown_connections 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/545334412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d7410c180 0x7f2d7410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/545334412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 0x7f2d7410bbb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/545334412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74102da0 0x7f2d74103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 -- 172.21.15.92:0/545334412 >> 172.21.15.92:0/545334412 conn(0x7f2d740fc7a0 msgr2=0x7f2d740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 -- 172.21.15.92:0/545334412 shutdown_connections 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 -- 172.21.15.92:0/545334412 wait complete. 2024-09-10T10:34:13.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 Processor -- start 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.794+0000 7f2d78fe9640 1 -- start start 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d78fe9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74102da0 0x7f2d74100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d78fe9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 0x7f2d74100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d78fe9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d7410c180 0x7f2d74101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d78fe9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74112020 con 0x7f2d741036c0 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d78fe9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74111ea0 con 0x7f2d7410c180 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d78fe9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741121a0 con 0x7f2d74102da0 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d71d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 0x7f2d74100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d71d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 0x7f2d74100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35246/0 (socket says 172.21.15.92:35246) 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d71d9b640 1 -- 172.21.15.92:0/2706752399 learned_addr learned my addr 172.21.15.92:0/2706752399 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d72d9d640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d7410c180 0x7f2d74101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:13.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d7259c640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74102da0 0x7f2d74100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:13.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d71d9b640 1 -- 172.21.15.92:0/2706752399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74102da0 msgr2=0x7f2d74100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:13.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d71d9b640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74102da0 0x7f2d74100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:13.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d71d9b640 1 -- 172.21.15.92:0/2706752399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d7410c180 msgr2=0x7f2d74101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:13.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d71d9b640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d7410c180 0x7f2d74101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:13.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d71d9b640 1 -- 172.21.15.92:0/2706752399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d741a6a60 con 0x7f2d741036c0 2024-09-10T10:34:13.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d71d9b640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 0x7f2d74100f40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d64005cc0 tx=0x7f2d6402f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:13.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d637fe640 1 -- 172.21.15.92:0/2706752399 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64034040 con 0x7f2d741036c0 2024-09-10T10:34:13.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d637fe640 1 -- 172.21.15.92:0/2706752399 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d64003e40 con 0x7f2d741036c0 2024-09-10T10:34:13.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d741a6cf0 con 0x7f2d741036c0 2024-09-10T10:34:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.795+0000 7f2d637fe640 1 -- 172.21.15.92:0/2706752399 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64045480 con 0x7f2d741036c0 2024-09-10T10:34:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.796+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d741a7180 con 0x7f2d741036c0 2024-09-10T10:34:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.797+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d74103200 con 0x7f2d741036c0 2024-09-10T10:34:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.797+0000 7f2d637fe640 1 -- 172.21.15.92:0/2706752399 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2d64037020 con 0x7f2d741036c0 2024-09-10T10:34:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.798+0000 7f2d637fe640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2d5c0a2b80 0x7f2d5c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.798+0000 7f2d7259c640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2d5c0a2b80 0x7f2d5c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.799+0000 7f2d637fe640 1 -- 172.21.15.92:0/2706752399 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f2d640eff00 con 0x7f2d741036c0 2024-09-10T10:34:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.799+0000 7f2d7259c640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2d5c0a2b80 0x7f2d5c0a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800a810 tx=0x7f2d68008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:13.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:13.803+0000 7f2d637fe640 1 -- 172.21.15.92:0/2706752399 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d640bd260 con 0x7f2d741036c0 2024-09-10T10:34:14.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.007+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d741071c0 con 0x7f2d741036c0 2024-09-10T10:34:14.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.007+0000 7f2d637fe640 1 -- 172.21.15.92:0/2706752399 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f2d640bcb60 con 0x7f2d741036c0 2024-09-10T10:34:14.009 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:14.009 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":5,"btime":"2024-09-10T10:34:13:170063+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24359,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T10:34:14.010 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 5 2024-09-10T10:34:14.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2d5c0a2b80 msgr2=0x7f2d5c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:14.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2d5c0a2b80 0x7f2d5c0a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800a810 tx=0x7f2d68008040 comp rx=0 tx=0).stop 2024-09-10T10:34:14.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 msgr2=0x7f2d74100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:14.011 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 0x7f2d74100f40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d64005cc0 tx=0x7f2d6402f770 comp rx=0 tx=0).stop 2024-09-10T10:34:14.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 shutdown_connections 2024-09-10T10:34:14.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2d5c0a2b80 0x7f2d5c0a5040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:14.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2d7410c180 0x7f2d74101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:14.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d741036c0 0x7f2d74100f40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:14.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 --2- 172.21.15.92:0/2706752399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d74102da0 0x7f2d74100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:14.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 >> 172.21.15.92:0/2706752399 conn(0x7f2d740fc7a0 msgr2=0x7f2d740fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:14.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 shutdown_connections 2024-09-10T10:34:14.012 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:14.010+0000 7f2d78fe9640 1 -- 172.21.15.92:0/2706752399 wait complete. 2024-09-10T10:34:14.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:14 smithi092 ceph-mon[30834]: Deploying daemon mds.e on smithi097 2024-09-10T10:34:14.302 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:14 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.92:6836/1435061291,v1:172.21.15.92:6837/1435061291] up:boot 2024-09-10T10:34:14.302 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:14 smithi092 ceph-mon[30834]: fsmap 4 up:standby 2024-09-10T10:34:14.302 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:14 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:34:14.302 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:14 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2706752399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:14.508 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:14 smithi097 ceph-mon[35213]: Deploying daemon mds.e on smithi097 2024-09-10T10:34:14.508 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:14 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.92:6836/1435061291,v1:172.21.15.92:6837/1435061291] up:boot 2024-09-10T10:34:14.508 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:14 smithi097 ceph-mon[35213]: fsmap 4 up:standby 2024-09-10T10:34:14.508 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:14 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:34:14.508 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:14 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2706752399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:14.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:14 smithi121 ceph-mon[35231]: Deploying daemon mds.e on smithi097 2024-09-10T10:34:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:14 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.92:6836/1435061291,v1:172.21.15.92:6837/1435061291] up:boot 2024-09-10T10:34:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:14 smithi121 ceph-mon[35231]: fsmap 4 up:standby 2024-09-10T10:34:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:14 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:34:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:14 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2706752399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:15.073 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:34:14 smithi097 systemd[1]: Starting Ceph mds.e for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:15.455 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:15 smithi097 ceph-mon[35213]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:15.455 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:34:15 smithi097 podman[64852]: 2024-09-10 10:34:15.092985581 +0000 UTC m=+0.015503251 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:15.455 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:34:15 smithi097 podman[64852]: 2024-09-10 10:34:15.210043426 +0000 UTC m=+0.132561087 container create 40985850e5ce7514341aec9ddfafdb1f30bc54ec623d145dde513d1adfc20271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:34:15.455 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:34:15 smithi097 podman[64852]: 2024-09-10 10:34:15.454636521 +0000 UTC m=+0.377154191 container init 40985850e5ce7514341aec9ddfafdb1f30bc54ec623d145dde513d1adfc20271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:34:15.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:15 smithi121 ceph-mon[35231]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:15.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:15 smithi092 ceph-mon[30834]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:15.820 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:34:15 smithi097 podman[64852]: 2024-09-10 10:34:15.457715076 +0000 UTC m=+0.380232737 container start 40985850e5ce7514341aec9ddfafdb1f30bc54ec623d145dde513d1adfc20271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:34:15.820 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:34:15 smithi097 ceph-mds[64871]: -- 172.21.15.97:0/1605414229 <== mon.2 v2:172.21.15.97:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5650496eb860 con 0x5650496c8800 2024-09-10T10:34:15.820 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:34:15 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e[64867]: starting mds.e at 2024-09-10T10:34:15.820 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:34:15 smithi097 bash[64852]: 40985850e5ce7514341aec9ddfafdb1f30bc54ec623d145dde513d1adfc20271 2024-09-10T10:34:15.820 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:34:15 smithi097 systemd[1]: Started Ceph mds.e for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:16.749 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: Deploying daemon mds.f on smithi121 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6834/9514508,v1:172.21.15.97:6835/9514508] up:boot 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: fsmap 5 up:standby 2024-09-10T10:34:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:16 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:34:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: Deploying daemon mds.f on smithi121 2024-09-10T10:34:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6834/9514508,v1:172.21.15.97:6835/9514508] up:boot 2024-09-10T10:34:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: fsmap 5 up:standby 2024-09-10T10:34:16.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:16 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:34:17.019 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:17.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:17.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:17.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:17.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:17.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:17.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:17.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: Deploying daemon mds.f on smithi121 2024-09-10T10:34:17.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:17.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6834/9514508,v1:172.21.15.97:6835/9514508] up:boot 2024-09-10T10:34:17.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: fsmap 5 up:standby 2024-09-10T10:34:17.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:16 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:34:17.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.526+0000 7ff8d2c28640 1 -- 172.21.15.92:0/2590279876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 msgr2=0x7ff8cc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:17.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.526+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/2590279876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 0x7ff8cc101200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009900 tx=0x7ff8c002a480 comp rx=0 tx=0).stop 2024-09-10T10:34:17.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.526+0000 7ff8d2c28640 1 -- 172.21.15.92:0/2590279876 shutdown_connections 2024-09-10T10:34:17.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.526+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/2590279876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8cc102ef0 0x7ff8cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:17.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.526+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/2590279876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc102570 0x7ff8cc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:17.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.526+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/2590279876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 0x7ff8cc101200 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:17.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.526+0000 7ff8d2c28640 1 -- 172.21.15.92:0/2590279876 >> 172.21.15.92:0/2590279876 conn(0x7ff8cc0fc7d0 msgr2=0x7ff8cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:17.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.526+0000 7ff8d2c28640 1 -- 172.21.15.92:0/2590279876 shutdown_connections 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.526+0000 7ff8d2c28640 1 -- 172.21.15.92:0/2590279876 wait complete. 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d2c28640 1 Processor -- start 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d2c28640 1 -- start start 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d2c28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 0x7ff8cc1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d2c28640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8cc102570 0x7ff8cc197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d2c28640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc102ef0 0x7ff8cc19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d2c28640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc110f80 con 0x7ff8cc100e20 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d2c28640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc110e00 con 0x7ff8cc102ef0 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d2c28640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc111100 con 0x7ff8cc102570 2024-09-10T10:34:17.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d09c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 0x7ff8cc1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d09c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 0x7ff8cc1973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35256/0 (socket says 172.21.15.92:35256) 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8d09c4640 1 -- 172.21.15.92:0/1651586886 learned_addr learned my addr 172.21.15.92:0/1651586886 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.527+0000 7ff8cbfff640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8cc102570 0x7ff8cc197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8d11c5640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc102ef0 0x7ff8cc19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8d09c4640 1 -- 172.21.15.92:0/1651586886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8cc102570 msgr2=0x7ff8cc197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8d09c4640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8cc102570 0x7ff8cc197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8d09c4640 1 -- 172.21.15.92:0/1651586886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc102ef0 msgr2=0x7ff8cc19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8d09c4640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc102ef0 0x7ff8cc19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8d09c4640 1 -- 172.21.15.92:0/1651586886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc19c370 con 0x7ff8cc100e20 2024-09-10T10:34:17.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8d09c4640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 0x7ff8cc1973c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0006010 tx=0x7ff8c0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8c9ffb640 1 -- 172.21.15.92:0/1651586886 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c003f070 con 0x7ff8cc100e20 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8c9ffb640 1 -- 172.21.15.92:0/1651586886 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8c0031c30 con 0x7ff8cc100e20 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc19c600 con 0x7ff8cc100e20 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8c9ffb640 1 -- 172.21.15.92:0/1651586886 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0035030 con 0x7ff8cc100e20 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.528+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc069f70 con 0x7ff8cc100e20 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.529+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc1021b0 con 0x7ff8cc100e20 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.530+0000 7ff8c9ffb640 1 -- 172.21.15.92:0/1651586886 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff8c0042070 con 0x7ff8cc100e20 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.531+0000 7ff8c9ffb640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff8bc0a2c00 0x7ff8bc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.531+0000 7ff8cbfff640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff8bc0a2c00 0x7ff8bc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.531+0000 7ff8c9ffb640 1 -- 172.21.15.92:0/1651586886 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff8c00ef180 con 0x7ff8cc100e20 2024-09-10T10:34:17.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.531+0000 7ff8cbfff640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff8bc0a2c00 0x7ff8bc0a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0ffdc0 tx=0x7ff8b800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:17.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.535+0000 7ff8c9ffb640 1 -- 172.21.15.92:0/1651586886 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8c00bbf30 con 0x7ff8cc100e20 2024-09-10T10:34:17.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.736+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8cc198750 con 0x7ff8cc100e20 2024-09-10T10:34:17.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.737+0000 7ff8c9ffb640 1 -- 172.21.15.92:0/1651586886 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4729 (secure 0 0 0) 0x7ff8cc198750 con 0x7ff8cc100e20 2024-09-10T10:34:17.739 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:17.739 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":6,"btime":"2024-09-10T10:34:16:181490+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24359,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24386,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T10:34:17.739 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 6 2024-09-10T10:34:17.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff8bc0a2c00 msgr2=0x7ff8bc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:17.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff8bc0a2c00 0x7ff8bc0a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0ffdc0 tx=0x7ff8b800b410 comp rx=0 tx=0).stop 2024-09-10T10:34:17.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 msgr2=0x7ff8cc1973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:17.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 0x7ff8cc1973c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0006010 tx=0x7ff8c0003c10 comp rx=0 tx=0).stop 2024-09-10T10:34:17.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 shutdown_connections 2024-09-10T10:34:17.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff8bc0a2c00 0x7ff8bc0a50c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:17.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff8cc102ef0 0x7ff8cc19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:17.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8cc102570 0x7ff8cc197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:17.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 --2- 172.21.15.92:0/1651586886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8cc100e20 0x7ff8cc1973c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:17.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 >> 172.21.15.92:0/1651586886 conn(0x7ff8cc0fc7d0 msgr2=0x7ff8cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:17.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 shutdown_connections 2024-09-10T10:34:17.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:17.739+0000 7ff8d2c28640 1 -- 172.21.15.92:0/1651586886 wait complete. 2024-09-10T10:34:17.752 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:34:17 smithi121 systemd[1]: Starting Ceph mds.f for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:18.008 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:17 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1651586886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:18.008 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:34:17 smithi121 podman[65286]: 2024-09-10 10:34:17.654237298 +0000 UTC m=+0.016250728 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:18.008 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:34:17 smithi121 podman[65286]: 2024-09-10 10:34:17.771365145 +0000 UTC m=+0.133378561 container create 6bb8c45fcf4976ba2b7235dc10736ddc6fd91e2636bf55baedc97eba37d0223b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T10:34:18.008 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:34:18 smithi121 podman[65286]: 2024-09-10 10:34:18.007365824 +0000 UTC m=+0.369379243 container init 6bb8c45fcf4976ba2b7235dc10736ddc6fd91e2636bf55baedc97eba37d0223b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:34:18.022 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:17 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1651586886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:18.064 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:17 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1651586886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:18.291 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:34:18 smithi121 podman[65286]: 2024-09-10 10:34:18.010172106 +0000 UTC m=+0.372185532 container start 6bb8c45fcf4976ba2b7235dc10736ddc6fd91e2636bf55baedc97eba37d0223b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2) 2024-09-10T10:34:18.291 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:34:18 smithi121 ceph-mds[65306]: -- 172.21.15.121:0/2918800196 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d9047f860 con 0x557d9045d000 2024-09-10T10:34:18.291 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:34:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f[65302]: starting mds.f at 2024-09-10T10:34:18.291 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:34:18 smithi121 bash[65286]: 6bb8c45fcf4976ba2b7235dc10736ddc6fd91e2636bf55baedc97eba37d0223b 2024-09-10T10:34:18.291 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:34:18 smithi121 systemd[1]: Started Ceph mds.f for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:19.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:19.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:19.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:19.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:19.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:19.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:19.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:19.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: Deploying daemon mds.c on smithi121 2024-09-10T10:34:19.293 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] up:boot 2024-09-10T10:34:19.294 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: fsmap 6 up:standby 2024-09-10T10:34:19.294 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:19 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:34:19.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: Deploying daemon mds.c on smithi121 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] up:boot 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: fsmap 6 up:standby 2024-09-10T10:34:19.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:19 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:34:19.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:19.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:19.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:19.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:19.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:19.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:19.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:19.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: Deploying daemon mds.c on smithi121 2024-09-10T10:34:19.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] up:boot 2024-09-10T10:34:19.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: fsmap 6 up:standby 2024-09-10T10:34:19.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:19 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:34:20.291 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:34:20 smithi121 systemd[1]: Starting Ceph mds.c for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:20.467 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:20.697 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:34:20 smithi121 podman[65586]: 2024-09-10 10:34:20.336318722 +0000 UTC m=+0.016342753 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:20.697 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:34:20 smithi121 podman[65586]: 2024-09-10 10:34:20.444054731 +0000 UTC m=+0.124078748 container create 0d2c7a22d4f38de297edeb7d041ec3f8435154a2eb99769e2670e0e3e832b625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:34:20.697 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:34:20 smithi121 podman[65586]: 2024-09-10 10:34:20.696991414 +0000 UTC m=+0.377015434 container init 0d2c7a22d4f38de297edeb7d041ec3f8435154a2eb99769e2670e0e3e832b625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T10:34:20.743 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:21.041 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:34:20 smithi121 podman[65586]: 2024-09-10 10:34:20.699897831 +0000 UTC m=+0.379921850 container start 0d2c7a22d4f38de297edeb7d041ec3f8435154a2eb99769e2670e0e3e832b625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T10:34:21.041 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:34:20 smithi121 ceph-mds[65606]: -- 172.21.15.121:0/856845739 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5602253cd860 con 0x5602253aa800 2024-09-10T10:34:21.041 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:34:20 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c[65602]: starting mds.c at 2024-09-10T10:34:21.041 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:34:20 smithi121 bash[65586]: 0d2c7a22d4f38de297edeb7d041ec3f8435154a2eb99769e2670e0e3e832b625 2024-09-10T10:34:21.041 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:34:20 smithi121 systemd[1]: Started Ceph mds.c for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:21.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.198+0000 7faf40a94640 1 -- 172.21.15.92:0/2846929306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 msgr2=0x7faf3c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:21.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.198+0000 7faf40a94640 1 --2- 172.21.15.92:0/2846929306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 0x7faf3c10da40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faf34009ca0 tx=0x7faf3402a950 comp rx=0 tx=0).stop 2024-09-10T10:34:21.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.198+0000 7faf40a94640 1 -- 172.21.15.92:0/2846929306 shutdown_connections 2024-09-10T10:34:21.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.198+0000 7faf40a94640 1 --2- 172.21.15.92:0/2846929306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 0x7faf3c10da40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.198+0000 7faf40a94640 1 --2- 172.21.15.92:0/2846929306 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf3c102570 0x7faf3c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.198+0000 7faf40a94640 1 --2- 172.21.15.92:0/2846929306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3c100e20 0x7faf3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.198+0000 7faf40a94640 1 -- 172.21.15.92:0/2846929306 >> 172.21.15.92:0/2846929306 conn(0x7faf3c0fc7d0 msgr2=0x7faf3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:21.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.198+0000 7faf40a94640 1 -- 172.21.15.92:0/2846929306 shutdown_connections 2024-09-10T10:34:21.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.198+0000 7faf40a94640 1 -- 172.21.15.92:0/2846929306 wait complete. 2024-09-10T10:34:21.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf40a94640 1 Processor -- start 2024-09-10T10:34:21.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf40a94640 1 -- start start 2024-09-10T10:34:21.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf40a94640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf3c100e20 0x7faf3c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:21.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf40a94640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3c102570 0x7faf3c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:21.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf40a94640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 0x7faf3c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:21.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf40a94640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c110fa0 con 0x7faf3c102ef0 2024-09-10T10:34:21.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf40a94640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c110e20 con 0x7faf3c100e20 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf40a94640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c111120 con 0x7faf3c102570 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf3ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 0x7faf3c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf3ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 0x7faf3c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35278/0 (socket says 172.21.15.92:35278) 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf3ad9d640 1 -- 172.21.15.92:0/3085777638 learned_addr learned my addr 172.21.15.92:0/3085777638 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf39d9b640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3c102570 0x7faf3c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf3a59c640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf3c100e20 0x7faf3c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf3ad9d640 1 -- 172.21.15.92:0/3085777638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3c102570 msgr2=0x7faf3c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf3ad9d640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3c102570 0x7faf3c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf3ad9d640 1 -- 172.21.15.92:0/3085777638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf3c100e20 msgr2=0x7faf3c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf3ad9d640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf3c100e20 0x7faf3c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.199+0000 7faf3ad9d640 1 -- 172.21.15.92:0/3085777638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c1a6910 con 0x7faf3c102ef0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.200+0000 7faf3ad9d640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 0x7faf3c0fd700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf34006010 tx=0x7faf3402f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.200+0000 7faf2b7fe640 1 -- 172.21.15.92:0/3085777638 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34034040 con 0x7faf3c102ef0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.200+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3c1a6ba0 con 0x7faf3c102ef0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.200+0000 7faf2b7fe640 1 -- 172.21.15.92:0/3085777638 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf34003e00 con 0x7faf3c102ef0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.200+0000 7faf2b7fe640 1 -- 172.21.15.92:0/3085777638 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34045480 con 0x7faf3c102ef0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.200+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3c1a70d0 con 0x7faf3c102ef0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.201+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf3c101200 con 0x7faf3c102ef0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.202+0000 7faf2b7fe640 1 -- 172.21.15.92:0/3085777638 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7faf34037020 con 0x7faf3c102ef0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.202+0000 7faf2b7fe640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faf240a2b80 0x7faf240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.203+0000 7faf2b7fe640 1 -- 172.21.15.92:0/3085777638 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7faf340efc70 con 0x7faf3c102ef0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.203+0000 7faf3a59c640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faf240a2b80 0x7faf240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:21.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.203+0000 7faf3a59c640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faf240a2b80 0x7faf240a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009890 tx=0x7faf2c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:21.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.207+0000 7faf2b7fe640 1 -- 172.21.15.92:0/3085777638 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf340bd070 con 0x7faf3c102ef0 2024-09-10T10:34:21.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.408+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf3c0fe1b0 con 0x7faf3c102ef0 2024-09-10T10:34:21.409 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:21 smithi092 ceph-mon[30834]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:21.410 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:21.410 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:21.410 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:21.410 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:21.410 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:21.410 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:21 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:21.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.408+0000 7faf2b7fe640 1 -- 172.21.15.92:0/3085777638 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6382 (secure 0 0 0) 0x7faf3c0fe1b0 con 0x7faf3c102ef0 2024-09-10T10:34:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:21.411 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"btime":"2024-09-10T10:34:21:150419+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24359,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24386,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T10:34:21.411 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-09-10T10:34:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faf240a2b80 msgr2=0x7faf240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faf240a2b80 0x7faf240a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009890 tx=0x7faf2c008040 comp rx=0 tx=0).stop 2024-09-10T10:34:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 msgr2=0x7faf3c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 0x7faf3c0fd700 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf34006010 tx=0x7faf3402f6f0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 shutdown_connections 2024-09-10T10:34:21.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faf240a2b80 0x7faf240a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf3c102ef0 0x7faf3c0fd700 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf3c102570 0x7faf3c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 --2- 172.21.15.92:0/3085777638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faf3c100e20 0x7faf3c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:21.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 >> 172.21.15.92:0/3085777638 conn(0x7faf3c0fc7d0 msgr2=0x7faf3c06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:21.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 shutdown_connections 2024-09-10T10:34:21.413 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:21.411+0000 7faf40a94640 1 -- 172.21.15.92:0/3085777638 wait complete. 2024-09-10T10:34:21.421 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:21 smithi097 ceph-mon[35213]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:21.421 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:21.421 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:21.421 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:21.421 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:21.421 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:21.421 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:21 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:21.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:21 smithi121 ceph-mon[35231]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:21.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:21.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:21.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:21.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:21.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:21.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:21 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:22.464 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:22 smithi097 ceph-mon[35213]: Deploying daemon mds.h on smithi097 2024-09-10T10:34:22.464 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:22 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] up:boot 2024-09-10T10:34:22.464 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:22 smithi097 ceph-mon[35213]: fsmap 7 up:standby 2024-09-10T10:34:22.464 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:22 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:34:22.464 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:22 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3085777638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:22.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:22 smithi121 ceph-mon[35231]: Deploying daemon mds.h on smithi097 2024-09-10T10:34:22.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:22 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] up:boot 2024-09-10T10:34:22.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:22 smithi121 ceph-mon[35231]: fsmap 7 up:standby 2024-09-10T10:34:22.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:22 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:34:22.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:22 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3085777638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:22.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:22 smithi092 ceph-mon[30834]: Deploying daemon mds.h on smithi097 2024-09-10T10:34:22.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:22 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] up:boot 2024-09-10T10:34:22.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:22 smithi092 ceph-mon[30834]: fsmap 7 up:standby 2024-09-10T10:34:22.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:22 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:34:22.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:22 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3085777638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:23.171 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:34:23 smithi097 podman[65154]: 2024-09-10 10:34:23.090637576 +0000 UTC m=+0.135368111 container create bb73635fbcac5fc7e43d688f291b31b99df8a9955704634289ac8055f2d7c0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:34:23.461 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:23 smithi097 ceph-mon[35213]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:23.461 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:34:23 smithi097 podman[65154]: 2024-09-10 10:34:23.352210752 +0000 UTC m=+0.396941290 container init bb73635fbcac5fc7e43d688f291b31b99df8a9955704634289ac8055f2d7c0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T10:34:23.461 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:34:23 smithi097 podman[65154]: 2024-09-10 10:34:23.354931614 +0000 UTC m=+0.399662160 container start bb73635fbcac5fc7e43d688f291b31b99df8a9955704634289ac8055f2d7c0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T10:34:23.461 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:34:23 smithi097 ceph-mds[65173]: -- 172.21.15.97:0/1831651968 <== mon.2 v2:172.21.15.97:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a11c791860 con 0x55a11c76f000 2024-09-10T10:34:23.461 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:34:23 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h[65169]: starting mds.h at 2024-09-10T10:34:23.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:23 smithi121 ceph-mon[35231]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:23.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:23 smithi092 ceph-mon[30834]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:23.820 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:34:23 smithi097 bash[65154]: bb73635fbcac5fc7e43d688f291b31b99df8a9955704634289ac8055f2d7c0d2 2024-09-10T10:34:23.820 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:34:23 smithi097 systemd[1]: Started Ceph mds.h for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:24.065 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:24.357 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:24.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:24.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:24.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:24.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:24.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:24.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:24.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: Deploying daemon mds.i on smithi121 2024-09-10T10:34:24.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:24.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6836/4081108899,v1:172.21.15.97:6837/4081108899] up:boot 2024-09-10T10:34:24.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: fsmap 8 up:standby 2024-09-10T10:34:24.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:24 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: Deploying daemon mds.i on smithi121 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6836/4081108899,v1:172.21.15.97:6837/4081108899] up:boot 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: fsmap 8 up:standby 2024-09-10T10:34:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:24 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: Deploying daemon mds.i on smithi121 2024-09-10T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6836/4081108899,v1:172.21.15.97:6837/4081108899] up:boot 2024-09-10T10:34:24.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: fsmap 8 up:standby 2024-09-10T10:34:24.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:24 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:34:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.859+0000 7fc35c307640 1 -- 172.21.15.92:0/1264532319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354101de0 msgr2=0x7fc3541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.859+0000 7fc35c307640 1 --2- 172.21.15.92:0/1264532319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354101de0 0x7fc3541021c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc350009900 tx=0x7fc35002a410 comp rx=0 tx=0).stop 2024-09-10T10:34:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.859+0000 7fc35c307640 1 -- 172.21.15.92:0/1264532319 shutdown_connections 2024-09-10T10:34:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.859+0000 7fc35c307640 1 --2- 172.21.15.92:0/1264532319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc354106f10 0x7fc35410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.859+0000 7fc35c307640 1 --2- 172.21.15.92:0/1264532319 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc354102790 0x7fc3541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.859+0000 7fc35c307640 1 --2- 172.21.15.92:0/1264532319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354101de0 0x7fc3541021c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:24.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.859+0000 7fc35c307640 1 -- 172.21.15.92:0/1264532319 >> 172.21.15.92:0/1264532319 conn(0x7fc3540fd8c0 msgr2=0x7fc3540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.859+0000 7fc35c307640 1 -- 172.21.15.92:0/1264532319 shutdown_connections 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.859+0000 7fc35c307640 1 -- 172.21.15.92:0/1264532319 wait complete. 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35c307640 1 Processor -- start 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35c307640 1 -- start start 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35c307640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc354101de0 0x7fc3540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35c307640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc354102790 0x7fc354074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35c307640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354106f10 0x7fc354074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35c307640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc354111f70 con 0x7fc354106f10 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35c307640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc354111df0 con 0x7fc354101de0 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35c307640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3541120f0 con 0x7fc354102790 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35a8a4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354106f10 0x7fc354074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:24.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35a8a4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354106f10 0x7fc354074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58778/0 (socket says 172.21.15.92:58778) 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35a8a4640 1 -- 172.21.15.92:0/3796695941 learned_addr learned my addr 172.21.15.92:0/3796695941 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc3598a2640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc354102790 0x7fc354074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35a0a3640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc354101de0 0x7fc3540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35a8a4640 1 -- 172.21.15.92:0/3796695941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc354102790 msgr2=0x7fc354074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35a8a4640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc354102790 0x7fc354074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35a8a4640 1 -- 172.21.15.92:0/3796695941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc354101de0 msgr2=0x7fc3540744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35a8a4640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc354101de0 0x7fc3540744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.860+0000 7fc35a8a4640 1 -- 172.21.15.92:0/3796695941 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3541a6830 con 0x7fc354106f10 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.861+0000 7fc35a8a4640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354106f10 0x7fc354074f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00eb10 tx=0x7fc34c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.861+0000 7fc34b7fe640 1 -- 172.21.15.92:0/3796695941 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00ce20 con 0x7fc354106f10 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.861+0000 7fc34b7fe640 1 -- 172.21.15.92:0/3796695941 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc34c005020 con 0x7fc354106f10 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.861+0000 7fc34b7fe640 1 -- 172.21.15.92:0/3796695941 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c010690 con 0x7fc354106f10 2024-09-10T10:34:24.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.861+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3541a6b20 con 0x7fc354106f10 2024-09-10T10:34:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.861+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3541a7060 con 0x7fc354106f10 2024-09-10T10:34:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.862+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3541021c0 con 0x7fc354106f10 2024-09-10T10:34:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.863+0000 7fc34b7fe640 1 -- 172.21.15.92:0/3796695941 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc34c005540 con 0x7fc354106f10 2024-09-10T10:34:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.864+0000 7fc34b7fe640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc3400a2b80 0x7fc3400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.864+0000 7fc35a0a3640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc3400a2b80 0x7fc3400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.864+0000 7fc34b7fe640 1 -- 172.21.15.92:0/3796695941 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc34c0cf250 con 0x7fc354106f10 2024-09-10T10:34:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.864+0000 7fc35a0a3640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc3400a2b80 0x7fc3400a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc350005ab0 tx=0x7fc350005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:24.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:24.868+0000 7fc34b7fe640 1 -- 172.21.15.92:0/3796695941 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc34c09c650 con 0x7fc354106f10 2024-09-10T10:34:25.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.068+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc35410a0f0 con 0x7fc354106f10 2024-09-10T10:34:25.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.069+0000 7fc34b7fe640 1 -- 172.21.15.92:0/3796695941 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7fc34c09bf50 con 0x7fc354106f10 2024-09-10T10:34:25.071 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:25.071 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":9,"btime":"2024-09-10T10:34:24:170065+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24359,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24386,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24407,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T10:34:25.071 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 9 2024-09-10T10:34:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc3400a2b80 msgr2=0x7fc3400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc3400a2b80 0x7fc3400a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc350005ab0 tx=0x7fc350005a20 comp rx=0 tx=0).stop 2024-09-10T10:34:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354106f10 msgr2=0x7fc354074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354106f10 0x7fc354074f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00eb10 tx=0x7fc34c00ef10 comp rx=0 tx=0).stop 2024-09-10T10:34:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 shutdown_connections 2024-09-10T10:34:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc3400a2b80 0x7fc3400a5040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc354106f10 0x7fc354074f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc354102790 0x7fc354074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 --2- 172.21.15.92:0/3796695941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc354101de0 0x7fc3540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:25.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.071+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 >> 172.21.15.92:0/3796695941 conn(0x7fc3540fd8c0 msgr2=0x7fc3540fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:25.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.072+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 shutdown_connections 2024-09-10T10:34:25.074 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:25.072+0000 7fc35c307640 1 -- 172.21.15.92:0/3796695941 wait complete. 2024-09-10T10:34:25.763 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:25 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3796695941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:25.764 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:25 smithi121 systemd[1]: Starting Ceph mds.i for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:25.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:25 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3796695941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:25.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:25 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3796695941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:26.030 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:25 smithi121 podman[65892]: 2024-09-10 10:34:25.666291296 +0000 UTC m=+0.015926000 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:26.030 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:25 smithi121 podman[65892]: 2024-09-10 10:34:25.782716857 +0000 UTC m=+0.132351594 container create 2f90512ba3ddf77125029bed87fd50f657b553c27c9fb9f9162815ac91d9b5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T10:34:26.030 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:26 smithi121 podman[65892]: 2024-09-10 10:34:26.029225718 +0000 UTC m=+0.378860412 container init 2f90512ba3ddf77125029bed87fd50f657b553c27c9fb9f9162815ac91d9b5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T10:34:26.291 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:26 smithi121 podman[65892]: 2024-09-10 10:34:26.032309266 +0000 UTC m=+0.381943960 container start 2f90512ba3ddf77125029bed87fd50f657b553c27c9fb9f9162815ac91d9b5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:34:26.291 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:26 smithi121 ceph-mds[65911]: -- 172.21.15.121:0/458009352 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4434ed860 con 0x55e4434cb400 2024-09-10T10:34:26.291 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:26 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: starting mds.i at 2024-09-10T10:34:26.291 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:26 smithi121 bash[65892]: 2f90512ba3ddf77125029bed87fd50f657b553c27c9fb9f9162815ac91d9b5cc 2024-09-10T10:34:26.291 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:26 smithi121 systemd[1]: Started Ceph mds.i for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:27.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:27.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:27.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:27.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:27.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:27.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:27.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:27.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: Deploying daemon mds.g on smithi092 2024-09-10T10:34:27.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] up:boot 2024-09-10T10:34:27.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: fsmap 9 up:standby 2024-09-10T10:34:27.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:27 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:34:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: Deploying daemon mds.g on smithi092 2024-09-10T10:34:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] up:boot 2024-09-10T10:34:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: fsmap 9 up:standby 2024-09-10T10:34:27.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:27 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:34:27.579 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:27.579 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:27.579 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:27.579 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:27.579 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:27.580 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:27.580 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:27.580 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: Deploying daemon mds.g on smithi092 2024-09-10T10:34:27.580 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] up:boot 2024-09-10T10:34:27.580 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: fsmap 9 up:standby 2024-09-10T10:34:27.581 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:27 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:34:27.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:28.104 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:28.110 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:34:28 smithi092 systemd[1]: Starting Ceph mds.g for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.579+0000 7f621bc28640 1 -- 172.21.15.92:0/887259601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214100a80 msgr2=0x7f6214100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.579+0000 7f621bc28640 1 --2- 172.21.15.92:0/887259601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214100a80 0x7f6214100ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6208009930 tx=0x7f620802a420 comp rx=0 tx=0).stop 2024-09-10T10:34:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.579+0000 7f621bc28640 1 -- 172.21.15.92:0/887259601 shutdown_connections 2024-09-10T10:34:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.579+0000 7f621bc28640 1 --2- 172.21.15.92:0/887259601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6214101420 0x7f621410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.579+0000 7f621bc28640 1 --2- 172.21.15.92:0/887259601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214100a80 0x7f6214100ee0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.579+0000 7f621bc28640 1 --2- 172.21.15.92:0/887259601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6214106a80 0x7f6214106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.579+0000 7f621bc28640 1 -- 172.21.15.92:0/887259601 >> 172.21.15.92:0/887259601 conn(0x7f62140fc7a0 msgr2=0x7f62140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.579+0000 7f621bc28640 1 -- 172.21.15.92:0/887259601 shutdown_connections 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.579+0000 7f621bc28640 1 -- 172.21.15.92:0/887259601 wait complete. 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621bc28640 1 Processor -- start 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621bc28640 1 -- start start 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621bc28640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6214100a80 0x7f62141984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621bc28640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6214101420 0x7f62141989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621bc28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214106a80 0x7f621419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621bc28640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6214110ec0 con 0x7f6214106a80 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621bc28640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6214110d40 con 0x7f6214101420 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621bc28640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6214111040 con 0x7f6214100a80 2024-09-10T10:34:28.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621a1c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214106a80 0x7f621419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621a1c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214106a80 0x7f621419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58800/0 (socket says 172.21.15.92:58800) 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621a1c5640 1 -- 172.21.15.92:0/323431861 learned_addr learned my addr 172.21.15.92:0/323431861 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f62199c4640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6214100a80 0x7f62141984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f62191c3640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6214101420 0x7f62141989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621a1c5640 1 -- 172.21.15.92:0/323431861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6214100a80 msgr2=0x7f62141984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621a1c5640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6214100a80 0x7f62141984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621a1c5640 1 -- 172.21.15.92:0/323431861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6214101420 msgr2=0x7f62141989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621a1c5640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6214101420 0x7f62141989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621a1c5640 1 -- 172.21.15.92:0/323431861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621419d450 con 0x7f6214106a80 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.580+0000 7f621a1c5640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214106a80 0x7f621419cd70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f620c00cad0 tx=0x7f620c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.581+0000 7f6206ffd640 1 -- 172.21.15.92:0/323431861 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c00ad60 con 0x7f6214106a80 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.581+0000 7f6206ffd640 1 -- 172.21.15.92:0/323431861 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f620c005020 con 0x7f6214106a80 2024-09-10T10:34:28.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.581+0000 7f6206ffd640 1 -- 172.21.15.92:0/323431861 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c00f6b0 con 0x7f6214106a80 2024-09-10T10:34:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.581+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621419d740 con 0x7f6214106a80 2024-09-10T10:34:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.581+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62141a5020 con 0x7f6214106a80 2024-09-10T10:34:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.582+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6214100ee0 con 0x7f6214106a80 2024-09-10T10:34:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.583+0000 7f6206ffd640 1 -- 172.21.15.92:0/323431861 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f620c005560 con 0x7f6214106a80 2024-09-10T10:34:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.584+0000 7f6206ffd640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62000a2b80 0x7f62000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.584+0000 7f62199c4640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62000a2b80 0x7f62000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.584+0000 7f6206ffd640 1 -- 172.21.15.92:0/323431861 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f620c0cebe0 con 0x7f6214106a80 2024-09-10T10:34:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.584+0000 7f62199c4640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62000a2b80 0x7f62000a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6210009990 tx=0x7f6210009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:28.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.588+0000 7f6206ffd640 1 -- 172.21.15.92:0/323431861 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f620c014030 con 0x7f6214106a80 2024-09-10T10:34:28.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.803+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f621402d7c0 con 0x7f6214106a80 2024-09-10T10:34:28.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.803+0000 7f6206ffd640 1 -- 172.21.15.92:0/323431861 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8037 (secure 0 0 0) 0x7f620c09bfe0 con 0x7f6214106a80 2024-09-10T10:34:28.805 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:28.805 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":10,"btime":"2024-09-10T10:34:26:531634+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24359,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24386,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24407,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T10:34:28.805 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 10 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62000a2b80 msgr2=0x7f62000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62000a2b80 0x7f62000a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6210009990 tx=0x7f6210009110 comp rx=0 tx=0).stop 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214106a80 msgr2=0x7f621419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214106a80 0x7f621419cd70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f620c00cad0 tx=0x7f620c00ced0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 shutdown_connections 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62000a2b80 0x7f62000a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6214106a80 0x7f621419cd70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6214101420 0x7f62141989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 --2- 172.21.15.92:0/323431861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6214100a80 0x7f62141984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 >> 172.21.15.92:0/323431861 conn(0x7f62140fc7a0 msgr2=0x7f621406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:28.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 shutdown_connections 2024-09-10T10:34:28.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:28.805+0000 7f621bc28640 1 -- 172.21.15.92:0/323431861 wait complete. 2024-09-10T10:34:29.110 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:34:28 smithi092 podman[71327]: 2024-09-10 10:34:28.667758942 +0000 UTC m=+0.019777545 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:29.111 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:34:28 smithi092 podman[71327]: 2024-09-10 10:34:28.793551554 +0000 UTC m=+0.145570146 container create edd545cebd5cfe529e9e619e2b058e69082d6017ddb056acb7a0a23224bbc8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T10:34:29.525 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:29 smithi092 ceph-mon[30834]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:29.525 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:29 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/323431861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:29.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:29 smithi121 ceph-mon[35231]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:29.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:29 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/323431861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:29 smithi097 ceph-mon[35213]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:29 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/323431861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:29.860 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:34:29 smithi092 podman[71327]: 2024-09-10 10:34:29.667736754 +0000 UTC m=+1.019755353 container init edd545cebd5cfe529e9e619e2b058e69082d6017ddb056acb7a0a23224bbc8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T10:34:30.372 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:34:29 smithi092 podman[71327]: 2024-09-10 10:34:29.670988523 +0000 UTC m=+1.023007119 container start edd545cebd5cfe529e9e619e2b058e69082d6017ddb056acb7a0a23224bbc8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T10:34:30.372 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:34:29 smithi092 ceph-mds[71364]: -- 172.21.15.92:0/1331775867 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e365d5860 con 0x562e365b3400 2024-09-10T10:34:30.372 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:34:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g[71356]: starting mds.g at 2024-09-10T10:34:30.372 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:34:29 smithi092 bash[71327]: edd545cebd5cfe529e9e619e2b058e69082d6017ddb056acb7a0a23224bbc8be 2024-09-10T10:34:30.372 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:34:29 smithi092 systemd[1]: Started Ceph mds.g for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:31.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:31.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:31.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:31.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:31.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:31.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:31.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: Deploying daemon mds.a on smithi092 2024-09-10T10:34:31.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:31.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.92:6838/1641635662,v1:172.21.15.92:6839/1641635662] up:boot 2024-09-10T10:34:31.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: fsmap 10 up:standby 2024-09-10T10:34:31.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:30 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:34:31.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: Deploying daemon mds.a on smithi092 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.92:6838/1641635662,v1:172.21.15.92:6839/1641635662] up:boot 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: fsmap 10 up:standby 2024-09-10T10:34:31.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:30 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: Deploying daemon mds.a on smithi092 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.92:6838/1641635662,v1:172.21.15.92:6839/1641635662] up:boot 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: fsmap 10 up:standby 2024-09-10T10:34:31.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:30 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:34:31.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:31.860 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:34:31 smithi092 systemd[1]: Starting Ceph mds.a for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:34:32.215 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:34:31 smithi092 podman[71669]: 2024-09-10 10:34:31.847082415 +0000 UTC m=+0.016019887 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:34:32.215 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:34:31 smithi092 podman[71669]: 2024-09-10 10:34:31.978956476 +0000 UTC m=+0.147893992 container create 10ee7b374e51defb2789af80d3b36272914dca7f7609824d9f21afd8bc369f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T10:34:32.216 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:34:32 smithi092 podman[71669]: 2024-09-10 10:34:32.214927611 +0000 UTC m=+0.383865087 container init 10ee7b374e51defb2789af80d3b36272914dca7f7609824d9f21afd8bc369f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:34:32.363 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:32.485 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:34:32 smithi092 podman[71669]: 2024-09-10 10:34:32.21827751 +0000 UTC m=+0.387214982 container start 10ee7b374e51defb2789af80d3b36272914dca7f7609824d9f21afd8bc369f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T10:34:32.485 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:34:32 smithi092 ceph-mds[71712]: -- 172.21.15.92:0/566889940 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e18a351860 con 0x55e18a32e800 2024-09-10T10:34:32.485 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:34:32 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a[71696]: starting mds.a at 2024-09-10T10:34:32.485 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:34:32 smithi092 bash[71669]: 10ee7b374e51defb2789af80d3b36272914dca7f7609824d9f21afd8bc369f6f 2024-09-10T10:34:32.485 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:34:32 smithi092 systemd[1]: Started Ceph mds.a for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:32.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/2844040265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8106f20 msgr2=0x7ff3f810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:32.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/2844040265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8106f20 0x7ff3f810eaa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009ca0 tx=0x7ff3f002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:34:32.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/2844040265 shutdown_connections 2024-09-10T10:34:32.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/2844040265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8106f20 0x7ff3f810eaa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:32.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/2844040265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3f81027a0 0x7ff3f81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:32.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/2844040265 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f8101df0 0x7ff3f81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:32.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/2844040265 >> 172.21.15.92:0/2844040265 conn(0x7ff3f80fd8b0 msgr2=0x7ff3f80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:32.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/2844040265 shutdown_connections 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/2844040265 wait complete. 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 Processor -- start 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.859+0000 7ff3ffa5e640 1 -- start start 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3ffa5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8101df0 0x7ff3f81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3ffa5e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3f81027a0 0x7ff3f8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3ffa5e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f8106f20 0x7ff3f819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3ffa5e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8111fa0 con 0x7ff3f8101df0 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3ffa5e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8111e20 con 0x7ff3f8106f20 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3ffa5e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8112120 con 0x7ff3f81027a0 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fd7fa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8101df0 0x7ff3f81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fd7fa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8101df0 0x7ff3f81984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51910/0 (socket says 172.21.15.92:51910) 2024-09-10T10:34:32.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fd7fa640 1 -- 172.21.15.92:0/175052361 learned_addr learned my addr 172.21.15.92:0/175052361 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fdffb640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f8106f20 0x7ff3f819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fcff9640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3f81027a0 0x7ff3f8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fd7fa640 1 -- 172.21.15.92:0/175052361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3f81027a0 msgr2=0x7ff3f8198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fd7fa640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3f81027a0 0x7ff3f8198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fd7fa640 1 -- 172.21.15.92:0/175052361 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f8106f20 msgr2=0x7ff3f819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fd7fa640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f8106f20 0x7ff3f819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fd7fa640 1 -- 172.21.15.92:0/175052361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f819d490 con 0x7ff3f8101df0 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fdffb640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f8106f20 0x7ff3f819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3fd7fa640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8101df0 0x7ff3f81984e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800c890 tx=0x7ff3e800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3f67fc640 1 -- 172.21.15.92:0/175052361 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8004220 con 0x7ff3f8101df0 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3f67fc640 1 -- 172.21.15.92:0/175052361 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3e80043c0 con 0x7ff3f8101df0 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f819d780 con 0x7ff3f8101df0 2024-09-10T10:34:32.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3f67fc640 1 -- 172.21.15.92:0/175052361 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80049e0 con 0x7ff3f8101df0 2024-09-10T10:34:32.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.860+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f81a5060 con 0x7ff3f8101df0 2024-09-10T10:34:32.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.861+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f81021d0 con 0x7ff3f8101df0 2024-09-10T10:34:32.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.863+0000 7ff3f67fc640 1 -- 172.21.15.92:0/175052361 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff3e80079b0 con 0x7ff3f8101df0 2024-09-10T10:34:32.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.863+0000 7ff3f67fc640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff3e40a2c00 0x7ff3e40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:32.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.863+0000 7ff3fcff9640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff3e40a2c00 0x7ff3e40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:32.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.863+0000 7ff3f67fc640 1 -- 172.21.15.92:0/175052361 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff3e80cee10 con 0x7ff3f8101df0 2024-09-10T10:34:32.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.864+0000 7ff3fcff9640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff3e40a2c00 0x7ff3e40a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80fdcf0 tx=0x7ff3e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:32.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:32.866+0000 7ff3f67fc640 1 -- 172.21.15.92:0/175052361 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3e8014030 con 0x7ff3f8101df0 2024-09-10T10:34:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.068+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3f8199840 con 0x7ff3f8101df0 2024-09-10T10:34:33.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.069+0000 7ff3f67fc640 1 -- 172.21.15.92:0/175052361 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8863 (secure 0 0 0) 0x7ff3f8199840 con 0x7ff3f8101df0 2024-09-10T10:34:33.070 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:33.070 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":11,"btime":"2024-09-10T10:34:30:172668+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24359,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24386,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24407,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T10:34:33.070 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 11 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff3e40a2c00 msgr2=0x7ff3e40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff3e40a2c00 0x7ff3e40a50c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80fdcf0 tx=0x7ff3e0008040 comp rx=0 tx=0).stop 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8101df0 msgr2=0x7ff3f81984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8101df0 0x7ff3f81984e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800c890 tx=0x7ff3e800cd50 comp rx=0 tx=0).stop 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 shutdown_connections 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff3e40a2c00 0x7ff3e40a50c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3f8106f20 0x7ff3f819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3f81027a0 0x7ff3f8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 --2- 172.21.15.92:0/175052361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3f8101df0 0x7ff3f81984e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 >> 172.21.15.92:0/175052361 conn(0x7ff3f80fd8b0 msgr2=0x7ff3f80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 shutdown_connections 2024-09-10T10:34:33.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:33.071+0000 7ff3ffa5e640 1 -- 172.21.15.92:0/175052361 wait complete. 2024-09-10T10:34:33.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:33 smithi092 ceph-mon[30834]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:33.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:33.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:33.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:33.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:33.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:33.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:33 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:33.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:33 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/175052361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:33 smithi121 ceph-mon[35231]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:33 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:33.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:33 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/175052361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:33 smithi097 ceph-mon[35213]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T10:34:33.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T10:34:33.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:33 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:33.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:33 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/175052361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:34.449 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:34 smithi097 ceph-mon[35213]: Deploying daemon mds.b on smithi097 2024-09-10T10:34:34.450 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:34 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.92:6840/15499972,v1:172.21.15.92:6841/15499972] up:boot 2024-09-10T10:34:34.450 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:34 smithi097 ceph-mon[35213]: fsmap 11 up:standby 2024-09-10T10:34:34.450 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:34 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:34:34.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:34 smithi121 ceph-mon[35231]: Deploying daemon mds.b on smithi097 2024-09-10T10:34:34.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:34 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.92:6840/15499972,v1:172.21.15.92:6841/15499972] up:boot 2024-09-10T10:34:34.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:34 smithi121 ceph-mon[35231]: fsmap 11 up:standby 2024-09-10T10:34:34.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:34 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:34:34.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:34 smithi092 ceph-mon[30834]: Deploying daemon mds.b on smithi097 2024-09-10T10:34:34.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:34 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.92:6840/15499972,v1:172.21.15.92:6841/15499972] up:boot 2024-09-10T10:34:34.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:34 smithi092 ceph-mon[30834]: fsmap 11 up:standby 2024-09-10T10:34:34.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:34 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:34:35.049 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:34:34 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-b[65470]: starting mds.b at 2024-09-10T10:34:35.050 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:34:35 smithi097 bash[65455]: 3ffb6fb77e350ecf03d49489402e4be0c5af84b90122a8bb2e1873293058a9aa 2024-09-10T10:34:35.320 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:34:35 smithi097 systemd[1]: Started Ceph mds.b for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:34:35.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:35 smithi097 ceph-mon[35213]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:35.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:35 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:35 smithi121 ceph-mon[35231]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:35 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:35 smithi092 ceph-mon[30834]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:35 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:35.796 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:34:36.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:36 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] up:boot 2024-09-10T10:34:36.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:36 smithi092 ceph-mon[30834]: fsmap 12 up:standby 2024-09-10T10:34:36.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:34:36.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:36 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:34:36.389 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:36.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:36 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] up:boot 2024-09-10T10:34:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:36 smithi121 ceph-mon[35231]: fsmap 12 up:standby 2024-09-10T10:34:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:34:36.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:36 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:34:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:36 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] up:boot 2024-09-10T10:34:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:36 smithi097 ceph-mon[35213]: fsmap 12 up:standby 2024-09-10T10:34:36.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:34:36.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:36 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:34:36.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 -- 172.21.15.92:0/2264821312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 msgr2=0x7f07e4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/2264821312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 0x7f07e4101200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009900 tx=0x7f07d402a480 comp rx=0 tx=0).stop 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 -- 172.21.15.92:0/2264821312 shutdown_connections 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/2264821312 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07e4102ef0 0x7f07e410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/2264821312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07e4102570 0x7f07e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/2264821312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 0x7f07e4101200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 -- 172.21.15.92:0/2264821312 >> 172.21.15.92:0/2264821312 conn(0x7f07e40fc7d0 msgr2=0x7f07e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 -- 172.21.15.92:0/2264821312 shutdown_connections 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 -- 172.21.15.92:0/2264821312 wait complete. 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.853+0000 7f07ea8c6640 1 Processor -- start 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07ea8c6640 1 -- start start 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07ea8c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 0x7f07e40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:36.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07ea8c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07e4102570 0x7f07e40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07ea8c6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07e4102ef0 0x7f07e40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07ea8c6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f07e4110ff0 con 0x7f07e4100e20 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07ea8c6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f07e4110e70 con 0x7f07e4102570 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07ea8c6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f07e4111170 con 0x7f07e4102ef0 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 0x7f07e40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 0x7f07e40fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51928/0 (socket says 172.21.15.92:51928) 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e3fff640 1 -- 172.21.15.92:0/1926451569 learned_addr learned my addr 172.21.15.92:0/1926451569 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e8e63640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07e4102ef0 0x7f07e40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e37fe640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07e4102570 0x7f07e40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e3fff640 1 -- 172.21.15.92:0/1926451569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07e4102ef0 msgr2=0x7f07e40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e3fff640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07e4102ef0 0x7f07e40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:36.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e3fff640 1 -- 172.21.15.92:0/1926451569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07e4102570 msgr2=0x7f07e40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e3fff640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07e4102570 0x7f07e40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.854+0000 7f07e3fff640 1 -- 172.21.15.92:0/1926451569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e41a69e0 con 0x7f07e4100e20 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.855+0000 7f07e3fff640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 0x7f07e40fcc80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f07d402aa70 tx=0x7f07d4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.855+0000 7f07e17fa640 1 -- 172.21.15.92:0/1926451569 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d403f070 con 0x7f07e4100e20 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.855+0000 7f07e17fa640 1 -- 172.21.15.92:0/1926451569 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07d4031c30 con 0x7f07e4100e20 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.855+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e41a6c70 con 0x7f07e4100e20 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.855+0000 7f07e17fa640 1 -- 172.21.15.92:0/1926451569 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4035030 con 0x7f07e4100e20 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.855+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e41a7150 con 0x7f07e4100e20 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.856+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e4101200 con 0x7f07e4100e20 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.858+0000 7f07e17fa640 1 -- 172.21.15.92:0/1926451569 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f07d4042070 con 0x7f07e4100e20 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.858+0000 7f07e17fa640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f07cc0a2cd0 0x7f07cc0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.858+0000 7f07e37fe640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f07cc0a2cd0 0x7f07cc0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:36.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.858+0000 7f07e17fa640 1 -- 172.21.15.92:0/1926451569 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f07d40ef800 con 0x7f07e4100e20 2024-09-10T10:34:36.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.859+0000 7f07e37fe640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f07cc0a2cd0 0x7f07cc0a5190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07e40fe710 tx=0x7f07d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:36.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:36.862+0000 7f07e17fa640 1 -- 172.21.15.92:0/1926451569 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07d4031de0 con 0x7f07e4100e20 2024-09-10T10:34:37.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.085+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07e410a0a0 con 0x7f07e4100e20 2024-09-10T10:34:37.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.085+0000 7f07e17fa640 1 -- 172.21.15.92:0/1926451569 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10509 (secure 0 0 0) 0x7f07d40bc590 con 0x7f07e4100e20 2024-09-10T10:34:37.087 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:37.087 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":13,"btime":"2024-09-10T10:34:35:188187+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14619,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/15499972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":15499972},{"type":"v1","addr":"172.21.15.92:6841","nonce":15499972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24359,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24386,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24407,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.97:6839/2331166625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6838","nonce":2331166625},{"type":"v1","addr":"172.21.15.97:6839","nonce":2331166625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T10:34:37.087 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 13 2024-09-10T10:34:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.087+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f07cc0a2cd0 msgr2=0x7f07cc0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.087+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f07cc0a2cd0 0x7f07cc0a5190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07e40fe710 tx=0x7f07d8005f90 comp rx=0 tx=0).stop 2024-09-10T10:34:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.087+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 msgr2=0x7f07e40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.087+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 0x7f07e40fcc80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f07d402aa70 tx=0x7f07d4003c10 comp rx=0 tx=0).stop 2024-09-10T10:34:37.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.088+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 shutdown_connections 2024-09-10T10:34:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.088+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f07cc0a2cd0 0x7f07cc0a5190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.088+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f07e4102ef0 0x7f07e40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.088+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f07e4102570 0x7f07e40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.088+0000 7f07ea8c6640 1 --2- 172.21.15.92:0/1926451569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07e4100e20 0x7f07e40fcc80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.088+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 >> 172.21.15.92:0/1926451569 conn(0x7f07e40fc7d0 msgr2=0x7f07e406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.088+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 shutdown_connections 2024-09-10T10:34:37.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:37.088+0000 7f07ea8c6640 1 -- 172.21.15.92:0/1926451569 wait complete. 2024-09-10T10:34:37.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:37 smithi092 ceph-mon[30834]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:37.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:37 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:37 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1926451569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:37 smithi121 ceph-mon[35231]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:37 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:37 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1926451569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:37 smithi097 ceph-mon[35213]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:37 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:37 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1926451569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:34:37.714 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T10:34:37.975 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 -- 172.21.15.92:0/2951780854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 msgr2=0x7f1cf01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2951780854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 0x7f1cf01021c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009900 tx=0x7f1ce002a410 comp rx=0 tx=0).stop 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 -- 172.21.15.92:0/2951780854 shutdown_connections 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2951780854 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cf0106f10 0x7f1cf010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2951780854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf0102790 0x7f1cf01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2951780854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 0x7f1cf01021c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 -- 172.21.15.92:0/2951780854 >> 172.21.15.92:0/2951780854 conn(0x7f1cf00fd8c0 msgr2=0x7f1cf00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 -- 172.21.15.92:0/2951780854 shutdown_connections 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 -- 172.21.15.92:0/2951780854 wait complete. 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 Processor -- start 2024-09-10T10:34:38.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.452+0000 7f1cf72da640 1 -- start start 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf72da640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 0x7f1cf00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf72da640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf0102790 0x7f1cf0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf72da640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cf0106f10 0x7f1cf0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf72da640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0112010 con 0x7f1cf0101de0 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf72da640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0111e90 con 0x7f1cf0106f10 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf72da640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0112190 con 0x7f1cf0102790 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5076640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 0x7f1cf00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5076640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 0x7f1cf00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51950/0 (socket says 172.21.15.92:51950) 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5076640 1 -- 172.21.15.92:0/2080878097 learned_addr learned my addr 172.21.15.92:0/2080878097 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf4875640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf0102790 0x7f1cf0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5877640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cf0106f10 0x7f1cf0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5076640 1 -- 172.21.15.92:0/2080878097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf0102790 msgr2=0x7f1cf0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:38.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5076640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf0102790 0x7f1cf0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5076640 1 -- 172.21.15.92:0/2080878097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cf0106f10 msgr2=0x7f1cf0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5076640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cf0106f10 0x7f1cf0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5076640 1 -- 172.21.15.92:0/2080878097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf01a6a70 con 0x7f1cf0101de0 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5877640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cf0106f10 0x7f1cf0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf4875640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf0102790 0x7f1cf0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf5076640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 0x7f1cf00744f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005ab0 tx=0x7f1ce00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1ce67fc640 1 -- 172.21.15.92:0/2080878097 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce003f030 con 0x7f1cf0101de0 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.453+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf01a6d00 con 0x7f1cf0101de0 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.454+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf01a71d0 con 0x7f1cf0101de0 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.454+0000 7f1ce67fc640 1 -- 172.21.15.92:0/2080878097 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ce0003ce0 con 0x7f1cf0101de0 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.454+0000 7f1ce67fc640 1 -- 172.21.15.92:0/2080878097 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0049060 con 0x7f1cf0101de0 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.454+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd4005290 con 0x7f1cf0101de0 2024-09-10T10:34:38.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.456+0000 7f1ce67fc640 1 -- 172.21.15.92:0/2080878097 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1ce0042030 con 0x7f1cf0101de0 2024-09-10T10:34:38.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.456+0000 7f1ce67fc640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1cdc0a2b80 0x7f1cdc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:38.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.456+0000 7f1ce67fc640 1 -- 172.21.15.92:0/2080878097 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f1ce00ef090 con 0x7f1cf0101de0 2024-09-10T10:34:38.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.456+0000 7f1cf4875640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1cdc0a2b80 0x7f1cdc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:38.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.457+0000 7f1cf4875640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1cdc0a2b80 0x7f1cdc0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1cec006fd0 tx=0x7f1cec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:38.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.459+0000 7f1ce67fc640 1 -- 172.21.15.92:0/2080878097 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ce00bc490 con 0x7f1cf0101de0 2024-09-10T10:34:38.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.639+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1cd4005850 con 0x7f1cf0101de0 2024-09-10T10:34:38.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.640+0000 7f1ce67fc640 1 -- 172.21.15.92:0/2080878097 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f1ce00bbd90 con 0x7f1cf0101de0 2024-09-10T10:34:38.641 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:38.641 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2024-09-10T10:34:38.642 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:34:38.642 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2024-09-10T10:34:38.642 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": ".mgr" 2024-09-10T10:34:38.642 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:34:38.642 INFO:teuthology.orchestra.run.smithi092.stdout:] 2024-09-10T10:34:38.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1cdc0a2b80 msgr2=0x7f1cdc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1cdc0a2b80 0x7f1cdc0a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1cec006fd0 tx=0x7f1cec008040 comp rx=0 tx=0).stop 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 msgr2=0x7f1cf00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 0x7f1cf00744f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005ab0 tx=0x7f1ce00042f0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 shutdown_connections 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1cdc0a2b80 0x7f1cdc0a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1cf0106f10 0x7f1cf0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1cf0102790 0x7f1cf0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 --2- 172.21.15.92:0/2080878097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cf0101de0 0x7f1cf00744f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 >> 172.21.15.92:0/2080878097 conn(0x7f1cf00fd8c0 msgr2=0x7f1cf00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 shutdown_connections 2024-09-10T10:34:38.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:38.642+0000 7f1cf72da640 1 -- 172.21.15.92:0/2080878097 wait complete. 2024-09-10T10:34:38.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:38 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:38.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:38 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:38.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:38 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:38.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:38 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:34:38.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:38 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:38.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:38 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:34:38.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:38 smithi092 ceph-mon[30834]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:38.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:38 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2080878097' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T10:34:39.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:38 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:39.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:38 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:39.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:38 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:39.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:38 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:34:39.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:38 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:39.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:38 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:34:39.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:38 smithi097 ceph-mon[35213]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:39.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:38 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2080878097' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T10:34:39.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:38 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:39.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:38 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:39.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:38 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:39.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:38 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:34:39.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:38 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:39.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:38 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:34:39.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:38 smithi121 ceph-mon[35231]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:39.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:38 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2080878097' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T10:34:39.894 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T10:34:39.895 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T10:34:40.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:40 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:40 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:40 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:40 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:40 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.174 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:40.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:40 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:40 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:40 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:40 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:40 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:40 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:40 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:40 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:40 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:40 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:40.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.629+0000 7f01edf02640 1 -- 172.21.15.92:0/2624320315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101ba0 msgr2=0x7f01e810d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.629+0000 7f01edf02640 1 --2- 172.21.15.92:0/2624320315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101ba0 0x7f01e810d8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009ca0 tx=0x7f01e002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.629+0000 7f01edf02640 1 -- 172.21.15.92:0/2624320315 shutdown_connections 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.629+0000 7f01edf02640 1 --2- 172.21.15.92:0/2624320315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101ba0 0x7f01e810d8f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.629+0000 7f01edf02640 1 --2- 172.21.15.92:0/2624320315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01e8101220 0x7f01e8101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.629+0000 7f01edf02640 1 --2- 172.21.15.92:0/2624320315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e8105a70 0x7f01e8105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.629+0000 7f01edf02640 1 -- 172.21.15.92:0/2624320315 >> 172.21.15.92:0/2624320315 conn(0x7f01e80fbee0 msgr2=0x7f01e80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.629+0000 7f01edf02640 1 -- 172.21.15.92:0/2624320315 shutdown_connections 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.629+0000 7f01edf02640 1 -- 172.21.15.92:0/2624320315 wait complete. 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01edf02640 1 Processor -- start 2024-09-10T10:34:40.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01edf02640 1 -- start start 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01edf02640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101220 0x7f01e8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01edf02640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e8101ba0 0x7f01e8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01edf02640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01e8105a70 0x7f01e819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01edf02640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01e8110f90 con 0x7f01e8101220 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01edf02640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f01e8110e10 con 0x7f01e8105a70 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01edf02640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01e8111110 con 0x7f01e8101ba0 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101220 0x7f01e8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101220 0x7f01e8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51968/0 (socket says 172.21.15.92:51968) 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e77fe640 1 -- 172.21.15.92:0/724528976 learned_addr learned my addr 172.21.15.92:0/724528976 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:40.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e7fff640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01e8105a70 0x7f01e819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e77fe640 1 -- 172.21.15.92:0/724528976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e8101ba0 msgr2=0x7f01e8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e6ffd640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e8101ba0 0x7f01e8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e77fe640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e8101ba0 0x7f01e8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e77fe640 1 -- 172.21.15.92:0/724528976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01e8105a70 msgr2=0x7f01e819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e77fe640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01e8105a70 0x7f01e819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e77fe640 1 -- 172.21.15.92:0/724528976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e819d400 con 0x7f01e8101220 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e7fff640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01e8105a70 0x7f01e819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.630+0000 7f01e6ffd640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e8101ba0 0x7f01e8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.631+0000 7f01e77fe640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101220 0x7f01e8198450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f01d800b4a0 tx=0x7f01d800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:40.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.631+0000 7f01e4ff9640 1 -- 172.21.15.92:0/724528976 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8014070 con 0x7f01e8101220 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.631+0000 7f01e4ff9640 1 -- 172.21.15.92:0/724528976 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d8010af0 con 0x7f01e8101220 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.631+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e819d6f0 con 0x7f01e8101220 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.631+0000 7f01e4ff9640 1 -- 172.21.15.92:0/724528976 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8017d10 con 0x7f01e8101220 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.631+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e81a4fd0 con 0x7f01e8101220 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.632+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e8101660 con 0x7f01e8101220 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.633+0000 7f01e4ff9640 1 -- 172.21.15.92:0/724528976 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f01d8017070 con 0x7f01e8101220 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.633+0000 7f01e4ff9640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f01d00a2b80 0x7f01d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.634+0000 7f01e6ffd640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f01d00a2b80 0x7f01d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.634+0000 7f01e4ff9640 1 -- 172.21.15.92:0/724528976 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f01d80ce020 con 0x7f01e8101220 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.634+0000 7f01e6ffd640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f01d00a2b80 0x7f01d00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01e80fe920 tx=0x7f01dc005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:40.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.638+0000 7f01e4ff9640 1 -- 172.21.15.92:0/724528976 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01d809b420 con 0x7f01e8101220 2024-09-10T10:34:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:40.821+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f01e810a000 con 0x7f01e8101220 2024-09-10T10:34:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:41 smithi121 ceph-mon[35231]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:34:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:41.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:41 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/724528976' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:34:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:41 smithi097 ceph-mon[35213]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:34:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:41 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/724528976' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:34:41.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:41 smithi092 ceph-mon[30834]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:41.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:41.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:34:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:34:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:34:41.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:41 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/724528976' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T10:34:41.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.708+0000 7f01e4ff9640 1 -- 172.21.15.92:0/724528976 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f01d809ad20 con 0x7f01e8101220 2024-09-10T10:34:41.710 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2024-09-10T10:34:41.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f01d00a2b80 msgr2=0x7f01d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:41.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f01d00a2b80 0x7f01d00a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f01e80fe920 tx=0x7f01dc005e50 comp rx=0 tx=0).stop 2024-09-10T10:34:41.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101220 msgr2=0x7f01e8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:41.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101220 0x7f01e8198450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f01d800b4a0 tx=0x7f01d800b960 comp rx=0 tx=0).stop 2024-09-10T10:34:41.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 shutdown_connections 2024-09-10T10:34:41.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f01d00a2b80 0x7f01d00a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:41.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f01e8105a70 0x7f01e819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:41.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e8101ba0 0x7f01e8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:41.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 --2- 172.21.15.92:0/724528976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01e8101220 0x7f01e8198450 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:41.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.710+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 >> 172.21.15.92:0/724528976 conn(0x7f01e80fbee0 msgr2=0x7f01e81002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:41.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.711+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 shutdown_connections 2024-09-10T10:34:41.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:41.711+0000 7f01edf02640 1 -- 172.21.15.92:0/724528976 wait complete. 2024-09-10T10:34:42.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T10:34:42.616 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:42.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:42 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/724528976' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T10:34:42.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:42 smithi092 ceph-mon[30834]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T10:34:42.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:42 smithi092 ceph-mon[30834]: pgmap v271: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:43.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:42 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/724528976' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T10:34:43.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:42 smithi121 ceph-mon[35231]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T10:34:43.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:42 smithi121 ceph-mon[35231]: pgmap v271: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:43.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:42 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/724528976' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T10:34:43.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:42 smithi097 ceph-mon[35213]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T10:34:43.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:42 smithi097 ceph-mon[35213]: pgmap v271: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.072+0000 7f3e78a54640 1 -- 172.21.15.92:0/349905182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 msgr2=0x7f3e74107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.072+0000 7f3e78a54640 1 --2- 172.21.15.92:0/349905182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 0x7f3e74107bc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009930 tx=0x7f3e5c02a420 comp rx=0 tx=0).stop 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.073+0000 7f3e78a54640 1 -- 172.21.15.92:0/349905182 shutdown_connections 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.073+0000 7f3e78a54640 1 --2- 172.21.15.92:0/349905182 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e74108300 0x7f3e7410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.073+0000 7f3e78a54640 1 --2- 172.21.15.92:0/349905182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 0x7f3e74107bc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.073+0000 7f3e78a54640 1 --2- 172.21.15.92:0/349905182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e74102dd0 0x7f3e741031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.073+0000 7f3e78a54640 1 -- 172.21.15.92:0/349905182 >> 172.21.15.92:0/349905182 conn(0x7f3e740fc7d0 msgr2=0x7f3e740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.073+0000 7f3e78a54640 1 -- 172.21.15.92:0/349905182 shutdown_connections 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.073+0000 7f3e78a54640 1 -- 172.21.15.92:0/349905182 wait complete. 2024-09-10T10:34:43.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.073+0000 7f3e78a54640 1 Processor -- start 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.073+0000 7f3e78a54640 1 -- start start 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e78a54640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e74102dd0 0x7f3e74100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e78a54640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 0x7f3e74100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e78a54640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e74108300 0x7f3e741014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e78a54640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e74112070 con 0x7f3e74103780 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e78a54640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3e74111ef0 con 0x7f3e74102dd0 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e78a54640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3e741121f0 con 0x7f3e74108300 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e71d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 0x7f3e74100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e71d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 0x7f3e74100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56742/0 (socket says 172.21.15.92:56742) 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e71d9b640 1 -- 172.21.15.92:0/1011815270 learned_addr learned my addr 172.21.15.92:0/1011815270 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e72d9d640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e74108300 0x7f3e741014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e7259c640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e74102dd0 0x7f3e74100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:43.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e71d9b640 1 -- 172.21.15.92:0/1011815270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e74108300 msgr2=0x7f3e741014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e71d9b640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e74108300 0x7f3e741014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e71d9b640 1 -- 172.21.15.92:0/1011815270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e74102dd0 msgr2=0x7f3e74100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e71d9b640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e74102dd0 0x7f3e74100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e71d9b640 1 -- 172.21.15.92:0/1011815270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e741a6ab0 con 0x7f3e74103780 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e71d9b640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 0x7f3e74100f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c005940 tx=0x7f3e5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e6b7fe640 1 -- 172.21.15.92:0/1011815270 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c03f030 con 0x7f3e74103780 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e6b7fe640 1 -- 172.21.15.92:0/1011815270 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e5c003ce0 con 0x7f3e74103780 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e6b7fe640 1 -- 172.21.15.92:0/1011815270 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c035070 con 0x7f3e74103780 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e741a6d40 con 0x7f3e74103780 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.074+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e741a7210 con 0x7f3e74103780 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.076+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e741031b0 con 0x7f3e74103780 2024-09-10T10:34:43.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.077+0000 7f3e6b7fe640 1 -- 172.21.15.92:0/1011815270 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3e5c042030 con 0x7f3e74103780 2024-09-10T10:34:43.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.078+0000 7f3e6b7fe640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3e600a2c00 0x7f3e600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:43.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.078+0000 7f3e7259c640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3e600a2c00 0x7f3e600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:43.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.078+0000 7f3e6b7fe640 1 -- 172.21.15.92:0/1011815270 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f3e5c0ef1a0 con 0x7f3e74103780 2024-09-10T10:34:43.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.078+0000 7f3e7259c640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3e600a2c00 0x7f3e600a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e64005c40 tx=0x7f3e64008230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:43.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.082+0000 7f3e6b7fe640 1 -- 172.21.15.92:0/1011815270 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e5c0bc430 con 0x7f3e74103780 2024-09-10T10:34:43.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.249+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3e7410a290 con 0x7f3e74103780 2024-09-10T10:34:43.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.723+0000 7f3e6b7fe640 1 -- 172.21.15.92:0/1011815270 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7f3e5c0bbd30 con 0x7f3e74103780 2024-09-10T10:34:43.725 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2024-09-10T10:34:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3e600a2c00 msgr2=0x7f3e600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3e600a2c00 0x7f3e600a50c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3e64005c40 tx=0x7f3e64008230 comp rx=0 tx=0).stop 2024-09-10T10:34:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 msgr2=0x7f3e74100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 0x7f3e74100f70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c005940 tx=0x7f3e5c0042f0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 shutdown_connections 2024-09-10T10:34:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3e600a2c00 0x7f3e600a50c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e74108300 0x7f3e741014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e74103780 0x7f3e74100f70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 --2- 172.21.15.92:0/1011815270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3e74102dd0 0x7f3e74100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 >> 172.21.15.92:0/1011815270 conn(0x7f3e740fc7d0 msgr2=0x7f3e74105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.725+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 shutdown_connections 2024-09-10T10:34:43.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:43.726+0000 7f3e78a54640 1 -- 172.21.15.92:0/1011815270 wait complete. 2024-09-10T10:34:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:43 smithi121 ceph-mon[35231]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:34:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:43 smithi121 ceph-mon[35231]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T10:34:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:43 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1011815270' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:34:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:43 smithi097 ceph-mon[35213]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:34:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:43 smithi097 ceph-mon[35213]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T10:34:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:43 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1011815270' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:34:44.102 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:43 smithi092 ceph-mon[30834]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T10:34:44.102 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:43 smithi092 ceph-mon[30834]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T10:34:44.102 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:43 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1011815270' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T10:34:44.413 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T10:34:44.657 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:45.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:44 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1011815270' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T10:34:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:44 smithi121 ceph-mon[35231]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T10:34:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:44 smithi121 ceph-mon[35231]: pgmap v274: 97 pgs: 9 creating+peering, 4 active+clean, 84 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:45.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:44 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1011815270' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T10:34:45.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:44 smithi092 ceph-mon[30834]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T10:34:45.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:44 smithi092 ceph-mon[30834]: pgmap v274: 97 pgs: 9 creating+peering, 4 active+clean, 84 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:44 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1011815270' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T10:34:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:44 smithi097 ceph-mon[35213]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T10:34:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:44 smithi097 ceph-mon[35213]: pgmap v274: 97 pgs: 9 creating+peering, 4 active+clean, 84 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:34:45.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.138+0000 7f36565d6640 1 -- 172.21.15.92:0/2125751007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650106a80 msgr2=0x7f3650106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:45.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.138+0000 7f36565d6640 1 --2- 172.21.15.92:0/2125751007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650106a80 0x7f3650106e60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3640009930 tx=0x7f364002a420 comp rx=0 tx=0).stop 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.138+0000 7f36565d6640 1 -- 172.21.15.92:0/2125751007 shutdown_connections 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.138+0000 7f36565d6640 1 --2- 172.21.15.92:0/2125751007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3650101420 0x7f365010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.138+0000 7f36565d6640 1 --2- 172.21.15.92:0/2125751007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3650100a80 0x7f3650100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.138+0000 7f36565d6640 1 --2- 172.21.15.92:0/2125751007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650106a80 0x7f3650106e60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.138+0000 7f36565d6640 1 -- 172.21.15.92:0/2125751007 >> 172.21.15.92:0/2125751007 conn(0x7f36500fc7a0 msgr2=0x7f36500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.138+0000 7f36565d6640 1 -- 172.21.15.92:0/2125751007 shutdown_connections 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.138+0000 7f36565d6640 1 -- 172.21.15.92:0/2125751007 wait complete. 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f36565d6640 1 Processor -- start 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f36565d6640 1 -- start start 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f36565d6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650100a80 0x7f36501973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f36565d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3650101420 0x7f3650197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:45.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f36565d6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3650106a80 0x7f365019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f36565d6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3650110ea0 con 0x7f3650100a80 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f36565d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3650110d20 con 0x7f3650101420 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f36565d6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3650111020 con 0x7f3650106a80 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f364ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650100a80 0x7f36501973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f364ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650100a80 0x7f36501973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56750/0 (socket says 172.21.15.92:56750) 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f364ffff640 1 -- 172.21.15.92:0/609531822 learned_addr learned my addr 172.21.15.92:0/609531822 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f364f7fe640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3650101420 0x7f3650197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f3654b73640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3650106a80 0x7f365019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f364ffff640 1 -- 172.21.15.92:0/609531822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3650106a80 msgr2=0x7f365019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f364ffff640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3650106a80 0x7f365019bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f364ffff640 1 -- 172.21.15.92:0/609531822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3650101420 msgr2=0x7f3650197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.139+0000 7f364ffff640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3650101420 0x7f3650197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.140+0000 7f364ffff640 1 -- 172.21.15.92:0/609531822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365019c370 con 0x7f3650100a80 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.140+0000 7f364f7fe640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3650101420 0x7f3650197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:34:45.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.140+0000 7f364ffff640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650100a80 0x7f36501973c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3640009230 tx=0x7f3640004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.140+0000 7f364d7fa640 1 -- 172.21.15.92:0/609531822 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364003f030 con 0x7f3650100a80 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.140+0000 7f364d7fa640 1 -- 172.21.15.92:0/609531822 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3640003ad0 con 0x7f3650100a80 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.140+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365019c600 con 0x7f3650100a80 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.140+0000 7f364d7fa640 1 -- 172.21.15.92:0/609531822 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640035070 con 0x7f3650100a80 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.140+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365006a790 con 0x7f3650100a80 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.141+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36501021c0 con 0x7f3650100a80 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.142+0000 7f364d7fa640 1 -- 172.21.15.92:0/609531822 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3640042030 con 0x7f3650100a80 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.143+0000 7f364d7fa640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f36380a2b80 0x7f36380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.143+0000 7f364f7fe640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f36380a2b80 0x7f36380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.143+0000 7f364d7fa640 1 -- 172.21.15.92:0/609531822 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f36400ef870 con 0x7f3650100a80 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.144+0000 7f364f7fe640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f36380a2b80 0x7f36380a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3644006fd0 tx=0x7f3644008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:45.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.147+0000 7f364d7fa640 1 -- 172.21.15.92:0/609531822 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36400bc960 con 0x7f3650100a80 2024-09-10T10:34:45.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.349+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3650100ee0 con 0x7f3650100a80 2024-09-10T10:34:45.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.735+0000 7f364d7fa640 1 -- 172.21.15.92:0/609531822 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f3650100ee0 con 0x7f3650100a80 2024-09-10T10:34:45.737 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T10:34:45.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f36380a2b80 msgr2=0x7f36380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:45.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f36380a2b80 0x7f36380a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3644006fd0 tx=0x7f3644008040 comp rx=0 tx=0).stop 2024-09-10T10:34:45.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650100a80 msgr2=0x7f36501973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:45.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650100a80 0x7f36501973c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3640009230 tx=0x7f3640004270 comp rx=0 tx=0).stop 2024-09-10T10:34:45.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 shutdown_connections 2024-09-10T10:34:45.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f36380a2b80 0x7f36380a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:45.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3650106a80 0x7f365019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:45.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3650101420 0x7f3650197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:45.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 --2- 172.21.15.92:0/609531822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650100a80 0x7f36501973c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:45.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 >> 172.21.15.92:0/609531822 conn(0x7f36500fc7a0 msgr2=0x7f36500fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:45.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 shutdown_connections 2024-09-10T10:34:45.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:45.738+0000 7f36565d6640 1 -- 172.21.15.92:0/609531822 wait complete. 2024-09-10T10:34:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:45 smithi121 ceph-mon[35231]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T10:34:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:45 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/609531822' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:34:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:45 smithi121 ceph-mon[35231]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T10:34:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:45 smithi097 ceph-mon[35213]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T10:34:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:45 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/609531822' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:34:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:45 smithi097 ceph-mon[35213]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T10:34:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:45 smithi092 ceph-mon[30834]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T10:34:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:45 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/609531822' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T10:34:46.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:45 smithi092 ceph-mon[30834]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-10T10:34:46.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:34:46.690 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:46 smithi121 ceph-mon[35231]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T10:34:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:46 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/609531822' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T10:34:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:46 smithi121 ceph-mon[35231]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T10:34:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:46 smithi121 ceph-mon[35231]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T10:34:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:46 smithi121 ceph-mon[35231]: pgmap v277: 97 pgs: 20 creating+peering, 19 active+clean, 58 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-10T10:34:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:46 smithi097 ceph-mon[35213]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T10:34:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:46 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/609531822' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T10:34:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:46 smithi097 ceph-mon[35213]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T10:34:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:46 smithi097 ceph-mon[35213]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T10:34:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:46 smithi097 ceph-mon[35213]: pgmap v277: 97 pgs: 20 creating+peering, 19 active+clean, 58 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-10T10:34:47.072 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:46 smithi092 ceph-mon[30834]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T10:34:47.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:46 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/609531822' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T10:34:47.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:46 smithi092 ceph-mon[30834]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-10T10:34:47.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:46 smithi092 ceph-mon[30834]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-10T10:34:47.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:46 smithi092 ceph-mon[30834]: pgmap v277: 97 pgs: 20 creating+peering, 19 active+clean, 58 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-10T10:34:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.152+0000 7efd27bc5640 1 -- 172.21.15.92:0/3887492399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 msgr2=0x7efd201029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.152+0000 7efd27bc5640 1 --2- 172.21.15.92:0/3887492399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 0x7efd201029b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efd10009900 tx=0x7efd1002a480 comp rx=0 tx=0).stop 2024-09-10T10:34:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.152+0000 7efd27bc5640 1 -- 172.21.15.92:0/3887492399 shutdown_connections 2024-09-10T10:34:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.152+0000 7efd27bc5640 1 --2- 172.21.15.92:0/3887492399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd20102ef0 0x7efd2010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.152+0000 7efd27bc5640 1 --2- 172.21.15.92:0/3887492399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 0x7efd201029b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.152+0000 7efd27bc5640 1 --2- 172.21.15.92:0/3887492399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd20100e20 0x7efd20101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.152+0000 7efd27bc5640 1 -- 172.21.15.92:0/3887492399 >> 172.21.15.92:0/3887492399 conn(0x7efd200fc7d0 msgr2=0x7efd200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.152+0000 7efd27bc5640 1 -- 172.21.15.92:0/3887492399 shutdown_connections 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.152+0000 7efd27bc5640 1 -- 172.21.15.92:0/3887492399 wait complete. 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd27bc5640 1 Processor -- start 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd27bc5640 1 -- start start 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd27bc5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd20100e20 0x7efd201992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd27bc5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 0x7efd20199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd27bc5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd20102ef0 0x7efd201a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd27bc5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd20110f80 con 0x7efd20102570 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd27bc5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efd20110e00 con 0x7efd20102ef0 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd27bc5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efd20111100 con 0x7efd20100e20 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd25160640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 0x7efd20199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.153+0000 7efd25961640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd20100e20 0x7efd201992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:47.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd25160640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 0x7efd20199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56766/0 (socket says 172.21.15.92:56766) 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd25160640 1 -- 172.21.15.92:0/1357843373 learned_addr learned my addr 172.21.15.92:0/1357843373 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd26162640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd20102ef0 0x7efd201a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd25160640 1 -- 172.21.15.92:0/1357843373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd20100e20 msgr2=0x7efd201992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd25160640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd20100e20 0x7efd201992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd25160640 1 -- 172.21.15.92:0/1357843373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd20102ef0 msgr2=0x7efd201a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd25160640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd20102ef0 0x7efd201a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd25160640 1 -- 172.21.15.92:0/1357843373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd201a4890 con 0x7efd20102570 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd25961640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd20100e20 0x7efd201992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd26162640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd20102ef0 0x7efd201a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd25160640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 0x7efd20199810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd10006010 tx=0x7efd10003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd16ffd640 1 -- 172.21.15.92:0/1357843373 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1003f070 con 0x7efd20102570 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd16ffd640 1 -- 172.21.15.92:0/1357843373 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd10031e30 con 0x7efd20102570 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd201a4a60 con 0x7efd20102570 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd16ffd640 1 -- 172.21.15.92:0/1357843373 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10035030 con 0x7efd20102570 2024-09-10T10:34:47.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.154+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd201a4f10 con 0x7efd20102570 2024-09-10T10:34:47.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.155+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd20101200 con 0x7efd20102570 2024-09-10T10:34:47.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.157+0000 7efd16ffd640 1 -- 172.21.15.92:0/1357843373 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efd10042070 con 0x7efd20102570 2024-09-10T10:34:47.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.157+0000 7efd16ffd640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd0c0a2c00 0x7efd0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:47.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.157+0000 7efd25961640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd0c0a2c00 0x7efd0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:47.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.157+0000 7efd16ffd640 1 -- 172.21.15.92:0/1357843373 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7efd100efd70 con 0x7efd20102570 2024-09-10T10:34:47.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.158+0000 7efd25961640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd0c0a2c00 0x7efd0c0a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0058c0 tx=0x7efd1c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:47.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.161+0000 7efd16ffd640 1 -- 172.21.15.92:0/1357843373 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd100bceb0 con 0x7efd20102570 2024-09-10T10:34:47.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.333+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd20109090 con 0x7efd20102570 2024-09-10T10:34:47.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.335+0000 7efd16ffd640 1 -- 172.21.15.92:0/1357843373 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22255 (secure 0 0 0) 0x7efd100bc7b0 con 0x7efd20102570 2024-09-10T10:34:47.337 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:47.337 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":81,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:34:45.350933+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:34:41.056656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:34:43.485327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:34:47.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.338+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd0c0a2c00 msgr2=0x7efd0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:47.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.338+0000 7efd27bc5640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd0c0a2c00 0x7efd0c0a50c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0058c0 tx=0x7efd1c00a2d0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.338+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 msgr2=0x7efd20199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:47.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.338+0000 7efd27bc5640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 0x7efd20199810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd10006010 tx=0x7efd10003c80 comp rx=0 tx=0).stop 2024-09-10T10:34:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.338+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 shutdown_connections 2024-09-10T10:34:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.338+0000 7efd27bc5640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7efd0c0a2c00 0x7efd0c0a50c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.339+0000 7efd27bc5640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efd20102ef0 0x7efd201a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.339+0000 7efd27bc5640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd20102570 0x7efd20199810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.339+0000 7efd27bc5640 1 --2- 172.21.15.92:0/1357843373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd20100e20 0x7efd201992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.339+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 >> 172.21.15.92:0/1357843373 conn(0x7efd200fc7d0 msgr2=0x7efd20105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.339+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 shutdown_connections 2024-09-10T10:34:47.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:47.339+0000 7efd27bc5640 1 -- 172.21.15.92:0/1357843373 wait complete. 2024-09-10T10:34:47.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:47 smithi092 ceph-mon[30834]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T10:34:47.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:47 smithi092 ceph-mon[30834]: Cluster is now healthy 2024-09-10T10:34:47.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:47 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] up:active 2024-09-10T10:34:47.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:47 smithi092 ceph-mon[30834]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:47.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:47 smithi092 ceph-mon[30834]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:47.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:47 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1357843373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:34:47.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:34:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:47 smithi121 ceph-mon[35231]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T10:34:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:47 smithi121 ceph-mon[35231]: Cluster is now healthy 2024-09-10T10:34:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:47 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] up:active 2024-09-10T10:34:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:47 smithi121 ceph-mon[35231]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:47 smithi121 ceph-mon[35231]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:47 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1357843373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:34:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:47 smithi097 ceph-mon[35213]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T10:34:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:47 smithi097 ceph-mon[35213]: Cluster is now healthy 2024-09-10T10:34:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:47 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] up:active 2024-09-10T10:34:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:47 smithi097 ceph-mon[35213]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:47 smithi097 ceph-mon[35213]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:47 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1357843373' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:34:48.247 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:48.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.748+0000 7f151deea640 1 -- 172.21.15.92:0/1736822623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518101de0 msgr2=0x7f15181021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:48.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.748+0000 7f151deea640 1 --2- 172.21.15.92:0/1736822623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518101de0 0x7f15181021c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1508009900 tx=0x7f150802a410 comp rx=0 tx=0).stop 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.748+0000 7f151deea640 1 -- 172.21.15.92:0/1736822623 shutdown_connections 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.748+0000 7f151deea640 1 --2- 172.21.15.92:0/1736822623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1518106f10 0x7f151810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.748+0000 7f151deea640 1 --2- 172.21.15.92:0/1736822623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1518102790 0x7f15181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.748+0000 7f151deea640 1 --2- 172.21.15.92:0/1736822623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518101de0 0x7f15181021c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.748+0000 7f151deea640 1 -- 172.21.15.92:0/1736822623 >> 172.21.15.92:0/1736822623 conn(0x7f15180fd8c0 msgr2=0x7f15180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 -- 172.21.15.92:0/1736822623 shutdown_connections 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 -- 172.21.15.92:0/1736822623 wait complete. 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 Processor -- start 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 -- start start 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1518101de0 0x7f15180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:48.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518102790 0x7f1518074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1518106f10 0x7f1518074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1518111f70 con 0x7f1518102790 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1518111df0 con 0x7f1518106f10 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f151deea640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f15181120f0 con 0x7f1518101de0 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f150ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518102790 0x7f1518074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f150ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518102790 0x7f1518074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56772/0 (socket says 172.21.15.92:56772) 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.749+0000 7f150ffff640 1 -- 172.21.15.92:0/721295058 learned_addr learned my addr 172.21.15.92:0/721295058 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f15177fe640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1518101de0 0x7f15180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f150ffff640 1 -- 172.21.15.92:0/721295058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1518101de0 msgr2=0x7f15180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f150ffff640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1518101de0 0x7f15180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f150ffff640 1 -- 172.21.15.92:0/721295058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1518106f10 msgr2=0x7f1518074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f150ffff640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1518106f10 0x7f1518074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f150ffff640 1 -- 172.21.15.92:0/721295058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15181a68f0 con 0x7f1518102790 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f150ffff640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518102790 0x7f1518074a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f150000e9f0 tx=0x7f150000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f15157fa640 1 -- 172.21.15.92:0/721295058 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150000cd80 con 0x7f1518102790 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15181a6be0 con 0x7f1518102790 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f15157fa640 1 -- 172.21.15.92:0/721295058 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1500005500 con 0x7f1518102790 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f15157fa640 1 -- 172.21.15.92:0/721295058 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500010690 con 0x7f1518102790 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.750+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15181a7120 con 0x7f1518102790 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.751+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15181021c0 con 0x7f1518102790 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.752+0000 7f15157fa640 1 -- 172.21.15.92:0/721295058 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f15000046c0 con 0x7f1518102790 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.753+0000 7f15157fa640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f15040a2b80 0x7f15040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:48.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.753+0000 7f15177fe640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f15040a2b80 0x7f15040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:48.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.753+0000 7f15157fa640 1 -- 172.21.15.92:0/721295058 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f15000cf430 con 0x7f1518102790 2024-09-10T10:34:48.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.753+0000 7f15177fe640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f15040a2b80 0x7f15040a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15080096c0 tx=0x7f1508000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:48.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.757+0000 7f15157fa640 1 -- 172.21.15.92:0/721295058 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f150009c4e0 con 0x7f1518102790 2024-09-10T10:34:48.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.922+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1518109b60 con 0x7f1518102790 2024-09-10T10:34:48.924 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:48 smithi092 ceph-mon[30834]: pgmap v278: 97 pgs: 11 creating+peering, 84 active+clean, 2 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-10T10:34:48.925 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.923+0000 7f15157fa640 1 -- 172.21.15.92:0/721295058 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22255 (secure 0 0 0) 0x7f150009bde0 con 0x7f1518102790 2024-09-10T10:34:48.925 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:34:48.925 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":81,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:34:45.350933+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:34:41.056656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:34:43.485327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:34:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.925+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f15040a2b80 msgr2=0x7f15040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.925+0000 7f151deea640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f15040a2b80 0x7f15040a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15080096c0 tx=0x7f1508000bc0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.925+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518102790 msgr2=0x7f1518074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.925+0000 7f151deea640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518102790 0x7f1518074a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f150000e9f0 tx=0x7f150000edf0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.926+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 shutdown_connections 2024-09-10T10:34:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.926+0000 7f151deea640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f15040a2b80 0x7f15040a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.926+0000 7f151deea640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1518106f10 0x7f1518074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.926+0000 7f151deea640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1518102790 0x7f1518074a30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.926+0000 7f151deea640 1 --2- 172.21.15.92:0/721295058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1518101de0 0x7f15180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:48.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.926+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 >> 172.21.15.92:0/721295058 conn(0x7f15180fd8c0 msgr2=0x7f15180fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:48.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.926+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 shutdown_connections 2024-09-10T10:34:48.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:48.926+0000 7f151deea640 1 -- 172.21.15.92:0/721295058 wait complete. 2024-09-10T10:34:49.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:48 smithi121 ceph-mon[35231]: pgmap v278: 97 pgs: 11 creating+peering, 84 active+clean, 2 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-10T10:34:49.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:48 smithi097 ceph-mon[35213]: pgmap v278: 97 pgs: 11 creating+peering, 84 active+clean, 2 unknown; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-10T10:34:49.623 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T10:34:49.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:49 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/721295058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:34:49.868 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:50.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:49 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/721295058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:34:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:49 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/721295058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:34:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.363+0000 7f2deca71640 1 -- 172.21.15.92:0/1885206142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8101420 msgr2=0x7f2de810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.363+0000 7f2deca71640 1 --2- 172.21.15.92:0/1885206142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8101420 0x7f2de810d950 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009cd0 tx=0x7f2de002a8e0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.363+0000 7f2deca71640 1 -- 172.21.15.92:0/1885206142 shutdown_connections 2024-09-10T10:34:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.363+0000 7f2deca71640 1 --2- 172.21.15.92:0/1885206142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8101420 0x7f2de810d950 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.363+0000 7f2deca71640 1 --2- 172.21.15.92:0/1885206142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8100a80 0x7f2de8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.363+0000 7f2deca71640 1 --2- 172.21.15.92:0/1885206142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de8106a80 0x7f2de8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.363+0000 7f2deca71640 1 -- 172.21.15.92:0/1885206142 >> 172.21.15.92:0/1885206142 conn(0x7f2de80fc7a0 msgr2=0x7f2de80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.363+0000 7f2deca71640 1 -- 172.21.15.92:0/1885206142 shutdown_connections 2024-09-10T10:34:50.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.363+0000 7f2deca71640 1 -- 172.21.15.92:0/1885206142 wait complete. 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2deca71640 1 Processor -- start 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2deca71640 1 -- start start 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2deca71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8100a80 0x7f2de8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2deca71640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de8101420 0x7f2de8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2deca71640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8106a80 0x7f2de819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2deca71640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8111fa0 con 0x7f2de8100a80 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2deca71640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8111e20 con 0x7f2de8101420 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2deca71640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8112120 con 0x7f2de8106a80 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2de659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8100a80 0x7f2de8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2de659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8100a80 0x7f2de8198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56798/0 (socket says 172.21.15.92:56798) 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.364+0000 7f2de659c640 1 -- 172.21.15.92:0/3761298405 learned_addr learned my addr 172.21.15.92:0/3761298405 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:50.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2ddffff640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de8101420 0x7f2de8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:50.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2de6d9d640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8106a80 0x7f2de819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:50.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2de659c640 1 -- 172.21.15.92:0/3761298405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8106a80 msgr2=0x7f2de819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:50.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2de659c640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8106a80 0x7f2de819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2de659c640 1 -- 172.21.15.92:0/3761298405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de8101420 msgr2=0x7f2de8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:50.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2de659c640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de8101420 0x7f2de8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2de659c640 1 -- 172.21.15.92:0/3761298405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de819d3f0 con 0x7f2de8100a80 2024-09-10T10:34:50.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2de659c640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8100a80 0x7f2de8198440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800d950 tx=0x7f2dd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:50.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2ddf7fe640 1 -- 172.21.15.92:0/3761298405 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8017070 con 0x7f2de8100a80 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de819d6e0 con 0x7f2de8100a80 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2ddf7fe640 1 -- 172.21.15.92:0/3761298405 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd8009c30 con 0x7f2de8100a80 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2ddf7fe640 1 -- 172.21.15.92:0/3761298405 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800f6b0 con 0x7f2de8100a80 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.365+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de81a4fc0 con 0x7f2de8100a80 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.366+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de8100ee0 con 0x7f2de8100a80 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.367+0000 7f2ddf7fe640 1 -- 172.21.15.92:0/3761298405 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2dd80109d0 con 0x7f2de8100a80 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.368+0000 7f2ddf7fe640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2dd40a2b80 0x7f2dd40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.368+0000 7f2ddffff640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2dd40a2b80 0x7f2dd40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.368+0000 7f2ddf7fe640 1 -- 172.21.15.92:0/3761298405 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f2dd80cea80 con 0x7f2de8100a80 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.368+0000 7f2ddffff640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2dd40a2b80 0x7f2dd40a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2de80fed80 tx=0x7f2dd000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:50.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.372+0000 7f2ddf7fe640 1 -- 172.21.15.92:0/3761298405 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2dd8009de0 con 0x7f2de8100a80 2024-09-10T10:34:50.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.573+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2de8108ff0 con 0x7f2de8100a80 2024-09-10T10:34:50.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.745+0000 7f2ddf7fe640 1 -- 172.21.15.92:0/3761298405 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f2dd809bb30 con 0x7f2de8100a80 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2dd40a2b80 msgr2=0x7f2dd40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2dd40a2b80 0x7f2dd40a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2de80fed80 tx=0x7f2dd000a250 comp rx=0 tx=0).stop 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8100a80 msgr2=0x7f2de8198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8100a80 0x7f2de8198440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800d950 tx=0x7f2dd800de10 comp rx=0 tx=0).stop 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 shutdown_connections 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2dd40a2b80 0x7f2dd40a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8106a80 0x7f2de819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2de8101420 0x7f2de8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 --2- 172.21.15.92:0/3761298405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2de8100a80 0x7f2de8198440 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 >> 172.21.15.92:0/3761298405 conn(0x7f2de80fc7a0 msgr2=0x7f2de80fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 shutdown_connections 2024-09-10T10:34:50.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:50.747+0000 7f2deca71640 1 -- 172.21.15.92:0/3761298405 wait complete. 2024-09-10T10:34:50.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:50 smithi092 ceph-mon[30834]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T10:34:50.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:50 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3761298405' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:34:51.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:50 smithi121 ceph-mon[35231]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T10:34:51.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:50 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3761298405' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:34:51.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:50 smithi097 ceph-mon[35213]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T10:34:51.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:50 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3761298405' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T10:34:51.467 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-10T10:34:51.467 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-10T10:34:51.713 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:52.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:51 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3761298405' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T10:34:52.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:51 smithi092 ceph-mon[30834]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:52.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:51 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3761298405' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T10:34:52.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:51 smithi121 ceph-mon[35231]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:52.041 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: 2024-09-10T10:34:51.546+0000 7f84c6011640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T10:34:52.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:51 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3761298405' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T10:34:52.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:51 smithi097 ceph-mon[35213]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:52.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.173+0000 7fadeb675640 1 -- 172.21.15.92:0/3495223411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 msgr2=0x7fade4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:52.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.173+0000 7fadeb675640 1 --2- 172.21.15.92:0/3495223411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 0x7fade4103120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fade0009900 tx=0x7fade002a480 comp rx=0 tx=0).stop 2024-09-10T10:34:52.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.173+0000 7fadeb675640 1 -- 172.21.15.92:0/3495223411 shutdown_connections 2024-09-10T10:34:52.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.173+0000 7fadeb675640 1 --2- 172.21.15.92:0/3495223411 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fade410c170 0x7fade410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.173+0000 7fadeb675640 1 --2- 172.21.15.92:0/3495223411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4103660 0x7fade410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.173+0000 7fadeb675640 1 --2- 172.21.15.92:0/3495223411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 0x7fade4103120 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.173+0000 7fadeb675640 1 -- 172.21.15.92:0/3495223411 >> 172.21.15.92:0/3495223411 conn(0x7fade40fc7a0 msgr2=0x7fade40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:52.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.173+0000 7fadeb675640 1 -- 172.21.15.92:0/3495223411 shutdown_connections 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.173+0000 7fadeb675640 1 -- 172.21.15.92:0/3495223411 wait complete. 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fadeb675640 1 Processor -- start 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fadeb675640 1 -- start start 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fadeb675640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 0x7fade4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fadeb675640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4103660 0x7fade4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fadeb675640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fade410c170 0x7fade419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fadeb675640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fade4111fd0 con 0x7fade4102d40 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fadeb675640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fade4111e50 con 0x7fade410c170 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fadeb675640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fade4112150 con 0x7fade4103660 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade9411640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 0x7fade4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade9411640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 0x7fade4198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56810/0 (socket says 172.21.15.92:56810) 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade9411640 1 -- 172.21.15.92:0/1218558399 learned_addr learned my addr 172.21.15.92:0/1218558399 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade8c10640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4103660 0x7fade4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:52.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade9c12640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fade410c170 0x7fade419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade9411640 1 -- 172.21.15.92:0/1218558399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4103660 msgr2=0x7fade4198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade9411640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4103660 0x7fade4198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade9411640 1 -- 172.21.15.92:0/1218558399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fade410c170 msgr2=0x7fade419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade9411640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fade410c170 0x7fade419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.174+0000 7fade9411640 1 -- 172.21.15.92:0/1218558399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade419d4e0 con 0x7fade4102d40 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.175+0000 7fade9411640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 0x7fade4198530 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fade0005ab0 tx=0x7fade00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.175+0000 7fadda7fc640 1 -- 172.21.15.92:0/1218558399 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade003f030 con 0x7fade4102d40 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.175+0000 7fadda7fc640 1 -- 172.21.15.92:0/1218558399 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fade0003ce0 con 0x7fade4102d40 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.175+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade419d770 con 0x7fade4102d40 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.175+0000 7fadda7fc640 1 -- 172.21.15.92:0/1218558399 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0035070 con 0x7fade4102d40 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.175+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade41a50b0 con 0x7fade4102d40 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.176+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade406b070 con 0x7fade4102d40 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.177+0000 7fadda7fc640 1 -- 172.21.15.92:0/1218558399 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fade0042030 con 0x7fade4102d40 2024-09-10T10:34:52.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.177+0000 7fadda7fc640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fadd00a2b80 0x7fadd00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:52.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.178+0000 7fade8c10640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fadd00a2b80 0x7fadd00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:52.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.178+0000 7fadda7fc640 1 -- 172.21.15.92:0/1218558399 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fade00ef890 con 0x7fade4102d40 2024-09-10T10:34:52.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.178+0000 7fade8c10640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fadd00a2b80 0x7fadd00a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fade410d570 tx=0x7fadd4005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:52.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.182+0000 7fadda7fc640 1 -- 172.21.15.92:0/1218558399 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fade00bc940 con 0x7fade4102d40 2024-09-10T10:34:52.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.396+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fade41071e0 con 0x7fade4102d40 2024-09-10T10:34:52.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.751+0000 7fadda7fc640 1 -- 172.21.15.92:0/1218558399 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fade00bc240 con 0x7fade4102d40 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fadd00a2b80 msgr2=0x7fadd00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fadd00a2b80 0x7fadd00a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fade410d570 tx=0x7fadd4005ec0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 msgr2=0x7fade4198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 0x7fade4198530 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fade0005ab0 tx=0x7fade00042f0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 shutdown_connections 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fadd00a2b80 0x7fadd00a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fade410c170 0x7fade419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fade4103660 0x7fade4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 --2- 172.21.15.92:0/1218558399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fade4102d40 0x7fade4198530 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 >> 172.21.15.92:0/1218558399 conn(0x7fade40fc7a0 msgr2=0x7fade40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 shutdown_connections 2024-09-10T10:34:52.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:52.754+0000 7fadeb675640 1 -- 172.21.15.92:0/1218558399 wait complete. 2024-09-10T10:34:53.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:52 smithi121 ceph-mon[35231]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T10:34:53.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:52 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1218558399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-10T10:34:53.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:52 smithi097 ceph-mon[35213]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T10:34:53.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:52 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1218558399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-10T10:34:53.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:52 smithi092 ceph-mon[30834]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T10:34:53.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:52 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1218558399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-10T10:34:53.475 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T10:34:53.721 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:54.012 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:53 smithi092 ceph-mon[30834]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:34:54.012 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:53 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1218558399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T10:34:54.012 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:53 smithi092 ceph-mon[30834]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:34:54.012 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:53 smithi092 ceph-mon[30834]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:54.012 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:53 smithi092 ceph-mon[30834]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-09-10T10:34:54.012 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:53 smithi092 ceph-mon[30834]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-09-10T10:34:54.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:53 smithi121 ceph-mon[35231]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:34:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:53 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1218558399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T10:34:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:53 smithi121 ceph-mon[35231]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:34:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:53 smithi121 ceph-mon[35231]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:53 smithi121 ceph-mon[35231]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-09-10T10:34:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:53 smithi121 ceph-mon[35231]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-09-10T10:34:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:53 smithi097 ceph-mon[35213]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T10:34:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:53 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1218558399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T10:34:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:53 smithi097 ceph-mon[35213]: daemon mds.c assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T10:34:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:53 smithi097 ceph-mon[35213]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-10T10:34:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:53 smithi097 ceph-mon[35213]: fsmap cephfs:2 {0=i=up:active,1=c=up:creating} 10 up:standby 2024-09-10T10:34:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:53 smithi097 ceph-mon[35213]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-09-10T10:34:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.200+0000 7f2cd543d640 1 -- 172.21.15.92:0/2619712136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 msgr2=0x7f2cd0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.200+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2619712136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 0x7f2cd0100ed0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009930 tx=0x7f2cb802a420 comp rx=0 tx=0).stop 2024-09-10T10:34:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.200+0000 7f2cd543d640 1 -- 172.21.15.92:0/2619712136 shutdown_connections 2024-09-10T10:34:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.200+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2619712136 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd0101410 0x7f2cd010d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.200+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2619712136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 0x7f2cd0100ed0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.200+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2619712136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cd0106a70 0x7f2cd0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.200+0000 7f2cd543d640 1 -- 172.21.15.92:0/2619712136 >> 172.21.15.92:0/2619712136 conn(0x7f2cd00fc7d0 msgr2=0x7f2cd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.200+0000 7f2cd543d640 1 -- 172.21.15.92:0/2619712136 shutdown_connections 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.200+0000 7f2cd543d640 1 -- 172.21.15.92:0/2619712136 wait complete. 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cd543d640 1 Processor -- start 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cd543d640 1 -- start start 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cd543d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 0x7f2cd00fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cd543d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cd0101410 0x7f2cd00fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cd543d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd0106a70 0x7f2cd00fd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cd543d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd0110e70 con 0x7f2cd0100a70 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cd543d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd0110cf0 con 0x7f2cd0106a70 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cd543d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd0110ff0 con 0x7f2cd0101410 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 0x7f2cd00fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cceffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 0x7f2cd00fcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59982/0 (socket says 172.21.15.92:59982) 2024-09-10T10:34:54.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cceffd640 1 -- 172.21.15.92:0/2773005810 learned_addr learned my addr 172.21.15.92:0/2773005810 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.201+0000 7f2cc7fff640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cd0101410 0x7f2cd00fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2ccf7fe640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd0106a70 0x7f2cd00fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cceffd640 1 -- 172.21.15.92:0/2773005810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cd0101410 msgr2=0x7f2cd00fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cceffd640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cd0101410 0x7f2cd00fd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cceffd640 1 -- 172.21.15.92:0/2773005810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd0106a70 msgr2=0x7f2cd00fd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cceffd640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd0106a70 0x7f2cd00fd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cceffd640 1 -- 172.21.15.92:0/2773005810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd01a6920 con 0x7f2cd0100a70 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cceffd640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 0x7f2cd00fcdc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000d770 tx=0x7f2cc000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cccff9640 1 -- 172.21.15.92:0/2773005810 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0017070 con 0x7f2cd0100a70 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd01a6c10 con 0x7f2cd0100a70 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cccff9640 1 -- 172.21.15.92:0/2773005810 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc0005500 con 0x7f2cd0100a70 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cccff9640 1 -- 172.21.15.92:0/2773005810 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0004e00 con 0x7f2cd0100a70 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.202+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd01a70d0 con 0x7f2cd0100a70 2024-09-10T10:34:54.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.203+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd0100ed0 con 0x7f2cd0100a70 2024-09-10T10:34:54.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.204+0000 7f2cccff9640 1 -- 172.21.15.92:0/2773005810 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2cc0004fa0 con 0x7f2cd0100a70 2024-09-10T10:34:54.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.205+0000 7f2cccff9640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2cbc0a2b80 0x7f2cbc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:54.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.205+0000 7f2cc7fff640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2cbc0a2b80 0x7f2cbc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:54.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.205+0000 7f2cccff9640 1 -- 172.21.15.92:0/2773005810 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f2cc00ce8c0 con 0x7f2cd0100a70 2024-09-10T10:34:54.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.205+0000 7f2cc7fff640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2cbc0a2b80 0x7f2cbc0a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009900 tx=0x7f2cb80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:54.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.209+0000 7f2cccff9640 1 -- 172.21.15.92:0/2773005810 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2cc009b970 con 0x7f2cd0100a70 2024-09-10T10:34:54.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.409+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f2cd0109a80 con 0x7f2cd0100a70 2024-09-10T10:34:54.772 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.771+0000 7f2cccff9640 1 -- 172.21.15.92:0/2773005810 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f2cc009b270 con 0x7f2cd0100a70 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2cbc0a2b80 msgr2=0x7f2cbc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2cbc0a2b80 0x7f2cbc0a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009900 tx=0x7f2cb80058d0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 msgr2=0x7f2cd00fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 0x7f2cd00fcdc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000d770 tx=0x7f2cc000dc30 comp rx=0 tx=0).stop 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 shutdown_connections 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2cbc0a2b80 0x7f2cbc0a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2cd0106a70 0x7f2cd00fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cd0101410 0x7f2cd00fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 --2- 172.21.15.92:0/2773005810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cd0100a70 0x7f2cd00fcdc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 >> 172.21.15.92:0/2773005810 conn(0x7f2cd00fc7d0 msgr2=0x7f2cd006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 shutdown_connections 2024-09-10T10:34:54.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:54.773+0000 7f2cd543d640 1 -- 172.21.15.92:0/2773005810 wait complete. 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] up:active 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-10T10:34:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-10T10:34:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-10T10:34:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-10T10:34:55.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:54 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2773005810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:34:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] up:active 2024-09-10T10:34:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T10:34:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-09-10T10:34:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-09-10T10:34:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-09-10T10:34:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-10T10:34:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T10:34:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-10T10:34:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-10T10:34:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-10T10:34:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-10T10:34:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-10T10:34:55.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:54 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2773005810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] up:active 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: daemon mds.f assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: fsmap cephfs:2 {0=i=up:active,1=c=up:active} 10 up:standby 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:creating} 9 up:standby 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-10T10:34:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:54 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2773005810' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T10:34:55.578 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T10:34:55.835 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:55.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2773005810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:34:55.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] up:active 2024-09-10T10:34:55.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: daemon mds.b assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:creating} 8 up:standby 2024-09-10T10:34:55.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:55 smithi092 ceph-mon[30834]: daemon mds.b is now active in filesystem cephfs as rank 3 2024-09-10T10:34:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2773005810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:34:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] up:active 2024-09-10T10:34:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: daemon mds.b assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T10:34:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-09-10T10:34:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T10:34:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T10:34:56.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-10T10:34:56.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T10:34:56.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-10T10:34:56.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T10:34:56.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T10:34:56.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:creating} 8 up:standby 2024-09-10T10:34:56.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:55 smithi121 ceph-mon[35231]: daemon mds.b is now active in filesystem cephfs as rank 3 2024-09-10T10:34:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2773005810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T10:34:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] up:active 2024-09-10T10:34:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: daemon mds.b assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T10:34:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: fsmap cephfs:3 {0=i=up:active,1=c=up:active,2=f=up:active} 9 up:standby 2024-09-10T10:34:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T10:34:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T10:34:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-10T10:34:56.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T10:34:56.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-10T10:34:56.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-10T10:34:56.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T10:34:56.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:creating} 8 up:standby 2024-09-10T10:34:56.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:55 smithi097 ceph-mon[35213]: daemon mds.b is now active in filesystem cephfs as rank 3 2024-09-10T10:34:56.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 -- 172.21.15.92:0/1824846315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 msgr2=0x7f0a0c100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:56.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 --2- 172.21.15.92:0/1824846315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 0x7f0a0c100430 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009900 tx=0x7f09f402a410 comp rx=0 tx=0).stop 2024-09-10T10:34:56.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 -- 172.21.15.92:0/1824846315 shutdown_connections 2024-09-10T10:34:56.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 --2- 172.21.15.92:0/1824846315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a0c100970 0x7f0a0c10ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 --2- 172.21.15.92:0/1824846315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 0x7f0a0c100430 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 --2- 172.21.15.92:0/1824846315 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a0c106bb0 0x7f0a0c106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 -- 172.21.15.92:0/1824846315 >> 172.21.15.92:0/1824846315 conn(0x7f0a0c0fbee0 msgr2=0x7f0a0c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 -- 172.21.15.92:0/1824846315 shutdown_connections 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 -- 172.21.15.92:0/1824846315 wait complete. 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.300+0000 7f0a1183d640 1 Processor -- start 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a1183d640 1 -- start start 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a1183d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 0x7f0a0c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a1183d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a0c100970 0x7f0a0c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a1183d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a0c106bb0 0x7f0a0c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a1183d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c112040 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a1183d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c111ec0 con 0x7f0a0c106bb0 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a1183d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c1121c0 con 0x7f0a0c100970 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 0x7f0a0c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 0x7f0a0c198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60010/0 (socket says 172.21.15.92:60010) 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0affd640 1 -- 172.21.15.92:0/2627488311 learned_addr learned my addr 172.21.15.92:0/2627488311 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a03fff640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a0c100970 0x7f0a0c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0b7fe640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a0c106bb0 0x7f0a0c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0affd640 1 -- 172.21.15.92:0/2627488311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a0c100970 msgr2=0x7f0a0c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0affd640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a0c100970 0x7f0a0c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0affd640 1 -- 172.21.15.92:0/2627488311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a0c106bb0 msgr2=0x7f0a0c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0affd640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a0c106bb0 0x7f0a0c19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0affd640 1 -- 172.21.15.92:0/2627488311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0c19d4d0 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a0affd640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 0x7f0a0c198520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c890 tx=0x7f09fc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a1083b640 1 -- 172.21.15.92:0/2627488311 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09fc004220 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.301+0000 7f0a1083b640 1 -- 172.21.15.92:0/2627488311 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09fc0043c0 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.302+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0c19d7c0 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.302+0000 7f0a1083b640 1 -- 172.21.15.92:0/2627488311 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0049e0 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.302+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a0c1a50a0 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.303+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a0c100430 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.304+0000 7f0a1083b640 1 -- 172.21.15.92:0/2627488311 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f09fc0079b0 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.304+0000 7f0a1083b640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f09f80a2b80 0x7f09f80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.305+0000 7f0a03fff640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f09f80a2b80 0x7f09f80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.305+0000 7f0a1083b640 1 -- 172.21.15.92:0/2627488311 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f09fc0cf0b0 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.305+0000 7f0a03fff640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f09f80a2b80 0x7f09f80a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0fe460 tx=0x7f09f4031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:56.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.308+0000 7f0a1083b640 1 -- 172.21.15.92:0/2627488311 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f09fc014030 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.510+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0a0c199880 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.800+0000 7f0a1083b640 1 -- 172.21.15.92:0/2627488311 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f09fc09c0b0 con 0x7f0a0c0fffd0 2024-09-10T10:34:56.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f09f80a2b80 msgr2=0x7f09f80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:56.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f09f80a2b80 0x7f09f80a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0fe460 tx=0x7f09f4031490 comp rx=0 tx=0).stop 2024-09-10T10:34:56.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 msgr2=0x7f0a0c198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:56.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 0x7f0a0c198520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c890 tx=0x7f09fc00cd50 comp rx=0 tx=0).stop 2024-09-10T10:34:56.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 shutdown_connections 2024-09-10T10:34:56.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f09f80a2b80 0x7f09f80a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:56.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0a0c106bb0 0x7f0a0c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:56.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0a0c100970 0x7f0a0c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:56.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 --2- 172.21.15.92:0/2627488311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a0c0fffd0 0x7f0a0c198520 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:56.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.802+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 >> 172.21.15.92:0/2627488311 conn(0x7f0a0c0fbee0 msgr2=0x7f0a0c0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:56.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.803+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 shutdown_connections 2024-09-10T10:34:56.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:56.803+0000 7f0a1183d640 1 -- 172.21.15.92:0/2627488311 wait complete. 2024-09-10T10:34:57.041 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: 2024-09-10T10:34:56.546+0000 7f84c6011640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T10:34:57.041 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: 2024-09-10T10:34:56.546+0000 7f84c6011640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T10:34:57.041 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: 2024-09-10T10:34:56.546+0000 7f84c6011640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-10T10:34:57.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T10:34:57.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] up:active 2024-09-10T10:34:57.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T10:34:57.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:34:57.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: Cluster is now healthy 2024-09-10T10:34:57.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:active} 8 up:standby 2024-09-10T10:34:57.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T10:34:57.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-10T10:34:57.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: pgmap v284: 97 pgs: 97 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-10T10:34:57.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:56 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2627488311' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] up:active 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: Cluster is now healthy 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:active} 8 up:standby 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: pgmap v284: 97 pgs: 97 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-10T10:34:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:56 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2627488311' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T10:34:57.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T10:34:57.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] up:active 2024-09-10T10:34:57.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T10:34:57.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T10:34:57.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: Cluster is now healthy 2024-09-10T10:34:57.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: fsmap cephfs:4 {0=i=up:active,1=c=up:active,2=f=up:active,3=b=up:active} 8 up:standby 2024-09-10T10:34:57.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T10:34:57.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-10T10:34:57.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: pgmap v284: 97 pgs: 97 active+clean; 581 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-10T10:34:57.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:56 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2627488311' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T10:34:57.524 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-10T10:34:57.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T10:34:57.771 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:58.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:57 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2627488311' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T10:34:58.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:57 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] up:active 2024-09-10T10:34:58.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:57 smithi092 ceph-mon[30834]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T10:34:58.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:57 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:34:58.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:57 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2627488311' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T10:34:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:57 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] up:active 2024-09-10T10:34:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:57 smithi097 ceph-mon[35213]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T10:34:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:57 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:34:58.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.259+0000 7f6b72fe9640 1 -- 172.21.15.92:0/4151722988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c101420 msgr2=0x7f6b6c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:58.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.259+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/4151722988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c101420 0x7f6b6c10d950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009930 tx=0x7f6b5c02a420 comp rx=0 tx=0).stop 2024-09-10T10:34:58.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.259+0000 7f6b72fe9640 1 -- 172.21.15.92:0/4151722988 shutdown_connections 2024-09-10T10:34:58.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.259+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/4151722988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c101420 0x7f6b6c10d950 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.259+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/4151722988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c100a80 0x7f6b6c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.259+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/4151722988 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b6c106a80 0x7f6b6c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.259+0000 7f6b72fe9640 1 -- 172.21.15.92:0/4151722988 >> 172.21.15.92:0/4151722988 conn(0x7f6b6c0fc7a0 msgr2=0x7f6b6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:58.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.259+0000 7f6b72fe9640 1 -- 172.21.15.92:0/4151722988 shutdown_connections 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.259+0000 7f6b72fe9640 1 -- 172.21.15.92:0/4151722988 wait complete. 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b72fe9640 1 Processor -- start 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b72fe9640 1 -- start start 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b72fe9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c100a80 0x7f6b6c196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b72fe9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c101420 0x7f6b6c1966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b72fe9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b6c106a80 0x7f6b6c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b72fe9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c10fd80 con 0x7f6b6c100a80 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b72fe9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c10fc00 con 0x7f6b6c106a80 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b72fe9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c10ff00 con 0x7f6b6c101420 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b70d85640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c100a80 0x7f6b6c196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b70d85640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c100a80 0x7f6b6c196180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60038/0 (socket says 172.21.15.92:60038) 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b70d85640 1 -- 172.21.15.92:0/3652026857 learned_addr learned my addr 172.21.15.92:0/3652026857 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:58.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b6bfff640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c101420 0x7f6b6c1966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b71586640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b6c106a80 0x7f6b6c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b70d85640 1 -- 172.21.15.92:0/3652026857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c101420 msgr2=0x7f6b6c1966c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b70d85640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c101420 0x7f6b6c1966c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b70d85640 1 -- 172.21.15.92:0/3652026857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b6c106a80 msgr2=0x7f6b6c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b70d85640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b6c106a80 0x7f6b6c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b70d85640 1 -- 172.21.15.92:0/3652026857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c19b130 con 0x7f6b6c100a80 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b6bfff640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c101420 0x7f6b6c1966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.260+0000 7f6b71586640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b6c106a80 0x7f6b6c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.261+0000 7f6b70d85640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c100a80 0x7f6b6c196180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400cce0 tx=0x7f6b6400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.261+0000 7f6b69ffb640 1 -- 172.21.15.92:0/3652026857 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6400f650 con 0x7f6b6c100a80 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.261+0000 7f6b69ffb640 1 -- 172.21.15.92:0/3652026857 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b6400fcd0 con 0x7f6b6c100a80 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.261+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c19b420 con 0x7f6b6c100a80 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.261+0000 7f6b69ffb640 1 -- 172.21.15.92:0/3652026857 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64018c70 con 0x7f6b6c100a80 2024-09-10T10:34:58.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.261+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6c1a2d00 con 0x7f6b6c100a80 2024-09-10T10:34:58.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.262+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6c100ee0 con 0x7f6b6c100a80 2024-09-10T10:34:58.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.263+0000 7f6b69ffb640 1 -- 172.21.15.92:0/3652026857 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6b6400f7f0 con 0x7f6b6c100a80 2024-09-10T10:34:58.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.264+0000 7f6b69ffb640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6b540a4d90 0x7f6b540a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:58.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.264+0000 7f6b6bfff640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6b540a4d90 0x7f6b540a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:58.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.264+0000 7f6b69ffb640 1 -- 172.21.15.92:0/3652026857 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f6b640cf4b0 con 0x7f6b6c100a80 2024-09-10T10:34:58.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.264+0000 7f6b6bfff640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6b540a4d90 0x7f6b540a7250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b60005fd0 tx=0x7f6b60005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:58.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.268+0000 7f6b69ffb640 1 -- 172.21.15.92:0/3652026857 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b64014030 con 0x7f6b6c100a80 2024-09-10T10:34:58.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:57 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2627488311' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T10:34:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:57 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] up:active 2024-09-10T10:34:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:57 smithi121 ceph-mon[35231]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T10:34:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:57 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:34:58.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.456+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6b6c0fd4a0 con 0x7f6b540a4d90 2024-09-10T10:34:58.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.482+0000 7f6b69ffb640 1 -- 172.21.15.92:0/3652026857 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6b6c0fd4a0 con 0x7f6b540a4d90 2024-09-10T10:34:58.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.484+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6b540a4d90 msgr2=0x7f6b540a7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:58.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6b540a4d90 0x7f6b540a7250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b60005fd0 tx=0x7f6b60005ea0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c100a80 msgr2=0x7f6b6c196180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:58.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c100a80 0x7f6b6c196180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400cce0 tx=0x7f6b6400a620 comp rx=0 tx=0).stop 2024-09-10T10:34:58.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 shutdown_connections 2024-09-10T10:34:58.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6b540a4d90 0x7f6b540a7250 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6b6c106a80 0x7f6b6c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b6c101420 0x7f6b6c1966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 --2- 172.21.15.92:0/3652026857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b6c100a80 0x7f6b6c196180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:58.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 >> 172.21.15.92:0/3652026857 conn(0x7f6b6c0fc7a0 msgr2=0x7f6b6c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:58.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 shutdown_connections 2024-09-10T10:34:58.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:58.485+0000 7f6b72fe9640 1 -- 172.21.15.92:0/3652026857 wait complete. 2024-09-10T10:34:58.809 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:34:58 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:34:58.462+0000 7fd212cd4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:34:58.809 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:34:58 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:34:58.462+0000 7fd212cd4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:34:58.809 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:34:58 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:34:58.462+0000 7fd212cd4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:34:58.809 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:34:58 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:34:58.462+0000 7fd212cd4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:34:58.809 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:34:58 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:34:58.462+0000 7fd212cd4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:34:59.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:58 smithi097 ceph-mon[35213]: pgmap v285: 97 pgs: 97 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 5.6 KiB/s wr, 16 op/s 2024-09-10T10:34:59.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:58 smithi092 ceph-mon[30834]: pgmap v285: 97 pgs: 97 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 5.6 KiB/s wr, 16 op/s 2024-09-10T10:34:59.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T10:34:59.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:58 smithi121 ceph-mon[35231]: pgmap v285: 97 pgs: 97 active+clean; 584 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 5.6 KiB/s wr, 16 op/s 2024-09-10T10:34:59.463 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:34:59.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:34:59 smithi092 ceph-mon[30834]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:34:59.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.951+0000 7ff4c6df4640 1 -- 172.21.15.92:0/1177445089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0102790 msgr2=0x7ff4c01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:59.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.951+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/1177445089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0102790 0x7ff4c01067e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009900 tx=0x7ff4b402a410 comp rx=0 tx=0).stop 2024-09-10T10:34:59.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 -- 172.21.15.92:0/1177445089 shutdown_connections 2024-09-10T10:34:59.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/1177445089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4c0106f10 0x7ff4c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:59.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/1177445089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0102790 0x7ff4c01067e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:59.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/1177445089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4c0101de0 0x7ff4c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:59.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 -- 172.21.15.92:0/1177445089 >> 172.21.15.92:0/1177445089 conn(0x7ff4c00fd8c0 msgr2=0x7ff4c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 -- 172.21.15.92:0/1177445089 shutdown_connections 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 -- 172.21.15.92:0/1177445089 wait complete. 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 Processor -- start 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 -- start start 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0101de0 0x7ff4c01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4c0102790 0x7ff4c0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4c0106f10 0x7ff4c019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0112010 con 0x7ff4c0101de0 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0111e90 con 0x7ff4c0106f10 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c6df4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0112190 con 0x7ff4c0102790 2024-09-10T10:34:59.979 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c4b90640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0101de0 0x7ff4c01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c4b90640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0101de0 0x7ff4c01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60074/0 (socket says 172.21.15.92:60074) 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.952+0000 7ff4c4b90640 1 -- 172.21.15.92:0/3380114805 learned_addr learned my addr 172.21.15.92:0/3380114805 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4bffff640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4c0102790 0x7ff4c0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4c4b90640 1 -- 172.21.15.92:0/3380114805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4c0102790 msgr2=0x7ff4c0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4c4b90640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4c0102790 0x7ff4c0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4c4b90640 1 -- 172.21.15.92:0/3380114805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4c0106f10 msgr2=0x7ff4c019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4c5391640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4c0106f10 0x7ff4c019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4c4b90640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4c0106f10 0x7ff4c019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4c4b90640 1 -- 172.21.15.92:0/3380114805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c019d560 con 0x7ff4c0101de0 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4c4b90640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0101de0 0x7ff4c01985b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000b4a0 tx=0x7ff4b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4bdffb640 1 -- 172.21.15.92:0/3380114805 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0014070 con 0x7ff4c0101de0 2024-09-10T10:34:59.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c019d850 con 0x7ff4c0101de0 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4bdffb640 1 -- 172.21.15.92:0/3380114805 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b0010af0 con 0x7ff4c0101de0 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4bdffb640 1 -- 172.21.15.92:0/3380114805 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0017d10 con 0x7ff4c0101de0 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.953+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c01a5130 con 0x7ff4c0101de0 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.954+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c0102240 con 0x7ff4c0101de0 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.955+0000 7ff4bdffb640 1 -- 172.21.15.92:0/3380114805 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff4b0017070 con 0x7ff4c0101de0 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.956+0000 7ff4bdffb640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff4a80a2b80 0x7ff4a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.956+0000 7ff4bffff640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff4a80a2b80 0x7ff4a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.956+0000 7ff4bdffb640 1 -- 172.21.15.92:0/3380114805 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7ff4b00ce490 con 0x7ff4c0101de0 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.956+0000 7ff4bffff640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff4a80a2b80 0x7ff4a80a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00fdd50 tx=0x7ff4b4031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:34:59.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:34:59.960+0000 7ff4bdffb640 1 -- 172.21.15.92:0/3380114805 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff4b009b490 con 0x7ff4c0101de0 2024-09-10T10:35:00.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:34:59 smithi097 ceph-mon[35213]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:00.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.151+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff4c010a160 con 0x7ff4a80a2b80 2024-09-10T10:35:00.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.175+0000 7ff4bdffb640 1 -- 172.21.15.92:0/3380114805 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff4b4031860 con 0x7ff4a80a2b80 2024-09-10T10:35:00.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff4a80a2b80 msgr2=0x7ff4a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:00.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff4a80a2b80 0x7ff4a80a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00fdd50 tx=0x7ff4b4031490 comp rx=0 tx=0).stop 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0101de0 msgr2=0x7ff4c01985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0101de0 0x7ff4c01985b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000b4a0 tx=0x7ff4b000b960 comp rx=0 tx=0).stop 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 shutdown_connections 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7ff4a80a2b80 0x7ff4a80a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff4c0106f10 0x7ff4c019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4c0102790 0x7ff4c0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 --2- 172.21.15.92:0/3380114805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff4c0101de0 0x7ff4c01985b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 >> 172.21.15.92:0/3380114805 conn(0x7ff4c00fd8c0 msgr2=0x7ff4c00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 shutdown_connections 2024-09-10T10:35:00.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:00.177+0000 7ff4c6df4640 1 -- 172.21.15.92:0/3380114805 wait complete. 2024-09-10T10:35:00.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:34:59 smithi121 ceph-mon[35231]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:00.876 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T10:35:01.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:00 smithi097 ceph-mon[35213]: pgmap v286: 97 pgs: 97 active+clean; 591 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6.9 KiB/s wr, 22 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:01.093 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:00 smithi097 ceph-mon[35213]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:01.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:00 smithi092 ceph-mon[30834]: pgmap v286: 97 pgs: 97 active+clean; 591 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6.9 KiB/s wr, 22 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:01.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:00 smithi092 ceph-mon[30834]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:01.125 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:01.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:00 smithi121 ceph-mon[35231]: pgmap v286: 97 pgs: 97 active+clean; 591 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6.9 KiB/s wr, 22 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:01.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:00 smithi121 ceph-mon[35231]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:01.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.593+0000 7f8616e15640 1 -- 172.21.15.92:0/559883178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102570 msgr2=0x7f86101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.593+0000 7f8616e15640 1 --2- 172.21.15.92:0/559883178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102570 0x7f86101029b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009900 tx=0x7f85f802a480 comp rx=0 tx=0).stop 2024-09-10T10:35:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.593+0000 7f8616e15640 1 -- 172.21.15.92:0/559883178 shutdown_connections 2024-09-10T10:35:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.593+0000 7f8616e15640 1 --2- 172.21.15.92:0/559883178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8610102ef0 0x7f861010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.593+0000 7f8616e15640 1 --2- 172.21.15.92:0/559883178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102570 0x7f86101029b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.593+0000 7f8616e15640 1 --2- 172.21.15.92:0/559883178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8610100e20 0x7f8610101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.593+0000 7f8616e15640 1 -- 172.21.15.92:0/559883178 >> 172.21.15.92:0/559883178 conn(0x7f86100fc7d0 msgr2=0x7f86100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.593+0000 7f8616e15640 1 -- 172.21.15.92:0/559883178 shutdown_connections 2024-09-10T10:35:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.593+0000 7f8616e15640 1 -- 172.21.15.92:0/559883178 wait complete. 2024-09-10T10:35:01.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f8616e15640 1 Processor -- start 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f8616e15640 1 -- start start 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f8616e15640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8610100e20 0x7f86101984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f8616e15640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8610102570 0x7f8610198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f8616e15640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102ef0 0x7f861019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f8616e15640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8610110fa0 con 0x7f8610102ef0 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f8616e15640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8610110e20 con 0x7f8610100e20 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f8616e15640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8610111120 con 0x7f8610102570 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f86153b2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102ef0 0x7f861019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f86153b2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102ef0 0x7f861019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60106/0 (socket says 172.21.15.92:60106) 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.594+0000 7f86153b2640 1 -- 172.21.15.92:0/2751785454 learned_addr learned my addr 172.21.15.92:0/2751785454 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f860ffff640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8610102570 0x7f8610198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:01.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f8614bb1640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8610100e20 0x7f86101984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f86153b2640 1 -- 172.21.15.92:0/2751785454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8610102570 msgr2=0x7f8610198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f86153b2640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8610102570 0x7f8610198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f86153b2640 1 -- 172.21.15.92:0/2751785454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8610100e20 msgr2=0x7f86101984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f86153b2640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8610100e20 0x7f86101984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f86153b2640 1 -- 172.21.15.92:0/2751785454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861019d4a0 con 0x7f8610102ef0 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f860ffff640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8610102570 0x7f8610198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f86153b2640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102ef0 0x7f861019cdc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f860800c970 tx=0x7f860800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f860dffb640 1 -- 172.21.15.92:0/2751785454 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608007bb0 con 0x7f8610102ef0 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f860dffb640 1 -- 172.21.15.92:0/2751785454 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8608007d50 con 0x7f8610102ef0 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861019d790 con 0x7f8610102ef0 2024-09-10T10:35:01.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f860dffb640 1 -- 172.21.15.92:0/2751785454 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608018800 con 0x7f8610102ef0 2024-09-10T10:35:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.595+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86101a5070 con 0x7f8610102ef0 2024-09-10T10:35:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.596+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8610101200 con 0x7f8610102ef0 2024-09-10T10:35:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.597+0000 7f860dffb640 1 -- 172.21.15.92:0/2751785454 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f860800fa50 con 0x7f8610102ef0 2024-09-10T10:35:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.598+0000 7f860dffb640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f85fc0a2c90 0x7f85fc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.598+0000 7f8614bb1640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f85fc0a2c90 0x7f85fc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.598+0000 7f860dffb640 1 -- 172.21.15.92:0/2751785454 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f86080cf140 con 0x7f8610102ef0 2024-09-10T10:35:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.598+0000 7f8614bb1640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f85fc0a2c90 0x7f85fc0a5150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8600007dc0 tx=0x7f86000072f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:01.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.602+0000 7f860dffb640 1 -- 172.21.15.92:0/2751785454 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8608014030 con 0x7f8610102ef0 2024-09-10T10:35:01.797 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.796+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f8610062630 con 0x7f85fc0a2c90 2024-09-10T10:35:01.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.801+0000 7f860dffb640 1 -- 172.21.15.92:0/2751785454 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f8610062630 con 0x7f85fc0a2c90 2024-09-10T10:35:01.802 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/qa/sv_0/cc18a42d-62e1-4489-8262-b7d3bedc1fe6 2024-09-10T10:35:01.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f85fc0a2c90 msgr2=0x7f85fc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:01.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f85fc0a2c90 0x7f85fc0a5150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8600007dc0 tx=0x7f86000072f0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102ef0 msgr2=0x7f861019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102ef0 0x7f861019cdc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f860800c970 tx=0x7f860800ce30 comp rx=0 tx=0).stop 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 shutdown_connections 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f85fc0a2c90 0x7f85fc0a5150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8610102ef0 0x7f861019cdc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8610102570 0x7f8610198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 --2- 172.21.15.92:0/2751785454 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8610100e20 0x7f86101984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 >> 172.21.15.92:0/2751785454 conn(0x7f86100fc7d0 msgr2=0x7f861006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 shutdown_connections 2024-09-10T10:35:01.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:01.803+0000 7f8616e15640 1 -- 172.21.15.92:0/2751785454 wait complete. 2024-09-10T10:35:01.817 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:35:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: 2024-09-10T10:35:01.547+0000 7f84c6011640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-10T10:35:02.048 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:01 smithi092 ceph-mon[30834]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T10:35:02.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:01 smithi097 ceph-mon[35213]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T10:35:02.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:01 smithi121 ceph-mon[35231]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T10:35:02.605 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T10:35:02.848 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:02.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:02 smithi092 ceph-mon[30834]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:02.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:02 smithi092 ceph-mon[30834]: pgmap v287: 97 pgs: 97 active+clean; 591 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.1 KiB/s wr, 28 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:03.192 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:02 smithi121 ceph-mon[35231]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:03.192 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:02 smithi121 ceph-mon[35231]: pgmap v287: 97 pgs: 97 active+clean; 591 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.1 KiB/s wr, 28 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:03.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:02 smithi097 ceph-mon[35213]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:03.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:02 smithi097 ceph-mon[35213]: pgmap v287: 97 pgs: 97 active+clean; 591 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.1 KiB/s wr, 28 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:03.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.330+0000 7f62dedd0640 1 -- 172.21.15.92:0/1513998013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8102ef0 msgr2=0x7f62d810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:03.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.330+0000 7f62dedd0640 1 --2- 172.21.15.92:0/1513998013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8102ef0 0x7f62d810da40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009900 tx=0x7f62d002a480 comp rx=0 tx=0).stop 2024-09-10T10:35:03.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.330+0000 7f62dedd0640 1 -- 172.21.15.92:0/1513998013 shutdown_connections 2024-09-10T10:35:03.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.330+0000 7f62dedd0640 1 --2- 172.21.15.92:0/1513998013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8102ef0 0x7f62d810da40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.330+0000 7f62dedd0640 1 --2- 172.21.15.92:0/1513998013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62d8102570 0x7f62d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.330+0000 7f62dedd0640 1 --2- 172.21.15.92:0/1513998013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62d8100e20 0x7f62d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.330+0000 7f62dedd0640 1 -- 172.21.15.92:0/1513998013 >> 172.21.15.92:0/1513998013 conn(0x7f62d80fc7d0 msgr2=0x7f62d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 -- 172.21.15.92:0/1513998013 shutdown_connections 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 -- 172.21.15.92:0/1513998013 wait complete. 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 Processor -- start 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 -- start start 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8100e20 0x7f62d81991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62d8102570 0x7f62d8199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62d8102ef0 0x7f62d81a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8110f80 con 0x7f62d8100e20 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8110e00 con 0x7f62d8102ef0 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dedd0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8111100 con 0x7f62d8102570 2024-09-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dcb6c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8100e20 0x7f62d81991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dcb6c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8100e20 0x7f62d81991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44736/0 (socket says 172.21.15.92:44736) 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62dcb6c640 1 -- 172.21.15.92:0/3564607650 learned_addr learned my addr 172.21.15.92:0/3564607650 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.331+0000 7f62d7fff640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62d8102570 0x7f62d8199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dd36d640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62d8102ef0 0x7f62d81a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dcb6c640 1 -- 172.21.15.92:0/3564607650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62d8102570 msgr2=0x7f62d8199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dcb6c640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62d8102570 0x7f62d8199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dcb6c640 1 -- 172.21.15.92:0/3564607650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62d8102ef0 msgr2=0x7f62d81a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dcb6c640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62d8102ef0 0x7f62d81a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dcb6c640 1 -- 172.21.15.92:0/3564607650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d81a47b0 con 0x7f62d8100e20 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dd36d640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62d8102ef0 0x7f62d81a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dcb6c640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8100e20 0x7f62d81991f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62c800d770 tx=0x7f62c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62d5ffb640 1 -- 172.21.15.92:0/3564607650 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c8017070 con 0x7f62d8100e20 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62d5ffb640 1 -- 172.21.15.92:0/3564607650 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62c8005500 con 0x7f62d8100e20 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d81a4980 con 0x7f62d8100e20 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62d5ffb640 1 -- 172.21.15.92:0/3564607650 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c8004e00 con 0x7f62d8100e20 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.332+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d81a4ec0 con 0x7f62d8100e20 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.333+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d8101200 con 0x7f62d8100e20 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.334+0000 7f62d5ffb640 1 -- 172.21.15.92:0/3564607650 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f62c8004fa0 con 0x7f62d8100e20 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.335+0000 7f62d5ffb640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62c00a2c90 0x7f62c00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.335+0000 7f62d7fff640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62c00a2c90 0x7f62c00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.335+0000 7f62d5ffb640 1 -- 172.21.15.92:0/3564607650 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f62c80ceae0 con 0x7f62d8100e20 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.335+0000 7f62d7fff640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62c00a2c90 0x7f62c00a5150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f62d806ab00 tx=0x7f62cc0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.339+0000 7f62d5ffb640 1 -- 172.21.15.92:0/3564607650 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62c809b9e0 con 0x7f62d8100e20 2024-09-10T10:35:03.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.530+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f62d8106ed0 con 0x7f62c00a2c90 2024-09-10T10:35:03.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.552+0000 7f62d5ffb640 1 -- 172.21.15.92:0/3564607650 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f62d8106ed0 con 0x7f62c00a2c90 2024-09-10T10:35:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62c00a2c90 msgr2=0x7f62c00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62c00a2c90 0x7f62c00a5150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f62d806ab00 tx=0x7f62cc0075b0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8100e20 msgr2=0x7f62d81991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8100e20 0x7f62d81991f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62c800d770 tx=0x7f62c800dc30 comp rx=0 tx=0).stop 2024-09-10T10:35:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 shutdown_connections 2024-09-10T10:35:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f62c00a2c90 0x7f62c00a5150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62d8102ef0 0x7f62d81a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62d8102570 0x7f62d8199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 --2- 172.21.15.92:0/3564607650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d8100e20 0x7f62d81991f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 >> 172.21.15.92:0/3564607650 conn(0x7f62d80fc7d0 msgr2=0x7f62d81067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 shutdown_connections 2024-09-10T10:35:03.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:03.555+0000 7f62dedd0640 1 -- 172.21.15.92:0/3564607650 wait complete. 2024-09-10T10:35:04.201 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T10:35:04.443 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:04.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.963+0000 7f44019a7640 1 -- 172.21.15.92:0/1700129081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc101de0 msgr2=0x7f43fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.963+0000 7f44019a7640 1 --2- 172.21.15.92:0/1700129081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc101de0 0x7f43fc1021c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009ca0 tx=0x7f43ec02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.963+0000 7f44019a7640 1 -- 172.21.15.92:0/1700129081 shutdown_connections 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.963+0000 7f44019a7640 1 --2- 172.21.15.92:0/1700129081 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43fc106f10 0x7f43fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.963+0000 7f44019a7640 1 --2- 172.21.15.92:0/1700129081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc102790 0x7f43fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.963+0000 7f44019a7640 1 --2- 172.21.15.92:0/1700129081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc101de0 0x7f43fc1021c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.963+0000 7f44019a7640 1 -- 172.21.15.92:0/1700129081 >> 172.21.15.92:0/1700129081 conn(0x7f43fc0fd8c0 msgr2=0x7f43fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.963+0000 7f44019a7640 1 -- 172.21.15.92:0/1700129081 shutdown_connections 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.963+0000 7f44019a7640 1 -- 172.21.15.92:0/1700129081 wait complete. 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.964+0000 7f44019a7640 1 Processor -- start 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.964+0000 7f44019a7640 1 -- start start 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.964+0000 7f44019a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc101de0 0x7f43fc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:04.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.964+0000 7f44019a7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc102790 0x7f43fc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.964+0000 7f44019a7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43fc106f10 0x7f43fc19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.964+0000 7f44019a7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc111f90 con 0x7f43fc102790 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.964+0000 7f44019a7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc111e10 con 0x7f43fc106f10 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.964+0000 7f44019a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc112110 con 0x7f43fc101de0 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fa7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc102790 0x7f43fc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fa7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc102790 0x7f43fc1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44754/0 (socket says 172.21.15.92:44754) 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fa7fc640 1 -- 172.21.15.92:0/1049086157 learned_addr learned my addr 172.21.15.92:0/1049086157 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43faffd640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc101de0 0x7f43fc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fb7fe640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43fc106f10 0x7f43fc19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fa7fc640 1 -- 172.21.15.92:0/1049086157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc101de0 msgr2=0x7f43fc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fa7fc640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc101de0 0x7f43fc198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fa7fc640 1 -- 172.21.15.92:0/1049086157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43fc106f10 msgr2=0x7f43fc19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:04.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fa7fc640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43fc106f10 0x7f43fc19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fa7fc640 1 -- 172.21.15.92:0/1049086157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc19d440 con 0x7f43fc102790 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fb7fe640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43fc106f10 0x7f43fc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f43fa7fc640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc102790 0x7f43fc1989d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43f000d950 tx=0x7f43f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f44009a5640 1 -- 172.21.15.92:0/1049086157 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f0017030 con 0x7f43fc102790 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f44009a5640 1 -- 172.21.15.92:0/1049086157 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43f0004020 con 0x7f43fc102790 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc19d730 con 0x7f43fc102790 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f44009a5640 1 -- 172.21.15.92:0/1049086157 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f00047a0 con 0x7f43fc102790 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.965+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc1a5010 con 0x7f43fc102790 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.966+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc1021c0 con 0x7f43fc102790 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.967+0000 7f44009a5640 1 -- 172.21.15.92:0/1049086157 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f43f00041d0 con 0x7f43fc102790 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.968+0000 7f44009a5640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f43e40a2c10 0x7f43e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.968+0000 7f44009a5640 1 -- 172.21.15.92:0/1049086157 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f43f00ceb70 con 0x7f43fc102790 2024-09-10T10:35:04.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.968+0000 7f43faffd640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f43e40a2c10 0x7f43e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:04.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.968+0000 7f43faffd640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f43e40a2c10 0x7f43e40a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000f80 tx=0x7f43ec0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:04.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:04.972+0000 7f44009a5640 1 -- 172.21.15.92:0/1049086157 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43f009ba70 con 0x7f43fc102790 2024-09-10T10:35:05.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.165+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f43fc062630 con 0x7f43e40a2c10 2024-09-10T10:35:05.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.169+0000 7f44009a5640 1 -- 172.21.15.92:0/1049086157 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f43fc062630 con 0x7f43e40a2c10 2024-09-10T10:35:05.170 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/qa/sv_1/1d1ba3c6-c144-4c8e-abf8-c335e9ab9eb2 2024-09-10T10:35:05.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f43e40a2c10 msgr2=0x7f43e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f43e40a2c10 0x7f43e40a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f43ec000f80 tx=0x7f43ec0093f0 comp rx=0 tx=0).stop 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc102790 msgr2=0x7f43fc1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc102790 0x7f43fc1989d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43f000d950 tx=0x7f43f000de10 comp rx=0 tx=0).stop 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 shutdown_connections 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f43e40a2c10 0x7f43e40a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f43fc106f10 0x7f43fc19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc102790 0x7f43fc1989d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 --2- 172.21.15.92:0/1049086157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc101de0 0x7f43fc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 >> 172.21.15.92:0/1049086157 conn(0x7f43fc0fd8c0 msgr2=0x7f43fc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:05.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 shutdown_connections 2024-09-10T10:35:05.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:05.171+0000 7f44019a7640 1 -- 172.21.15.92:0/1049086157 wait complete. 2024-09-10T10:35:05.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:05 smithi092 ceph-mon[30834]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:05.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:05 smithi092 ceph-mon[30834]: pgmap v288: 97 pgs: 97 active+clean; 591 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.3 KiB/s wr, 25 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:05.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:05 smithi121 ceph-mon[35231]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:05.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:05 smithi121 ceph-mon[35231]: pgmap v288: 97 pgs: 97 active+clean; 591 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.3 KiB/s wr, 25 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:05.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:05 smithi097 ceph-mon[35213]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:05.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:05 smithi097 ceph-mon[35213]: pgmap v288: 97 pgs: 97 active+clean; 591 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.3 KiB/s wr, 25 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:05.932 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:35:06.175 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:06.446 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:06 smithi092 ceph-mon[30834]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:06.552 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:06 smithi121 ceph-mon[35231]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:06.580 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:06 smithi097 ceph-mon[35213]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:35:06.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.699+0000 7fc195b9c640 1 -- 172.21.15.92:0/1709713107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc190103760 msgr2=0x7fc190107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:06.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.699+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1709713107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc190103760 0x7fc190107ba0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc178009930 tx=0x7fc17802a420 comp rx=0 tx=0).stop 2024-09-10T10:35:06.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.699+0000 7fc195b9c640 1 -- 172.21.15.92:0/1709713107 shutdown_connections 2024-09-10T10:35:06.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.699+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1709713107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1901082e0 0x7fc19010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:06.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.699+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1709713107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc190103760 0x7fc190107ba0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:06.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.699+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1709713107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc190102db0 0x7fc190103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:06.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.699+0000 7fc195b9c640 1 -- 172.21.15.92:0/1709713107 >> 172.21.15.92:0/1709713107 conn(0x7fc1900fc7d0 msgr2=0x7fc1900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:06.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.699+0000 7fc195b9c640 1 -- 172.21.15.92:0/1709713107 shutdown_connections 2024-09-10T10:35:06.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.699+0000 7fc195b9c640 1 -- 172.21.15.92:0/1709713107 wait complete. 2024-09-10T10:35:06.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc195b9c640 1 Processor -- start 2024-09-10T10:35:06.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc195b9c640 1 -- start start 2024-09-10T10:35:06.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc195b9c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc190102db0 0x7fc190198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:06.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc195b9c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc190103760 0x7fc190198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:06.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc195b9c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1901082e0 0x7fc19019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:06.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc195b9c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc1901120d0 con 0x7fc1901082e0 2024-09-10T10:35:06.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc195b9c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc190111f50 con 0x7fc190103760 2024-09-10T10:35:06.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc195b9c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc190112250 con 0x7fc190102db0 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1901082e0 0x7fc19019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1901082e0 0x7fc19019ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44776/0 (socket says 172.21.15.92:44776) 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18ffff640 1 -- 172.21.15.92:0/1749249566 learned_addr learned my addr 172.21.15.92:0/1749249566 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc187fff640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc190103760 0x7fc190198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18f7fe640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc190102db0 0x7fc190198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18ffff640 1 -- 172.21.15.92:0/1749249566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc190102db0 msgr2=0x7fc190198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18ffff640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc190102db0 0x7fc190198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18ffff640 1 -- 172.21.15.92:0/1749249566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc190103760 msgr2=0x7fc190198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18ffff640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc190103760 0x7fc190198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18ffff640 1 -- 172.21.15.92:0/1749249566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19019d5b0 con 0x7fc1901082e0 2024-09-10T10:35:06.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18f7fe640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc190102db0 0x7fc190198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:06.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.700+0000 7fc18ffff640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1901082e0 0x7fc19019ced0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc18800b970 tx=0x7fc18800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:06.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.701+0000 7fc18d7fa640 1 -- 172.21.15.92:0/1749249566 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188019070 con 0x7fc1901082e0 2024-09-10T10:35:06.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.701+0000 7fc18d7fa640 1 -- 172.21.15.92:0/1749249566 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc18800cb40 con 0x7fc1901082e0 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.701+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19019d8a0 con 0x7fc1901082e0 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.701+0000 7fc18d7fa640 1 -- 172.21.15.92:0/1749249566 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188007650 con 0x7fc1901082e0 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.701+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1901a5180 con 0x7fc1901082e0 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.702+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc190103190 con 0x7fc1901082e0 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.703+0000 7fc18d7fa640 1 -- 172.21.15.92:0/1749249566 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc18801c070 con 0x7fc1901082e0 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.703+0000 7fc18d7fa640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc17c0a2c10 0x7fc17c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.704+0000 7fc18f7fe640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc17c0a2c10 0x7fc17c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.704+0000 7fc18d7fa640 1 -- 172.21.15.92:0/1749249566 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fc1880ce520 con 0x7fc1901082e0 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.704+0000 7fc18f7fe640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc17c0a2c10 0x7fc17c0a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc180005d00 tx=0x7fc180009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:06.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.708+0000 7fc18d7fa640 1 -- 172.21.15.92:0/1749249566 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc18809aee0 con 0x7fc1901082e0 2024-09-10T10:35:06.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.912+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc19010a2c0 con 0x7fc1901082e0 2024-09-10T10:35:06.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.913+0000 7fc18d7fa640 1 -- 172.21.15.92:0/1749249566 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7fc18809f1e0 con 0x7fc1901082e0 2024-09-10T10:35:06.915 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"btime":"2024-09-10T10:34:56:804663+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:34:45.351151+0000","modified":"2024-09-10T10:34:56.804641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24472,"mds_1":24451,"mds_2":24445,"mds_3":24431,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/15499972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":15499972},{"type":"v1","addr":"172.21.15.92:6841","nonce":15499972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24359":{"gid":24359,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24386":{"gid":24386,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":15,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"b","rank":3,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6839/2331166625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6838","nonce":2331166625},{"type":"v1","addr":"172.21.15.97:6839","nonce":2331166625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24451,24445,24431,24424]},"id":1}]} 2024-09-10T10:35:06.915 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2024-09-10T10:35:06.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.915+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc17c0a2c10 msgr2=0x7fc17c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:06.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.915+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc17c0a2c10 0x7fc17c0a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc180005d00 tx=0x7fc180009550 comp rx=0 tx=0).stop 2024-09-10T10:35:06.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.915+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1901082e0 msgr2=0x7fc19019ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:06.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.915+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1901082e0 0x7fc19019ced0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc18800b970 tx=0x7fc18800be30 comp rx=0 tx=0).stop 2024-09-10T10:35:06.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.915+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 shutdown_connections 2024-09-10T10:35:06.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.916+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc17c0a2c10 0x7fc17c0a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:06.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.916+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1901082e0 0x7fc19019ced0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:06.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.916+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc190103760 0x7fc190198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:06.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.916+0000 7fc195b9c640 1 --2- 172.21.15.92:0/1749249566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc190102db0 0x7fc190198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:06.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.916+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 >> 172.21.15.92:0/1749249566 conn(0x7fc1900fc7d0 msgr2=0x7fc190105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:06.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.916+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 shutdown_connections 2024-09-10T10:35:06.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:06.916+0000 7fc195b9c640 1 -- 172.21.15.92:0/1749249566 wait complete. 2024-09-10T10:35:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:07 smithi121 ceph-mon[35231]: pgmap v289: 97 pgs: 97 active+clean; 623 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 25 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:07 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1749249566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:35:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:07 smithi097 ceph-mon[35213]: pgmap v289: 97 pgs: 97 active+clean; 623 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 25 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:07 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1749249566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:35:07.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:07 smithi092 ceph-mon[30834]: pgmap v289: 97 pgs: 97 active+clean; 623 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 25 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T10:35:07.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:07 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1749249566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:35:07.682 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:35:07.935 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:08.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.411+0000 7f881d9d2640 1 -- 172.21.15.92:0/2319854002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818102d90 msgr2=0x7f8818103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:08.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.411+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2319854002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818102d90 0x7f8818103170 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8808009cd0 tx=0x7f880802a8e0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.411+0000 7f881d9d2640 1 -- 172.21.15.92:0/2319854002 shutdown_connections 2024-09-10T10:35:08.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.411+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2319854002 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8818108290 0x7f881810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.411+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2319854002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8818103740 0x7f8818107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.411+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2319854002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818102d90 0x7f8818103170 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.411+0000 7f881d9d2640 1 -- 172.21.15.92:0/2319854002 >> 172.21.15.92:0/2319854002 conn(0x7f88180fc7d0 msgr2=0x7f88180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:08.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.411+0000 7f881d9d2640 1 -- 172.21.15.92:0/2319854002 shutdown_connections 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.411+0000 7f881d9d2640 1 -- 172.21.15.92:0/2319854002 wait complete. 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f881d9d2640 1 Processor -- start 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f881d9d2640 1 -- start start 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f881d9d2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8818102d90 0x7f88181985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f881d9d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8818103740 0x7f8818198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f881d9d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818108290 0x7f881819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f881d9d2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f88181120d0 con 0x7f8818108290 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f881d9d2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8818111f50 con 0x7f8818102d90 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f881d9d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8818112250 con 0x7f8818103740 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f88177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818108290 0x7f881819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f88177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818108290 0x7f881819cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44804/0 (socket says 172.21.15.92:44804) 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.412+0000 7f88177fe640 1 -- 172.21.15.92:0/2347232536 learned_addr learned my addr 172.21.15.92:0/2347232536 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:08.437 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f88167fc640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8818103740 0x7f8818198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f8816ffd640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8818102d90 0x7f88181985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f88177fe640 1 -- 172.21.15.92:0/2347232536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8818103740 msgr2=0x7f8818198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f88177fe640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8818103740 0x7f8818198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f88177fe640 1 -- 172.21.15.92:0/2347232536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8818102d90 msgr2=0x7f88181985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f88177fe640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8818102d90 0x7f88181985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f88177fe640 1 -- 172.21.15.92:0/2347232536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881819d580 con 0x7f8818108290 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f88167fc640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8818103740 0x7f8818198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f88177fe640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818108290 0x7f881819cea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8810009fd0 tx=0x7f881000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f881c9d0640 1 -- 172.21.15.92:0/2347232536 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810011830 con 0x7f8818108290 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f881c9d0640 1 -- 172.21.15.92:0/2347232536 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8810016070 con 0x7f8818108290 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881819d870 con 0x7f8818108290 2024-09-10T10:35:08.438 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f881c9d0640 1 -- 172.21.15.92:0/2347232536 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881000f2e0 con 0x7f8818108290 2024-09-10T10:35:08.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.413+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88181a5150 con 0x7f8818108290 2024-09-10T10:35:08.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.414+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881806a7f0 con 0x7f8818108290 2024-09-10T10:35:08.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.415+0000 7f881c9d0640 1 -- 172.21.15.92:0/2347232536 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f88100119d0 con 0x7f8818108290 2024-09-10T10:35:08.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.416+0000 7f881c9d0640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f88040a2c10 0x7f88040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:08.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.416+0000 7f8816ffd640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f88040a2c10 0x7f88040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:08.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.416+0000 7f881c9d0640 1 -- 172.21.15.92:0/2347232536 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f88100ce820 con 0x7f8818108290 2024-09-10T10:35:08.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.417+0000 7f8816ffd640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f88040a2c10 0x7f88040a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8808006010 tx=0x7f8808009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:08.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.420+0000 7f881c9d0640 1 -- 172.21.15.92:0/2347232536 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f881009b730 con 0x7f8818108290 2024-09-10T10:35:08.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.589+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f881810a2a0 con 0x7f8818108290 2024-09-10T10:35:08.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.591+0000 7f881c9d0640 1 -- 172.21.15.92:0/2347232536 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22594 (secure 0 0 0) 0x7f881009b030 con 0x7f8818108290 2024-09-10T10:35:08.592 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":83,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:34:55.779980+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:34:41.056656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:34:43.485327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:35:08.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f88040a2c10 msgr2=0x7f88040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:08.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f88040a2c10 0x7f88040a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8808006010 tx=0x7f8808009800 comp rx=0 tx=0).stop 2024-09-10T10:35:08.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818108290 msgr2=0x7f881819cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:08.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818108290 0x7f881819cea0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8810009fd0 tx=0x7f881000b8e0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 shutdown_connections 2024-09-10T10:35:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f88040a2c10 0x7f88040a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8818108290 0x7f881819cea0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8818103740 0x7f8818198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 --2- 172.21.15.92:0/2347232536 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8818102d90 0x7f88181985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 >> 172.21.15.92:0/2347232536 conn(0x7f88180fc7d0 msgr2=0x7f8818105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 shutdown_connections 2024-09-10T10:35:08.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:08.594+0000 7f881d9d2640 1 -- 172.21.15.92:0/2347232536 wait complete. 2024-09-10T10:35:09.236 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T10:35:09.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:35:09.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:09 smithi092 ceph-mon[30834]: pgmap v290: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.9 KiB/s wr, 22 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:35:09.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:09 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2347232536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:09.482 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:09.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:09 smithi121 ceph-mon[35231]: pgmap v290: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.9 KiB/s wr, 22 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:35:09.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:09 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2347232536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:09.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:09 smithi097 ceph-mon[35213]: pgmap v290: 97 pgs: 97 active+clean; 624 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.9 KiB/s wr, 22 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:35:09.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:09 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2347232536' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 -- 172.21.15.92:0/3730917286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c103640 msgr2=0x7f322c10bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 --2- 172.21.15.92:0/3730917286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c103640 0x7f322c10bb30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3220009900 tx=0x7f322002a480 comp rx=0 tx=0).stop 2024-09-10T10:35:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 -- 172.21.15.92:0/3730917286 shutdown_connections 2024-09-10T10:35:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 --2- 172.21.15.92:0/3730917286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f322c10c150 0x7f322c10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 --2- 172.21.15.92:0/3730917286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c103640 0x7f322c10bb30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 --2- 172.21.15.92:0/3730917286 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f322c102d20 0x7f322c103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:09.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 -- 172.21.15.92:0/3730917286 >> 172.21.15.92:0/3730917286 conn(0x7f322c0fc780 msgr2=0x7f322c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 -- 172.21.15.92:0/3730917286 shutdown_connections 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 -- 172.21.15.92:0/3730917286 wait complete. 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 Processor -- start 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 -- start start 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.973+0000 7f32338c1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f322c102d20 0x7f322c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f32338c1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f322c103640 0x7f322c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f32338c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c10c150 0x7f322c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f32338c1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f322c111fb0 con 0x7f322c10c150 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f32338c1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f322c111e30 con 0x7f322c102d20 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f32338c1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f322c112130 con 0x7f322c103640 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3231e5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c10c150 0x7f322c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:09.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3231e5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c10c150 0x7f322c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44818/0 (socket says 172.21.15.92:44818) 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3231e5e640 1 -- 172.21.15.92:0/1367880726 learned_addr learned my addr 172.21.15.92:0/1367880726 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3230e5c640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f322c103640 0x7f322c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f323165d640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f322c102d20 0x7f322c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3231e5e640 1 -- 172.21.15.92:0/1367880726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f322c103640 msgr2=0x7f322c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3231e5e640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f322c103640 0x7f322c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3231e5e640 1 -- 172.21.15.92:0/1367880726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f322c102d20 msgr2=0x7f322c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3231e5e640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f322c102d20 0x7f322c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3231e5e640 1 -- 172.21.15.92:0/1367880726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c19d4f0 con 0x7f322c10c150 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3230e5c640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f322c103640 0x7f322c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f323165d640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f322c102d20 0x7f322c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f3231e5e640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c10c150 0x7f322c19ce10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f322400eaa0 tx=0x7f322400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:09.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f321e7fc640 1 -- 172.21.15.92:0/1367880726 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322400cdb0 con 0x7f322c10c150 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f321e7fc640 1 -- 172.21.15.92:0/1367880726 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3224005020 con 0x7f322c10c150 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c19d7e0 con 0x7f322c10c150 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f321e7fc640 1 -- 172.21.15.92:0/1367880726 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32240116b0 con 0x7f322c10c150 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.974+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c1a50c0 con 0x7f322c10c150 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.975+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c103100 con 0x7f322c10c150 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.976+0000 7f321e7fc640 1 -- 172.21.15.92:0/1367880726 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3224005560 con 0x7f322c10c150 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.977+0000 7f321e7fc640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f32180a2c90 0x7f32180a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.977+0000 7f323165d640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f32180a2c90 0x7f32180a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.977+0000 7f321e7fc640 1 -- 172.21.15.92:0/1367880726 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f32240cf350 con 0x7f322c10c150 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.977+0000 7f323165d640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f32180a2c90 0x7f32180a5150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3228006fd0 tx=0x7f3228008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:09.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:09.981+0000 7f321e7fc640 1 -- 172.21.15.92:0/1367880726 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3224016030 con 0x7f322c10c150 2024-09-10T10:35:10.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.145+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f322c062630 con 0x7f32180a2c90 2024-09-10T10:35:10.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.151+0000 7f321e7fc640 1 -- 172.21.15.92:0/1367880726 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258920 (secure 0 0 0) 0x7f322c062630 con 0x7f32180a2c90 2024-09-10T10:35:10.154 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:10.155 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-10T10:35:10.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f32180a2c90 msgr2=0x7f32180a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:10.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f32180a2c90 0x7f32180a5150 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3228006fd0 tx=0x7f3228008040 comp rx=0 tx=0).stop 2024-09-10T10:35:10.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c10c150 msgr2=0x7f322c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:10.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c10c150 0x7f322c19ce10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f322400eaa0 tx=0x7f322400ef60 comp rx=0 tx=0).stop 2024-09-10T10:35:10.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 shutdown_connections 2024-09-10T10:35:10.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f32180a2c90 0x7f32180a5150 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:10.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322c10c150 0x7f322c19ce10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:10.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f322c103640 0x7f322c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:10.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 --2- 172.21.15.92:0/1367880726 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f322c102d20 0x7f322c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:10.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 >> 172.21.15.92:0/1367880726 conn(0x7f322c0fc780 msgr2=0x7f322c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:10.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 shutdown_connections 2024-09-10T10:35:10.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:10.154+0000 7f32338c1640 1 -- 172.21.15.92:0/1367880726 wait complete. 2024-09-10T10:35:10.835 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-10T10:35:10.130804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647020,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":289,"num_read_kb":263,"num_write":420,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368772,"kb_used_data":11188,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573052,"statfs":{"total":1151940427776,"available":1151562805248,"internally_reserved":0,"allocated":11456512,"data_stored":7191162,"data_compressed":107496,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":365933884},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48832,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":149,"num_read_kb":141,"num_write":71,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003314"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788050+0000","last_change":"2024-09-10T10:34:44.757989+0000","last_active":"2024-09-10T10:34:55.788050+0000","last_peered":"2024-09-10T10:34:55.788050+0000","last_clean":"2024-09-10T10:34:55.788050+0000","last_became_active":"2024-09-10T10:34:44.757638+0000","last_became_peered":"2024-09-10T10:34:44.757638+0000","last_unstale":"2024-09-10T10:34:55.788050+0000","last_undegraded":"2024-09-10T10:34:55.788050+0000","last_fullsized":"2024-09-10T10:34:55.788050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:41.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807821+0000","last_change":"2024-09-10T10:34:44.750218+0000","last_active":"2024-09-10T10:34:55.807821+0000","last_peered":"2024-09-10T10:34:55.807821+0000","last_clean":"2024-09-10T10:34:55.807821+0000","last_became_active":"2024-09-10T10:34:44.749807+0000","last_became_peered":"2024-09-10T10:34:44.749807+0000","last_unstale":"2024-09-10T10:34:55.807821+0000","last_undegraded":"2024-09-10T10:34:55.807821+0000","last_fullsized":"2024-09-10T10:34:55.807821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:17.123136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806919+0000","last_change":"2024-09-10T10:34:44.756169+0000","last_active":"2024-09-10T10:34:55.806919+0000","last_peered":"2024-09-10T10:34:55.806919+0000","last_clean":"2024-09-10T10:34:55.806919+0000","last_became_active":"2024-09-10T10:34:44.755845+0000","last_became_peered":"2024-09-10T10:34:44.755845+0000","last_unstale":"2024-09-10T10:34:55.806919+0000","last_undegraded":"2024-09-10T10:34:55.806919+0000","last_fullsized":"2024-09-10T10:34:55.806919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:11.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790302+0000","last_change":"2024-09-10T10:34:44.750153+0000","last_active":"2024-09-10T10:34:55.790302+0000","last_peered":"2024-09-10T10:34:55.790302+0000","last_clean":"2024-09-10T10:34:55.790302+0000","last_became_active":"2024-09-10T10:34:44.749830+0000","last_became_peered":"2024-09-10T10:34:44.749830+0000","last_unstale":"2024-09-10T10:34:55.790302+0000","last_undegraded":"2024-09-10T10:34:55.790302+0000","last_fullsized":"2024-09-10T10:34:55.790302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:30.799158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790670+0000","last_change":"2024-09-10T10:34:44.752766+0000","last_active":"2024-09-10T10:34:55.790670+0000","last_peered":"2024-09-10T10:34:55.790670+0000","last_clean":"2024-09-10T10:34:55.790670+0000","last_became_active":"2024-09-10T10:34:44.750892+0000","last_became_peered":"2024-09-10T10:34:44.750892+0000","last_unstale":"2024-09-10T10:34:55.790670+0000","last_undegraded":"2024-09-10T10:34:55.790670+0000","last_fullsized":"2024-09-10T10:34:55.790670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:20.139995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790850+0000","last_change":"2024-09-10T10:34:44.746378+0000","last_active":"2024-09-10T10:34:55.790850+0000","last_peered":"2024-09-10T10:34:55.790850+0000","last_clean":"2024-09-10T10:34:55.790850+0000","last_became_active":"2024-09-10T10:34:44.745996+0000","last_became_peered":"2024-09-10T10:34:44.745996+0000","last_unstale":"2024-09-10T10:34:55.790850+0000","last_undegraded":"2024-09-10T10:34:55.790850+0000","last_fullsized":"2024-09-10T10:34:55.790850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:14.444518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.805589+0000","last_change":"2024-09-10T10:34:44.756457+0000","last_active":"2024-09-10T10:34:55.805589+0000","last_peered":"2024-09-10T10:34:55.805589+0000","last_clean":"2024-09-10T10:34:55.805589+0000","last_became_active":"2024-09-10T10:34:44.756017+0000","last_became_peered":"2024-09-10T10:34:44.756017+0000","last_unstale":"2024-09-10T10:34:55.805589+0000","last_undegraded":"2024-09-10T10:34:55.805589+0000","last_fullsized":"2024-09-10T10:34:55.805589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:10.421223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790142+0000","last_change":"2024-09-10T10:34:44.735096+0000","last_active":"2024-09-10T10:34:55.790142+0000","last_peered":"2024-09-10T10:34:55.790142+0000","last_clean":"2024-09-10T10:34:55.790142+0000","last_became_active":"2024-09-10T10:34:44.734810+0000","last_became_peered":"2024-09-10T10:34:44.734810+0000","last_unstale":"2024-09-10T10:34:55.790142+0000","last_undegraded":"2024-09-10T10:34:55.790142+0000","last_fullsized":"2024-09-10T10:34:55.790142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:18.094135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788046+0000","last_change":"2024-09-10T10:34:44.760336+0000","last_active":"2024-09-10T10:34:55.788046+0000","last_peered":"2024-09-10T10:34:55.788046+0000","last_clean":"2024-09-10T10:34:55.788046+0000","last_became_active":"2024-09-10T10:34:44.759995+0000","last_became_peered":"2024-09-10T10:34:44.759995+0000","last_unstale":"2024-09-10T10:34:55.788046+0000","last_undegraded":"2024-09-10T10:34:55.788046+0000","last_fullsized":"2024-09-10T10:34:55.788046+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:56.471705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791244+0000","last_change":"2024-09-10T10:34:44.748238+0000","last_active":"2024-09-10T10:34:55.791244+0000","last_peered":"2024-09-10T10:34:55.791244+0000","last_clean":"2024-09-10T10:34:55.791244+0000","last_became_active":"2024-09-10T10:34:44.747876+0000","last_became_peered":"2024-09-10T10:34:44.747876+0000","last_unstale":"2024-09-10T10:34:55.791244+0000","last_undegraded":"2024-09-10T10:34:55.791244+0000","last_fullsized":"2024-09-10T10:34:55.791244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:30:01.721300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806892+0000","last_change":"2024-09-10T10:34:44.757513+0000","last_active":"2024-09-10T10:34:55.806892+0000","last_peered":"2024-09-10T10:34:55.806892+0000","last_clean":"2024-09-10T10:34:55.806892+0000","last_became_active":"2024-09-10T10:34:44.757207+0000","last_became_peered":"2024-09-10T10:34:44.757207+0000","last_unstale":"2024-09-10T10:34:55.806892+0000","last_undegraded":"2024-09-10T10:34:55.806892+0000","last_fullsized":"2024-09-10T10:34:55.806892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:07.351617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790432+0000","last_change":"2024-09-10T10:34:44.749394+0000","last_active":"2024-09-10T10:34:55.790432+0000","last_peered":"2024-09-10T10:34:55.790432+0000","last_clean":"2024-09-10T10:34:55.790432+0000","last_became_active":"2024-09-10T10:34:44.749029+0000","last_became_peered":"2024-09-10T10:34:44.749029+0000","last_unstale":"2024-09-10T10:34:55.790432+0000","last_undegraded":"2024-09-10T10:34:55.790432+0000","last_fullsized":"2024-09-10T10:34:55.790432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:46.772305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790387+0000","last_change":"2024-09-10T10:34:44.742056+0000","last_active":"2024-09-10T10:34:55.790387+0000","last_peered":"2024-09-10T10:34:55.790387+0000","last_clean":"2024-09-10T10:34:55.790387+0000","last_became_active":"2024-09-10T10:34:44.741716+0000","last_became_peered":"2024-09-10T10:34:44.741716+0000","last_unstale":"2024-09-10T10:34:55.790387+0000","last_undegraded":"2024-09-10T10:34:55.790387+0000","last_fullsized":"2024-09-10T10:34:55.790387+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:04.112050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806807+0000","last_change":"2024-09-10T10:34:44.747573+0000","last_active":"2024-09-10T10:34:55.806807+0000","last_peered":"2024-09-10T10:34:55.806807+0000","last_clean":"2024-09-10T10:34:55.806807+0000","last_became_active":"2024-09-10T10:34:44.747284+0000","last_became_peered":"2024-09-10T10:34:44.747284+0000","last_unstale":"2024-09-10T10:34:55.806807+0000","last_undegraded":"2024-09-10T10:34:55.806807+0000","last_fullsized":"2024-09-10T10:34:55.806807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:24.567112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806649+0000","last_change":"2024-09-10T10:34:44.745494+0000","last_active":"2024-09-10T10:34:55.806649+0000","last_peered":"2024-09-10T10:34:55.806649+0000","last_clean":"2024-09-10T10:34:55.806649+0000","last_became_active":"2024-09-10T10:34:44.744525+0000","last_became_peered":"2024-09-10T10:34:44.744525+0000","last_unstale":"2024-09-10T10:34:55.806649+0000","last_undegraded":"2024-09-10T10:34:55.806649+0000","last_fullsized":"2024-09-10T10:34:55.806649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:46.120579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787378+0000","last_change":"2024-09-10T10:34:44.755247+0000","last_active":"2024-09-10T10:34:55.787378+0000","last_peered":"2024-09-10T10:34:55.787378+0000","last_clean":"2024-09-10T10:34:55.787378+0000","last_became_active":"2024-09-10T10:34:44.754897+0000","last_became_peered":"2024-09-10T10:34:44.754897+0000","last_unstale":"2024-09-10T10:34:55.787378+0000","last_undegraded":"2024-09-10T10:34:55.787378+0000","last_fullsized":"2024-09-10T10:34:55.787378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:58.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788169+0000","last_change":"2024-09-10T10:34:44.758550+0000","last_active":"2024-09-10T10:34:55.788169+0000","last_peered":"2024-09-10T10:34:55.788169+0000","last_clean":"2024-09-10T10:34:55.788169+0000","last_became_active":"2024-09-10T10:34:44.757767+0000","last_became_peered":"2024-09-10T10:34:44.757767+0000","last_unstale":"2024-09-10T10:34:55.788169+0000","last_undegraded":"2024-09-10T10:34:55.788169+0000","last_fullsized":"2024-09-10T10:34:55.788169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.937733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787366+0000","last_change":"2024-09-10T10:34:44.748830+0000","last_active":"2024-09-10T10:34:55.787366+0000","last_peered":"2024-09-10T10:34:55.787366+0000","last_clean":"2024-09-10T10:34:55.787366+0000","last_became_active":"2024-09-10T10:34:44.748518+0000","last_became_peered":"2024-09-10T10:34:44.748518+0000","last_unstale":"2024-09-10T10:34:55.787366+0000","last_undegraded":"2024-09-10T10:34:55.787366+0000","last_fullsized":"2024-09-10T10:34:55.787366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:15.786806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786493+0000","last_change":"2024-09-10T10:34:44.752523+0000","last_active":"2024-09-10T10:34:55.786493+0000","last_peered":"2024-09-10T10:34:55.786493+0000","last_clean":"2024-09-10T10:34:55.786493+0000","last_became_active":"2024-09-10T10:34:44.752153+0000","last_became_peered":"2024-09-10T10:34:44.752153+0000","last_unstale":"2024-09-10T10:34:55.786493+0000","last_undegraded":"2024-09-10T10:34:55.786493+0000","last_fullsized":"2024-09-10T10:34:55.786493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:45.826111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787609+0000","last_change":"2024-09-10T10:34:44.750249+0000","last_active":"2024-09-10T10:34:55.787609+0000","last_peered":"2024-09-10T10:34:55.787609+0000","last_clean":"2024-09-10T10:34:55.787609+0000","last_became_active":"2024-09-10T10:34:44.749812+0000","last_became_peered":"2024-09-10T10:34:44.749812+0000","last_unstale":"2024-09-10T10:34:55.787609+0000","last_undegraded":"2024-09-10T10:34:55.787609+0000","last_fullsized":"2024-09-10T10:34:55.787609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:45.584744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790439+0000","last_change":"2024-09-10T10:34:44.747529+0000","last_active":"2024-09-10T10:34:55.790439+0000","last_peered":"2024-09-10T10:34:55.790439+0000","last_clean":"2024-09-10T10:34:55.790439+0000","last_became_active":"2024-09-10T10:34:44.747183+0000","last_became_peered":"2024-09-10T10:34:44.747183+0000","last_unstale":"2024-09-10T10:34:55.790439+0000","last_undegraded":"2024-09-10T10:34:55.790439+0000","last_fullsized":"2024-09-10T10:34:55.790439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:03.813289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787588+0000","last_change":"2024-09-10T10:34:44.755879+0000","last_active":"2024-09-10T10:34:55.787588+0000","last_peered":"2024-09-10T10:34:55.787588+0000","last_clean":"2024-09-10T10:34:55.787588+0000","last_became_active":"2024-09-10T10:34:44.755470+0000","last_became_peered":"2024-09-10T10:34:44.755470+0000","last_unstale":"2024-09-10T10:34:55.787588+0000","last_undegraded":"2024-09-10T10:34:55.787588+0000","last_fullsized":"2024-09-10T10:34:55.787588+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:01.424727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790858+0000","last_change":"2024-09-10T10:34:44.748049+0000","last_active":"2024-09-10T10:34:55.790858+0000","last_peered":"2024-09-10T10:34:55.790858+0000","last_clean":"2024-09-10T10:34:55.790858+0000","last_became_active":"2024-09-10T10:34:44.747708+0000","last_became_peered":"2024-09-10T10:34:44.747708+0000","last_unstale":"2024-09-10T10:34:55.790858+0000","last_undegraded":"2024-09-10T10:34:55.790858+0000","last_fullsized":"2024-09-10T10:34:55.790858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:20.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790796+0000","last_change":"2024-09-10T10:34:44.738305+0000","last_active":"2024-09-10T10:34:55.790796+0000","last_peered":"2024-09-10T10:34:55.790796+0000","last_clean":"2024-09-10T10:34:55.790796+0000","last_became_active":"2024-09-10T10:34:44.737625+0000","last_became_peered":"2024-09-10T10:34:44.737625+0000","last_unstale":"2024-09-10T10:34:55.790796+0000","last_undegraded":"2024-09-10T10:34:55.790796+0000","last_fullsized":"2024-09-10T10:34:55.790796+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:39.578131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791523+0000","last_change":"2024-09-10T10:34:44.748021+0000","last_active":"2024-09-10T10:34:55.791523+0000","last_peered":"2024-09-10T10:34:55.791523+0000","last_clean":"2024-09-10T10:34:55.791523+0000","last_became_active":"2024-09-10T10:34:44.747632+0000","last_became_peered":"2024-09-10T10:34:44.747632+0000","last_unstale":"2024-09-10T10:34:55.791523+0000","last_undegraded":"2024-09-10T10:34:55.791523+0000","last_fullsized":"2024-09-10T10:34:55.791523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:52.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786486+0000","last_change":"2024-09-10T10:34:44.746279+0000","last_active":"2024-09-10T10:34:55.786486+0000","last_peered":"2024-09-10T10:34:55.786486+0000","last_clean":"2024-09-10T10:34:55.786486+0000","last_became_active":"2024-09-10T10:34:44.745851+0000","last_became_peered":"2024-09-10T10:34:44.745851+0000","last_unstale":"2024-09-10T10:34:55.786486+0000","last_undegraded":"2024-09-10T10:34:55.786486+0000","last_fullsized":"2024-09-10T10:34:55.786486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:49.935780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787744+0000","last_change":"2024-09-10T10:34:44.749481+0000","last_active":"2024-09-10T10:34:55.787744+0000","last_peered":"2024-09-10T10:34:55.787744+0000","last_clean":"2024-09-10T10:34:55.787744+0000","last_became_active":"2024-09-10T10:34:44.749154+0000","last_became_peered":"2024-09-10T10:34:44.749154+0000","last_unstale":"2024-09-10T10:34:55.787744+0000","last_undegraded":"2024-09-10T10:34:55.787744+0000","last_fullsized":"2024-09-10T10:34:55.787744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:28:12.250198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808905+0000","last_change":"2024-09-10T10:34:55.808905+0000","last_active":"2024-09-10T10:34:55.808905+0000","last_peered":"2024-09-10T10:34:55.808905+0000","last_clean":"2024-09-10T10:34:55.808905+0000","last_became_active":"2024-09-10T10:34:55.808450+0000","last_became_peered":"2024-09-10T10:34:55.808450+0000","last_unstale":"2024-09-10T10:34:55.808905+0000","last_undegraded":"2024-09-10T10:34:55.808905+0000","last_fullsized":"2024-09-10T10:34:55.808905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:47.506359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807586+0000","last_change":"2024-09-10T10:34:44.753638+0000","last_active":"2024-09-10T10:34:55.807586+0000","last_peered":"2024-09-10T10:34:55.807586+0000","last_clean":"2024-09-10T10:34:55.807586+0000","last_became_active":"2024-09-10T10:34:44.752423+0000","last_became_peered":"2024-09-10T10:34:44.752423+0000","last_unstale":"2024-09-10T10:34:55.807586+0000","last_undegraded":"2024-09-10T10:34:55.807586+0000","last_fullsized":"2024-09-10T10:34:55.807586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:43.842713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.785975+0000","last_change":"2024-09-10T10:34:44.745530+0000","last_active":"2024-09-10T10:34:55.785975+0000","last_peered":"2024-09-10T10:34:55.785975+0000","last_clean":"2024-09-10T10:34:55.785975+0000","last_became_active":"2024-09-10T10:34:44.744856+0000","last_became_peered":"2024-09-10T10:34:44.744856+0000","last_unstale":"2024-09-10T10:34:55.785975+0000","last_undegraded":"2024-09-10T10:34:55.785975+0000","last_fullsized":"2024-09-10T10:34:55.785975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.496321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786069+0000","last_change":"2024-09-10T10:34:44.748888+0000","last_active":"2024-09-10T10:34:55.786069+0000","last_peered":"2024-09-10T10:34:55.786069+0000","last_clean":"2024-09-10T10:34:55.786069+0000","last_became_active":"2024-09-10T10:34:44.748402+0000","last_became_peered":"2024-09-10T10:34:44.748402+0000","last_unstale":"2024-09-10T10:34:55.786069+0000","last_undegraded":"2024-09-10T10:34:55.786069+0000","last_fullsized":"2024-09-10T10:34:55.786069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:33:11.491674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.789801+0000","last_change":"2024-09-10T10:34:55.789801+0000","last_active":"2024-09-10T10:34:55.789801+0000","last_peered":"2024-09-10T10:34:55.789801+0000","last_clean":"2024-09-10T10:34:55.789801+0000","last_became_active":"2024-09-10T10:34:55.789449+0000","last_became_peered":"2024-09-10T10:34:55.789449+0000","last_unstale":"2024-09-10T10:34:55.789801+0000","last_undegraded":"2024-09-10T10:34:55.789801+0000","last_fullsized":"2024-09-10T10:34:55.789801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:24.784027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790662+0000","last_change":"2024-09-10T10:34:44.753011+0000","last_active":"2024-09-10T10:34:55.790662+0000","last_peered":"2024-09-10T10:34:55.790662+0000","last_clean":"2024-09-10T10:34:55.790662+0000","last_became_active":"2024-09-10T10:34:44.752667+0000","last_became_peered":"2024-09-10T10:34:44.752667+0000","last_unstale":"2024-09-10T10:34:55.790662+0000","last_undegraded":"2024-09-10T10:34:55.790662+0000","last_fullsized":"2024-09-10T10:34:55.790662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:44.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:04.825956+0000","last_change":"2024-09-10T10:34:42.728468+0000","last_active":"2024-09-10T10:35:04.825956+0000","last_peered":"2024-09-10T10:35:04.825956+0000","last_clean":"2024-09-10T10:35:04.825956+0000","last_became_active":"2024-09-10T10:34:42.727707+0000","last_became_peered":"2024-09-10T10:34:42.727707+0000","last_unstale":"2024-09-10T10:35:04.825956+0000","last_undegraded":"2024-09-10T10:35:04.825956+0000","last_fullsized":"2024-09-10T10:35:04.825956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.920375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791368+0000","last_change":"2024-09-10T10:34:44.743410+0000","last_active":"2024-09-10T10:34:55.791368+0000","last_peered":"2024-09-10T10:34:55.791368+0000","last_clean":"2024-09-10T10:34:55.791368+0000","last_became_active":"2024-09-10T10:34:44.743040+0000","last_became_peered":"2024-09-10T10:34:44.743040+0000","last_unstale":"2024-09-10T10:34:55.791368+0000","last_undegraded":"2024-09-10T10:34:55.791368+0000","last_fullsized":"2024-09-10T10:34:55.791368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790902+0000","last_change":"2024-09-10T10:34:42.730778+0000","last_active":"2024-09-10T10:34:55.790902+0000","last_peered":"2024-09-10T10:34:55.790902+0000","last_clean":"2024-09-10T10:34:55.790902+0000","last_became_active":"2024-09-10T10:34:42.730360+0000","last_became_peered":"2024-09-10T10:34:42.730360+0000","last_unstale":"2024-09-10T10:34:55.790902+0000","last_undegraded":"2024-09-10T10:34:55.790902+0000","last_fullsized":"2024-09-10T10:34:55.790902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:41.596309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790332+0000","last_change":"2024-09-10T10:34:42.730251+0000","last_active":"2024-09-10T10:34:55.790332+0000","last_peered":"2024-09-10T10:34:55.790332+0000","last_clean":"2024-09-10T10:34:55.790332+0000","last_became_active":"2024-09-10T10:34:42.729915+0000","last_became_peered":"2024-09-10T10:34:42.729915+0000","last_unstale":"2024-09-10T10:34:55.790332+0000","last_undegraded":"2024-09-10T10:34:55.790332+0000","last_fullsized":"2024-09-10T10:34:55.790332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:10.215793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790686+0000","last_change":"2024-09-10T10:34:44.745663+0000","last_active":"2024-09-10T10:34:55.790686+0000","last_peered":"2024-09-10T10:34:55.790686+0000","last_clean":"2024-09-10T10:34:55.790686+0000","last_became_active":"2024-09-10T10:34:44.745361+0000","last_became_peered":"2024-09-10T10:34:44.745361+0000","last_unstale":"2024-09-10T10:34:55.790686+0000","last_undegraded":"2024-09-10T10:34:55.790686+0000","last_fullsized":"2024-09-10T10:34:55.790686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:17.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810334+0000","last_change":"2024-09-10T10:34:42.731515+0000","last_active":"2024-09-10T10:34:55.810334+0000","last_peered":"2024-09-10T10:34:55.810334+0000","last_clean":"2024-09-10T10:34:55.810334+0000","last_became_active":"2024-09-10T10:34:42.731103+0000","last_became_peered":"2024-09-10T10:34:42.731103+0000","last_unstale":"2024-09-10T10:34:55.810334+0000","last_undegraded":"2024-09-10T10:34:55.810334+0000","last_fullsized":"2024-09-10T10:34:55.810334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:51.181868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787178+0000","last_change":"2024-09-10T10:34:44.740826+0000","last_active":"2024-09-10T10:34:55.787178+0000","last_peered":"2024-09-10T10:34:55.787178+0000","last_clean":"2024-09-10T10:34:55.787178+0000","last_became_active":"2024-09-10T10:34:44.740510+0000","last_became_peered":"2024-09-10T10:34:44.740510+0000","last_unstale":"2024-09-10T10:34:55.787178+0000","last_undegraded":"2024-09-10T10:34:55.787178+0000","last_fullsized":"2024-09-10T10:34:55.787178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:30:44.650840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:08.830180+0000","last_change":"2024-09-10T10:34:42.733744+0000","last_active":"2024-09-10T10:35:08.830180+0000","last_peered":"2024-09-10T10:35:08.830180+0000","last_clean":"2024-09-10T10:35:08.830180+0000","last_became_active":"2024-09-10T10:34:42.733380+0000","last_became_peered":"2024-09-10T10:34:42.733380+0000","last_unstale":"2024-09-10T10:35:08.830180+0000","last_undegraded":"2024-09-10T10:35:08.830180+0000","last_fullsized":"2024-09-10T10:35:08.830180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:39.227094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787875+0000","last_change":"2024-09-10T10:34:44.749534+0000","last_active":"2024-09-10T10:34:55.787875+0000","last_peered":"2024-09-10T10:34:55.787875+0000","last_clean":"2024-09-10T10:34:55.787875+0000","last_became_active":"2024-09-10T10:34:44.749007+0000","last_became_peered":"2024-09-10T10:34:44.749007+0000","last_unstale":"2024-09-10T10:34:55.787875+0000","last_undegraded":"2024-09-10T10:34:55.787875+0000","last_fullsized":"2024-09-10T10:34:55.787875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:48.949171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810027+0000","last_change":"2024-09-10T10:34:42.728670+0000","last_active":"2024-09-10T10:34:55.810027+0000","last_peered":"2024-09-10T10:34:55.810027+0000","last_clean":"2024-09-10T10:34:55.810027+0000","last_became_active":"2024-09-10T10:34:42.728313+0000","last_became_peered":"2024-09-10T10:34:42.728313+0000","last_unstale":"2024-09-10T10:34:55.810027+0000","last_undegraded":"2024-09-10T10:34:55.810027+0000","last_fullsized":"2024-09-10T10:34:55.810027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:43.354818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807562+0000","last_change":"2024-09-10T10:34:44.752536+0000","last_active":"2024-09-10T10:34:55.807562+0000","last_peered":"2024-09-10T10:34:55.807562+0000","last_clean":"2024-09-10T10:34:55.807562+0000","last_became_active":"2024-09-10T10:34:44.750285+0000","last_became_peered":"2024-09-10T10:34:44.750285+0000","last_unstale":"2024-09-10T10:34:55.807562+0000","last_undegraded":"2024-09-10T10:34:55.807562+0000","last_fullsized":"2024-09-10T10:34:55.807562+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:53.610166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791508+0000","last_change":"2024-09-10T10:34:42.760713+0000","last_active":"2024-09-10T10:34:55.791508+0000","last_peered":"2024-09-10T10:34:55.791508+0000","last_clean":"2024-09-10T10:34:55.791508+0000","last_became_active":"2024-09-10T10:34:42.760294+0000","last_became_peered":"2024-09-10T10:34:42.760294+0000","last_unstale":"2024-09-10T10:34:55.791508+0000","last_undegraded":"2024-09-10T10:34:55.791508+0000","last_fullsized":"2024-09-10T10:34:55.791508+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:43.687485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.795427+0000","last_change":"2024-09-10T10:34:55.795427+0000","last_active":"2024-09-10T10:34:55.795427+0000","last_peered":"2024-09-10T10:34:55.795427+0000","last_clean":"2024-09-10T10:34:55.795427+0000","last_became_active":"2024-09-10T10:34:55.795072+0000","last_became_peered":"2024-09-10T10:34:55.795072+0000","last_unstale":"2024-09-10T10:34:55.795427+0000","last_undegraded":"2024-09-10T10:34:55.795427+0000","last_fullsized":"2024-09-10T10:34:55.795427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:39.758626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'27","reported_seq":82,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:08.836788+0000","last_change":"2024-09-10T10:34:42.734059+0000","last_active":"2024-09-10T10:35:08.836788+0000","last_peered":"2024-09-10T10:35:08.836788+0000","last_clean":"2024-09-10T10:35:08.836788+0000","last_became_active":"2024-09-10T10:34:42.733589+0000","last_became_peered":"2024-09-10T10:34:42.733589+0000","last_unstale":"2024-09-10T10:35:08.836788+0000","last_undegraded":"2024-09-10T10:35:08.836788+0000","last_fullsized":"2024-09-10T10:35:08.836788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:29.257184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":64,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791068+0000","last_change":"2024-09-10T10:34:44.750286+0000","last_active":"2024-09-10T10:34:55.791068+0000","last_peered":"2024-09-10T10:34:55.791068+0000","last_clean":"2024-09-10T10:34:55.791068+0000","last_became_active":"2024-09-10T10:34:44.749776+0000","last_became_peered":"2024-09-10T10:34:44.749776+0000","last_unstale":"2024-09-10T10:34:55.791068+0000","last_undegraded":"2024-09-10T10:34:55.791068+0000","last_fullsized":"2024-09-10T10:34:55.791068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:36.962707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.810651+0000","last_change":"2024-09-10T10:34:42.730667+0000","last_active":"2024-09-10T10:34:56.810651+0000","last_peered":"2024-09-10T10:34:56.810651+0000","last_clean":"2024-09-10T10:34:56.810651+0000","last_became_active":"2024-09-10T10:34:42.730299+0000","last_became_peered":"2024-09-10T10:34:42.730299+0000","last_unstale":"2024-09-10T10:34:56.810651+0000","last_undegraded":"2024-09-10T10:34:56.810651+0000","last_fullsized":"2024-09-10T10:34:56.810651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:53.313073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790409+0000","last_change":"2024-09-10T10:34:44.749059+0000","last_active":"2024-09-10T10:34:55.790409+0000","last_peered":"2024-09-10T10:34:55.790409+0000","last_clean":"2024-09-10T10:34:55.790409+0000","last_became_active":"2024-09-10T10:34:44.748770+0000","last_became_peered":"2024-09-10T10:34:44.748770+0000","last_unstale":"2024-09-10T10:34:55.790409+0000","last_undegraded":"2024-09-10T10:34:55.790409+0000","last_fullsized":"2024-09-10T10:34:55.790409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:26.992447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810381+0000","last_change":"2024-09-10T10:34:42.729171+0000","last_active":"2024-09-10T10:34:55.810381+0000","last_peered":"2024-09-10T10:34:55.810381+0000","last_clean":"2024-09-10T10:34:55.810381+0000","last_became_active":"2024-09-10T10:34:42.728432+0000","last_became_peered":"2024-09-10T10:34:42.728432+0000","last_unstale":"2024-09-10T10:34:55.810381+0000","last_undegraded":"2024-09-10T10:34:55.810381+0000","last_fullsized":"2024-09-10T10:34:55.810381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:40.513818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.805866+0000","last_change":"2024-09-10T10:34:44.746936+0000","last_active":"2024-09-10T10:34:55.805866+0000","last_peered":"2024-09-10T10:34:55.805866+0000","last_clean":"2024-09-10T10:34:55.805866+0000","last_became_active":"2024-09-10T10:34:44.746565+0000","last_became_peered":"2024-09-10T10:34:44.746565+0000","last_unstale":"2024-09-10T10:34:55.805866+0000","last_undegraded":"2024-09-10T10:34:55.805866+0000","last_fullsized":"2024-09-10T10:34:55.805866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:47.819637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:03.824123+0000","last_change":"2024-09-10T10:34:42.730369+0000","last_active":"2024-09-10T10:35:03.824123+0000","last_peered":"2024-09-10T10:35:03.824123+0000","last_clean":"2024-09-10T10:35:03.824123+0000","last_became_active":"2024-09-10T10:34:42.729917+0000","last_became_peered":"2024-09-10T10:34:42.729917+0000","last_unstale":"2024-09-10T10:35:03.824123+0000","last_undegraded":"2024-09-10T10:35:03.824123+0000","last_fullsized":"2024-09-10T10:35:03.824123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:59.882719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807035+0000","last_change":"2024-09-10T10:34:44.756160+0000","last_active":"2024-09-10T10:34:55.807035+0000","last_peered":"2024-09-10T10:34:55.807035+0000","last_clean":"2024-09-10T10:34:55.807035+0000","last_became_active":"2024-09-10T10:34:44.755811+0000","last_became_peered":"2024-09-10T10:34:44.755811+0000","last_unstale":"2024-09-10T10:34:55.807035+0000","last_undegraded":"2024-09-10T10:34:55.807035+0000","last_fullsized":"2024-09-10T10:34:55.807035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:37.299385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808007+0000","last_change":"2024-09-10T10:34:42.761084+0000","last_active":"2024-09-10T10:34:55.808007+0000","last_peered":"2024-09-10T10:34:55.808007+0000","last_clean":"2024-09-10T10:34:55.808007+0000","last_became_active":"2024-09-10T10:34:42.760223+0000","last_became_peered":"2024-09-10T10:34:42.760223+0000","last_unstale":"2024-09-10T10:34:55.808007+0000","last_undegraded":"2024-09-10T10:34:55.808007+0000","last_fullsized":"2024-09-10T10:34:55.808007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:24.001455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790499+0000","last_change":"2024-09-10T10:34:44.758495+0000","last_active":"2024-09-10T10:34:55.790499+0000","last_peered":"2024-09-10T10:34:55.790499+0000","last_clean":"2024-09-10T10:34:55.790499+0000","last_became_active":"2024-09-10T10:34:44.757701+0000","last_became_peered":"2024-09-10T10:34:44.757701+0000","last_unstale":"2024-09-10T10:34:55.790499+0000","last_undegraded":"2024-09-10T10:34:55.790499+0000","last_fullsized":"2024-09-10T10:34:55.790499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:42.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.811594+0000","last_change":"2024-09-10T10:34:55.800279+0000","last_active":"2024-09-10T10:34:56.811594+0000","last_peered":"2024-09-10T10:34:56.811594+0000","last_clean":"2024-09-10T10:34:56.811594+0000","last_became_active":"2024-09-10T10:34:55.792658+0000","last_became_peered":"2024-09-10T10:34:55.792658+0000","last_unstale":"2024-09-10T10:34:56.811594+0000","last_undegraded":"2024-09-10T10:34:56.811594+0000","last_fullsized":"2024-09-10T10:34:56.811594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:21.840613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787778+0000","last_change":"2024-09-10T10:34:44.751002+0000","last_active":"2024-09-10T10:34:55.787778+0000","last_peered":"2024-09-10T10:34:55.787778+0000","last_clean":"2024-09-10T10:34:55.787778+0000","last_became_active":"2024-09-10T10:34:44.749753+0000","last_became_peered":"2024-09-10T10:34:44.749753+0000","last_unstale":"2024-09-10T10:34:55.787778+0000","last_undegraded":"2024-09-10T10:34:55.787778+0000","last_fullsized":"2024-09-10T10:34:55.787778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:31.211448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807724+0000","last_change":"2024-09-10T10:34:42.727332+0000","last_active":"2024-09-10T10:34:55.807724+0000","last_peered":"2024-09-10T10:34:55.807724+0000","last_clean":"2024-09-10T10:34:55.807724+0000","last_became_active":"2024-09-10T10:34:42.726946+0000","last_became_peered":"2024-09-10T10:34:42.726946+0000","last_unstale":"2024-09-10T10:34:55.807724+0000","last_undegraded":"2024-09-10T10:34:55.807724+0000","last_fullsized":"2024-09-10T10:34:55.807724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:07.302005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806275+0000","last_change":"2024-09-10T10:34:44.753230+0000","last_active":"2024-09-10T10:34:55.806275+0000","last_peered":"2024-09-10T10:34:55.806275+0000","last_clean":"2024-09-10T10:34:55.806275+0000","last_became_active":"2024-09-10T10:34:44.752901+0000","last_became_peered":"2024-09-10T10:34:44.752901+0000","last_unstale":"2024-09-10T10:34:55.806275+0000","last_undegraded":"2024-09-10T10:34:55.806275+0000","last_fullsized":"2024-09-10T10:34:55.806275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:06.037445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808506+0000","last_change":"2024-09-10T10:34:42.731101+0000","last_active":"2024-09-10T10:34:55.808506+0000","last_peered":"2024-09-10T10:34:55.808506+0000","last_clean":"2024-09-10T10:34:55.808506+0000","last_became_active":"2024-09-10T10:34:42.730459+0000","last_became_peered":"2024-09-10T10:34:42.730459+0000","last_unstale":"2024-09-10T10:34:55.808506+0000","last_undegraded":"2024-09-10T10:34:55.808506+0000","last_fullsized":"2024-09-10T10:34:55.808506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:03.170940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806157+0000","last_change":"2024-09-10T10:34:44.756021+0000","last_active":"2024-09-10T10:34:55.806157+0000","last_peered":"2024-09-10T10:34:55.806157+0000","last_clean":"2024-09-10T10:34:55.806157+0000","last_became_active":"2024-09-10T10:34:44.755673+0000","last_became_peered":"2024-09-10T10:34:44.755673+0000","last_unstale":"2024-09-10T10:34:55.806157+0000","last_undegraded":"2024-09-10T10:34:55.806157+0000","last_fullsized":"2024-09-10T10:34:55.806157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:32.183967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:04.828970+0000","last_change":"2024-09-10T10:34:42.816450+0000","last_active":"2024-09-10T10:35:04.828970+0000","last_peered":"2024-09-10T10:35:04.828970+0000","last_clean":"2024-09-10T10:35:04.828970+0000","last_became_active":"2024-09-10T10:34:42.816049+0000","last_became_peered":"2024-09-10T10:34:42.816049+0000","last_unstale":"2024-09-10T10:35:04.828970+0000","last_undegraded":"2024-09-10T10:35:04.828970+0000","last_fullsized":"2024-09-10T10:35:04.828970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:54.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807005+0000","last_change":"2024-09-10T10:34:44.756769+0000","last_active":"2024-09-10T10:34:55.807005+0000","last_peered":"2024-09-10T10:34:55.807005+0000","last_clean":"2024-09-10T10:34:55.807005+0000","last_became_active":"2024-09-10T10:34:44.755873+0000","last_became_peered":"2024-09-10T10:34:44.755873+0000","last_unstale":"2024-09-10T10:34:55.807005+0000","last_undegraded":"2024-09-10T10:34:55.807005+0000","last_fullsized":"2024-09-10T10:34:55.807005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:56.481504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807659+0000","last_change":"2024-09-10T10:33:32.204576+0000","last_active":"2024-09-10T10:34:55.807659+0000","last_peered":"2024-09-10T10:34:55.807659+0000","last_clean":"2024-09-10T10:34:55.807659+0000","last_became_active":"2024-09-10T10:33:32.204173+0000","last_became_peered":"2024-09-10T10:33:32.204173+0000","last_unstale":"2024-09-10T10:34:55.807659+0000","last_undegraded":"2024-09-10T10:34:55.807659+0000","last_fullsized":"2024-09-10T10:34:55.807659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:30:07.036460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:30:07.036460+0000","last_clean_scrub_stamp":"2024-09-10T10:30:07.036460+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:27.845983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.811839+0000","last_change":"2024-09-10T10:34:42.731365+0000","last_active":"2024-09-10T10:34:56.811839+0000","last_peered":"2024-09-10T10:34:56.811839+0000","last_clean":"2024-09-10T10:34:56.811839+0000","last_became_active":"2024-09-10T10:34:42.731021+0000","last_became_peered":"2024-09-10T10:34:42.731021+0000","last_unstale":"2024-09-10T10:34:56.811839+0000","last_undegraded":"2024-09-10T10:34:56.811839+0000","last_fullsized":"2024-09-10T10:34:56.811839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:50.105188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790983+0000","last_change":"2024-09-10T10:34:44.749912+0000","last_active":"2024-09-10T10:34:55.790983+0000","last_peered":"2024-09-10T10:34:55.790983+0000","last_clean":"2024-09-10T10:34:55.790983+0000","last_became_active":"2024-09-10T10:34:44.747509+0000","last_became_peered":"2024-09-10T10:34:44.747509+0000","last_unstale":"2024-09-10T10:34:55.790983+0000","last_undegraded":"2024-09-10T10:34:55.790983+0000","last_fullsized":"2024-09-10T10:34:55.790983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:53.870350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808261+0000","last_change":"2024-09-10T10:34:42.733396+0000","last_active":"2024-09-10T10:34:55.808261+0000","last_peered":"2024-09-10T10:34:55.808261+0000","last_clean":"2024-09-10T10:34:55.808261+0000","last_became_active":"2024-09-10T10:34:42.733003+0000","last_became_peered":"2024-09-10T10:34:42.733003+0000","last_unstale":"2024-09-10T10:34:55.808261+0000","last_undegraded":"2024-09-10T10:34:55.808261+0000","last_fullsized":"2024-09-10T10:34:55.808261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:20.960255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790177+0000","last_change":"2024-09-10T10:34:44.747384+0000","last_active":"2024-09-10T10:34:55.790177+0000","last_peered":"2024-09-10T10:34:55.790177+0000","last_clean":"2024-09-10T10:34:55.790177+0000","last_became_active":"2024-09-10T10:34:44.747090+0000","last_became_peered":"2024-09-10T10:34:44.747090+0000","last_unstale":"2024-09-10T10:34:55.790177+0000","last_undegraded":"2024-09-10T10:34:55.790177+0000","last_fullsized":"2024-09-10T10:34:55.790177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:57.205351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:05.825919+0000","last_change":"2024-09-10T10:34:42.761200+0000","last_active":"2024-09-10T10:35:05.825919+0000","last_peered":"2024-09-10T10:35:05.825919+0000","last_clean":"2024-09-10T10:35:05.825919+0000","last_became_active":"2024-09-10T10:34:42.759724+0000","last_became_peered":"2024-09-10T10:34:42.759724+0000","last_unstale":"2024-09-10T10:35:05.825919+0000","last_undegraded":"2024-09-10T10:35:05.825919+0000","last_fullsized":"2024-09-10T10:35:05.825919+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:29.614079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790902+0000","last_change":"2024-09-10T10:34:44.753426+0000","last_active":"2024-09-10T10:34:55.790902+0000","last_peered":"2024-09-10T10:34:55.790902+0000","last_clean":"2024-09-10T10:34:55.790902+0000","last_became_active":"2024-09-10T10:34:44.752709+0000","last_became_peered":"2024-09-10T10:34:44.752709+0000","last_unstale":"2024-09-10T10:34:55.790902+0000","last_undegraded":"2024-09-10T10:34:55.790902+0000","last_fullsized":"2024-09-10T10:34:55.790902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:44.046117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:05.826311+0000","last_change":"2024-09-10T10:34:42.729475+0000","last_active":"2024-09-10T10:35:05.826311+0000","last_peered":"2024-09-10T10:35:05.826311+0000","last_clean":"2024-09-10T10:35:05.826311+0000","last_became_active":"2024-09-10T10:34:42.729053+0000","last_became_peered":"2024-09-10T10:34:42.729053+0000","last_unstale":"2024-09-10T10:35:05.826311+0000","last_undegraded":"2024-09-10T10:35:05.826311+0000","last_fullsized":"2024-09-10T10:35:05.826311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:40.184538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.809197+0000","last_change":"2024-09-10T10:34:55.809197+0000","last_active":"2024-09-10T10:34:55.809197+0000","last_peered":"2024-09-10T10:34:55.809197+0000","last_clean":"2024-09-10T10:34:55.809197+0000","last_became_active":"2024-09-10T10:34:55.808757+0000","last_became_peered":"2024-09-10T10:34:55.808757+0000","last_unstale":"2024-09-10T10:34:55.809197+0000","last_undegraded":"2024-09-10T10:34:55.809197+0000","last_fullsized":"2024-09-10T10:34:55.809197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:15.117612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787178+0000","last_change":"2024-09-10T10:34:42.761268+0000","last_active":"2024-09-10T10:34:55.787178+0000","last_peered":"2024-09-10T10:34:55.787178+0000","last_clean":"2024-09-10T10:34:55.787178+0000","last_became_active":"2024-09-10T10:34:42.760889+0000","last_became_peered":"2024-09-10T10:34:42.760889+0000","last_unstale":"2024-09-10T10:34:55.787178+0000","last_undegraded":"2024-09-10T10:34:55.787178+0000","last_fullsized":"2024-09-10T10:34:55.787178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:46.767378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791069+0000","last_change":"2024-09-10T10:34:44.743850+0000","last_active":"2024-09-10T10:34:55.791069+0000","last_peered":"2024-09-10T10:34:55.791069+0000","last_clean":"2024-09-10T10:34:55.791069+0000","last_became_active":"2024-09-10T10:34:44.743496+0000","last_became_peered":"2024-09-10T10:34:44.743496+0000","last_unstale":"2024-09-10T10:34:55.791069+0000","last_undegraded":"2024-09-10T10:34:55.791069+0000","last_fullsized":"2024-09-10T10:34:55.791069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:48.113862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808471+0000","last_change":"2024-09-10T10:34:42.760831+0000","last_active":"2024-09-10T10:34:55.808471+0000","last_peered":"2024-09-10T10:34:55.808471+0000","last_clean":"2024-09-10T10:34:55.808471+0000","last_became_active":"2024-09-10T10:34:42.760311+0000","last_became_peered":"2024-09-10T10:34:42.760311+0000","last_unstale":"2024-09-10T10:34:55.808471+0000","last_undegraded":"2024-09-10T10:34:55.808471+0000","last_fullsized":"2024-09-10T10:34:55.808471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:31.748386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790314+0000","last_change":"2024-09-10T10:34:44.746139+0000","last_active":"2024-09-10T10:34:55.790314+0000","last_peered":"2024-09-10T10:34:55.790314+0000","last_clean":"2024-09-10T10:34:55.790314+0000","last_became_active":"2024-09-10T10:34:44.745464+0000","last_became_peered":"2024-09-10T10:34:44.745464+0000","last_unstale":"2024-09-10T10:34:55.790314+0000","last_undegraded":"2024-09-10T10:34:55.790314+0000","last_fullsized":"2024-09-10T10:34:55.790314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:17.916893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:06.746403+0000","last_change":"2024-09-10T10:34:42.726550+0000","last_active":"2024-09-10T10:35:06.746403+0000","last_peered":"2024-09-10T10:35:06.746403+0000","last_clean":"2024-09-10T10:35:06.746403+0000","last_became_active":"2024-09-10T10:34:42.726205+0000","last_became_peered":"2024-09-10T10:34:42.726205+0000","last_unstale":"2024-09-10T10:35:06.746403+0000","last_undegraded":"2024-09-10T10:35:06.746403+0000","last_fullsized":"2024-09-10T10:35:06.746403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:07.689782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791609+0000","last_change":"2024-09-10T10:34:44.743986+0000","last_active":"2024-09-10T10:34:55.791609+0000","last_peered":"2024-09-10T10:34:55.791609+0000","last_clean":"2024-09-10T10:34:55.791609+0000","last_became_active":"2024-09-10T10:34:44.743692+0000","last_became_peered":"2024-09-10T10:34:44.743692+0000","last_unstale":"2024-09-10T10:34:55.791609+0000","last_undegraded":"2024-09-10T10:34:55.791609+0000","last_fullsized":"2024-09-10T10:34:55.791609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:52.703390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807986+0000","last_change":"2024-09-10T10:34:42.816493+0000","last_active":"2024-09-10T10:34:55.807986+0000","last_peered":"2024-09-10T10:34:55.807986+0000","last_clean":"2024-09-10T10:34:55.807986+0000","last_became_active":"2024-09-10T10:34:42.816184+0000","last_became_peered":"2024-09-10T10:34:42.816184+0000","last_unstale":"2024-09-10T10:34:55.807986+0000","last_undegraded":"2024-09-10T10:34:55.807986+0000","last_fullsized":"2024-09-10T10:34:55.807986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:36.589002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807910+0000","last_change":"2024-09-10T10:34:44.753526+0000","last_active":"2024-09-10T10:34:55.807910+0000","last_peered":"2024-09-10T10:34:55.807910+0000","last_clean":"2024-09-10T10:34:55.807910+0000","last_became_active":"2024-09-10T10:34:44.753243+0000","last_became_peered":"2024-09-10T10:34:44.753243+0000","last_unstale":"2024-09-10T10:34:55.807910+0000","last_undegraded":"2024-09-10T10:34:55.807910+0000","last_fullsized":"2024-09-10T10:34:55.807910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:37.310489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787510+0000","last_change":"2024-09-10T10:34:42.760422+0000","last_active":"2024-09-10T10:34:55.787510+0000","last_peered":"2024-09-10T10:34:55.787510+0000","last_clean":"2024-09-10T10:34:55.787510+0000","last_became_active":"2024-09-10T10:34:42.759992+0000","last_became_peered":"2024-09-10T10:34:42.759992+0000","last_unstale":"2024-09-10T10:34:55.787510+0000","last_undegraded":"2024-09-10T10:34:55.787510+0000","last_fullsized":"2024-09-10T10:34:55.787510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:40.191718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790527+0000","last_change":"2024-09-10T10:34:44.748835+0000","last_active":"2024-09-10T10:34:55.790527+0000","last_peered":"2024-09-10T10:34:55.790527+0000","last_clean":"2024-09-10T10:34:55.790527+0000","last_became_active":"2024-09-10T10:34:44.748512+0000","last_became_peered":"2024-09-10T10:34:44.748512+0000","last_unstale":"2024-09-10T10:34:55.790527+0000","last_undegraded":"2024-09-10T10:34:55.790527+0000","last_fullsized":"2024-09-10T10:34:55.790527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:23.208046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808545+0000","last_change":"2024-09-10T10:34:42.730533+0000","last_active":"2024-09-10T10:34:55.808545+0000","last_peered":"2024-09-10T10:34:55.808545+0000","last_clean":"2024-09-10T10:34:55.808545+0000","last_became_active":"2024-09-10T10:34:42.730182+0000","last_became_peered":"2024-09-10T10:34:42.730182+0000","last_unstale":"2024-09-10T10:34:55.808545+0000","last_undegraded":"2024-09-10T10:34:55.808545+0000","last_fullsized":"2024-09-10T10:34:55.808545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:52.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788162+0000","last_change":"2024-09-10T10:34:44.748168+0000","last_active":"2024-09-10T10:34:55.788162+0000","last_peered":"2024-09-10T10:34:55.788162+0000","last_clean":"2024-09-10T10:34:55.788162+0000","last_became_active":"2024-09-10T10:34:44.747728+0000","last_became_peered":"2024-09-10T10:34:44.747728+0000","last_unstale":"2024-09-10T10:34:55.788162+0000","last_undegraded":"2024-09-10T10:34:55.788162+0000","last_fullsized":"2024-09-10T10:34:55.788162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:07.854731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.786661+0000","last_change":"2024-09-10T10:34:55.797384+0000","last_active":"2024-09-10T10:34:56.786661+0000","last_peered":"2024-09-10T10:34:56.786661+0000","last_clean":"2024-09-10T10:34:56.786661+0000","last_became_active":"2024-09-10T10:34:55.792994+0000","last_became_peered":"2024-09-10T10:34:55.792994+0000","last_unstale":"2024-09-10T10:34:56.786661+0000","last_undegraded":"2024-09-10T10:34:56.786661+0000","last_fullsized":"2024-09-10T10:34:56.786661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:11.161379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791002+0000","last_change":"2024-09-10T10:34:44.752488+0000","last_active":"2024-09-10T10:34:55.791002+0000","last_peered":"2024-09-10T10:34:55.791002+0000","last_clean":"2024-09-10T10:34:55.791002+0000","last_became_active":"2024-09-10T10:34:44.752172+0000","last_became_peered":"2024-09-10T10:34:44.752172+0000","last_unstale":"2024-09-10T10:34:55.791002+0000","last_undegraded":"2024-09-10T10:34:55.791002+0000","last_fullsized":"2024-09-10T10:34:55.791002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:25:18.150982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790888+0000","last_change":"2024-09-10T10:34:42.729662+0000","last_active":"2024-09-10T10:34:55.790888+0000","last_peered":"2024-09-10T10:34:55.790888+0000","last_clean":"2024-09-10T10:34:55.790888+0000","last_became_active":"2024-09-10T10:34:42.729037+0000","last_became_peered":"2024-09-10T10:34:42.729037+0000","last_unstale":"2024-09-10T10:34:55.790888+0000","last_undegraded":"2024-09-10T10:34:55.790888+0000","last_fullsized":"2024-09-10T10:34:55.790888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:19.367904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806223+0000","last_change":"2024-09-10T10:34:44.759093+0000","last_active":"2024-09-10T10:34:55.806223+0000","last_peered":"2024-09-10T10:34:55.806223+0000","last_clean":"2024-09-10T10:34:55.806223+0000","last_became_active":"2024-09-10T10:34:44.758625+0000","last_became_peered":"2024-09-10T10:34:44.758625+0000","last_unstale":"2024-09-10T10:34:55.806223+0000","last_undegraded":"2024-09-10T10:34:55.806223+0000","last_fullsized":"2024-09-10T10:34:55.806223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791414+0000","last_change":"2024-09-10T10:34:44.757373+0000","last_active":"2024-09-10T10:34:55.791414+0000","last_peered":"2024-09-10T10:34:55.791414+0000","last_clean":"2024-09-10T10:34:55.791414+0000","last_became_active":"2024-09-10T10:34:44.757048+0000","last_became_peered":"2024-09-10T10:34:44.757048+0000","last_unstale":"2024-09-10T10:34:55.791414+0000","last_undegraded":"2024-09-10T10:34:55.791414+0000","last_fullsized":"2024-09-10T10:34:55.791414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:30.438703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808480+0000","last_change":"2024-09-10T10:34:42.732645+0000","last_active":"2024-09-10T10:34:55.808480+0000","last_peered":"2024-09-10T10:34:55.808480+0000","last_clean":"2024-09-10T10:34:55.808480+0000","last_became_active":"2024-09-10T10:34:42.732342+0000","last_became_peered":"2024-09-10T10:34:42.732342+0000","last_unstale":"2024-09-10T10:34:55.808480+0000","last_undegraded":"2024-09-10T10:34:55.808480+0000","last_fullsized":"2024-09-10T10:34:55.808480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:21.866063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787603+0000","last_change":"2024-09-10T10:34:44.752039+0000","last_active":"2024-09-10T10:34:55.787603+0000","last_peered":"2024-09-10T10:34:55.787603+0000","last_clean":"2024-09-10T10:34:55.787603+0000","last_became_active":"2024-09-10T10:34:44.751706+0000","last_became_peered":"2024-09-10T10:34:44.751706+0000","last_unstale":"2024-09-10T10:34:55.787603+0000","last_undegraded":"2024-09-10T10:34:55.787603+0000","last_fullsized":"2024-09-10T10:34:55.787603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:37.775921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.810394+0000","last_change":"2024-09-10T10:34:42.729973+0000","last_active":"2024-09-10T10:34:56.810394+0000","last_peered":"2024-09-10T10:34:56.810394+0000","last_clean":"2024-09-10T10:34:56.810394+0000","last_became_active":"2024-09-10T10:34:42.729554+0000","last_became_peered":"2024-09-10T10:34:42.729554+0000","last_unstale":"2024-09-10T10:34:56.810394+0000","last_undegraded":"2024-09-10T10:34:56.810394+0000","last_fullsized":"2024-09-10T10:34:56.810394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:15.289199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807732+0000","last_change":"2024-09-10T10:34:44.756215+0000","last_active":"2024-09-10T10:34:55.807732+0000","last_peered":"2024-09-10T10:34:55.807732+0000","last_clean":"2024-09-10T10:34:55.807732+0000","last_became_active":"2024-09-10T10:34:44.755875+0000","last_became_peered":"2024-09-10T10:34:44.755875+0000","last_unstale":"2024-09-10T10:34:55.807732+0000","last_undegraded":"2024-09-10T10:34:55.807732+0000","last_fullsized":"2024-09-10T10:34:55.807732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:32.835503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791603+0000","last_change":"2024-09-10T10:34:42.760332+0000","last_active":"2024-09-10T10:34:55.791603+0000","last_peered":"2024-09-10T10:34:55.791603+0000","last_clean":"2024-09-10T10:34:55.791603+0000","last_became_active":"2024-09-10T10:34:42.759719+0000","last_became_peered":"2024-09-10T10:34:42.759719+0000","last_unstale":"2024-09-10T10:34:55.791603+0000","last_undegraded":"2024-09-10T10:34:55.791603+0000","last_fullsized":"2024-09-10T10:34:55.791603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791467+0000","last_change":"2024-09-10T10:34:44.752056+0000","last_active":"2024-09-10T10:34:55.791467+0000","last_peered":"2024-09-10T10:34:55.791467+0000","last_clean":"2024-09-10T10:34:55.791467+0000","last_became_active":"2024-09-10T10:34:44.751528+0000","last_became_peered":"2024-09-10T10:34:44.751528+0000","last_unstale":"2024-09-10T10:34:55.791467+0000","last_undegraded":"2024-09-10T10:34:55.791467+0000","last_fullsized":"2024-09-10T10:34:55.791467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:44.101379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:06.827021+0000","last_change":"2024-09-10T10:34:42.726735+0000","last_active":"2024-09-10T10:35:06.827021+0000","last_peered":"2024-09-10T10:35:06.827021+0000","last_clean":"2024-09-10T10:35:06.827021+0000","last_became_active":"2024-09-10T10:34:42.726351+0000","last_became_peered":"2024-09-10T10:34:42.726351+0000","last_unstale":"2024-09-10T10:35:06.827021+0000","last_undegraded":"2024-09-10T10:35:06.827021+0000","last_fullsized":"2024-09-10T10:35:06.827021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:20.412565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56418,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":237,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":169254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281739,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":1080044,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":439342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":439698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1031847,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":439059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1031525,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":438920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":481650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":489575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":440791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:35:10.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:35:11.083 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:11.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:11 smithi092 ceph-mon[30834]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.3 KiB/s wr, 18 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:35:11.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:11 smithi092 ceph-mon[30834]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:11.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:11 smithi121 ceph-mon[35231]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.3 KiB/s wr, 18 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:35:11.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:11 smithi121 ceph-mon[35231]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:11 smithi097 ceph-mon[35213]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.3 KiB/s wr, 18 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T10:35:11.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:11 smithi097 ceph-mon[35213]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 -- 172.21.15.92:0/3982296380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 msgr2=0x7fcddc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 --2- 172.21.15.92:0/3982296380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 0x7fcddc1029b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009900 tx=0x7fcdc402a480 comp rx=0 tx=0).stop 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 -- 172.21.15.92:0/3982296380 shutdown_connections 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 --2- 172.21.15.92:0/3982296380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcddc102ef0 0x7fcddc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 --2- 172.21.15.92:0/3982296380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 0x7fcddc1029b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 --2- 172.21.15.92:0/3982296380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcddc100e20 0x7fcddc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 -- 172.21.15.92:0/3982296380 >> 172.21.15.92:0/3982296380 conn(0x7fcddc0fc7d0 msgr2=0x7fcddc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 -- 172.21.15.92:0/3982296380 shutdown_connections 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 -- 172.21.15.92:0/3982296380 wait complete. 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 Processor -- start 2024-09-10T10:35:11.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.554+0000 7fcde1822640 1 -- start start 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde1822640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcddc100e20 0x7fcddc10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde1822640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 0x7fcddc10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde1822640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcddc102ef0 0x7fcddc10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde1822640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc1120a0 con 0x7fcddc102570 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde1822640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc111f20 con 0x7fcddc100e20 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde1822640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc112220 con 0x7fcddc102ef0 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcdd27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 0x7fcddc10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcdd27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 0x7fcddc10ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44834/0 (socket says 172.21.15.92:44834) 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcdd27fc640 1 -- 172.21.15.92:0/3016798470 learned_addr learned my addr 172.21.15.92:0/3016798470 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcddaffd640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcddc100e20 0x7fcddc10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcddb7fe640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcddc102ef0 0x7fcddc10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:11.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcdd27fc640 1 -- 172.21.15.92:0/3016798470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcddc102ef0 msgr2=0x7fcddc10ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcdd27fc640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcddc102ef0 0x7fcddc10ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcdd27fc640 1 -- 172.21.15.92:0/3016798470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcddc100e20 msgr2=0x7fcddc10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcdd27fc640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcddc100e20 0x7fcddc10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcdd27fc640 1 -- 172.21.15.92:0/3016798470 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcddc1a6a20 con 0x7fcddc102570 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcdd27fc640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 0x7fcddc10ea10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4006010 tx=0x7fcdc4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde0820640 1 -- 172.21.15.92:0/3016798470 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc403f070 con 0x7fcddc102570 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde0820640 1 -- 172.21.15.92:0/3016798470 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdc4031e30 con 0x7fcddc102570 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcddc1a6cb0 con 0x7fcddc102570 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde0820640 1 -- 172.21.15.92:0/3016798470 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4035030 con 0x7fcddc102570 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.555+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcddc1a7190 con 0x7fcddc102570 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.557+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcddc101200 con 0x7fcddc102570 2024-09-10T10:35:11.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.558+0000 7fcde0820640 1 -- 172.21.15.92:0/3016798470 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcdc4042070 con 0x7fcddc102570 2024-09-10T10:35:11.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.559+0000 7fcde0820640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcdc80a2c10 0x7fcdc80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:11.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.559+0000 7fcddaffd640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcdc80a2c10 0x7fcdc80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:11.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.559+0000 7fcde0820640 1 -- 172.21.15.92:0/3016798470 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fcdc40efad0 con 0x7fcddc102570 2024-09-10T10:35:11.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.559+0000 7fcddaffd640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcdc80a2c10 0x7fcdc80a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0058c0 tx=0x7fcdcc00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:11.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.563+0000 7fcde0820640 1 -- 172.21.15.92:0/3016798470 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcdc40bc9d0 con 0x7fcddc102570 2024-09-10T10:35:11.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.726+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcddc109100 con 0x7fcdc80a2c10 2024-09-10T10:35:11.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.733+0000 7fcde0820640 1 -- 172.21.15.92:0/3016798470 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258920 (secure 0 0 0) 0x7fcdcc00a6d0 con 0x7fcdc80a2c10 2024-09-10T10:35:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:11.739 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-10T10:35:11.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.735+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcdc80a2c10 msgr2=0x7fcdc80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:11.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.735+0000 7fcde1822640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcdc80a2c10 0x7fcdc80a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0058c0 tx=0x7fcdcc00a4c0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.735+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 msgr2=0x7fcddc10ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:11.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.735+0000 7fcde1822640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 0x7fcddc10ea10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4006010 tx=0x7fcdc4003c80 comp rx=0 tx=0).stop 2024-09-10T10:35:11.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.736+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 shutdown_connections 2024-09-10T10:35:11.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.736+0000 7fcde1822640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fcdc80a2c10 0x7fcdc80a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.736+0000 7fcde1822640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcddc102ef0 0x7fcddc10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.736+0000 7fcde1822640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcddc102570 0x7fcddc10ea10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.736+0000 7fcde1822640 1 --2- 172.21.15.92:0/3016798470 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcddc100e20 0x7fcddc10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:11.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.736+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 >> 172.21.15.92:0/3016798470 conn(0x7fcddc0fc7d0 msgr2=0x7fcddc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:11.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.736+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 shutdown_connections 2024-09-10T10:35:11.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:11.736+0000 7fcde1822640 1 -- 172.21.15.92:0/3016798470 wait complete. 2024-09-10T10:35:12.515 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-10T10:35:10.130804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647020,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":289,"num_read_kb":263,"num_write":420,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368772,"kb_used_data":11188,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573052,"statfs":{"total":1151940427776,"available":1151562805248,"internally_reserved":0,"allocated":11456512,"data_stored":7191162,"data_compressed":107496,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":365933884},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48832,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":149,"num_read_kb":141,"num_write":71,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003314"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788050+0000","last_change":"2024-09-10T10:34:44.757989+0000","last_active":"2024-09-10T10:34:55.788050+0000","last_peered":"2024-09-10T10:34:55.788050+0000","last_clean":"2024-09-10T10:34:55.788050+0000","last_became_active":"2024-09-10T10:34:44.757638+0000","last_became_peered":"2024-09-10T10:34:44.757638+0000","last_unstale":"2024-09-10T10:34:55.788050+0000","last_undegraded":"2024-09-10T10:34:55.788050+0000","last_fullsized":"2024-09-10T10:34:55.788050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:41.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807821+0000","last_change":"2024-09-10T10:34:44.750218+0000","last_active":"2024-09-10T10:34:55.807821+0000","last_peered":"2024-09-10T10:34:55.807821+0000","last_clean":"2024-09-10T10:34:55.807821+0000","last_became_active":"2024-09-10T10:34:44.749807+0000","last_became_peered":"2024-09-10T10:34:44.749807+0000","last_unstale":"2024-09-10T10:34:55.807821+0000","last_undegraded":"2024-09-10T10:34:55.807821+0000","last_fullsized":"2024-09-10T10:34:55.807821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:17.123136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806919+0000","last_change":"2024-09-10T10:34:44.756169+0000","last_active":"2024-09-10T10:34:55.806919+0000","last_peered":"2024-09-10T10:34:55.806919+0000","last_clean":"2024-09-10T10:34:55.806919+0000","last_became_active":"2024-09-10T10:34:44.755845+0000","last_became_peered":"2024-09-10T10:34:44.755845+0000","last_unstale":"2024-09-10T10:34:55.806919+0000","last_undegraded":"2024-09-10T10:34:55.806919+0000","last_fullsized":"2024-09-10T10:34:55.806919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:11.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790302+0000","last_change":"2024-09-10T10:34:44.750153+0000","last_active":"2024-09-10T10:34:55.790302+0000","last_peered":"2024-09-10T10:34:55.790302+0000","last_clean":"2024-09-10T10:34:55.790302+0000","last_became_active":"2024-09-10T10:34:44.749830+0000","last_became_peered":"2024-09-10T10:34:44.749830+0000","last_unstale":"2024-09-10T10:34:55.790302+0000","last_undegraded":"2024-09-10T10:34:55.790302+0000","last_fullsized":"2024-09-10T10:34:55.790302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:30.799158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790670+0000","last_change":"2024-09-10T10:34:44.752766+0000","last_active":"2024-09-10T10:34:55.790670+0000","last_peered":"2024-09-10T10:34:55.790670+0000","last_clean":"2024-09-10T10:34:55.790670+0000","last_became_active":"2024-09-10T10:34:44.750892+0000","last_became_peered":"2024-09-10T10:34:44.750892+0000","last_unstale":"2024-09-10T10:34:55.790670+0000","last_undegraded":"2024-09-10T10:34:55.790670+0000","last_fullsized":"2024-09-10T10:34:55.790670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:20.139995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790850+0000","last_change":"2024-09-10T10:34:44.746378+0000","last_active":"2024-09-10T10:34:55.790850+0000","last_peered":"2024-09-10T10:34:55.790850+0000","last_clean":"2024-09-10T10:34:55.790850+0000","last_became_active":"2024-09-10T10:34:44.745996+0000","last_became_peered":"2024-09-10T10:34:44.745996+0000","last_unstale":"2024-09-10T10:34:55.790850+0000","last_undegraded":"2024-09-10T10:34:55.790850+0000","last_fullsized":"2024-09-10T10:34:55.790850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:14.444518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.805589+0000","last_change":"2024-09-10T10:34:44.756457+0000","last_active":"2024-09-10T10:34:55.805589+0000","last_peered":"2024-09-10T10:34:55.805589+0000","last_clean":"2024-09-10T10:34:55.805589+0000","last_became_active":"2024-09-10T10:34:44.756017+0000","last_became_peered":"2024-09-10T10:34:44.756017+0000","last_unstale":"2024-09-10T10:34:55.805589+0000","last_undegraded":"2024-09-10T10:34:55.805589+0000","last_fullsized":"2024-09-10T10:34:55.805589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:10.421223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790142+0000","last_change":"2024-09-10T10:34:44.735096+0000","last_active":"2024-09-10T10:34:55.790142+0000","last_peered":"2024-09-10T10:34:55.790142+0000","last_clean":"2024-09-10T10:34:55.790142+0000","last_became_active":"2024-09-10T10:34:44.734810+0000","last_became_peered":"2024-09-10T10:34:44.734810+0000","last_unstale":"2024-09-10T10:34:55.790142+0000","last_undegraded":"2024-09-10T10:34:55.790142+0000","last_fullsized":"2024-09-10T10:34:55.790142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:18.094135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788046+0000","last_change":"2024-09-10T10:34:44.760336+0000","last_active":"2024-09-10T10:34:55.788046+0000","last_peered":"2024-09-10T10:34:55.788046+0000","last_clean":"2024-09-10T10:34:55.788046+0000","last_became_active":"2024-09-10T10:34:44.759995+0000","last_became_peered":"2024-09-10T10:34:44.759995+0000","last_unstale":"2024-09-10T10:34:55.788046+0000","last_undegraded":"2024-09-10T10:34:55.788046+0000","last_fullsized":"2024-09-10T10:34:55.788046+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:56.471705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791244+0000","last_change":"2024-09-10T10:34:44.748238+0000","last_active":"2024-09-10T10:34:55.791244+0000","last_peered":"2024-09-10T10:34:55.791244+0000","last_clean":"2024-09-10T10:34:55.791244+0000","last_became_active":"2024-09-10T10:34:44.747876+0000","last_became_peered":"2024-09-10T10:34:44.747876+0000","last_unstale":"2024-09-10T10:34:55.791244+0000","last_undegraded":"2024-09-10T10:34:55.791244+0000","last_fullsized":"2024-09-10T10:34:55.791244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:30:01.721300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806892+0000","last_change":"2024-09-10T10:34:44.757513+0000","last_active":"2024-09-10T10:34:55.806892+0000","last_peered":"2024-09-10T10:34:55.806892+0000","last_clean":"2024-09-10T10:34:55.806892+0000","last_became_active":"2024-09-10T10:34:44.757207+0000","last_became_peered":"2024-09-10T10:34:44.757207+0000","last_unstale":"2024-09-10T10:34:55.806892+0000","last_undegraded":"2024-09-10T10:34:55.806892+0000","last_fullsized":"2024-09-10T10:34:55.806892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:07.351617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790432+0000","last_change":"2024-09-10T10:34:44.749394+0000","last_active":"2024-09-10T10:34:55.790432+0000","last_peered":"2024-09-10T10:34:55.790432+0000","last_clean":"2024-09-10T10:34:55.790432+0000","last_became_active":"2024-09-10T10:34:44.749029+0000","last_became_peered":"2024-09-10T10:34:44.749029+0000","last_unstale":"2024-09-10T10:34:55.790432+0000","last_undegraded":"2024-09-10T10:34:55.790432+0000","last_fullsized":"2024-09-10T10:34:55.790432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:46.772305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790387+0000","last_change":"2024-09-10T10:34:44.742056+0000","last_active":"2024-09-10T10:34:55.790387+0000","last_peered":"2024-09-10T10:34:55.790387+0000","last_clean":"2024-09-10T10:34:55.790387+0000","last_became_active":"2024-09-10T10:34:44.741716+0000","last_became_peered":"2024-09-10T10:34:44.741716+0000","last_unstale":"2024-09-10T10:34:55.790387+0000","last_undegraded":"2024-09-10T10:34:55.790387+0000","last_fullsized":"2024-09-10T10:34:55.790387+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:04.112050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806807+0000","last_change":"2024-09-10T10:34:44.747573+0000","last_active":"2024-09-10T10:34:55.806807+0000","last_peered":"2024-09-10T10:34:55.806807+0000","last_clean":"2024-09-10T10:34:55.806807+0000","last_became_active":"2024-09-10T10:34:44.747284+0000","last_became_peered":"2024-09-10T10:34:44.747284+0000","last_unstale":"2024-09-10T10:34:55.806807+0000","last_undegraded":"2024-09-10T10:34:55.806807+0000","last_fullsized":"2024-09-10T10:34:55.806807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:24.567112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806649+0000","last_change":"2024-09-10T10:34:44.745494+0000","last_active":"2024-09-10T10:34:55.806649+0000","last_peered":"2024-09-10T10:34:55.806649+0000","last_clean":"2024-09-10T10:34:55.806649+0000","last_became_active":"2024-09-10T10:34:44.744525+0000","last_became_peered":"2024-09-10T10:34:44.744525+0000","last_unstale":"2024-09-10T10:34:55.806649+0000","last_undegraded":"2024-09-10T10:34:55.806649+0000","last_fullsized":"2024-09-10T10:34:55.806649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:46.120579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787378+0000","last_change":"2024-09-10T10:34:44.755247+0000","last_active":"2024-09-10T10:34:55.787378+0000","last_peered":"2024-09-10T10:34:55.787378+0000","last_clean":"2024-09-10T10:34:55.787378+0000","last_became_active":"2024-09-10T10:34:44.754897+0000","last_became_peered":"2024-09-10T10:34:44.754897+0000","last_unstale":"2024-09-10T10:34:55.787378+0000","last_undegraded":"2024-09-10T10:34:55.787378+0000","last_fullsized":"2024-09-10T10:34:55.787378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:58.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788169+0000","last_change":"2024-09-10T10:34:44.758550+0000","last_active":"2024-09-10T10:34:55.788169+0000","last_peered":"2024-09-10T10:34:55.788169+0000","last_clean":"2024-09-10T10:34:55.788169+0000","last_became_active":"2024-09-10T10:34:44.757767+0000","last_became_peered":"2024-09-10T10:34:44.757767+0000","last_unstale":"2024-09-10T10:34:55.788169+0000","last_undegraded":"2024-09-10T10:34:55.788169+0000","last_fullsized":"2024-09-10T10:34:55.788169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.937733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787366+0000","last_change":"2024-09-10T10:34:44.748830+0000","last_active":"2024-09-10T10:34:55.787366+0000","last_peered":"2024-09-10T10:34:55.787366+0000","last_clean":"2024-09-10T10:34:55.787366+0000","last_became_active":"2024-09-10T10:34:44.748518+0000","last_became_peered":"2024-09-10T10:34:44.748518+0000","last_unstale":"2024-09-10T10:34:55.787366+0000","last_undegraded":"2024-09-10T10:34:55.787366+0000","last_fullsized":"2024-09-10T10:34:55.787366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:15.786806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786493+0000","last_change":"2024-09-10T10:34:44.752523+0000","last_active":"2024-09-10T10:34:55.786493+0000","last_peered":"2024-09-10T10:34:55.786493+0000","last_clean":"2024-09-10T10:34:55.786493+0000","last_became_active":"2024-09-10T10:34:44.752153+0000","last_became_peered":"2024-09-10T10:34:44.752153+0000","last_unstale":"2024-09-10T10:34:55.786493+0000","last_undegraded":"2024-09-10T10:34:55.786493+0000","last_fullsized":"2024-09-10T10:34:55.786493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:45.826111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787609+0000","last_change":"2024-09-10T10:34:44.750249+0000","last_active":"2024-09-10T10:34:55.787609+0000","last_peered":"2024-09-10T10:34:55.787609+0000","last_clean":"2024-09-10T10:34:55.787609+0000","last_became_active":"2024-09-10T10:34:44.749812+0000","last_became_peered":"2024-09-10T10:34:44.749812+0000","last_unstale":"2024-09-10T10:34:55.787609+0000","last_undegraded":"2024-09-10T10:34:55.787609+0000","last_fullsized":"2024-09-10T10:34:55.787609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:45.584744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790439+0000","last_change":"2024-09-10T10:34:44.747529+0000","last_active":"2024-09-10T10:34:55.790439+0000","last_peered":"2024-09-10T10:34:55.790439+0000","last_clean":"2024-09-10T10:34:55.790439+0000","last_became_active":"2024-09-10T10:34:44.747183+0000","last_became_peered":"2024-09-10T10:34:44.747183+0000","last_unstale":"2024-09-10T10:34:55.790439+0000","last_undegraded":"2024-09-10T10:34:55.790439+0000","last_fullsized":"2024-09-10T10:34:55.790439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:03.813289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787588+0000","last_change":"2024-09-10T10:34:44.755879+0000","last_active":"2024-09-10T10:34:55.787588+0000","last_peered":"2024-09-10T10:34:55.787588+0000","last_clean":"2024-09-10T10:34:55.787588+0000","last_became_active":"2024-09-10T10:34:44.755470+0000","last_became_peered":"2024-09-10T10:34:44.755470+0000","last_unstale":"2024-09-10T10:34:55.787588+0000","last_undegraded":"2024-09-10T10:34:55.787588+0000","last_fullsized":"2024-09-10T10:34:55.787588+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:01.424727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790858+0000","last_change":"2024-09-10T10:34:44.748049+0000","last_active":"2024-09-10T10:34:55.790858+0000","last_peered":"2024-09-10T10:34:55.790858+0000","last_clean":"2024-09-10T10:34:55.790858+0000","last_became_active":"2024-09-10T10:34:44.747708+0000","last_became_peered":"2024-09-10T10:34:44.747708+0000","last_unstale":"2024-09-10T10:34:55.790858+0000","last_undegraded":"2024-09-10T10:34:55.790858+0000","last_fullsized":"2024-09-10T10:34:55.790858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:20.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790796+0000","last_change":"2024-09-10T10:34:44.738305+0000","last_active":"2024-09-10T10:34:55.790796+0000","last_peered":"2024-09-10T10:34:55.790796+0000","last_clean":"2024-09-10T10:34:55.790796+0000","last_became_active":"2024-09-10T10:34:44.737625+0000","last_became_peered":"2024-09-10T10:34:44.737625+0000","last_unstale":"2024-09-10T10:34:55.790796+0000","last_undegraded":"2024-09-10T10:34:55.790796+0000","last_fullsized":"2024-09-10T10:34:55.790796+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:39.578131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791523+0000","last_change":"2024-09-10T10:34:44.748021+0000","last_active":"2024-09-10T10:34:55.791523+0000","last_peered":"2024-09-10T10:34:55.791523+0000","last_clean":"2024-09-10T10:34:55.791523+0000","last_became_active":"2024-09-10T10:34:44.747632+0000","last_became_peered":"2024-09-10T10:34:44.747632+0000","last_unstale":"2024-09-10T10:34:55.791523+0000","last_undegraded":"2024-09-10T10:34:55.791523+0000","last_fullsized":"2024-09-10T10:34:55.791523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:52.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786486+0000","last_change":"2024-09-10T10:34:44.746279+0000","last_active":"2024-09-10T10:34:55.786486+0000","last_peered":"2024-09-10T10:34:55.786486+0000","last_clean":"2024-09-10T10:34:55.786486+0000","last_became_active":"2024-09-10T10:34:44.745851+0000","last_became_peered":"2024-09-10T10:34:44.745851+0000","last_unstale":"2024-09-10T10:34:55.786486+0000","last_undegraded":"2024-09-10T10:34:55.786486+0000","last_fullsized":"2024-09-10T10:34:55.786486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:49.935780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787744+0000","last_change":"2024-09-10T10:34:44.749481+0000","last_active":"2024-09-10T10:34:55.787744+0000","last_peered":"2024-09-10T10:34:55.787744+0000","last_clean":"2024-09-10T10:34:55.787744+0000","last_became_active":"2024-09-10T10:34:44.749154+0000","last_became_peered":"2024-09-10T10:34:44.749154+0000","last_unstale":"2024-09-10T10:34:55.787744+0000","last_undegraded":"2024-09-10T10:34:55.787744+0000","last_fullsized":"2024-09-10T10:34:55.787744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:28:12.250198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808905+0000","last_change":"2024-09-10T10:34:55.808905+0000","last_active":"2024-09-10T10:34:55.808905+0000","last_peered":"2024-09-10T10:34:55.808905+0000","last_clean":"2024-09-10T10:34:55.808905+0000","last_became_active":"2024-09-10T10:34:55.808450+0000","last_became_peered":"2024-09-10T10:34:55.808450+0000","last_unstale":"2024-09-10T10:34:55.808905+0000","last_undegraded":"2024-09-10T10:34:55.808905+0000","last_fullsized":"2024-09-10T10:34:55.808905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:47.506359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807586+0000","last_change":"2024-09-10T10:34:44.753638+0000","last_active":"2024-09-10T10:34:55.807586+0000","last_peered":"2024-09-10T10:34:55.807586+0000","last_clean":"2024-09-10T10:34:55.807586+0000","last_became_active":"2024-09-10T10:34:44.752423+0000","last_became_peered":"2024-09-10T10:34:44.752423+0000","last_unstale":"2024-09-10T10:34:55.807586+0000","last_undegraded":"2024-09-10T10:34:55.807586+0000","last_fullsized":"2024-09-10T10:34:55.807586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:43.842713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.785975+0000","last_change":"2024-09-10T10:34:44.745530+0000","last_active":"2024-09-10T10:34:55.785975+0000","last_peered":"2024-09-10T10:34:55.785975+0000","last_clean":"2024-09-10T10:34:55.785975+0000","last_became_active":"2024-09-10T10:34:44.744856+0000","last_became_peered":"2024-09-10T10:34:44.744856+0000","last_unstale":"2024-09-10T10:34:55.785975+0000","last_undegraded":"2024-09-10T10:34:55.785975+0000","last_fullsized":"2024-09-10T10:34:55.785975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.496321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786069+0000","last_change":"2024-09-10T10:34:44.748888+0000","last_active":"2024-09-10T10:34:55.786069+0000","last_peered":"2024-09-10T10:34:55.786069+0000","last_clean":"2024-09-10T10:34:55.786069+0000","last_became_active":"2024-09-10T10:34:44.748402+0000","last_became_peered":"2024-09-10T10:34:44.748402+0000","last_unstale":"2024-09-10T10:34:55.786069+0000","last_undegraded":"2024-09-10T10:34:55.786069+0000","last_fullsized":"2024-09-10T10:34:55.786069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:33:11.491674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.789801+0000","last_change":"2024-09-10T10:34:55.789801+0000","last_active":"2024-09-10T10:34:55.789801+0000","last_peered":"2024-09-10T10:34:55.789801+0000","last_clean":"2024-09-10T10:34:55.789801+0000","last_became_active":"2024-09-10T10:34:55.789449+0000","last_became_peered":"2024-09-10T10:34:55.789449+0000","last_unstale":"2024-09-10T10:34:55.789801+0000","last_undegraded":"2024-09-10T10:34:55.789801+0000","last_fullsized":"2024-09-10T10:34:55.789801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:24.784027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790662+0000","last_change":"2024-09-10T10:34:44.753011+0000","last_active":"2024-09-10T10:34:55.790662+0000","last_peered":"2024-09-10T10:34:55.790662+0000","last_clean":"2024-09-10T10:34:55.790662+0000","last_became_active":"2024-09-10T10:34:44.752667+0000","last_became_peered":"2024-09-10T10:34:44.752667+0000","last_unstale":"2024-09-10T10:34:55.790662+0000","last_undegraded":"2024-09-10T10:34:55.790662+0000","last_fullsized":"2024-09-10T10:34:55.790662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:44.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:04.825956+0000","last_change":"2024-09-10T10:34:42.728468+0000","last_active":"2024-09-10T10:35:04.825956+0000","last_peered":"2024-09-10T10:35:04.825956+0000","last_clean":"2024-09-10T10:35:04.825956+0000","last_became_active":"2024-09-10T10:34:42.727707+0000","last_became_peered":"2024-09-10T10:34:42.727707+0000","last_unstale":"2024-09-10T10:35:04.825956+0000","last_undegraded":"2024-09-10T10:35:04.825956+0000","last_fullsized":"2024-09-10T10:35:04.825956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.920375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791368+0000","last_change":"2024-09-10T10:34:44.743410+0000","last_active":"2024-09-10T10:34:55.791368+0000","last_peered":"2024-09-10T10:34:55.791368+0000","last_clean":"2024-09-10T10:34:55.791368+0000","last_became_active":"2024-09-10T10:34:44.743040+0000","last_became_peered":"2024-09-10T10:34:44.743040+0000","last_unstale":"2024-09-10T10:34:55.791368+0000","last_undegraded":"2024-09-10T10:34:55.791368+0000","last_fullsized":"2024-09-10T10:34:55.791368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790902+0000","last_change":"2024-09-10T10:34:42.730778+0000","last_active":"2024-09-10T10:34:55.790902+0000","last_peered":"2024-09-10T10:34:55.790902+0000","last_clean":"2024-09-10T10:34:55.790902+0000","last_became_active":"2024-09-10T10:34:42.730360+0000","last_became_peered":"2024-09-10T10:34:42.730360+0000","last_unstale":"2024-09-10T10:34:55.790902+0000","last_undegraded":"2024-09-10T10:34:55.790902+0000","last_fullsized":"2024-09-10T10:34:55.790902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:41.596309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790332+0000","last_change":"2024-09-10T10:34:42.730251+0000","last_active":"2024-09-10T10:34:55.790332+0000","last_peered":"2024-09-10T10:34:55.790332+0000","last_clean":"2024-09-10T10:34:55.790332+0000","last_became_active":"2024-09-10T10:34:42.729915+0000","last_became_peered":"2024-09-10T10:34:42.729915+0000","last_unstale":"2024-09-10T10:34:55.790332+0000","last_undegraded":"2024-09-10T10:34:55.790332+0000","last_fullsized":"2024-09-10T10:34:55.790332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:10.215793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790686+0000","last_change":"2024-09-10T10:34:44.745663+0000","last_active":"2024-09-10T10:34:55.790686+0000","last_peered":"2024-09-10T10:34:55.790686+0000","last_clean":"2024-09-10T10:34:55.790686+0000","last_became_active":"2024-09-10T10:34:44.745361+0000","last_became_peered":"2024-09-10T10:34:44.745361+0000","last_unstale":"2024-09-10T10:34:55.790686+0000","last_undegraded":"2024-09-10T10:34:55.790686+0000","last_fullsized":"2024-09-10T10:34:55.790686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:17.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810334+0000","last_change":"2024-09-10T10:34:42.731515+0000","last_active":"2024-09-10T10:34:55.810334+0000","last_peered":"2024-09-10T10:34:55.810334+0000","last_clean":"2024-09-10T10:34:55.810334+0000","last_became_active":"2024-09-10T10:34:42.731103+0000","last_became_peered":"2024-09-10T10:34:42.731103+0000","last_unstale":"2024-09-10T10:34:55.810334+0000","last_undegraded":"2024-09-10T10:34:55.810334+0000","last_fullsized":"2024-09-10T10:34:55.810334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:51.181868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787178+0000","last_change":"2024-09-10T10:34:44.740826+0000","last_active":"2024-09-10T10:34:55.787178+0000","last_peered":"2024-09-10T10:34:55.787178+0000","last_clean":"2024-09-10T10:34:55.787178+0000","last_became_active":"2024-09-10T10:34:44.740510+0000","last_became_peered":"2024-09-10T10:34:44.740510+0000","last_unstale":"2024-09-10T10:34:55.787178+0000","last_undegraded":"2024-09-10T10:34:55.787178+0000","last_fullsized":"2024-09-10T10:34:55.787178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:30:44.650840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:08.830180+0000","last_change":"2024-09-10T10:34:42.733744+0000","last_active":"2024-09-10T10:35:08.830180+0000","last_peered":"2024-09-10T10:35:08.830180+0000","last_clean":"2024-09-10T10:35:08.830180+0000","last_became_active":"2024-09-10T10:34:42.733380+0000","last_became_peered":"2024-09-10T10:34:42.733380+0000","last_unstale":"2024-09-10T10:35:08.830180+0000","last_undegraded":"2024-09-10T10:35:08.830180+0000","last_fullsized":"2024-09-10T10:35:08.830180+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:39.227094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787875+0000","last_change":"2024-09-10T10:34:44.749534+0000","last_active":"2024-09-10T10:34:55.787875+0000","last_peered":"2024-09-10T10:34:55.787875+0000","last_clean":"2024-09-10T10:34:55.787875+0000","last_became_active":"2024-09-10T10:34:44.749007+0000","last_became_peered":"2024-09-10T10:34:44.749007+0000","last_unstale":"2024-09-10T10:34:55.787875+0000","last_undegraded":"2024-09-10T10:34:55.787875+0000","last_fullsized":"2024-09-10T10:34:55.787875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:48.949171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810027+0000","last_change":"2024-09-10T10:34:42.728670+0000","last_active":"2024-09-10T10:34:55.810027+0000","last_peered":"2024-09-10T10:34:55.810027+0000","last_clean":"2024-09-10T10:34:55.810027+0000","last_became_active":"2024-09-10T10:34:42.728313+0000","last_became_peered":"2024-09-10T10:34:42.728313+0000","last_unstale":"2024-09-10T10:34:55.810027+0000","last_undegraded":"2024-09-10T10:34:55.810027+0000","last_fullsized":"2024-09-10T10:34:55.810027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:43.354818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807562+0000","last_change":"2024-09-10T10:34:44.752536+0000","last_active":"2024-09-10T10:34:55.807562+0000","last_peered":"2024-09-10T10:34:55.807562+0000","last_clean":"2024-09-10T10:34:55.807562+0000","last_became_active":"2024-09-10T10:34:44.750285+0000","last_became_peered":"2024-09-10T10:34:44.750285+0000","last_unstale":"2024-09-10T10:34:55.807562+0000","last_undegraded":"2024-09-10T10:34:55.807562+0000","last_fullsized":"2024-09-10T10:34:55.807562+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:53.610166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791508+0000","last_change":"2024-09-10T10:34:42.760713+0000","last_active":"2024-09-10T10:34:55.791508+0000","last_peered":"2024-09-10T10:34:55.791508+0000","last_clean":"2024-09-10T10:34:55.791508+0000","last_became_active":"2024-09-10T10:34:42.760294+0000","last_became_peered":"2024-09-10T10:34:42.760294+0000","last_unstale":"2024-09-10T10:34:55.791508+0000","last_undegraded":"2024-09-10T10:34:55.791508+0000","last_fullsized":"2024-09-10T10:34:55.791508+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:43.687485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.795427+0000","last_change":"2024-09-10T10:34:55.795427+0000","last_active":"2024-09-10T10:34:55.795427+0000","last_peered":"2024-09-10T10:34:55.795427+0000","last_clean":"2024-09-10T10:34:55.795427+0000","last_became_active":"2024-09-10T10:34:55.795072+0000","last_became_peered":"2024-09-10T10:34:55.795072+0000","last_unstale":"2024-09-10T10:34:55.795427+0000","last_undegraded":"2024-09-10T10:34:55.795427+0000","last_fullsized":"2024-09-10T10:34:55.795427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:39.758626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'27","reported_seq":82,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:08.836788+0000","last_change":"2024-09-10T10:34:42.734059+0000","last_active":"2024-09-10T10:35:08.836788+0000","last_peered":"2024-09-10T10:35:08.836788+0000","last_clean":"2024-09-10T10:35:08.836788+0000","last_became_active":"2024-09-10T10:34:42.733589+0000","last_became_peered":"2024-09-10T10:34:42.733589+0000","last_unstale":"2024-09-10T10:35:08.836788+0000","last_undegraded":"2024-09-10T10:35:08.836788+0000","last_fullsized":"2024-09-10T10:35:08.836788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:29.257184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49603,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":64,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791068+0000","last_change":"2024-09-10T10:34:44.750286+0000","last_active":"2024-09-10T10:34:55.791068+0000","last_peered":"2024-09-10T10:34:55.791068+0000","last_clean":"2024-09-10T10:34:55.791068+0000","last_became_active":"2024-09-10T10:34:44.749776+0000","last_became_peered":"2024-09-10T10:34:44.749776+0000","last_unstale":"2024-09-10T10:34:55.791068+0000","last_undegraded":"2024-09-10T10:34:55.791068+0000","last_fullsized":"2024-09-10T10:34:55.791068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:36.962707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.810651+0000","last_change":"2024-09-10T10:34:42.730667+0000","last_active":"2024-09-10T10:34:56.810651+0000","last_peered":"2024-09-10T10:34:56.810651+0000","last_clean":"2024-09-10T10:34:56.810651+0000","last_became_active":"2024-09-10T10:34:42.730299+0000","last_became_peered":"2024-09-10T10:34:42.730299+0000","last_unstale":"2024-09-10T10:34:56.810651+0000","last_undegraded":"2024-09-10T10:34:56.810651+0000","last_fullsized":"2024-09-10T10:34:56.810651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:53.313073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790409+0000","last_change":"2024-09-10T10:34:44.749059+0000","last_active":"2024-09-10T10:34:55.790409+0000","last_peered":"2024-09-10T10:34:55.790409+0000","last_clean":"2024-09-10T10:34:55.790409+0000","last_became_active":"2024-09-10T10:34:44.748770+0000","last_became_peered":"2024-09-10T10:34:44.748770+0000","last_unstale":"2024-09-10T10:34:55.790409+0000","last_undegraded":"2024-09-10T10:34:55.790409+0000","last_fullsized":"2024-09-10T10:34:55.790409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:26.992447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810381+0000","last_change":"2024-09-10T10:34:42.729171+0000","last_active":"2024-09-10T10:34:55.810381+0000","last_peered":"2024-09-10T10:34:55.810381+0000","last_clean":"2024-09-10T10:34:55.810381+0000","last_became_active":"2024-09-10T10:34:42.728432+0000","last_became_peered":"2024-09-10T10:34:42.728432+0000","last_unstale":"2024-09-10T10:34:55.810381+0000","last_undegraded":"2024-09-10T10:34:55.810381+0000","last_fullsized":"2024-09-10T10:34:55.810381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:40.513818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.805866+0000","last_change":"2024-09-10T10:34:44.746936+0000","last_active":"2024-09-10T10:34:55.805866+0000","last_peered":"2024-09-10T10:34:55.805866+0000","last_clean":"2024-09-10T10:34:55.805866+0000","last_became_active":"2024-09-10T10:34:44.746565+0000","last_became_peered":"2024-09-10T10:34:44.746565+0000","last_unstale":"2024-09-10T10:34:55.805866+0000","last_undegraded":"2024-09-10T10:34:55.805866+0000","last_fullsized":"2024-09-10T10:34:55.805866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:47.819637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:03.824123+0000","last_change":"2024-09-10T10:34:42.730369+0000","last_active":"2024-09-10T10:35:03.824123+0000","last_peered":"2024-09-10T10:35:03.824123+0000","last_clean":"2024-09-10T10:35:03.824123+0000","last_became_active":"2024-09-10T10:34:42.729917+0000","last_became_peered":"2024-09-10T10:34:42.729917+0000","last_unstale":"2024-09-10T10:35:03.824123+0000","last_undegraded":"2024-09-10T10:35:03.824123+0000","last_fullsized":"2024-09-10T10:35:03.824123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:59.882719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807035+0000","last_change":"2024-09-10T10:34:44.756160+0000","last_active":"2024-09-10T10:34:55.807035+0000","last_peered":"2024-09-10T10:34:55.807035+0000","last_clean":"2024-09-10T10:34:55.807035+0000","last_became_active":"2024-09-10T10:34:44.755811+0000","last_became_peered":"2024-09-10T10:34:44.755811+0000","last_unstale":"2024-09-10T10:34:55.807035+0000","last_undegraded":"2024-09-10T10:34:55.807035+0000","last_fullsized":"2024-09-10T10:34:55.807035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:37.299385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808007+0000","last_change":"2024-09-10T10:34:42.761084+0000","last_active":"2024-09-10T10:34:55.808007+0000","last_peered":"2024-09-10T10:34:55.808007+0000","last_clean":"2024-09-10T10:34:55.808007+0000","last_became_active":"2024-09-10T10:34:42.760223+0000","last_became_peered":"2024-09-10T10:34:42.760223+0000","last_unstale":"2024-09-10T10:34:55.808007+0000","last_undegraded":"2024-09-10T10:34:55.808007+0000","last_fullsized":"2024-09-10T10:34:55.808007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:24.001455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790499+0000","last_change":"2024-09-10T10:34:44.758495+0000","last_active":"2024-09-10T10:34:55.790499+0000","last_peered":"2024-09-10T10:34:55.790499+0000","last_clean":"2024-09-10T10:34:55.790499+0000","last_became_active":"2024-09-10T10:34:44.757701+0000","last_became_peered":"2024-09-10T10:34:44.757701+0000","last_unstale":"2024-09-10T10:34:55.790499+0000","last_undegraded":"2024-09-10T10:34:55.790499+0000","last_fullsized":"2024-09-10T10:34:55.790499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:42.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.811594+0000","last_change":"2024-09-10T10:34:55.800279+0000","last_active":"2024-09-10T10:34:56.811594+0000","last_peered":"2024-09-10T10:34:56.811594+0000","last_clean":"2024-09-10T10:34:56.811594+0000","last_became_active":"2024-09-10T10:34:55.792658+0000","last_became_peered":"2024-09-10T10:34:55.792658+0000","last_unstale":"2024-09-10T10:34:56.811594+0000","last_undegraded":"2024-09-10T10:34:56.811594+0000","last_fullsized":"2024-09-10T10:34:56.811594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:21.840613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787778+0000","last_change":"2024-09-10T10:34:44.751002+0000","last_active":"2024-09-10T10:34:55.787778+0000","last_peered":"2024-09-10T10:34:55.787778+0000","last_clean":"2024-09-10T10:34:55.787778+0000","last_became_active":"2024-09-10T10:34:44.749753+0000","last_became_peered":"2024-09-10T10:34:44.749753+0000","last_unstale":"2024-09-10T10:34:55.787778+0000","last_undegraded":"2024-09-10T10:34:55.787778+0000","last_fullsized":"2024-09-10T10:34:55.787778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:31.211448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807724+0000","last_change":"2024-09-10T10:34:42.727332+0000","last_active":"2024-09-10T10:34:55.807724+0000","last_peered":"2024-09-10T10:34:55.807724+0000","last_clean":"2024-09-10T10:34:55.807724+0000","last_became_active":"2024-09-10T10:34:42.726946+0000","last_became_peered":"2024-09-10T10:34:42.726946+0000","last_unstale":"2024-09-10T10:34:55.807724+0000","last_undegraded":"2024-09-10T10:34:55.807724+0000","last_fullsized":"2024-09-10T10:34:55.807724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:07.302005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806275+0000","last_change":"2024-09-10T10:34:44.753230+0000","last_active":"2024-09-10T10:34:55.806275+0000","last_peered":"2024-09-10T10:34:55.806275+0000","last_clean":"2024-09-10T10:34:55.806275+0000","last_became_active":"2024-09-10T10:34:44.752901+0000","last_became_peered":"2024-09-10T10:34:44.752901+0000","last_unstale":"2024-09-10T10:34:55.806275+0000","last_undegraded":"2024-09-10T10:34:55.806275+0000","last_fullsized":"2024-09-10T10:34:55.806275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:06.037445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808506+0000","last_change":"2024-09-10T10:34:42.731101+0000","last_active":"2024-09-10T10:34:55.808506+0000","last_peered":"2024-09-10T10:34:55.808506+0000","last_clean":"2024-09-10T10:34:55.808506+0000","last_became_active":"2024-09-10T10:34:42.730459+0000","last_became_peered":"2024-09-10T10:34:42.730459+0000","last_unstale":"2024-09-10T10:34:55.808506+0000","last_undegraded":"2024-09-10T10:34:55.808506+0000","last_fullsized":"2024-09-10T10:34:55.808506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:03.170940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806157+0000","last_change":"2024-09-10T10:34:44.756021+0000","last_active":"2024-09-10T10:34:55.806157+0000","last_peered":"2024-09-10T10:34:55.806157+0000","last_clean":"2024-09-10T10:34:55.806157+0000","last_became_active":"2024-09-10T10:34:44.755673+0000","last_became_peered":"2024-09-10T10:34:44.755673+0000","last_unstale":"2024-09-10T10:34:55.806157+0000","last_undegraded":"2024-09-10T10:34:55.806157+0000","last_fullsized":"2024-09-10T10:34:55.806157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:32.183967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:04.828970+0000","last_change":"2024-09-10T10:34:42.816450+0000","last_active":"2024-09-10T10:35:04.828970+0000","last_peered":"2024-09-10T10:35:04.828970+0000","last_clean":"2024-09-10T10:35:04.828970+0000","last_became_active":"2024-09-10T10:34:42.816049+0000","last_became_peered":"2024-09-10T10:34:42.816049+0000","last_unstale":"2024-09-10T10:35:04.828970+0000","last_undegraded":"2024-09-10T10:35:04.828970+0000","last_fullsized":"2024-09-10T10:35:04.828970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:54.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807005+0000","last_change":"2024-09-10T10:34:44.756769+0000","last_active":"2024-09-10T10:34:55.807005+0000","last_peered":"2024-09-10T10:34:55.807005+0000","last_clean":"2024-09-10T10:34:55.807005+0000","last_became_active":"2024-09-10T10:34:44.755873+0000","last_became_peered":"2024-09-10T10:34:44.755873+0000","last_unstale":"2024-09-10T10:34:55.807005+0000","last_undegraded":"2024-09-10T10:34:55.807005+0000","last_fullsized":"2024-09-10T10:34:55.807005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:56.481504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807659+0000","last_change":"2024-09-10T10:33:32.204576+0000","last_active":"2024-09-10T10:34:55.807659+0000","last_peered":"2024-09-10T10:34:55.807659+0000","last_clean":"2024-09-10T10:34:55.807659+0000","last_became_active":"2024-09-10T10:33:32.204173+0000","last_became_peered":"2024-09-10T10:33:32.204173+0000","last_unstale":"2024-09-10T10:34:55.807659+0000","last_undegraded":"2024-09-10T10:34:55.807659+0000","last_fullsized":"2024-09-10T10:34:55.807659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:30:07.036460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:30:07.036460+0000","last_clean_scrub_stamp":"2024-09-10T10:30:07.036460+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:27.845983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.811839+0000","last_change":"2024-09-10T10:34:42.731365+0000","last_active":"2024-09-10T10:34:56.811839+0000","last_peered":"2024-09-10T10:34:56.811839+0000","last_clean":"2024-09-10T10:34:56.811839+0000","last_became_active":"2024-09-10T10:34:42.731021+0000","last_became_peered":"2024-09-10T10:34:42.731021+0000","last_unstale":"2024-09-10T10:34:56.811839+0000","last_undegraded":"2024-09-10T10:34:56.811839+0000","last_fullsized":"2024-09-10T10:34:56.811839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:50.105188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790983+0000","last_change":"2024-09-10T10:34:44.749912+0000","last_active":"2024-09-10T10:34:55.790983+0000","last_peered":"2024-09-10T10:34:55.790983+0000","last_clean":"2024-09-10T10:34:55.790983+0000","last_became_active":"2024-09-10T10:34:44.747509+0000","last_became_peered":"2024-09-10T10:34:44.747509+0000","last_unstale":"2024-09-10T10:34:55.790983+0000","last_undegraded":"2024-09-10T10:34:55.790983+0000","last_fullsized":"2024-09-10T10:34:55.790983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:53.870350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808261+0000","last_change":"2024-09-10T10:34:42.733396+0000","last_active":"2024-09-10T10:34:55.808261+0000","last_peered":"2024-09-10T10:34:55.808261+0000","last_clean":"2024-09-10T10:34:55.808261+0000","last_became_active":"2024-09-10T10:34:42.733003+0000","last_became_peered":"2024-09-10T10:34:42.733003+0000","last_unstale":"2024-09-10T10:34:55.808261+0000","last_undegraded":"2024-09-10T10:34:55.808261+0000","last_fullsized":"2024-09-10T10:34:55.808261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:20.960255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790177+0000","last_change":"2024-09-10T10:34:44.747384+0000","last_active":"2024-09-10T10:34:55.790177+0000","last_peered":"2024-09-10T10:34:55.790177+0000","last_clean":"2024-09-10T10:34:55.790177+0000","last_became_active":"2024-09-10T10:34:44.747090+0000","last_became_peered":"2024-09-10T10:34:44.747090+0000","last_unstale":"2024-09-10T10:34:55.790177+0000","last_undegraded":"2024-09-10T10:34:55.790177+0000","last_fullsized":"2024-09-10T10:34:55.790177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:57.205351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:05.825919+0000","last_change":"2024-09-10T10:34:42.761200+0000","last_active":"2024-09-10T10:35:05.825919+0000","last_peered":"2024-09-10T10:35:05.825919+0000","last_clean":"2024-09-10T10:35:05.825919+0000","last_became_active":"2024-09-10T10:34:42.759724+0000","last_became_peered":"2024-09-10T10:34:42.759724+0000","last_unstale":"2024-09-10T10:35:05.825919+0000","last_undegraded":"2024-09-10T10:35:05.825919+0000","last_fullsized":"2024-09-10T10:35:05.825919+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:29.614079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790902+0000","last_change":"2024-09-10T10:34:44.753426+0000","last_active":"2024-09-10T10:34:55.790902+0000","last_peered":"2024-09-10T10:34:55.790902+0000","last_clean":"2024-09-10T10:34:55.790902+0000","last_became_active":"2024-09-10T10:34:44.752709+0000","last_became_peered":"2024-09-10T10:34:44.752709+0000","last_unstale":"2024-09-10T10:34:55.790902+0000","last_undegraded":"2024-09-10T10:34:55.790902+0000","last_fullsized":"2024-09-10T10:34:55.790902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:44.046117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:05.826311+0000","last_change":"2024-09-10T10:34:42.729475+0000","last_active":"2024-09-10T10:35:05.826311+0000","last_peered":"2024-09-10T10:35:05.826311+0000","last_clean":"2024-09-10T10:35:05.826311+0000","last_became_active":"2024-09-10T10:34:42.729053+0000","last_became_peered":"2024-09-10T10:34:42.729053+0000","last_unstale":"2024-09-10T10:35:05.826311+0000","last_undegraded":"2024-09-10T10:35:05.826311+0000","last_fullsized":"2024-09-10T10:35:05.826311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:40.184538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.809197+0000","last_change":"2024-09-10T10:34:55.809197+0000","last_active":"2024-09-10T10:34:55.809197+0000","last_peered":"2024-09-10T10:34:55.809197+0000","last_clean":"2024-09-10T10:34:55.809197+0000","last_became_active":"2024-09-10T10:34:55.808757+0000","last_became_peered":"2024-09-10T10:34:55.808757+0000","last_unstale":"2024-09-10T10:34:55.809197+0000","last_undegraded":"2024-09-10T10:34:55.809197+0000","last_fullsized":"2024-09-10T10:34:55.809197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:15.117612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787178+0000","last_change":"2024-09-10T10:34:42.761268+0000","last_active":"2024-09-10T10:34:55.787178+0000","last_peered":"2024-09-10T10:34:55.787178+0000","last_clean":"2024-09-10T10:34:55.787178+0000","last_became_active":"2024-09-10T10:34:42.760889+0000","last_became_peered":"2024-09-10T10:34:42.760889+0000","last_unstale":"2024-09-10T10:34:55.787178+0000","last_undegraded":"2024-09-10T10:34:55.787178+0000","last_fullsized":"2024-09-10T10:34:55.787178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:46.767378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791069+0000","last_change":"2024-09-10T10:34:44.743850+0000","last_active":"2024-09-10T10:34:55.791069+0000","last_peered":"2024-09-10T10:34:55.791069+0000","last_clean":"2024-09-10T10:34:55.791069+0000","last_became_active":"2024-09-10T10:34:44.743496+0000","last_became_peered":"2024-09-10T10:34:44.743496+0000","last_unstale":"2024-09-10T10:34:55.791069+0000","last_undegraded":"2024-09-10T10:34:55.791069+0000","last_fullsized":"2024-09-10T10:34:55.791069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:48.113862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808471+0000","last_change":"2024-09-10T10:34:42.760831+0000","last_active":"2024-09-10T10:34:55.808471+0000","last_peered":"2024-09-10T10:34:55.808471+0000","last_clean":"2024-09-10T10:34:55.808471+0000","last_became_active":"2024-09-10T10:34:42.760311+0000","last_became_peered":"2024-09-10T10:34:42.760311+0000","last_unstale":"2024-09-10T10:34:55.808471+0000","last_undegraded":"2024-09-10T10:34:55.808471+0000","last_fullsized":"2024-09-10T10:34:55.808471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:31.748386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790314+0000","last_change":"2024-09-10T10:34:44.746139+0000","last_active":"2024-09-10T10:34:55.790314+0000","last_peered":"2024-09-10T10:34:55.790314+0000","last_clean":"2024-09-10T10:34:55.790314+0000","last_became_active":"2024-09-10T10:34:44.745464+0000","last_became_peered":"2024-09-10T10:34:44.745464+0000","last_unstale":"2024-09-10T10:34:55.790314+0000","last_undegraded":"2024-09-10T10:34:55.790314+0000","last_fullsized":"2024-09-10T10:34:55.790314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:17.916893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:06.746403+0000","last_change":"2024-09-10T10:34:42.726550+0000","last_active":"2024-09-10T10:35:06.746403+0000","last_peered":"2024-09-10T10:35:06.746403+0000","last_clean":"2024-09-10T10:35:06.746403+0000","last_became_active":"2024-09-10T10:34:42.726205+0000","last_became_peered":"2024-09-10T10:34:42.726205+0000","last_unstale":"2024-09-10T10:35:06.746403+0000","last_undegraded":"2024-09-10T10:35:06.746403+0000","last_fullsized":"2024-09-10T10:35:06.746403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:07.689782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791609+0000","last_change":"2024-09-10T10:34:44.743986+0000","last_active":"2024-09-10T10:34:55.791609+0000","last_peered":"2024-09-10T10:34:55.791609+0000","last_clean":"2024-09-10T10:34:55.791609+0000","last_became_active":"2024-09-10T10:34:44.743692+0000","last_became_peered":"2024-09-10T10:34:44.743692+0000","last_unstale":"2024-09-10T10:34:55.791609+0000","last_undegraded":"2024-09-10T10:34:55.791609+0000","last_fullsized":"2024-09-10T10:34:55.791609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:52.703390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807986+0000","last_change":"2024-09-10T10:34:42.816493+0000","last_active":"2024-09-10T10:34:55.807986+0000","last_peered":"2024-09-10T10:34:55.807986+0000","last_clean":"2024-09-10T10:34:55.807986+0000","last_became_active":"2024-09-10T10:34:42.816184+0000","last_became_peered":"2024-09-10T10:34:42.816184+0000","last_unstale":"2024-09-10T10:34:55.807986+0000","last_undegraded":"2024-09-10T10:34:55.807986+0000","last_fullsized":"2024-09-10T10:34:55.807986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:36.589002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807910+0000","last_change":"2024-09-10T10:34:44.753526+0000","last_active":"2024-09-10T10:34:55.807910+0000","last_peered":"2024-09-10T10:34:55.807910+0000","last_clean":"2024-09-10T10:34:55.807910+0000","last_became_active":"2024-09-10T10:34:44.753243+0000","last_became_peered":"2024-09-10T10:34:44.753243+0000","last_unstale":"2024-09-10T10:34:55.807910+0000","last_undegraded":"2024-09-10T10:34:55.807910+0000","last_fullsized":"2024-09-10T10:34:55.807910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:37.310489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787510+0000","last_change":"2024-09-10T10:34:42.760422+0000","last_active":"2024-09-10T10:34:55.787510+0000","last_peered":"2024-09-10T10:34:55.787510+0000","last_clean":"2024-09-10T10:34:55.787510+0000","last_became_active":"2024-09-10T10:34:42.759992+0000","last_became_peered":"2024-09-10T10:34:42.759992+0000","last_unstale":"2024-09-10T10:34:55.787510+0000","last_undegraded":"2024-09-10T10:34:55.787510+0000","last_fullsized":"2024-09-10T10:34:55.787510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:40.191718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790527+0000","last_change":"2024-09-10T10:34:44.748835+0000","last_active":"2024-09-10T10:34:55.790527+0000","last_peered":"2024-09-10T10:34:55.790527+0000","last_clean":"2024-09-10T10:34:55.790527+0000","last_became_active":"2024-09-10T10:34:44.748512+0000","last_became_peered":"2024-09-10T10:34:44.748512+0000","last_unstale":"2024-09-10T10:34:55.790527+0000","last_undegraded":"2024-09-10T10:34:55.790527+0000","last_fullsized":"2024-09-10T10:34:55.790527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:23.208046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808545+0000","last_change":"2024-09-10T10:34:42.730533+0000","last_active":"2024-09-10T10:34:55.808545+0000","last_peered":"2024-09-10T10:34:55.808545+0000","last_clean":"2024-09-10T10:34:55.808545+0000","last_became_active":"2024-09-10T10:34:42.730182+0000","last_became_peered":"2024-09-10T10:34:42.730182+0000","last_unstale":"2024-09-10T10:34:55.808545+0000","last_undegraded":"2024-09-10T10:34:55.808545+0000","last_fullsized":"2024-09-10T10:34:55.808545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:52.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788162+0000","last_change":"2024-09-10T10:34:44.748168+0000","last_active":"2024-09-10T10:34:55.788162+0000","last_peered":"2024-09-10T10:34:55.788162+0000","last_clean":"2024-09-10T10:34:55.788162+0000","last_became_active":"2024-09-10T10:34:44.747728+0000","last_became_peered":"2024-09-10T10:34:44.747728+0000","last_unstale":"2024-09-10T10:34:55.788162+0000","last_undegraded":"2024-09-10T10:34:55.788162+0000","last_fullsized":"2024-09-10T10:34:55.788162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:07.854731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.786661+0000","last_change":"2024-09-10T10:34:55.797384+0000","last_active":"2024-09-10T10:34:56.786661+0000","last_peered":"2024-09-10T10:34:56.786661+0000","last_clean":"2024-09-10T10:34:56.786661+0000","last_became_active":"2024-09-10T10:34:55.792994+0000","last_became_peered":"2024-09-10T10:34:55.792994+0000","last_unstale":"2024-09-10T10:34:56.786661+0000","last_undegraded":"2024-09-10T10:34:56.786661+0000","last_fullsized":"2024-09-10T10:34:56.786661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:11.161379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791002+0000","last_change":"2024-09-10T10:34:44.752488+0000","last_active":"2024-09-10T10:34:55.791002+0000","last_peered":"2024-09-10T10:34:55.791002+0000","last_clean":"2024-09-10T10:34:55.791002+0000","last_became_active":"2024-09-10T10:34:44.752172+0000","last_became_peered":"2024-09-10T10:34:44.752172+0000","last_unstale":"2024-09-10T10:34:55.791002+0000","last_undegraded":"2024-09-10T10:34:55.791002+0000","last_fullsized":"2024-09-10T10:34:55.791002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:25:18.150982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790888+0000","last_change":"2024-09-10T10:34:42.729662+0000","last_active":"2024-09-10T10:34:55.790888+0000","last_peered":"2024-09-10T10:34:55.790888+0000","last_clean":"2024-09-10T10:34:55.790888+0000","last_became_active":"2024-09-10T10:34:42.729037+0000","last_became_peered":"2024-09-10T10:34:42.729037+0000","last_unstale":"2024-09-10T10:34:55.790888+0000","last_undegraded":"2024-09-10T10:34:55.790888+0000","last_fullsized":"2024-09-10T10:34:55.790888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:19.367904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806223+0000","last_change":"2024-09-10T10:34:44.759093+0000","last_active":"2024-09-10T10:34:55.806223+0000","last_peered":"2024-09-10T10:34:55.806223+0000","last_clean":"2024-09-10T10:34:55.806223+0000","last_became_active":"2024-09-10T10:34:44.758625+0000","last_became_peered":"2024-09-10T10:34:44.758625+0000","last_unstale":"2024-09-10T10:34:55.806223+0000","last_undegraded":"2024-09-10T10:34:55.806223+0000","last_fullsized":"2024-09-10T10:34:55.806223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791414+0000","last_change":"2024-09-10T10:34:44.757373+0000","last_active":"2024-09-10T10:34:55.791414+0000","last_peered":"2024-09-10T10:34:55.791414+0000","last_clean":"2024-09-10T10:34:55.791414+0000","last_became_active":"2024-09-10T10:34:44.757048+0000","last_became_peered":"2024-09-10T10:34:44.757048+0000","last_unstale":"2024-09-10T10:34:55.791414+0000","last_undegraded":"2024-09-10T10:34:55.791414+0000","last_fullsized":"2024-09-10T10:34:55.791414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:30.438703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808480+0000","last_change":"2024-09-10T10:34:42.732645+0000","last_active":"2024-09-10T10:34:55.808480+0000","last_peered":"2024-09-10T10:34:55.808480+0000","last_clean":"2024-09-10T10:34:55.808480+0000","last_became_active":"2024-09-10T10:34:42.732342+0000","last_became_peered":"2024-09-10T10:34:42.732342+0000","last_unstale":"2024-09-10T10:34:55.808480+0000","last_undegraded":"2024-09-10T10:34:55.808480+0000","last_fullsized":"2024-09-10T10:34:55.808480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:21.866063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787603+0000","last_change":"2024-09-10T10:34:44.752039+0000","last_active":"2024-09-10T10:34:55.787603+0000","last_peered":"2024-09-10T10:34:55.787603+0000","last_clean":"2024-09-10T10:34:55.787603+0000","last_became_active":"2024-09-10T10:34:44.751706+0000","last_became_peered":"2024-09-10T10:34:44.751706+0000","last_unstale":"2024-09-10T10:34:55.787603+0000","last_undegraded":"2024-09-10T10:34:55.787603+0000","last_fullsized":"2024-09-10T10:34:55.787603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:37.775921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.810394+0000","last_change":"2024-09-10T10:34:42.729973+0000","last_active":"2024-09-10T10:34:56.810394+0000","last_peered":"2024-09-10T10:34:56.810394+0000","last_clean":"2024-09-10T10:34:56.810394+0000","last_became_active":"2024-09-10T10:34:42.729554+0000","last_became_peered":"2024-09-10T10:34:42.729554+0000","last_unstale":"2024-09-10T10:34:56.810394+0000","last_undegraded":"2024-09-10T10:34:56.810394+0000","last_fullsized":"2024-09-10T10:34:56.810394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:15.289199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807732+0000","last_change":"2024-09-10T10:34:44.756215+0000","last_active":"2024-09-10T10:34:55.807732+0000","last_peered":"2024-09-10T10:34:55.807732+0000","last_clean":"2024-09-10T10:34:55.807732+0000","last_became_active":"2024-09-10T10:34:44.755875+0000","last_became_peered":"2024-09-10T10:34:44.755875+0000","last_unstale":"2024-09-10T10:34:55.807732+0000","last_undegraded":"2024-09-10T10:34:55.807732+0000","last_fullsized":"2024-09-10T10:34:55.807732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:32.835503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791603+0000","last_change":"2024-09-10T10:34:42.760332+0000","last_active":"2024-09-10T10:34:55.791603+0000","last_peered":"2024-09-10T10:34:55.791603+0000","last_clean":"2024-09-10T10:34:55.791603+0000","last_became_active":"2024-09-10T10:34:42.759719+0000","last_became_peered":"2024-09-10T10:34:42.759719+0000","last_unstale":"2024-09-10T10:34:55.791603+0000","last_undegraded":"2024-09-10T10:34:55.791603+0000","last_fullsized":"2024-09-10T10:34:55.791603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791467+0000","last_change":"2024-09-10T10:34:44.752056+0000","last_active":"2024-09-10T10:34:55.791467+0000","last_peered":"2024-09-10T10:34:55.791467+0000","last_clean":"2024-09-10T10:34:55.791467+0000","last_became_active":"2024-09-10T10:34:44.751528+0000","last_became_peered":"2024-09-10T10:34:44.751528+0000","last_unstale":"2024-09-10T10:34:55.791467+0000","last_undegraded":"2024-09-10T10:34:55.791467+0000","last_fullsized":"2024-09-10T10:34:55.791467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:44.101379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:06.827021+0000","last_change":"2024-09-10T10:34:42.726735+0000","last_active":"2024-09-10T10:35:06.827021+0000","last_peered":"2024-09-10T10:35:06.827021+0000","last_clean":"2024-09-10T10:35:06.827021+0000","last_became_active":"2024-09-10T10:34:42.726351+0000","last_became_peered":"2024-09-10T10:34:42.726351+0000","last_unstale":"2024-09-10T10:35:06.827021+0000","last_undegraded":"2024-09-10T10:35:06.827021+0000","last_fullsized":"2024-09-10T10:35:06.827021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:20.412565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56418,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":237,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":169254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281739,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":1080044,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":439342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":439698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1031847,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":439059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1031525,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":438920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":481650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":489575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":440791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":51355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":51968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":51339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:35:12.519 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T10:35:12.520 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T10:35:12.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T10:35:12.799 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:13.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.279+0000 7f5446f9b640 1 -- 172.21.15.92:0/1805139232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 msgr2=0x7f5440102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.279+0000 7f5446f9b640 1 --2- 172.21.15.92:0/1805139232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 0x7f5440102000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5434009900 tx=0x7f543402a410 comp rx=0 tx=0).stop 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.279+0000 7f5446f9b640 1 -- 172.21.15.92:0/1805139232 shutdown_connections 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.279+0000 7f5446f9b640 1 --2- 172.21.15.92:0/1805139232 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54401037c0 0x7f544010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.279+0000 7f5446f9b640 1 --2- 172.21.15.92:0/1805139232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5440102e00 0x7f5440103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.279+0000 7f5446f9b640 1 --2- 172.21.15.92:0/1805139232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 0x7f5440102000 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.279+0000 7f5446f9b640 1 -- 172.21.15.92:0/1805139232 >> 172.21.15.92:0/1805139232 conn(0x7f54400fd390 msgr2=0x7f54400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.279+0000 7f5446f9b640 1 -- 172.21.15.92:0/1805139232 shutdown_connections 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.279+0000 7f5446f9b640 1 -- 172.21.15.92:0/1805139232 wait complete. 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5446f9b640 1 Processor -- start 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5446f9b640 1 -- start start 2024-09-10T10:35:13.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5446f9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 0x7f5440197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5446f9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5440102e00 0x7f5440198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5446f9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54401037c0 0x7f544019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5446f9b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f544010d8e0 con 0x7f5440101c00 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5446f9b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f544010d760 con 0x7f5440102e00 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5446f9b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f544010da60 con 0x7f54401037c0 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5444d37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 0x7f5440197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5444d37640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 0x7f5440197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51922/0 (socket says 172.21.15.92:51922) 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5444d37640 1 -- 172.21.15.92:0/683379744 learned_addr learned my addr 172.21.15.92:0/683379744 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5444d37640 1 -- 172.21.15.92:0/683379744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54401037c0 msgr2=0x7f544019f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5444d37640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54401037c0 0x7f544019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5444d37640 1 -- 172.21.15.92:0/683379744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5440102e00 msgr2=0x7f5440198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f543ffff640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5440102e00 0x7f5440198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5444d37640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5440102e00 0x7f5440198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5444d37640 1 -- 172.21.15.92:0/683379744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544019fb50 con 0x7f5440101c00 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f543ffff640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5440102e00 0x7f5440198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.280+0000 7f5444d37640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 0x7f5440197f20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5434031610 tx=0x7f54340043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.281+0000 7f543dffb640 1 -- 172.21.15.92:0/683379744 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543403f030 con 0x7f5440101c00 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.281+0000 7f543dffb640 1 -- 172.21.15.92:0/683379744 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5434003ce0 con 0x7f5440101c00 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.281+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544019fde0 con 0x7f5440101c00 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.281+0000 7f543dffb640 1 -- 172.21.15.92:0/683379744 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5434035070 con 0x7f5440101c00 2024-09-10T10:35:13.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.281+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54401a0260 con 0x7f5440101c00 2024-09-10T10:35:13.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.282+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5440108fa0 con 0x7f5440101c00 2024-09-10T10:35:13.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.283+0000 7f543dffb640 1 -- 172.21.15.92:0/683379744 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5434042030 con 0x7f5440101c00 2024-09-10T10:35:13.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.283+0000 7f543dffb640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f54300a2cc0 0x7f54300a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:13.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.283+0000 7f543ffff640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f54300a2cc0 0x7f54300a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:13.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.284+0000 7f543dffb640 1 -- 172.21.15.92:0/683379744 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f54340ef790 con 0x7f5440101c00 2024-09-10T10:35:13.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.284+0000 7f543ffff640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f54300a2cc0 0x7f54300a5180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f542c006fd0 tx=0x7f542c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:13.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.287+0000 7f543dffb640 1 -- 172.21.15.92:0/683379744 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54340bc690 con 0x7f5440101c00 2024-09-10T10:35:13.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.517+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f544002d7c0 con 0x7f5440101c00 2024-09-10T10:35:13.519 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:13 smithi092 ceph-mon[30834]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:13.519 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:13 smithi092 ceph-mon[30834]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 4.5 KiB/s wr, 15 op/s 2024-09-10T10:35:13.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.520+0000 7f543dffb640 1 -- 172.21.15.92:0/683379744 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f54340bbf90 con 0x7f5440101c00 2024-09-10T10:35:13.521 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-09-10T10:35:13.521 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDhIOBmqUP1HhAAKC6LYobJJ+ShmJJs4CvtvA== 2024-09-10T10:35:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f54300a2cc0 msgr2=0x7f54300a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f54300a2cc0 0x7f54300a5180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f542c006fd0 tx=0x7f542c008040 comp rx=0 tx=0).stop 2024-09-10T10:35:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 msgr2=0x7f5440197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 0x7f5440197f20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5434031610 tx=0x7f54340043b0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 shutdown_connections 2024-09-10T10:35:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f54300a2cc0 0x7f54300a5180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54401037c0 0x7f544019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5440102e00 0x7f5440198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 --2- 172.21.15.92:0/683379744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5440101c00 0x7f5440197f20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:13.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 >> 172.21.15.92:0/683379744 conn(0x7f54400fd390 msgr2=0x7f5440106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:13.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 shutdown_connections 2024-09-10T10:35:13.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:13.522+0000 7f5446f9b640 1 -- 172.21.15.92:0/683379744 wait complete. 2024-09-10T10:35:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:13 smithi121 ceph-mon[35231]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:13 smithi121 ceph-mon[35231]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 4.5 KiB/s wr, 15 op/s 2024-09-10T10:35:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:13 smithi097 ceph-mon[35213]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:13 smithi097 ceph-mon[35213]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 4.5 KiB/s wr, 15 op/s 2024-09-10T10:35:14.320 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:35:14.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T10:35:14.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T10:35:14.356 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T10:35:14.356 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T10:35:14.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T10:35:14.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:14 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/683379744' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:35:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:14 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/683379744' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:35:14.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:14 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/683379744' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:35:14.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:14 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/683379744' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:35:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:14 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/683379744' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T10:35:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:14 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/683379744' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T10:35:14.638 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:15.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.107+0000 7f1596009640 1 -- 172.21.15.92:0/3078277040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590102d90 msgr2=0x7f1590103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.107+0000 7f1596009640 1 --2- 172.21.15.92:0/3078277040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590102d90 0x7f1590103170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1580009930 tx=0x7f158002a420 comp rx=0 tx=0).stop 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.107+0000 7f1596009640 1 -- 172.21.15.92:0/3078277040 shutdown_connections 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.107+0000 7f1596009640 1 --2- 172.21.15.92:0/3078277040 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1590108290 0x7f159010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.107+0000 7f1596009640 1 --2- 172.21.15.92:0/3078277040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1590103740 0x7f1590107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.107+0000 7f1596009640 1 --2- 172.21.15.92:0/3078277040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590102d90 0x7f1590103170 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.107+0000 7f1596009640 1 -- 172.21.15.92:0/3078277040 >> 172.21.15.92:0/3078277040 conn(0x7f15900fc7d0 msgr2=0x7f15900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.107+0000 7f1596009640 1 -- 172.21.15.92:0/3078277040 shutdown_connections 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.107+0000 7f1596009640 1 -- 172.21.15.92:0/3078277040 wait complete. 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1596009640 1 Processor -- start 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1596009640 1 -- start start 2024-09-10T10:35:15.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1596009640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1590102d90 0x7f1590198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1596009640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103740 0x7f1590198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1596009640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1590108290 0x7f159019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1596009640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1590112150 con 0x7f1590103740 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1596009640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1590111fd0 con 0x7f1590102d90 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1596009640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f15901122d0 con 0x7f1590108290 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1587fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103740 0x7f1590198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1587fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103740 0x7f1590198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51940/0 (socket says 172.21.15.92:51940) 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1587fff640 1 -- 172.21.15.92:0/2288860512 learned_addr learned my addr 172.21.15.92:0/2288860512 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f158ffff640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1590108290 0x7f159019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f158f7fe640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1590102d90 0x7f1590198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1587fff640 1 -- 172.21.15.92:0/2288860512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1590108290 msgr2=0x7f159019cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:15.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1587fff640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1590108290 0x7f159019cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1587fff640 1 -- 172.21.15.92:0/2288860512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1590102d90 msgr2=0x7f1590198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1587fff640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1590102d90 0x7f1590198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.108+0000 7f1587fff640 1 -- 172.21.15.92:0/2288860512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159019d6c0 con 0x7f1590103740 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.109+0000 7f158f7fe640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1590102d90 0x7f1590198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.109+0000 7f1587fff640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103740 0x7f1590198c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f157800b450 tx=0x7f157800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.109+0000 7f158d7fa640 1 -- 172.21.15.92:0/2288860512 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578015020 con 0x7f1590103740 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.109+0000 7f158d7fa640 1 -- 172.21.15.92:0/2288860512 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1578011d70 con 0x7f1590103740 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.109+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159019d9b0 con 0x7f1590103740 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.109+0000 7f158d7fa640 1 -- 172.21.15.92:0/2288860512 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157800f340 con 0x7f1590103740 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.109+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15901a5290 con 0x7f1590103740 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.110+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159006a7f0 con 0x7f1590103740 2024-09-10T10:35:15.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.111+0000 7f158d7fa640 1 -- 172.21.15.92:0/2288860512 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1578018020 con 0x7f1590103740 2024-09-10T10:35:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.112+0000 7f158d7fa640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f157c0a2c10 0x7f157c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.112+0000 7f158f7fe640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f157c0a2c10 0x7f157c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.112+0000 7f158d7fa640 1 -- 172.21.15.92:0/2288860512 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f15780ceb20 con 0x7f1590103740 2024-09-10T10:35:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.112+0000 7f158f7fe640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f157c0a2c10 0x7f157c0a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1580000c00 tx=0x7f1580005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:15.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.116+0000 7f158d7fa640 1 -- 172.21.15.92:0/2288860512 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f157801f020 con 0x7f1590103740 2024-09-10T10:35:15.331 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:15 smithi092 ceph-mon[30834]: pgmap v293: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-09-10T10:35:15.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.330+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f159010a2a0 con 0x7f1590103740 2024-09-10T10:35:15.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.334+0000 7f158d7fa640 1 -- 172.21.15.92:0/2288860512 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263198 (secure 0 0 0) 0x7f157800d040 con 0x7f1590103740 2024-09-10T10:35:15.339 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f157c0a2c10 msgr2=0x7f157c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f157c0a2c10 0x7f157c0a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1580000c00 tx=0x7f1580005a20 comp rx=0 tx=0).stop 2024-09-10T10:35:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103740 msgr2=0x7f1590198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103740 0x7f1590198c50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f157800b450 tx=0x7f157800b910 comp rx=0 tx=0).stop 2024-09-10T10:35:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 shutdown_connections 2024-09-10T10:35:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f157c0a2c10 0x7f157c0a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1590108290 0x7f159019cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103740 0x7f1590198c50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:15.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 --2- 172.21.15.92:0/2288860512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1590102d90 0x7f1590198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:15.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 >> 172.21.15.92:0/2288860512 conn(0x7f15900fc7d0 msgr2=0x7f1590105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:15.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 shutdown_connections 2024-09-10T10:35:15.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:15.337+0000 7f1596009640 1 -- 172.21.15.92:0/2288860512 wait complete. 2024-09-10T10:35:15.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:15 smithi121 ceph-mon[35231]: pgmap v293: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-09-10T10:35:15.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:15 smithi097 ceph-mon[35213]: pgmap v293: 97 pgs: 97 active+clean; 632 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.3 KiB/s wr, 12 op/s 2024-09-10T10:35:16.112 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2834815615},{"type":"v1","addr":"172.21.15.92:6801","nonce":2834815615}]},"active_addr":"172.21.15.92:6801/2834815615","active_change":"2024-09-10T10:27:54.047407+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.92:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":88974791}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":1058999410}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":1498104734}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3275925367}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":626939941}]}]} 2024-09-10T10:35:16.119 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T10:35:16.119 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T10:35:16.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:35:16.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:16 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2288860512' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T10:35:16.366 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:16.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:16 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2288860512' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T10:35:16.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:16 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2288860512' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T10:35:16.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 -- 172.21.15.92:0/1936449380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 msgr2=0x7fb3c010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/1936449380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 0x7fb3c010da40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009900 tx=0x7fb3b002a480 comp rx=0 tx=0).stop 2024-09-10T10:35:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 -- 172.21.15.92:0/1936449380 shutdown_connections 2024-09-10T10:35:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/1936449380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 0x7fb3c010da40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/1936449380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0102570 0x7fb3c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/1936449380 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3c0100e20 0x7fb3c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 -- 172.21.15.92:0/1936449380 >> 172.21.15.92:0/1936449380 conn(0x7fb3c00fc7d0 msgr2=0x7fb3c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 -- 172.21.15.92:0/1936449380 shutdown_connections 2024-09-10T10:35:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 -- 172.21.15.92:0/1936449380 wait complete. 2024-09-10T10:35:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 Processor -- start 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.861+0000 7fb3c54a1640 1 -- start start 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3c54a1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0100e20 0x7fb3c0197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3c54a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3c0102570 0x7fb3c0197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3c54a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 0x7fb3c0197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3c54a1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0110fa0 con 0x7fb3c0102ef0 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3c54a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0110e20 con 0x7fb3c0102570 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3c54a1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0111120 con 0x7fb3c0100e20 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3bf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 0x7fb3c0197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3bf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 0x7fb3c0197bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51958/0 (socket says 172.21.15.92:51958) 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3bf7fe640 1 -- 172.21.15.92:0/334235221 learned_addr learned my addr 172.21.15.92:0/334235221 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3beffd640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0100e20 0x7fb3c0197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3be7fc640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3c0102570 0x7fb3c0197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3bf7fe640 1 -- 172.21.15.92:0/334235221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0100e20 msgr2=0x7fb3c0197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3bf7fe640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0100e20 0x7fb3c0197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3bf7fe640 1 -- 172.21.15.92:0/334235221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3c0102570 msgr2=0x7fb3c0197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3bf7fe640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3c0102570 0x7fb3c0197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3bf7fe640 1 -- 172.21.15.92:0/334235221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c01a69b0 con 0x7fb3c0102ef0 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3beffd640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0100e20 0x7fb3c0197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3be7fc640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3c0102570 0x7fb3c0197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3bf7fe640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 0x7fb3c0197bc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0004770 tx=0x7fb3b0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3b7fff640 1 -- 172.21.15.92:0/334235221 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b003f070 con 0x7fb3c0102ef0 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c01a6c40 con 0x7fb3c0102ef0 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3b7fff640 1 -- 172.21.15.92:0/334235221 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3b0031c30 con 0x7fb3c0102ef0 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3b7fff640 1 -- 172.21.15.92:0/334235221 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0035030 con 0x7fb3c0102ef0 2024-09-10T10:35:16.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.862+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c01a71f0 con 0x7fb3c0102ef0 2024-09-10T10:35:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.864+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c0101200 con 0x7fb3c0102ef0 2024-09-10T10:35:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.865+0000 7fb3b7fff640 1 -- 172.21.15.92:0/334235221 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb3b0042070 con 0x7fb3c0102ef0 2024-09-10T10:35:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.865+0000 7fb3b7fff640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb3ac0a2c10 0x7fb3ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.865+0000 7fb3beffd640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb3ac0a2c10 0x7fb3ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.865+0000 7fb3b7fff640 1 -- 172.21.15.92:0/334235221 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fb3b00ef990 con 0x7fb3c0102ef0 2024-09-10T10:35:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.866+0000 7fb3beffd640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb3ac0a2c10 0x7fb3ac0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8005fd0 tx=0x7fb3b8009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:16.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:16.870+0000 7fb3b7fff640 1 -- 172.21.15.92:0/334235221 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3b00bc890 con 0x7fb3c0102ef0 2024-09-10T10:35:17.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.036+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3c01a7450 con 0x7fb3c0102ef0 2024-09-10T10:35:17.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.038+0000 7fb3b7fff640 1 -- 172.21.15.92:0/334235221 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22594 (secure 0 0 0) 0x7fb3b00bc190 con 0x7fb3c0102ef0 2024-09-10T10:35:17.040 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:17.040 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":83,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:34:55.779980+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:34:41.056656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:34:43.485327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:35:17.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb3ac0a2c10 msgr2=0x7fb3ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb3ac0a2c10 0x7fb3ac0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8005fd0 tx=0x7fb3b8009520 comp rx=0 tx=0).stop 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 msgr2=0x7fb3c0197bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 0x7fb3c0197bc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0004770 tx=0x7fb3b0003c10 comp rx=0 tx=0).stop 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 shutdown_connections 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb3ac0a2c10 0x7fb3ac0a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3c0102ef0 0x7fb3c0197bc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb3c0102570 0x7fb3c0197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 --2- 172.21.15.92:0/334235221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0100e20 0x7fb3c0197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 >> 172.21.15.92:0/334235221 conn(0x7fb3c00fc7d0 msgr2=0x7fb3c0106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 shutdown_connections 2024-09-10T10:35:17.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:17.041+0000 7fb3c54a1640 1 -- 172.21.15.92:0/334235221 wait complete. 2024-09-10T10:35:17.307 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:17 smithi092 ceph-mon[30834]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-10T10:35:17.307 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:17 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/334235221' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:17.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:17 smithi121 ceph-mon[35231]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-10T10:35:17.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:17 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/334235221' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:17.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:17 smithi097 ceph-mon[35213]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.8 KiB/s wr, 13 op/s 2024-09-10T10:35:17.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:17 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/334235221' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:17.849 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T10:35:17.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:35:18.096 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:18.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 -- 172.21.15.92:0/398875120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060102790 msgr2=0x7f20601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:18.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 --2- 172.21.15.92:0/398875120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060102790 0x7f20601067e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2050009900 tx=0x7f205002a410 comp rx=0 tx=0).stop 2024-09-10T10:35:18.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 -- 172.21.15.92:0/398875120 shutdown_connections 2024-09-10T10:35:18.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 --2- 172.21.15.92:0/398875120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2060106f10 0x7f206010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 --2- 172.21.15.92:0/398875120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060102790 0x7f20601067e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 --2- 172.21.15.92:0/398875120 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2060101de0 0x7f20601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 -- 172.21.15.92:0/398875120 >> 172.21.15.92:0/398875120 conn(0x7f20600fd8c0 msgr2=0x7f20600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 -- 172.21.15.92:0/398875120 shutdown_connections 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 -- 172.21.15.92:0/398875120 wait complete. 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 Processor -- start 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.604+0000 7f20684fd640 1 -- start start 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f20684fd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2060101de0 0x7f2060198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f20684fd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2060102790 0x7f2060198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f20684fd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060106f10 0x7f206019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f20684fd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2060111f90 con 0x7f2060106f10 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f20684fd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2060111e10 con 0x7f2060102790 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f20684fd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2060112110 con 0x7f2060101de0 2024-09-10T10:35:18.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066a9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060106f10 0x7f206019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066a9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060106f10 0x7f206019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51970/0 (socket says 172.21.15.92:51970) 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066a9a640 1 -- 172.21.15.92:0/4262128044 learned_addr learned my addr 172.21.15.92:0/4262128044 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066299640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2060101de0 0x7f2060198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066a9a640 1 -- 172.21.15.92:0/4262128044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2060101de0 msgr2=0x7f2060198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066a9a640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2060101de0 0x7f2060198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066a9a640 1 -- 172.21.15.92:0/4262128044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2060102790 msgr2=0x7f2060198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2065a98640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2060102790 0x7f2060198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066a9a640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2060102790 0x7f2060198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066a9a640 1 -- 172.21.15.92:0/4262128044 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206019d520 con 0x7f2060106f10 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f2066a9a640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060106f10 0x7f206019ce40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f205800b970 tx=0x7f205800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f20577fe640 1 -- 172.21.15.92:0/4262128044 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058019070 con 0x7f2060106f10 2024-09-10T10:35:18.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.605+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206019d810 con 0x7f2060106f10 2024-09-10T10:35:18.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.606+0000 7f20577fe640 1 -- 172.21.15.92:0/4262128044 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f205800cb40 con 0x7f2060106f10 2024-09-10T10:35:18.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.606+0000 7f20577fe640 1 -- 172.21.15.92:0/4262128044 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058007610 con 0x7f2060106f10 2024-09-10T10:35:18.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.606+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20601a50f0 con 0x7f2060106f10 2024-09-10T10:35:18.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.607+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20601021c0 con 0x7f2060106f10 2024-09-10T10:35:18.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.608+0000 7f20577fe640 1 -- 172.21.15.92:0/4262128044 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f205801c070 con 0x7f2060106f10 2024-09-10T10:35:18.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.609+0000 7f20577fe640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f204c0a2c10 0x7f204c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:18.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.609+0000 7f2066299640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f204c0a2c10 0x7f204c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:18.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.609+0000 7f20577fe640 1 -- 172.21.15.92:0/4262128044 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f20580cea90 con 0x7f2060106f10 2024-09-10T10:35:18.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.610+0000 7f2066299640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f204c0a2c10 0x7f204c0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f205c0058c0 tx=0x7f205c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:18.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.612+0000 7f20577fe640 1 -- 172.21.15.92:0/4262128044 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f205809baa0 con 0x7f2060106f10 2024-09-10T10:35:18.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.781+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f206010a150 con 0x7f2060106f10 2024-09-10T10:35:18.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.782+0000 7f20577fe640 1 -- 172.21.15.92:0/4262128044 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22594 (secure 0 0 0) 0x7f205809b3a0 con 0x7f2060106f10 2024-09-10T10:35:18.784 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:18.784 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":83,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:34:55.779980+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:34:41.056656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:34:43.485327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:35:18.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f204c0a2c10 msgr2=0x7f204c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:18.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f204c0a2c10 0x7f204c0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f205c0058c0 tx=0x7f205c00a4c0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060106f10 msgr2=0x7f206019ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060106f10 0x7f206019ce40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f205800b970 tx=0x7f205800be30 comp rx=0 tx=0).stop 2024-09-10T10:35:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 shutdown_connections 2024-09-10T10:35:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f204c0a2c10 0x7f204c0a50d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2060106f10 0x7f206019ce40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2060102790 0x7f2060198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 --2- 172.21.15.92:0/4262128044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2060101de0 0x7f2060198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 >> 172.21.15.92:0/4262128044 conn(0x7f20600fd8c0 msgr2=0x7f20600fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 shutdown_connections 2024-09-10T10:35:18.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:18.785+0000 7f20684fd640 1 -- 172.21.15.92:0/4262128044 wait complete. 2024-09-10T10:35:19.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:19 smithi092 ceph-mon[30834]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-10T10:35:19.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:19 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/4262128044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:19.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T10:35:19.529 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T10:35:19.529 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T10:35:19.529 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T10:35:19.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T10:35:19.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T10:35:19.531 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T10:35:19.531 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T10:35:19.532 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T10:35:19.532 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T10:35:19.532 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T10:35:19.533 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T10:35:19.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:19 smithi121 ceph-mon[35231]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-10T10:35:19.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:19 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/4262128044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:19.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:19 smithi097 ceph-mon[35213]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-10T10:35:19.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:19 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/4262128044' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:20.222 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.230 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.239 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.240 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.242 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.244 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.245 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.247 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.301 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.538 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:20.539 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:21.534 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:21 smithi092 ceph-mon[30834]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-10T10:35:21.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:21 smithi121 ceph-mon[35231]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-10T10:35:21.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.532+0000 7fef0e895640 1 -- 172.21.15.92:0/4271425005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef08106f20 msgr2=0x7fef0810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.532+0000 7fef0e895640 1 --2- 172.21.15.92:0/4271425005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef08106f20 0x7fef0810eaa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fef00009ca0 tx=0x7fef0002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.532+0000 7fef0e895640 1 -- 172.21.15.92:0/4271425005 shutdown_connections 2024-09-10T10:35:21.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.532+0000 7fef0e895640 1 --2- 172.21.15.92:0/4271425005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef08106f20 0x7fef0810eaa0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.532+0000 7fef0e895640 1 --2- 172.21.15.92:0/4271425005 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef081027a0 0x7fef081067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.532+0000 7fef0e895640 1 --2- 172.21.15.92:0/4271425005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef08101df0 0x7fef081021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.532+0000 7fef0e895640 1 -- 172.21.15.92:0/4271425005 >> 172.21.15.92:0/4271425005 conn(0x7fef080fd8f0 msgr2=0x7fef080ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.532+0000 7fef0e895640 1 -- 172.21.15.92:0/4271425005 shutdown_connections 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.532+0000 7fef0e895640 1 -- 172.21.15.92:0/4271425005 wait complete. 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0e895640 1 Processor -- start 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0e895640 1 -- start start 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0e895640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef08101df0 0x7fef0819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0e895640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef081027a0 0x7fef0819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0e895640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef08106f20 0x7fef0819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0e895640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fef08111f80 con 0x7fef08106f20 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0e895640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fef08111e00 con 0x7fef081027a0 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0e895640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fef08112100 con 0x7fef08101df0 2024-09-10T10:35:21.547 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0ce32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef08106f20 0x7fef0819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0ce32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef08106f20 0x7fef0819ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52032/0 (socket says 172.21.15.92:52032) 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef0ce32640 1 -- 172.21.15.92:0/3915480898 learned_addr learned my addr 172.21.15.92:0/3915480898 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.533+0000 7fef077fe640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef081027a0 0x7fef0819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef0ce32640 1 -- 172.21.15.92:0/3915480898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef08101df0 msgr2=0x7fef0819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef07fff640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef08101df0 0x7fef0819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef0ce32640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef08101df0 0x7fef0819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef0ce32640 1 -- 172.21.15.92:0/3915480898 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef081027a0 msgr2=0x7fef0819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef0ce32640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fef081027a0 0x7fef0819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef0ce32640 1 -- 172.21.15.92:0/3915480898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0819f5f0 con 0x7fef08106f20 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef0ce32640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef08106f20 0x7fef0819ef10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef00031a20 tx=0x7fef00031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef057fa640 1 -- 172.21.15.92:0/3915480898 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef00003c30 con 0x7fef08106f20 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef057fa640 1 -- 172.21.15.92:0/3915480898 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef00003dd0 con 0x7fef08106f20 2024-09-10T10:35:21.548 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0819f880 con 0x7fef08106f20 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef057fa640 1 -- 172.21.15.92:0/3915480898 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0002fc40 con 0x7fef08106f20 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.534+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef081a71c0 con 0x7fef08106f20 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.535+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef08075700 con 0x7fef08106f20 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.536+0000 7fef057fa640 1 -- 172.21.15.92:0/3915480898 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fef00004050 con 0x7fef08106f20 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.537+0000 7fef057fa640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7feef00a2c10 0x7feef00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.537+0000 7fef07fff640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7feef00a2c10 0x7feef00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.537+0000 7fef057fa640 1 -- 172.21.15.92:0/3915480898 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fef000f04a0 con 0x7fef08106f20 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.537+0000 7fef057fa640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] conn(0x7feef00ac590 0x7feef00aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.537+0000 7fef057fa640 1 -- 172.21.15.92:0/3915480898 --> [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feef00af100 con 0x7feef00ac590 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.537+0000 7fef057fa640 1 -- 172.21.15.92:0/3915480898 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fef000f0980 con 0x7fef08106f20 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.537+0000 7fef07fff640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7feef00a2c10 0x7feef00a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feef8005fd0 tx=0x7feef8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:21.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.538+0000 7fef077fe640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] conn(0x7feef00ac590 0x7feef00aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.538+0000 7fef077fe640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] conn(0x7feef00ac590 0x7feef00aea30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:21.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.539+0000 7fef057fa640 1 -- 172.21.15.92:0/3915480898 <== osd.4 v2:172.21.15.97:6808/1960503640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feef00af100 con 0x7feef00ac590 2024-09-10T10:35:21.551 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:21.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.552+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 --> [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef081032d0 con 0x7feef00ac590 2024-09-10T10:35:21.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef057fa640 1 -- 172.21.15.92:0/3915480898 <== osd.4 v2:172.21.15.97:6808/1960503640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fef081032d0 con 0x7feef00ac590 2024-09-10T10:35:21.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 >> [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] conn(0x7feef00ac590 msgr2=0x7feef00aea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef0e895640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] conn(0x7feef00ac590 0x7feef00aea30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7feef00a2c10 msgr2=0x7feef00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef0e895640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7feef00a2c10 0x7feef00a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feef8005fd0 tx=0x7feef8005850 comp rx=0 tx=0).stop 2024-09-10T10:35:21.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef08106f20 msgr2=0x7fef0819ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef0e895640 1 --2- 172.21.15.92:0/3915480898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef08106f20 0x7fef0819ef10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef00031a20 tx=0x7fef00031a50 comp rx=0 tx=0).stop 2024-09-10T10:35:21.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef0ce32640 1 -- 172.21.15.92:0/3915480898 reap_dead start 2024-09-10T10:35:21.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 shutdown_connections 2024-09-10T10:35:21.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.553+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 >> 172.21.15.92:0/3915480898 conn(0x7fef080fd8f0 msgr2=0x7fef080fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:21.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.554+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 shutdown_connections 2024-09-10T10:35:21.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.554+0000 7fef0e895640 1 -- 172.21.15.92:0/3915480898 wait complete. 2024-09-10T10:35:21.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:21 smithi097 ceph-mon[35213]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-10T10:35:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.196+0000 7f0d81767640 1 -- 172.21.15.92:0/736861605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7c102d40 msgr2=0x7f0d7c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.196+0000 7f0d81767640 1 --2- 172.21.15.92:0/736861605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7c102d40 0x7f0d7c103120 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009900 tx=0x7f0d6c02a480 comp rx=0 tx=0).stop 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.196+0000 7f0d81767640 1 -- 172.21.15.92:0/736861605 shutdown_connections 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.196+0000 7f0d81767640 1 --2- 172.21.15.92:0/736861605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c10c170 0x7f0d7c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.196+0000 7f0d81767640 1 --2- 172.21.15.92:0/736861605 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d7c103660 0x7f0d7c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.196+0000 7f0d81767640 1 --2- 172.21.15.92:0/736861605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7c102d40 0x7f0d7c103120 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.196+0000 7f0d81767640 1 -- 172.21.15.92:0/736861605 >> 172.21.15.92:0/736861605 conn(0x7f0d7c0fc7a0 msgr2=0x7f0d7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.196+0000 7f0d81767640 1 -- 172.21.15.92:0/736861605 shutdown_connections 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.196+0000 7f0d81767640 1 -- 172.21.15.92:0/736861605 wait complete. 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d81767640 1 Processor -- start 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d81767640 1 -- start start 2024-09-10T10:35:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d81767640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d7c102d40 0x7f0d7c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d81767640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c103660 0x7f0d7c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d81767640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7c10c170 0x7f0d7c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d81767640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c111fb0 con 0x7f0d7c10c170 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d81767640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c111e30 con 0x7f0d7c102d40 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d81767640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c112130 con 0x7f0d7c103660 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d7b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7c10c170 0x7f0d7c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d7b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7c10c170 0x7f0d7c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51988/0 (socket says 172.21.15.92:51988) 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d7b7fe640 1 -- 172.21.15.92:0/4038772064 learned_addr learned my addr 172.21.15.92:0/4038772064 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.197+0000 7f0d7affd640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d7c102d40 0x7f0d7c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d7a7fc640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c103660 0x7f0d7c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d7b7fe640 1 -- 172.21.15.92:0/4038772064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c103660 msgr2=0x7f0d7c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d7b7fe640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c103660 0x7f0d7c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d7b7fe640 1 -- 172.21.15.92:0/4038772064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d7c102d40 msgr2=0x7f0d7c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d7b7fe640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0d7c102d40 0x7f0d7c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d7b7fe640 1 -- 172.21.15.92:0/4038772064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c1a69d0 con 0x7f0d7c10c170 2024-09-10T10:35:21.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d7a7fc640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d7c103660 0x7f0d7c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:21.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d7b7fe640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7c10c170 0x7f0d7c101420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400b970 tx=0x7f0d7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:21.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d63fff640 1 -- 172.21.15.92:0/4038772064 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74019070 con 0x7f0d7c10c170 2024-09-10T10:35:21.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d63fff640 1 -- 172.21.15.92:0/4038772064 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d7400cb40 con 0x7f0d7c10c170 2024-09-10T10:35:21.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c1a6cc0 con 0x7f0d7c10c170 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d63fff640 1 -- 172.21.15.92:0/4038772064 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74007650 con 0x7f0d7c10c170 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.198+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c1a7200 con 0x7f0d7c10c170 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.199+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d7c0628c0 con 0x7f0d7c10c170 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.200+0000 7f0d63fff640 1 -- 172.21.15.92:0/4038772064 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0d7401c070 con 0x7f0d7c10c170 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.201+0000 7f0d63fff640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0d640a2c10 0x7f0d640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.201+0000 7f0d7affd640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0d640a2c10 0x7f0d640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.201+0000 7f0d63fff640 1 -- 172.21.15.92:0/4038772064 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f0d740ced50 con 0x7f0d7c10c170 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.201+0000 7f0d63fff640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] conn(0x7f0d640ac6c0 0x7f0d640aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.201+0000 7f0d63fff640 1 -- 172.21.15.92:0/4038772064 --> [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d740047d0 con 0x7f0d640ac6c0 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.201+0000 7f0d63fff640 1 -- 172.21.15.92:0/4038772064 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f0d740cf230 con 0x7f0d7c10c170 2024-09-10T10:35:21.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.201+0000 7f0d7affd640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0d640a2c10 0x7f0d640a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009230 tx=0x7f0d6c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.201+0000 7f0d7a7fc640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] conn(0x7f0d640ac6c0 0x7f0d640aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.202+0000 7f0d7a7fc640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] conn(0x7f0d640ac6c0 0x7f0d640aeb60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.203+0000 7f0d63fff640 1 -- 172.21.15.92:0/4038772064 <== osd.2 v2:172.21.15.121:6800/1231693534 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d740047d0 con 0x7f0d640ac6c0 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.217+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 --> [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d7c062cc0 con 0x7f0d640ac6c0 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.217+0000 7f0d63fff640 1 -- 172.21.15.92:0/4038772064 <== osd.2 v2:172.21.15.121:6800/1231693534 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0d7c062cc0 con 0x7f0d640ac6c0 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 >> [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] conn(0x7f0d640ac6c0 msgr2=0x7f0d640aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] conn(0x7f0d640ac6c0 0x7f0d640aeb60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0d640a2c10 msgr2=0x7f0d640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0d640a2c10 0x7f0d640a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009230 tx=0x7f0d6c0058d0 comp rx=0 tx=0).stop 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7c10c170 msgr2=0x7f0d7c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 --2- 172.21.15.92:0/4038772064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d7c10c170 0x7f0d7c101420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400b970 tx=0x7f0d7400be30 comp rx=0 tx=0).stop 2024-09-10T10:35:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d7b7fe640 1 -- 172.21.15.92:0/4038772064 reap_dead start 2024-09-10T10:35:21.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 shutdown_connections 2024-09-10T10:35:21.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 >> 172.21.15.92:0/4038772064 conn(0x7f0d7c0fc7a0 msgr2=0x7f0d7c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:21.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 shutdown_connections 2024-09-10T10:35:21.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.218+0000 7f0d81767640 1 -- 172.21.15.92:0/4038772064 wait complete. 2024-09-10T10:35:22.536 INFO:teuthology.orchestra.run.smithi092.stdout:77309411393 2024-09-10T10:35:22.536 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T10:35:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.290+0000 7f3181cb9640 1 -- 172.21.15.92:0/43044282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f317c108300 msgr2=0x7f317c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.290+0000 7f3181cb9640 1 --2- 172.21.15.92:0/43044282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f317c108300 0x7f317c10ec70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3174009cd0 tx=0x7f317402a8d0 comp rx=0 tx=0).stop 2024-09-10T10:35:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.290+0000 7f3181cb9640 1 -- 172.21.15.92:0/43044282 shutdown_connections 2024-09-10T10:35:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.290+0000 7f3181cb9640 1 --2- 172.21.15.92:0/43044282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f317c108300 0x7f317c10ec70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.290+0000 7f3181cb9640 1 --2- 172.21.15.92:0/43044282 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f317c103780 0x7f317c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.290+0000 7f3181cb9640 1 --2- 172.21.15.92:0/43044282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f317c102dd0 0x7f317c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.291+0000 7f3181cb9640 1 -- 172.21.15.92:0/43044282 >> 172.21.15.92:0/43044282 conn(0x7f317c0fc7d0 msgr2=0x7f317c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.291+0000 7f3181cb9640 1 -- 172.21.15.92:0/43044282 shutdown_connections 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.291+0000 7f3181cb9640 1 -- 172.21.15.92:0/43044282 wait complete. 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.291+0000 7f3181cb9640 1 Processor -- start 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.291+0000 7f3181cb9640 1 -- start start 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3181cb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f317c102dd0 0x7f317c100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3181cb9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f317c103780 0x7f317c100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3181cb9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f317c108300 0x7f317c1014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3181cb9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f317c1120d0 con 0x7f317c108300 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3181cb9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f317c111f50 con 0x7f317c102dd0 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3181cb9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f317c112250 con 0x7f317c103780 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f317c108300 0x7f317c1014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f317c108300 0x7f317c1014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52010/0 (socket says 172.21.15.92:52010) 2024-09-10T10:35:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317bfff640 1 -- 172.21.15.92:0/604637508 learned_addr learned my addr 172.21.15.92:0/604637508 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317b7fe640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f317c102dd0 0x7f317c100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317bfff640 1 -- 172.21.15.92:0/604637508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f317c103780 msgr2=0x7f317c100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317affd640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f317c103780 0x7f317c100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317bfff640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f317c103780 0x7f317c100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317bfff640 1 -- 172.21.15.92:0/604637508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f317c102dd0 msgr2=0x7f317c100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317bfff640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f317c102dd0 0x7f317c100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317bfff640 1 -- 172.21.15.92:0/604637508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317c1a6a00 con 0x7f317c108300 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317b7fe640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f317c102dd0 0x7f317c100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f317bfff640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f317c108300 0x7f317c1014b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3174009ca0 tx=0x7f317402f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3178ff9640 1 -- 172.21.15.92:0/604637508 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174031860 con 0x7f317c108300 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3178ff9640 1 -- 172.21.15.92:0/604637508 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3174003e50 con 0x7f317c108300 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317c1a6c90 con 0x7f317c108300 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3178ff9640 1 -- 172.21.15.92:0/604637508 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31740307f0 con 0x7f317c108300 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.292+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f317c1a71d0 con 0x7f317c108300 2024-09-10T10:35:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.293+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f317c0628c0 con 0x7f317c108300 2024-09-10T10:35:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.294+0000 7f3178ff9640 1 -- 172.21.15.92:0/604637508 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f31740041d0 con 0x7f317c108300 2024-09-10T10:35:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.295+0000 7f3178ff9640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31640a2c10 0x7f31640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.295+0000 7f317b7fe640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31640a2c10 0x7f31640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.295+0000 7f3178ff9640 1 -- 172.21.15.92:0/604637508 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f31740f0360 con 0x7f317c108300 2024-09-10T10:35:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.295+0000 7f3178ff9640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] conn(0x7f31640ac590 0x7f31640aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.295+0000 7f3178ff9640 1 -- 172.21.15.92:0/604637508 --> [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3174003ca0 con 0x7f31640ac590 2024-09-10T10:35:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.295+0000 7f3178ff9640 1 -- 172.21.15.92:0/604637508 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f31740f0840 con 0x7f317c108300 2024-09-10T10:35:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.295+0000 7f317b7fe640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31640a2c10 0x7f31640a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f316c005fd0 tx=0x7f316c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:22.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.296+0000 7f317affd640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] conn(0x7f31640ac590 0x7f31640aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:22.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.296+0000 7f317affd640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] conn(0x7f31640ac590 0x7f31640aea30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:22.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.297+0000 7f3178ff9640 1 -- 172.21.15.92:0/604637508 <== osd.5 v2:172.21.15.121:6808/2173743717 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3174003ca0 con 0x7f31640ac590 2024-09-10T10:35:22.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.310+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 --> [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f317c062cc0 con 0x7f31640ac590 2024-09-10T10:35:22.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3178ff9640 1 -- 172.21.15.92:0/604637508 <== osd.5 v2:172.21.15.121:6808/2173743717 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f317c062cc0 con 0x7f31640ac590 2024-09-10T10:35:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 >> [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] conn(0x7f31640ac590 msgr2=0x7f31640aea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] conn(0x7f31640ac590 0x7f31640aea30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31640a2c10 msgr2=0x7f31640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f31640a2c10 0x7f31640a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f316c005fd0 tx=0x7f316c00b5f0 comp rx=0 tx=0).stop 2024-09-10T10:35:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f317c108300 msgr2=0x7f317c1014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 --2- 172.21.15.92:0/604637508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f317c108300 0x7f317c1014b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3174009ca0 tx=0x7f317402f420 comp rx=0 tx=0).stop 2024-09-10T10:35:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f317bfff640 1 -- 172.21.15.92:0/604637508 reap_dead start 2024-09-10T10:35:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 shutdown_connections 2024-09-10T10:35:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 >> 172.21.15.92:0/604637508 conn(0x7f317c0fc7d0 msgr2=0x7f317c105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 shutdown_connections 2024-09-10T10:35:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:21.311+0000 7f3181cb9640 1 -- 172.21.15.92:0/604637508 wait complete. 2024-09-10T10:35:23.380 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:23 smithi092 ceph-mon[30834]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-10T10:35:23.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:23 smithi121 ceph-mon[35231]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-10T10:35:23.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:23 smithi097 ceph-mon[35213]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-10T10:35:24.246 INFO:teuthology.orchestra.run.smithi092.stdout:133143986233 2024-09-10T10:35:24.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T10:35:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.457+0000 7f46b0f3f640 1 -- 172.21.15.92:0/4155161883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ac101de0 msgr2=0x7f46ac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.457+0000 7f46b0f3f640 1 --2- 172.21.15.92:0/4155161883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ac101de0 0x7f46ac1021c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f469c009900 tx=0x7f469c02a410 comp rx=0 tx=0).stop 2024-09-10T10:35:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.457+0000 7f46b0f3f640 1 -- 172.21.15.92:0/4155161883 shutdown_connections 2024-09-10T10:35:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.457+0000 7f46b0f3f640 1 --2- 172.21.15.92:0/4155161883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ac106f10 0x7f46ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:24.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.457+0000 7f46b0f3f640 1 --2- 172.21.15.92:0/4155161883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46ac102790 0x7f46ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.457+0000 7f46b0f3f640 1 --2- 172.21.15.92:0/4155161883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ac101de0 0x7f46ac1021c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.457+0000 7f46b0f3f640 1 -- 172.21.15.92:0/4155161883 >> 172.21.15.92:0/4155161883 conn(0x7f46ac0fd8c0 msgr2=0x7f46ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.457+0000 7f46b0f3f640 1 -- 172.21.15.92:0/4155161883 shutdown_connections 2024-09-10T10:35:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.457+0000 7f46b0f3f640 1 -- 172.21.15.92:0/4155161883 wait complete. 2024-09-10T10:35:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.458+0000 7f46b0f3f640 1 Processor -- start 2024-09-10T10:35:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.458+0000 7f46b0f3f640 1 -- start start 2024-09-10T10:35:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46b0f3f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ac101de0 0x7f46ac198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:24.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46b0f3f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46ac102790 0x7f46ac198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46b0f3f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ac106f10 0x7f46ac19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46b0f3f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac111f90 con 0x7f46ac101de0 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46b0f3f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac111e10 con 0x7f46ac106f10 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46b0f3f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac112110 con 0x7f46ac102790 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aa59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ac101de0 0x7f46ac198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aa59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ac101de0 0x7f46ac198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33820/0 (socket says 172.21.15.92:33820) 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aa59c640 1 -- 172.21.15.92:0/2239086987 learned_addr learned my addr 172.21.15.92:0/2239086987 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aad9d640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ac106f10 0x7f46ac19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46a9d9b640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46ac102790 0x7f46ac198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aa59c640 1 -- 172.21.15.92:0/2239086987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46ac102790 msgr2=0x7f46ac198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:24.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aa59c640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46ac102790 0x7f46ac198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aa59c640 1 -- 172.21.15.92:0/2239086987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ac106f10 msgr2=0x7f46ac19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aa59c640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f46ac106f10 0x7f46ac19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aa59c640 1 -- 172.21.15.92:0/2239086987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac19d400 con 0x7f46ac101de0 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46aa59c640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ac101de0 0x7f46ac198450 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f469c005ab0 tx=0x7f469c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f469b7fe640 1 -- 172.21.15.92:0/2239086987 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c03f030 con 0x7f46ac101de0 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ac19d690 con 0x7f46ac101de0 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f469b7fe640 1 -- 172.21.15.92:0/2239086987 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f469c003ce0 con 0x7f46ac101de0 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f469b7fe640 1 -- 172.21.15.92:0/2239086987 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c035070 con 0x7f46ac101de0 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.459+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ac1a4fd0 con 0x7f46ac101de0 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.460+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46ac062980 con 0x7f46ac101de0 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.461+0000 7f469b7fe640 1 -- 172.21.15.92:0/2239086987 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f469c042030 con 0x7f46ac101de0 2024-09-10T10:35:24.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.462+0000 7f469b7fe640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f46940a2c10 0x7f46940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.462+0000 7f46a9d9b640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f46940a2c10 0x7f46940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.462+0000 7f469b7fe640 1 -- 172.21.15.92:0/2239086987 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f469c0efdb0 con 0x7f46ac101de0 2024-09-10T10:35:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.462+0000 7f469b7fe640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] conn(0x7f46940ac6c0 0x7f46940aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.462+0000 7f469b7fe640 1 -- 172.21.15.92:0/2239086987 --> [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f469c001d30 con 0x7f46940ac6c0 2024-09-10T10:35:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.462+0000 7f469b7fe640 1 -- 172.21.15.92:0/2239086987 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f469c0f0160 con 0x7f46ac101de0 2024-09-10T10:35:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.463+0000 7f46a9d9b640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f46940a2c10 0x7f46940a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0fdce0 tx=0x7f46a0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.463+0000 7f46aad9d640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] conn(0x7f46940ac6c0 0x7f46940aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.463+0000 7f46aad9d640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] conn(0x7f46940ac6c0 0x7f46940aeb60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:24.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.463+0000 7f469b7fe640 1 -- 172.21.15.92:0/2239086987 <== osd.0 v2:172.21.15.92:6802/2143150260 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f469c001d30 con 0x7f46940ac6c0 2024-09-10T10:35:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.477+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 --> [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46ac062d80 con 0x7f46940ac6c0 2024-09-10T10:35:24.481 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.477+0000 7f469b7fe640 1 -- 172.21.15.92:0/2239086987 <== osd.0 v2:172.21.15.92:6802/2143150260 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f46ac062d80 con 0x7f46940ac6c0 2024-09-10T10:35:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] conn(0x7f46940ac6c0 msgr2=0x7f46940aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] conn(0x7f46940ac6c0 0x7f46940aeb60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f46940a2c10 msgr2=0x7f46940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f46940a2c10 0x7f46940a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0fdce0 tx=0x7f46a0008040 comp rx=0 tx=0).stop 2024-09-10T10:35:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ac101de0 msgr2=0x7f46ac198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 --2- 172.21.15.92:0/2239086987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46ac101de0 0x7f46ac198450 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f469c005ab0 tx=0x7f469c0042f0 comp rx=0 tx=0).stop 2024-09-10T10:35:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46aad9d640 1 -- 172.21.15.92:0/2239086987 reap_dead start 2024-09-10T10:35:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 shutdown_connections 2024-09-10T10:35:24.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 >> 172.21.15.92:0/2239086987 conn(0x7f46ac0fd8c0 msgr2=0x7f46ac0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 shutdown_connections 2024-09-10T10:35:24.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:24.478+0000 7f46b0f3f640 1 -- 172.21.15.92:0/2239086987 wait complete. 2024-09-10T10:35:25.134 INFO:teuthology.orchestra.run.smithi092.stdout:34359738444 2024-09-10T10:35:25.135 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T10:35:25.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:25 smithi092 ceph-mon[30834]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-10T10:35:25.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:25 smithi121 ceph-mon[35231]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-10T10:35:25.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:25 smithi097 ceph-mon[35213]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-10T10:35:25.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 -- 172.21.15.92:0/2853108109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f18106f20 msgr2=0x7f2f1810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:25.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 --2- 172.21.15.92:0/2853108109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f18106f20 0x7f2f1810eaa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009ca0 tx=0x7f2f1002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:35:25.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 -- 172.21.15.92:0/2853108109 shutdown_connections 2024-09-10T10:35:25.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 --2- 172.21.15.92:0/2853108109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f18106f20 0x7f2f1810eaa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:25.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 --2- 172.21.15.92:0/2853108109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f181027a0 0x7f2f181067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:25.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 --2- 172.21.15.92:0/2853108109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f18101df0 0x7f2f181021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:25.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 -- 172.21.15.92:0/2853108109 >> 172.21.15.92:0/2853108109 conn(0x7f2f180fd8b0 msgr2=0x7f2f180ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 -- 172.21.15.92:0/2853108109 shutdown_connections 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 -- 172.21.15.92:0/2853108109 wait complete. 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 Processor -- start 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.566+0000 7f2f1d326640 1 -- start start 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f1d326640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f18101df0 0x7f2f18198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f1d326640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f181027a0 0x7f2f18198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f1d326640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f18106f20 0x7f2f1819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f1d326640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2f18112020 con 0x7f2f18101df0 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f1d326640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2f18111ea0 con 0x7f2f181027a0 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f1d326640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2f181121a0 con 0x7f2f18106f20 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f16ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f18101df0 0x7f2f18198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f16ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f18101df0 0x7f2f18198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33844/0 (socket says 172.21.15.92:33844) 2024-09-10T10:35:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f16ffd640 1 -- 172.21.15.92:0/2962952918 learned_addr learned my addr 172.21.15.92:0/2962952918 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f0ffff640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f181027a0 0x7f2f18198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f16ffd640 1 -- 172.21.15.92:0/2962952918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f18106f20 msgr2=0x7f2f1819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f16ffd640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2f18106f20 0x7f2f1819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f16ffd640 1 -- 172.21.15.92:0/2962952918 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f181027a0 msgr2=0x7f2f18198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f16ffd640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2f181027a0 0x7f2f18198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f16ffd640 1 -- 172.21.15.92:0/2962952918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1819d4d0 con 0x7f2f18101df0 2024-09-10T10:35:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f16ffd640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f18101df0 0x7f2f18198520 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800b4a0 tx=0x7f2f0800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f14ff9640 1 -- 172.21.15.92:0/2962952918 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08014070 con 0x7f2f18101df0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1819d7c0 con 0x7f2f18101df0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f14ff9640 1 -- 172.21.15.92:0/2962952918 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f08010af0 con 0x7f2f18101df0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f14ff9640 1 -- 172.21.15.92:0/2962952918 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08017d10 con 0x7f2f18101df0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.567+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f181a50a0 con 0x7f2f18101df0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.568+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f18062980 con 0x7f2f18101df0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.569+0000 7f2f14ff9640 1 -- 172.21.15.92:0/2962952918 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2f08017070 con 0x7f2f18101df0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.570+0000 7f2f14ff9640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2f040a2c10 0x7f2f040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.570+0000 7f2f0ffff640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2f040a2c10 0x7f2f040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.570+0000 7f2f14ff9640 1 -- 172.21.15.92:0/2962952918 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f2f080ce7e0 con 0x7f2f18101df0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.570+0000 7f2f14ff9640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] conn(0x7f2f040ac6c0 0x7f2f040aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.570+0000 7f2f14ff9640 1 -- 172.21.15.92:0/2962952918 --> [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f0801ae50 con 0x7f2f040ac6c0 2024-09-10T10:35:25.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.570+0000 7f2f14ff9640 1 -- 172.21.15.92:0/2962952918 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f2f080cecc0 con 0x7f2f18101df0 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.571+0000 7f2f177fe640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] conn(0x7f2f040ac6c0 0x7f2f040aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.571+0000 7f2f0ffff640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2f040a2c10 0x7f2f040a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f180fddd0 tx=0x7f2f00008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.571+0000 7f2f177fe640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] conn(0x7f2f040ac6c0 0x7f2f040aeb60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.572+0000 7f2f14ff9640 1 -- 172.21.15.92:0/2962952918 <== osd.1 v2:172.21.15.97:6800/3508346445 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f0801ae50 con 0x7f2f040ac6c0 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.585+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 --> [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f18062d80 con 0x7f2f040ac6c0 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f14ff9640 1 -- 172.21.15.92:0/2962952918 <== osd.1 v2:172.21.15.97:6800/3508346445 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2f18062d80 con 0x7f2f040ac6c0 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 >> [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] conn(0x7f2f040ac6c0 msgr2=0x7f2f040aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] conn(0x7f2f040ac6c0 0x7f2f040aeb60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2f040a2c10 msgr2=0x7f2f040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2f040a2c10 0x7f2f040a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2f180fddd0 tx=0x7f2f00008040 comp rx=0 tx=0).stop 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f18101df0 msgr2=0x7f2f18198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 --2- 172.21.15.92:0/2962952918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f18101df0 0x7f2f18198520 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800b4a0 tx=0x7f2f0800b960 comp rx=0 tx=0).stop 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f177fe640 1 -- 172.21.15.92:0/2962952918 reap_dead start 2024-09-10T10:35:25.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 shutdown_connections 2024-09-10T10:35:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 >> 172.21.15.92:0/2962952918 conn(0x7f2f180fd8b0 msgr2=0x7f2f180fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 shutdown_connections 2024-09-10T10:35:25.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:25.586+0000 7f2f1d326640 1 -- 172.21.15.92:0/2962952918 wait complete. 2024-09-10T10:35:26.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.026+0000 7fe91cfe0640 1 -- 172.21.15.92:0/3059613956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9181036e0 msgr2=0x7fe918107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.026+0000 7fe91cfe0640 1 --2- 172.21.15.92:0/3059613956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9181036e0 0x7fe918107b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe900009930 tx=0x7fe90002a420 comp rx=0 tx=0).stop 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.026+0000 7fe91cfe0640 1 -- 172.21.15.92:0/3059613956 shutdown_connections 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.026+0000 7fe91cfe0640 1 --2- 172.21.15.92:0/3059613956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9181082a0 0x7fe91810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.026+0000 7fe91cfe0640 1 --2- 172.21.15.92:0/3059613956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9181036e0 0x7fe918107b90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.026+0000 7fe91cfe0640 1 --2- 172.21.15.92:0/3059613956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe918102d30 0x7fe918103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.026+0000 7fe91cfe0640 1 -- 172.21.15.92:0/3059613956 >> 172.21.15.92:0/3059613956 conn(0x7fe9180fc7d0 msgr2=0x7fe9180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.026+0000 7fe91cfe0640 1 -- 172.21.15.92:0/3059613956 shutdown_connections 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.026+0000 7fe91cfe0640 1 -- 172.21.15.92:0/3059613956 wait complete. 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe91cfe0640 1 Processor -- start 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe91cfe0640 1 -- start start 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe91cfe0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe918102d30 0x7fe918100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:26.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe91cfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9181036e0 0x7fe918100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe91cfe0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9181082a0 0x7fe918101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe91cfe0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe9181120a0 con 0x7fe9181036e0 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe91cfe0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe918111f20 con 0x7fe9181082a0 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe91cfe0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe918112220 con 0x7fe918102d30 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe90dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9181036e0 0x7fe918100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe90dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9181036e0 0x7fe918100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33870/0 (socket says 172.21.15.92:33870) 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe90dd9b640 1 -- 172.21.15.92:0/1057917925 learned_addr learned my addr 172.21.15.92:0/1057917925 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe916d9d640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9181082a0 0x7fe918101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.027+0000 7fe91659c640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe918102d30 0x7fe918100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe90dd9b640 1 -- 172.21.15.92:0/1057917925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe918102d30 msgr2=0x7fe918100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe90dd9b640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe918102d30 0x7fe918100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:26.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe90dd9b640 1 -- 172.21.15.92:0/1057917925 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9181082a0 msgr2=0x7fe918101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:26.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe90dd9b640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe9181082a0 0x7fe918101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:26.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe90dd9b640 1 -- 172.21.15.92:0/1057917925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9181a6aa0 con 0x7fe9181036e0 2024-09-10T10:35:26.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe90dd9b640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9181036e0 0x7fe918100ed0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe900005940 tx=0x7fe9000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:26.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe90ffff640 1 -- 172.21.15.92:0/1057917925 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90003f030 con 0x7fe9181036e0 2024-09-10T10:35:26.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9181a6d30 con 0x7fe9181036e0 2024-09-10T10:35:26.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe90ffff640 1 -- 172.21.15.92:0/1057917925 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe900003ce0 con 0x7fe9181036e0 2024-09-10T10:35:26.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe90ffff640 1 -- 172.21.15.92:0/1057917925 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900035070 con 0x7fe9181036e0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.028+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9181a71c0 con 0x7fe9181036e0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.029+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe918062900 con 0x7fe9181036e0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.030+0000 7fe90ffff640 1 -- 172.21.15.92:0/1057917925 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe900042030 con 0x7fe9181036e0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.031+0000 7fe90ffff640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fe9040a2c10 0x7fe9040a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.031+0000 7fe91659c640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fe9040a2c10 0x7fe9040a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.031+0000 7fe90ffff640 1 -- 172.21.15.92:0/1057917925 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fe9000efb20 con 0x7fe9181036e0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.031+0000 7fe90ffff640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] conn(0x7fe9040ac6c0 0x7fe9040aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.031+0000 7fe90ffff640 1 -- 172.21.15.92:0/1057917925 --> [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9040af230 con 0x7fe9040ac6c0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.031+0000 7fe90ffff640 1 -- 172.21.15.92:0/1057917925 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe9000f0000 con 0x7fe9181036e0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.031+0000 7fe916d9d640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] conn(0x7fe9040ac6c0 0x7fe9040aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.031+0000 7fe91659c640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fe9040a2c10 0x7fe9040a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe90800bbe0 tx=0x7fe90800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.031+0000 7fe916d9d640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] conn(0x7fe9040ac6c0 0x7fe9040aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:26.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.032+0000 7fe90ffff640 1 -- 172.21.15.92:0/1057917925 <== osd.3 v2:172.21.15.92:6810/3638563027 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe9040af230 con 0x7fe9040ac6c0 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.045+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 --> [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe918062d00 con 0x7fe9040ac6c0 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe90ffff640 1 -- 172.21.15.92:0/1057917925 <== osd.3 v2:172.21.15.92:6810/3638563027 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe918062d00 con 0x7fe9040ac6c0 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] conn(0x7fe9040ac6c0 msgr2=0x7fe9040aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] conn(0x7fe9040ac6c0 0x7fe9040aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fe9040a2c10 msgr2=0x7fe9040a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fe9040a2c10 0x7fe9040a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe90800bbe0 tx=0x7fe90800b390 comp rx=0 tx=0).stop 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9181036e0 msgr2=0x7fe918100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 --2- 172.21.15.92:0/1057917925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9181036e0 0x7fe918100ed0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe900005940 tx=0x7fe9000042f0 comp rx=0 tx=0).stop 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe916d9d640 1 -- 172.21.15.92:0/1057917925 reap_dead start 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 shutdown_connections 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 >> 172.21.15.92:0/1057917925 conn(0x7fe9180fc7d0 msgr2=0x7fe918105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 shutdown_connections 2024-09-10T10:35:26.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:26.046+0000 7fe91cfe0640 1 -- 172.21.15.92:0/1057917925 wait complete. 2024-09-10T10:35:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.195+0000 7f779c209640 1 -- 172.21.15.92:0/458862521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7794101420 msgr2=0x7f779410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.195+0000 7f779c209640 1 --2- 172.21.15.92:0/458862521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7794101420 0x7f779410d950 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f778c009cd0 tx=0x7f778c02a8e0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.195+0000 7f779c209640 1 -- 172.21.15.92:0/458862521 shutdown_connections 2024-09-10T10:35:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.195+0000 7f779c209640 1 --2- 172.21.15.92:0/458862521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7794101420 0x7f779410d950 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.195+0000 7f779c209640 1 --2- 172.21.15.92:0/458862521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7794100a80 0x7f7794100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.195+0000 7f779c209640 1 --2- 172.21.15.92:0/458862521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7794106a80 0x7f7794106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.195+0000 7f779c209640 1 -- 172.21.15.92:0/458862521 >> 172.21.15.92:0/458862521 conn(0x7f77940fc7a0 msgr2=0x7f77940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.195+0000 7f779c209640 1 -- 172.21.15.92:0/458862521 shutdown_connections 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.195+0000 7f779c209640 1 -- 172.21.15.92:0/458862521 wait complete. 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779c209640 1 Processor -- start 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779c209640 1 -- start start 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779c209640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7794100a80 0x7f7794197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779c209640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7794101420 0x7f77941978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779c209640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7794106a80 0x7f779419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779c209640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7794110ea0 con 0x7f7794106a80 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779c209640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7794110d20 con 0x7f7794100a80 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779c209640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7794111020 con 0x7f7794101420 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779a7a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7794106a80 0x7f779419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779a7a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7794106a80 0x7f779419bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33900/0 (socket says 172.21.15.92:33900) 2024-09-10T10:35:27.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779a7a6640 1 -- 172.21.15.92:0/2578185147 learned_addr learned my addr 172.21.15.92:0/2578185147 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f7799fa5640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7794100a80 0x7f7794197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779a7a6640 1 -- 172.21.15.92:0/2578185147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7794101420 msgr2=0x7f77941978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f77997a4640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7794101420 0x7f77941978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779a7a6640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7794101420 0x7f77941978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779a7a6640 1 -- 172.21.15.92:0/2578185147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7794100a80 msgr2=0x7f7794197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779a7a6640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7794100a80 0x7f7794197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f779a7a6640 1 -- 172.21.15.92:0/2578185147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779419c330 con 0x7f7794106a80 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f7799fa5640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7794100a80 0x7f7794197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.196+0000 7f77997a4640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7794101420 0x7f77941978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.197+0000 7f779a7a6640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7794106a80 0x7f779419bc50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f778c006010 tx=0x7f778c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.197+0000 7f778affd640 1 -- 172.21.15.92:0/2578185147 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c004450 con 0x7f7794106a80 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.197+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779419c5c0 con 0x7f7794106a80 2024-09-10T10:35:27.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.197+0000 7f778affd640 1 -- 172.21.15.92:0/2578185147 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f778c003e10 con 0x7f7794106a80 2024-09-10T10:35:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.197+0000 7f778affd640 1 -- 172.21.15.92:0/2578185147 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c0466e0 con 0x7f7794106a80 2024-09-10T10:35:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.197+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77941a3f00 con 0x7f7794106a80 2024-09-10T10:35:27.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.198+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77940fd940 con 0x7f7794106a80 2024-09-10T10:35:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.199+0000 7f778affd640 1 -- 172.21.15.92:0/2578185147 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f778c0305a0 con 0x7f7794106a80 2024-09-10T10:35:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.200+0000 7f778affd640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77800a2c10 0x7f77800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.200+0000 7f7799fa5640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77800a2c10 0x7f77800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.200+0000 7f778affd640 1 -- 172.21.15.92:0/2578185147 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f778c02e030 con 0x7f7794106a80 2024-09-10T10:35:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.200+0000 7f778affd640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] conn(0x7f77800ac6c0 0x7f77800aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.200+0000 7f778affd640 1 -- 172.21.15.92:0/2578185147 --> [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f778c0020b0 con 0x7f77800ac6c0 2024-09-10T10:35:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.200+0000 7f778affd640 1 -- 172.21.15.92:0/2578185147 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f778c0f10a0 con 0x7f7794106a80 2024-09-10T10:35:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.200+0000 7f7799fa5640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77800a2c10 0x7f77800a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f77900058c0 tx=0x7f7790005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:27.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.200+0000 7f77997a4640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] conn(0x7f77800ac6c0 0x7f77800aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.201+0000 7f77997a4640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] conn(0x7f77800ac6c0 0x7f77800aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:27.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.201+0000 7f778affd640 1 -- 172.21.15.92:0/2578185147 <== osd.7 v2:172.21.15.97:6816/2587554904 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f778c0020b0 con 0x7f77800ac6c0 2024-09-10T10:35:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.215+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 --> [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77941021c0 con 0x7f77800ac6c0 2024-09-10T10:35:27.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f778affd640 1 -- 172.21.15.92:0/2578185147 <== osd.7 v2:172.21.15.97:6816/2587554904 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f77941021c0 con 0x7f77800ac6c0 2024-09-10T10:35:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 >> [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] conn(0x7f77800ac6c0 msgr2=0x7f77800aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] conn(0x7f77800ac6c0 0x7f77800aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77800a2c10 msgr2=0x7f77800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77800a2c10 0x7f77800a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f77900058c0 tx=0x7f7790005ec0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7794106a80 msgr2=0x7f779419bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 --2- 172.21.15.92:0/2578185147 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7794106a80 0x7f779419bc50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f778c006010 tx=0x7f778c003c20 comp rx=0 tx=0).stop 2024-09-10T10:35:27.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779a7a6640 1 -- 172.21.15.92:0/2578185147 reap_dead start 2024-09-10T10:35:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 shutdown_connections 2024-09-10T10:35:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 >> 172.21.15.92:0/2578185147 conn(0x7f77940fc7a0 msgr2=0x7f77940fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 shutdown_connections 2024-09-10T10:35:27.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.216+0000 7f779c209640 1 -- 172.21.15.92:0/2578185147 wait complete. 2024-09-10T10:35:27.417 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:27 smithi092 ceph-mon[30834]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-10T10:35:27.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:27 smithi121 ceph-mon[35231]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-10T10:35:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:27 smithi097 ceph-mon[35213]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.951+0000 7f597cbd7640 1 -- 172.21.15.92:0/4004442532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5978102790 msgr2=0x7f59781067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.951+0000 7f597cbd7640 1 --2- 172.21.15.92:0/4004442532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5978102790 0x7f59781067e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5960009900 tx=0x7f596002a410 comp rx=0 tx=0).stop 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.951+0000 7f597cbd7640 1 -- 172.21.15.92:0/4004442532 shutdown_connections 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.951+0000 7f597cbd7640 1 --2- 172.21.15.92:0/4004442532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5978106f10 0x7f597810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.951+0000 7f597cbd7640 1 --2- 172.21.15.92:0/4004442532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5978102790 0x7f59781067e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.951+0000 7f597cbd7640 1 --2- 172.21.15.92:0/4004442532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5978101de0 0x7f59781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.951+0000 7f597cbd7640 1 -- 172.21.15.92:0/4004442532 >> 172.21.15.92:0/4004442532 conn(0x7f59780fd8c0 msgr2=0x7f59780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.951+0000 7f597cbd7640 1 -- 172.21.15.92:0/4004442532 shutdown_connections 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.951+0000 7f597cbd7640 1 -- 172.21.15.92:0/4004442532 wait complete. 2024-09-10T10:35:27.973 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f597cbd7640 1 Processor -- start 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f597cbd7640 1 -- start start 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f597cbd7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5978101de0 0x7f59780744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f597cbd7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5978102790 0x7f5978074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f597cbd7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5978106f10 0x7f5978074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f597cbd7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5978112010 con 0x7f5978102790 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f597cbd7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5978111e90 con 0x7f5978101de0 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f597cbd7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5978112190 con 0x7f5978106f10 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f596dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5978102790 0x7f5978074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f596dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5978102790 0x7f5978074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33920/0 (socket says 172.21.15.92:33920) 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f596dd9b640 1 -- 172.21.15.92:0/3250580499 learned_addr learned my addr 172.21.15.92:0/3250580499 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f5976d9d640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5978106f10 0x7f5978074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f597659c640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5978101de0 0x7f59780744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f596dd9b640 1 -- 172.21.15.92:0/3250580499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5978106f10 msgr2=0x7f5978074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f596dd9b640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5978106f10 0x7f5978074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f596dd9b640 1 -- 172.21.15.92:0/3250580499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5978101de0 msgr2=0x7f59780744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f596dd9b640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5978101de0 0x7f59780744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.952+0000 7f596dd9b640 1 -- 172.21.15.92:0/3250580499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59781a6a70 con 0x7f5978102790 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.953+0000 7f596dd9b640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5978102790 0x7f5978074a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5960005ab0 tx=0x7f59600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.953+0000 7f596ffff640 1 -- 172.21.15.92:0/3250580499 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596003f030 con 0x7f5978102790 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.953+0000 7f596ffff640 1 -- 172.21.15.92:0/3250580499 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5960003ce0 con 0x7f5978102790 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.953+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59781a6d00 con 0x7f5978102790 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.953+0000 7f596ffff640 1 -- 172.21.15.92:0/3250580499 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960035070 con 0x7f5978102790 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.953+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59781a7190 con 0x7f5978102790 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.954+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5978062900 con 0x7f5978102790 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.955+0000 7f596ffff640 1 -- 172.21.15.92:0/3250580499 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5960042030 con 0x7f5978102790 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.955+0000 7f596ffff640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f59640a2c10 0x7f59640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.956+0000 7f597659c640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f59640a2c10 0x7f59640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.956+0000 7f596ffff640 1 -- 172.21.15.92:0/3250580499 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f59600efcb0 con 0x7f5978102790 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.956+0000 7f596ffff640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] conn(0x7f59640ac6c0 0x7f59640aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.956+0000 7f596ffff640 1 -- 172.21.15.92:0/3250580499 --> [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5960001d30 con 0x7f59640ac6c0 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.956+0000 7f596ffff640 1 -- 172.21.15.92:0/3250580499 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f59600f0190 con 0x7f5978102790 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.956+0000 7f597659c640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f59640a2c10 0x7f59640a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f596800a810 tx=0x7f5968008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.956+0000 7f5976d9d640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] conn(0x7f59640ac6c0 0x7f59640aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.956+0000 7f5976d9d640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] conn(0x7f59640ac6c0 0x7f59640aeb60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.957+0000 7f596ffff640 1 -- 172.21.15.92:0/3250580499 <== osd.8 v2:172.21.15.121:6816/852392331 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5960001d30 con 0x7f59640ac6c0 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 --> [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5978062d80 con 0x7f59640ac6c0 2024-09-10T10:35:27.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f596ffff640 1 -- 172.21.15.92:0/3250580499 <== osd.8 v2:172.21.15.121:6816/852392331 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5978062d80 con 0x7f59640ac6c0 2024-09-10T10:35:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 >> [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] conn(0x7f59640ac6c0 msgr2=0x7f59640aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f597cbd7640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] conn(0x7f59640ac6c0 0x7f59640aeb60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f59640a2c10 msgr2=0x7f59640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f597cbd7640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f59640a2c10 0x7f59640a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f596800a810 tx=0x7f5968008040 comp rx=0 tx=0).stop 2024-09-10T10:35:27.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5978102790 msgr2=0x7f5978074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:27.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f597cbd7640 1 --2- 172.21.15.92:0/3250580499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5978102790 0x7f5978074a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5960005ab0 tx=0x7f59600042f0 comp rx=0 tx=0).stop 2024-09-10T10:35:27.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f5976d9d640 1 -- 172.21.15.92:0/3250580499 reap_dead start 2024-09-10T10:35:27.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 shutdown_connections 2024-09-10T10:35:27.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.971+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 >> 172.21.15.92:0/3250580499 conn(0x7f59780fd8c0 msgr2=0x7f59780fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:27.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.972+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 shutdown_connections 2024-09-10T10:35:27.978 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:27.972+0000 7f597cbd7640 1 -- 172.21.15.92:0/3250580499 wait complete. 2024-09-10T10:35:29.321 INFO:teuthology.orchestra.run.smithi092.stdout:103079215166 2024-09-10T10:35:29.322 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T10:35:29.438 INFO:teuthology.orchestra.run.smithi092.stdout:55834574920 2024-09-10T10:35:29.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T10:35:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:29 smithi097 ceph-mon[35213]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-10T10:35:29.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.521+0000 7fcce5515640 1 -- 172.21.15.92:0/589400248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102ef0 msgr2=0x7fcce010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.521+0000 7fcce5515640 1 --2- 172.21.15.92:0/589400248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102ef0 0x7fcce010da40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009900 tx=0x7fccd802a480 comp rx=0 tx=0).stop 2024-09-10T10:35:29.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.521+0000 7fcce5515640 1 -- 172.21.15.92:0/589400248 shutdown_connections 2024-09-10T10:35:29.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.521+0000 7fcce5515640 1 --2- 172.21.15.92:0/589400248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0102ef0 0x7fcce010da40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.521+0000 7fcce5515640 1 --2- 172.21.15.92:0/589400248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce0102570 0x7fcce01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.577 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.521+0000 7fcce5515640 1 --2- 172.21.15.92:0/589400248 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcce0100e20 0x7fcce0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.521+0000 7fcce5515640 1 -- 172.21.15.92:0/589400248 >> 172.21.15.92:0/589400248 conn(0x7fcce00fc7d0 msgr2=0x7fcce00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.521+0000 7fcce5515640 1 -- 172.21.15.92:0/589400248 shutdown_connections 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.521+0000 7fcce5515640 1 -- 172.21.15.92:0/589400248 wait complete. 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.522+0000 7fcce5515640 1 Processor -- start 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.522+0000 7fcce5515640 1 -- start start 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.522+0000 7fcce5515640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0100e20 0x7fcce0197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.522+0000 7fcce5515640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce0102570 0x7fcce0197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.522+0000 7fcce5515640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcce0102ef0 0x7fcce019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.522+0000 7fcce5515640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcce0110f80 con 0x7fcce0100e20 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.522+0000 7fcce5515640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcce0110e00 con 0x7fcce0102ef0 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.522+0000 7fcce5515640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcce0111100 con 0x7fcce0102570 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0100e20 0x7fcce0197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0100e20 0x7fcce0197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33938/0 (socket says 172.21.15.92:33938) 2024-09-10T10:35:29.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdeffd640 1 -- 172.21.15.92:0/1628309195 learned_addr learned my addr 172.21.15.92:0/1628309195 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:29.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdf7fe640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcce0102ef0 0x7fcce019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccde7fc640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce0102570 0x7fcce0197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdeffd640 1 -- 172.21.15.92:0/1628309195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce0102570 msgr2=0x7fcce0197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdeffd640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce0102570 0x7fcce0197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdeffd640 1 -- 172.21.15.92:0/1628309195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcce0102ef0 msgr2=0x7fcce019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdeffd640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcce0102ef0 0x7fcce019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdeffd640 1 -- 172.21.15.92:0/1628309195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce019c3b0 con 0x7fcce0100e20 2024-09-10T10:35:29.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccde7fc640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce0102570 0x7fcce0197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccdeffd640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0100e20 0x7fcce0197400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fccd000eab0 tx=0x7fccd000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccc7fff640 1 -- 172.21.15.92:0/1628309195 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd000ce40 con 0x7fcce0100e20 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce019c6a0 con 0x7fcce0100e20 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccc7fff640 1 -- 172.21.15.92:0/1628309195 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccd0011950 con 0x7fcce0100e20 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fccc7fff640 1 -- 172.21.15.92:0/1628309195 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0010ae0 con 0x7fcce0100e20 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.523+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce01a3f80 con 0x7fcce0100e20 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.524+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcce0062940 con 0x7fcce0100e20 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.525+0000 7fccc7fff640 1 -- 172.21.15.92:0/1628309195 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fccd0011b00 con 0x7fcce0100e20 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.526+0000 7fccc7fff640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fccc80a2c10 0x7fccc80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.526+0000 7fccde7fc640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fccc80a2c10 0x7fccc80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.526+0000 7fccc7fff640 1 -- 172.21.15.92:0/1628309195 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fccd00cf790 con 0x7fcce0100e20 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.526+0000 7fccc7fff640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] conn(0x7fccc80ac6c0 0x7fccc80aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.526+0000 7fccc7fff640 1 -- 172.21.15.92:0/1628309195 --> [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccd0014ec0 con 0x7fccc80ac6c0 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.526+0000 7fccc7fff640 1 -- 172.21.15.92:0/1628309195 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fccd00cfc70 con 0x7fcce0100e20 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.526+0000 7fccdf7fe640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] conn(0x7fccc80ac6c0 0x7fccc80aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.527+0000 7fccde7fc640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fccc80a2c10 0x7fccc80a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fccd4005fd0 tx=0x7fccd400b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.527+0000 7fccdf7fe640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] conn(0x7fccc80ac6c0 0x7fccc80aeb60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.527+0000 7fccc7fff640 1 -- 172.21.15.92:0/1628309195 <== osd.6 v2:172.21.15.92:6818/4073590316 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccd0014ec0 con 0x7fccc80ac6c0 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.541+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 --> [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcce0062dc0 con 0x7fccc80ac6c0 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.541+0000 7fccc7fff640 1 -- 172.21.15.92:0/1628309195 <== osd.6 v2:172.21.15.92:6818/4073590316 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcce0062dc0 con 0x7fccc80ac6c0 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] conn(0x7fccc80ac6c0 msgr2=0x7fccc80aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] conn(0x7fccc80ac6c0 0x7fccc80aeb60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fccc80a2c10 msgr2=0x7fccc80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fccc80a2c10 0x7fccc80a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fccd4005fd0 tx=0x7fccd400b5d0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0100e20 msgr2=0x7fcce0197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 --2- 172.21.15.92:0/1628309195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcce0100e20 0x7fcce0197400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fccd000eab0 tx=0x7fccd000ef70 comp rx=0 tx=0).stop 2024-09-10T10:35:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fccdf7fe640 1 -- 172.21.15.92:0/1628309195 reap_dead start 2024-09-10T10:35:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 shutdown_connections 2024-09-10T10:35:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 >> 172.21.15.92:0/1628309195 conn(0x7fcce00fc7d0 msgr2=0x7fcce01068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 shutdown_connections 2024-09-10T10:35:29.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:28.542+0000 7fcce5515640 1 -- 172.21.15.92:0/1628309195 wait complete. 2024-09-10T10:35:29.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:29 smithi092 ceph-mon[30834]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-10T10:35:29.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:29 smithi121 ceph-mon[35231]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-10T10:35:29.980 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 -- 172.21.15.92:0/2937057913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc106f40 msgr2=0x7fb9dc10eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 --2- 172.21.15.92:0/2937057913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc106f40 0x7fb9dc10eac0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009ca0 tx=0x7fb9d402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 -- 172.21.15.92:0/2937057913 shutdown_connections 2024-09-10T10:35:29.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 --2- 172.21.15.92:0/2937057913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc106f40 0x7fb9dc10eac0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 --2- 172.21.15.92:0/2937057913 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9dc1027c0 0x7fb9dc106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 --2- 172.21.15.92:0/2937057913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9dc101e10 0x7fb9dc1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 -- 172.21.15.92:0/2937057913 >> 172.21.15.92:0/2937057913 conn(0x7fb9dc0fd8d0 msgr2=0x7fb9dc0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:29.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 -- 172.21.15.92:0/2937057913 shutdown_connections 2024-09-10T10:35:29.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 -- 172.21.15.92:0/2937057913 wait complete. 2024-09-10T10:35:29.981 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.960+0000 7fb9e2858640 1 Processor -- start 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e2858640 1 -- start start 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e2858640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9dc101e10 0x7fb9dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e2858640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9dc1027c0 0x7fb9dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e2858640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc106f40 0x7fb9dc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e2858640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc111fa0 con 0x7fb9dc106f40 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e2858640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc111e20 con 0x7fb9dc1027c0 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e2858640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc112120 con 0x7fb9dc101e10 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e0df5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc106f40 0x7fb9dc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e0df5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc106f40 0x7fb9dc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33964/0 (socket says 172.21.15.92:33964) 2024-09-10T10:35:29.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e0df5640 1 -- 172.21.15.92:0/2414211722 learned_addr learned my addr 172.21.15.92:0/2414211722 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9db7fe640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9dc1027c0 0x7fb9dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9dc101e10 0x7fb9dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e0df5640 1 -- 172.21.15.92:0/2414211722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9dc101e10 msgr2=0x7fb9dc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e0df5640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9dc101e10 0x7fb9dc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e0df5640 1 -- 172.21.15.92:0/2414211722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9dc1027c0 msgr2=0x7fb9dc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e0df5640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9dc1027c0 0x7fb9dc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e0df5640 1 -- 172.21.15.92:0/2414211722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc1a67c0 con 0x7fb9dc106f40 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.961+0000 7fb9e0df5640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc106f40 0x7fb9dc074f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4031a60 tx=0x7fb9d4031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.962+0000 7fb9d97fa640 1 -- 172.21.15.92:0/2414211722 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4003c30 con 0x7fb9dc106f40 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.962+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9dc1a6a50 con 0x7fb9dc106f40 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.962+0000 7fb9d97fa640 1 -- 172.21.15.92:0/2414211722 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9d4003dd0 con 0x7fb9dc106f40 2024-09-10T10:35:29.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.962+0000 7fb9d97fa640 1 -- 172.21.15.92:0/2414211722 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40047e0 con 0x7fb9dc106f40 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.962+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9dc1a6f90 con 0x7fb9dc106f40 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.963+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb9dc0fed60 con 0x7fb9dc106f40 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.964+0000 7fb9d97fa640 1 -- 172.21.15.92:0/2414211722 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb9d402f790 con 0x7fb9dc106f40 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.964+0000 7fb9d97fa640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb9c40a2c10 0x7fb9c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.964+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb9c40a2c10 0x7fb9c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.965+0000 7fb9d97fa640 1 -- 172.21.15.92:0/2414211722 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fb9d40f0690 con 0x7fb9dc106f40 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.965+0000 7fb9d97fa640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] conn(0x7fb9c40ac6c0 0x7fb9c40aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.965+0000 7fb9d97fa640 1 -- 172.21.15.92:0/2414211722 --> [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9c40af230 con 0x7fb9c40ac6c0 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.965+0000 7fb9d97fa640 1 -- 172.21.15.92:0/2414211722 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fb9d40f0b70 con 0x7fb9dc106f40 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.965+0000 7fb9db7fe640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] conn(0x7fb9c40ac6c0 0x7fb9c40aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:29.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.965+0000 7fb9dbfff640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb9c40a2c10 0x7fb9c40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00ba40 tx=0x7fb9cc005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:29.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.965+0000 7fb9db7fe640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] conn(0x7fb9c40ac6c0 0x7fb9c40aeb60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:29.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.966+0000 7fb9d97fa640 1 -- 172.21.15.92:0/2414211722 <== osd.9 v2:172.21.15.92:6826/1628602922 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb9c40af230 con 0x7fb9c40ac6c0 2024-09-10T10:35:29.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 --> [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb9dc1032f0 con 0x7fb9c40ac6c0 2024-09-10T10:35:29.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9d97fa640 1 -- 172.21.15.92:0/2414211722 <== osd.9 v2:172.21.15.92:6826/1628602922 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb9dc1032f0 con 0x7fb9c40ac6c0 2024-09-10T10:35:29.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] conn(0x7fb9c40ac6c0 msgr2=0x7fb9c40aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] conn(0x7fb9c40ac6c0 0x7fb9c40aeb60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb9c40a2c10 msgr2=0x7fb9c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb9c40a2c10 0x7fb9c40a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00ba40 tx=0x7fb9cc005cc0 comp rx=0 tx=0).stop 2024-09-10T10:35:29.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc106f40 msgr2=0x7fb9dc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:29.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 --2- 172.21.15.92:0/2414211722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9dc106f40 0x7fb9dc074f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4031a60 tx=0x7fb9d4031a90 comp rx=0 tx=0).stop 2024-09-10T10:35:29.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e0df5640 1 -- 172.21.15.92:0/2414211722 reap_dead start 2024-09-10T10:35:29.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 shutdown_connections 2024-09-10T10:35:29.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 >> 172.21.15.92:0/2414211722 conn(0x7fb9dc0fd8d0 msgr2=0x7fb9dc0fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:29.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 shutdown_connections 2024-09-10T10:35:29.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:29.980+0000 7fb9e2858640 1 -- 172.21.15.92:0/2414211722 wait complete. 2024-09-10T10:35:30.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.724+0000 7f70161c1640 1 -- 172.21.15.92:0/800524321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7010106f10 msgr2=0x7f701010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:30.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.724+0000 7f70161c1640 1 --2- 172.21.15.92:0/800524321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7010106f10 0x7f701010ea90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7008009ca0 tx=0x7f700802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:35:30.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.724+0000 7f70161c1640 1 -- 172.21.15.92:0/800524321 shutdown_connections 2024-09-10T10:35:30.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.724+0000 7f70161c1640 1 --2- 172.21.15.92:0/800524321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7010106f10 0x7f701010ea90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:30.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.724+0000 7f70161c1640 1 --2- 172.21.15.92:0/800524321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7010102790 0x7f70101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:30.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.724+0000 7f70161c1640 1 --2- 172.21.15.92:0/800524321 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7010101de0 0x7f70101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:30.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.724+0000 7f70161c1640 1 -- 172.21.15.92:0/800524321 >> 172.21.15.92:0/800524321 conn(0x7f70100fd8c0 msgr2=0x7f70100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.724+0000 7f70161c1640 1 -- 172.21.15.92:0/800524321 shutdown_connections 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.724+0000 7f70161c1640 1 -- 172.21.15.92:0/800524321 wait complete. 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f70161c1640 1 Processor -- start 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f70161c1640 1 -- start start 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f70161c1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7010101de0 0x7f70101983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f70161c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7010102790 0x7f7010198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f70161c1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7010106f10 0x7f701019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f70161c1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7010111f70 con 0x7f7010102790 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f70161c1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7010111df0 con 0x7f7010106f10 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f70161c1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f70101120f0 con 0x7f7010101de0 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f700effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7010102790 0x7f7010198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:30.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f700effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7010102790 0x7f7010198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33990/0 (socket says 172.21.15.92:33990) 2024-09-10T10:35:30.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f700effd640 1 -- 172.21.15.92:0/4162063798 learned_addr learned my addr 172.21.15.92:0/4162063798 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:30.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f700ffff640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7010106f10 0x7f701019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:30.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.725+0000 7f700f7fe640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7010101de0 0x7f70101983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:30.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f700effd640 1 -- 172.21.15.92:0/4162063798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7010101de0 msgr2=0x7f70101983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:30.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f700effd640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7010101de0 0x7f70101983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:30.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f700effd640 1 -- 172.21.15.92:0/4162063798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7010106f10 msgr2=0x7f701019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:30.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f700effd640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7010106f10 0x7f701019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f700effd640 1 -- 172.21.15.92:0/4162063798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f701019d380 con 0x7f7010102790 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f700effd640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7010102790 0x7f7010198910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f700400c890 tx=0x7f700400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f700cff9640 1 -- 172.21.15.92:0/4162063798 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004004220 con 0x7f7010102790 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f701019d670 con 0x7f7010102790 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70101a4f50 con 0x7f7010102790 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f700cff9640 1 -- 172.21.15.92:0/4162063798 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70040043c0 con 0x7f7010102790 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.726+0000 7f700cff9640 1 -- 172.21.15.92:0/4162063798 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004004a00 con 0x7f7010102790 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.727+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ffc001030 con 0x7f7010102790 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.729+0000 7f700cff9640 1 -- 172.21.15.92:0/4162063798 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f70040079b0 con 0x7f7010102790 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.729+0000 7f700cff9640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6ff80a2c10 0x7f6ff80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.729+0000 7f700f7fe640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6ff80a2c10 0x7f6ff80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.729+0000 7f700cff9640 1 -- 172.21.15.92:0/4162063798 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f70040cef90 con 0x7f7010102790 2024-09-10T10:35:30.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.729+0000 7f700cff9640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] conn(0x7f6ff80ac6c0 0x7f6ff80aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.730+0000 7f700cff9640 1 -- 172.21.15.92:0/4162063798 --> [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ff80af230 con 0x7f6ff80ac6c0 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.730+0000 7f700cff9640 1 -- 172.21.15.92:0/4162063798 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f70040cf470 con 0x7f7010102790 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.730+0000 7f700ffff640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] conn(0x7f6ff80ac6c0 0x7f6ff80aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.730+0000 7f700f7fe640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6ff80a2c10 0x7f6ff80a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f700000bbe0 tx=0x7f700000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.730+0000 7f700ffff640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] conn(0x7f6ff80ac6c0 0x7f6ff80aeb60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.731+0000 7f700cff9640 1 -- 172.21.15.92:0/4162063798 <== osd.11 v2:172.21.15.121:6824/328137928 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ff80af230 con 0x7f6ff80ac6c0 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.744+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 --> [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ffc002dd0 con 0x7f6ff80ac6c0 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f700cff9640 1 -- 172.21.15.92:0/4162063798 <== osd.11 v2:172.21.15.121:6824/328137928 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6ffc002dd0 con 0x7f6ff80ac6c0 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 >> [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] conn(0x7f6ff80ac6c0 msgr2=0x7f6ff80aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] conn(0x7f6ff80ac6c0 0x7f6ff80aeb60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6ff80a2c10 msgr2=0x7f6ff80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6ff80a2c10 0x7f6ff80a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f700000bbe0 tx=0x7f700000b390 comp rx=0 tx=0).stop 2024-09-10T10:35:30.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7010102790 msgr2=0x7f7010198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:30.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 --2- 172.21.15.92:0/4162063798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7010102790 0x7f7010198910 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f700400c890 tx=0x7f700400cd50 comp rx=0 tx=0).stop 2024-09-10T10:35:30.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f700ffff640 1 -- 172.21.15.92:0/4162063798 reap_dead start 2024-09-10T10:35:30.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 shutdown_connections 2024-09-10T10:35:30.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 >> 172.21.15.92:0/4162063798 conn(0x7f70100fd8c0 msgr2=0x7f70100fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:30.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 shutdown_connections 2024-09-10T10:35:30.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.745+0000 7f70161c1640 1 -- 172.21.15.92:0/4162063798 wait complete. 2024-09-10T10:35:31.343 INFO:teuthology.orchestra.run.smithi092.stdout:240518168613 2024-09-10T10:35:31.344 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T10:35:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:31 smithi097 ceph-mon[35213]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T10:35:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:31 smithi092 ceph-mon[30834]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T10:35:31.672 INFO:teuthology.orchestra.run.smithi092.stdout:154618822706 2024-09-10T10:35:31.673 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 -- 172.21.15.92:0/2903836672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c102570 msgr2=0x7f923c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 --2- 172.21.15.92:0/2903836672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c102570 0x7f923c1029b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9238009900 tx=0x7f923802a480 comp rx=0 tx=0).stop 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 -- 172.21.15.92:0/2903836672 shutdown_connections 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 --2- 172.21.15.92:0/2903836672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f923c102ef0 0x7f923c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 --2- 172.21.15.92:0/2903836672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c102570 0x7f923c1029b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 --2- 172.21.15.92:0/2903836672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f923c100e20 0x7f923c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 -- 172.21.15.92:0/2903836672 >> 172.21.15.92:0/2903836672 conn(0x7f923c0fc7d0 msgr2=0x7f923c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 -- 172.21.15.92:0/2903836672 shutdown_connections 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 -- 172.21.15.92:0/2903836672 wait complete. 2024-09-10T10:35:31.755 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 Processor -- start 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.597+0000 7f9243b34640 1 -- start start 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f9243b34640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f923c100e20 0x7f923c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f9243b34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c102570 0x7f923c10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f9243b34640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f923c102ef0 0x7f923c10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f9243b34640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f923c1120a0 con 0x7f923c102570 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f9243b34640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f923c111f20 con 0x7f923c100e20 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f9243b34640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f923c112220 con 0x7f923c102ef0 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92410cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c102570 0x7f923c10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92410cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c102570 0x7f923c10ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33986/0 (socket says 172.21.15.92:33986) 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92410cf640 1 -- 172.21.15.92:0/3515650590 learned_addr learned my addr 172.21.15.92:0/3515650590 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92418d0640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f923c100e20 0x7f923c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92410cf640 1 -- 172.21.15.92:0/3515650590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f923c102ef0 msgr2=0x7f923c10ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:31.756 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92410cf640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f923c102ef0 0x7f923c10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92410cf640 1 -- 172.21.15.92:0/3515650590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f923c100e20 msgr2=0x7f923c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92410cf640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f923c100e20 0x7f923c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92410cf640 1 -- 172.21.15.92:0/3515650590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c1aaeb0 con 0x7f923c102570 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92418d0640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f923c100e20 0x7f923c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.598+0000 7f92410cf640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c102570 0x7f923c10ea10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9238006010 tx=0x7f9238003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.599+0000 7f922effd640 1 -- 172.21.15.92:0/3515650590 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923803f070 con 0x7f923c102570 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.599+0000 7f922effd640 1 -- 172.21.15.92:0/3515650590 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9238031e30 con 0x7f923c102570 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.599+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923c1ab080 con 0x7f923c102570 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.599+0000 7f922effd640 1 -- 172.21.15.92:0/3515650590 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238035030 con 0x7f923c102570 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.599+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f923c1ab5c0 con 0x7f923c102570 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.599+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f923c107300 con 0x7f923c102570 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.601+0000 7f922effd640 1 -- 172.21.15.92:0/3515650590 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9238042070 con 0x7f923c102570 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.601+0000 7f922effd640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92280a2c10 0x7f92280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:31.757 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.602+0000 7f92418d0640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92280a2c10 0x7f92280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.602+0000 7f922effd640 1 -- 172.21.15.92:0/3515650590 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f92380f0200 con 0x7f923c102570 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.602+0000 7f922effd640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] conn(0x7f92280ac6c0 0x7f92280aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.602+0000 7f922effd640 1 -- 172.21.15.92:0/3515650590 --> [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9238038e90 con 0x7f92280ac6c0 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.602+0000 7f922effd640 1 -- 172.21.15.92:0/3515650590 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f92380f05b0 con 0x7f923c102570 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.602+0000 7f92418d0640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92280a2c10 0x7f92280a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9230009930 tx=0x7f9230008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.602+0000 7f92420d1640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] conn(0x7f92280ac6c0 0x7f92280aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.603+0000 7f92420d1640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] conn(0x7f92280ac6c0 0x7f92280aeb60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.603+0000 7f922effd640 1 -- 172.21.15.92:0/3515650590 <== osd.10 v2:172.21.15.97:6824/4185201186 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9238038e90 con 0x7f92280ac6c0 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.617+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 --> [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f923c1021b0 con 0x7f92280ac6c0 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.617+0000 7f922effd640 1 -- 172.21.15.92:0/3515650590 <== osd.10 v2:172.21.15.97:6824/4185201186 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f923c1021b0 con 0x7f92280ac6c0 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 >> [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] conn(0x7f92280ac6c0 msgr2=0x7f92280aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] conn(0x7f92280ac6c0 0x7f92280aeb60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:31.758 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92280a2c10 msgr2=0x7f92280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:31.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f92280a2c10 0x7f92280a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9230009930 tx=0x7f9230008040 comp rx=0 tx=0).stop 2024-09-10T10:35:31.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c102570 msgr2=0x7f923c10ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:31.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 --2- 172.21.15.92:0/3515650590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f923c102570 0x7f923c10ea10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9238006010 tx=0x7f9238003c80 comp rx=0 tx=0).stop 2024-09-10T10:35:31.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f92420d1640 1 -- 172.21.15.92:0/3515650590 reap_dead start 2024-09-10T10:35:31.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 shutdown_connections 2024-09-10T10:35:31.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 >> 172.21.15.92:0/3515650590 conn(0x7f923c0fc7d0 msgr2=0x7f923c1068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:31.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 shutdown_connections 2024-09-10T10:35:31.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:30.618+0000 7f9243b34640 1 -- 172.21.15.92:0/3515650590 wait complete. 2024-09-10T10:35:31.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:31 smithi121 ceph-mon[35231]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T10:35:32.406 INFO:teuthology.orchestra.run.smithi092.stdout:292057776156 2024-09-10T10:35:32.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T10:35:33.042 INFO:teuthology.orchestra.run.smithi092.stdout:188978561072 2024-09-10T10:35:33.042 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T10:35:33.486 INFO:teuthology.orchestra.run.smithi092.stdout:270582939681 2024-09-10T10:35:33.487 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T10:35:33.563 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:33 smithi092 ceph-mon[30834]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:35:33.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:33 smithi097 ceph-mon[35213]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:35:33.593 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:33 smithi121 ceph-mon[35231]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:35:33.936 INFO:teuthology.orchestra.run.smithi092.stdout:322122547222 2024-09-10T10:35:33.936 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T10:35:34.394 INFO:teuthology.orchestra.run.smithi092.stdout:210453397547 2024-09-10T10:35:34.394 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T10:35:34.441 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:34.441 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:34.445 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:34.455 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:34.537 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:34.538 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:34.767 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:34.767 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.180+0000 7f4937c01640 1 -- 172.21.15.92:0/809014697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102570 msgr2=0x7f49301029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.180+0000 7f4937c01640 1 --2- 172.21.15.92:0/809014697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102570 0x7f49301029b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4920009900 tx=0x7f492002a480 comp rx=0 tx=0).stop 2024-09-10T10:35:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.180+0000 7f4937c01640 1 -- 172.21.15.92:0/809014697 shutdown_connections 2024-09-10T10:35:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.180+0000 7f4937c01640 1 --2- 172.21.15.92:0/809014697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4930102ef0 0x7f493010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.180+0000 7f4937c01640 1 --2- 172.21.15.92:0/809014697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102570 0x7f49301029b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.180+0000 7f4937c01640 1 --2- 172.21.15.92:0/809014697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4930100e20 0x7f4930101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.180+0000 7f4937c01640 1 -- 172.21.15.92:0/809014697 >> 172.21.15.92:0/809014697 conn(0x7f49300fc7d0 msgr2=0x7f49300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.180+0000 7f4937c01640 1 -- 172.21.15.92:0/809014697 shutdown_connections 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.180+0000 7f4937c01640 1 -- 172.21.15.92:0/809014697 wait complete. 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f4937c01640 1 Processor -- start 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f4937c01640 1 -- start start 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f4937c01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4930100e20 0x7f49301a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f4937c01640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4930102570 0x7f49301a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f4937c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102ef0 0x7f493019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f4937c01640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4930110fa0 con 0x7f4930102ef0 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f4937c01640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4930110e20 con 0x7f4930100e20 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f4937c01640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4930111120 con 0x7f4930102570 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493619e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102ef0 0x7f493019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493619e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102ef0 0x7f493019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57408/0 (socket says 172.21.15.92:57408) 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493619e640 1 -- 172.21.15.92:0/3265004549 learned_addr learned my addr 172.21.15.92:0/3265004549 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:35.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493599d640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4930100e20 0x7f49301a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493519c640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4930102570 0x7f49301a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493619e640 1 -- 172.21.15.92:0/3265004549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4930102570 msgr2=0x7f49301a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493619e640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4930102570 0x7f49301a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493619e640 1 -- 172.21.15.92:0/3265004549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4930100e20 msgr2=0x7f49301a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493619e640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4930100e20 0x7f49301a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493619e640 1 -- 172.21.15.92:0/3265004549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493019ad20 con 0x7f4930102ef0 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.181+0000 7f493599d640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4930100e20 0x7f49301a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.182+0000 7f493619e640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102ef0 0x7f493019a5f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f492800cad0 tx=0x7f492800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.182+0000 7f4926ffd640 1 -- 172.21.15.92:0/3265004549 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800ae20 con 0x7f4930102ef0 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.182+0000 7f4926ffd640 1 -- 172.21.15.92:0/3265004549 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4928005020 con 0x7f4930102ef0 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.182+0000 7f4926ffd640 1 -- 172.21.15.92:0/3265004549 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800f6f0 con 0x7f4930102ef0 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.182+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493019b010 con 0x7f4930102ef0 2024-09-10T10:35:35.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.182+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49301a7300 con 0x7f4930102ef0 2024-09-10T10:35:35.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.183+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4930101200 con 0x7f4930102ef0 2024-09-10T10:35:35.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.184+0000 7f4926ffd640 1 -- 172.21.15.92:0/3265004549 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f49280051d0 con 0x7f4930102ef0 2024-09-10T10:35:35.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.184+0000 7f4926ffd640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f491c0a2c10 0x7f491c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.185+0000 7f493599d640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f491c0a2c10 0x7f491c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.185+0000 7f4926ffd640 1 -- 172.21.15.92:0/3265004549 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f49280cf220 con 0x7f4930102ef0 2024-09-10T10:35:35.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.185+0000 7f493599d640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f491c0a2c10 0x7f491c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f492c009930 tx=0x7f492c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:35.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.189+0000 7f4926ffd640 1 -- 172.21.15.92:0/3265004549 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4928014030 con 0x7f4930102ef0 2024-09-10T10:35:35.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.365+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f49301a74d0 con 0x7f4930102ef0 2024-09-10T10:35:35.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.366+0000 7f4926ffd640 1 -- 172.21.15.92:0/3265004549 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f492809c120 con 0x7f4930102ef0 2024-09-10T10:35:35.367 INFO:teuthology.orchestra.run.smithi092.stdout:240518168614 2024-09-10T10:35:35.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f491c0a2c10 msgr2=0x7f491c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f491c0a2c10 0x7f491c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f492c009930 tx=0x7f492c008040 comp rx=0 tx=0).stop 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102ef0 msgr2=0x7f493019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102ef0 0x7f493019a5f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f492800cad0 tx=0x7f492800cf90 comp rx=0 tx=0).stop 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 shutdown_connections 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f491c0a2c10 0x7f491c0a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4930102ef0 0x7f493019a5f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4930102570 0x7f49301a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 --2- 172.21.15.92:0/3265004549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4930100e20 0x7f49301a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 >> 172.21.15.92:0/3265004549 conn(0x7f49300fc7d0 msgr2=0x7f493006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 shutdown_connections 2024-09-10T10:35:35.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.368+0000 7f4937c01640 1 -- 172.21.15.92:0/3265004549 wait complete. 2024-09-10T10:35:35.461 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:35 smithi092 ceph-mon[30834]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-10T10:35:35.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:35 smithi097 ceph-mon[35213]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-10T10:35:35.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.634+0000 7fdae0645640 1 -- 172.21.15.92:0/4054926870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8106f10 msgr2=0x7fdad810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.634+0000 7fdae0645640 1 --2- 172.21.15.92:0/4054926870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8106f10 0x7fdad810ea90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009ca0 tx=0x7fdad002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.634+0000 7fdae0645640 1 -- 172.21.15.92:0/4054926870 shutdown_connections 2024-09-10T10:35:35.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.634+0000 7fdae0645640 1 --2- 172.21.15.92:0/4054926870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8106f10 0x7fdad810ea90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.634+0000 7fdae0645640 1 --2- 172.21.15.92:0/4054926870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdad8102790 0x7fdad81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.634+0000 7fdae0645640 1 --2- 172.21.15.92:0/4054926870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdad8101de0 0x7fdad81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.634+0000 7fdae0645640 1 -- 172.21.15.92:0/4054926870 >> 172.21.15.92:0/4054926870 conn(0x7fdad80fd8c0 msgr2=0x7fdad80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:35.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.634+0000 7fdae0645640 1 -- 172.21.15.92:0/4054926870 shutdown_connections 2024-09-10T10:35:35.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.634+0000 7fdae0645640 1 -- 172.21.15.92:0/4054926870 wait complete. 2024-09-10T10:35:35.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdae0645640 1 Processor -- start 2024-09-10T10:35:35.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdae0645640 1 -- start start 2024-09-10T10:35:35.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdae0645640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8101de0 0x7fdad8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdae0645640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdad8102790 0x7fdad81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdae0645640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdad8106f10 0x7fdad819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdae0645640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdad8111f70 con 0x7fdad8101de0 2024-09-10T10:35:35.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdae0645640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdad8111df0 con 0x7fdad8102790 2024-09-10T10:35:35.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdae0645640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdad81120f0 con 0x7fdad8106f10 2024-09-10T10:35:35.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdade3e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8101de0 0x7fdad8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdade3e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8101de0 0x7fdad8198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57428/0 (socket says 172.21.15.92:57428) 2024-09-10T10:35:35.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdade3e1640 1 -- 172.21.15.92:0/4282001788 learned_addr learned my addr 172.21.15.92:0/4282001788 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:35.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdade3e1640 1 -- 172.21.15.92:0/4282001788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdad8106f10 msgr2=0x7fdad819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdadebe2640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdad8106f10 0x7fdad819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdade3e1640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdad8106f10 0x7fdad819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdade3e1640 1 -- 172.21.15.92:0/4282001788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdad8102790 msgr2=0x7fdad81989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdade3e1640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdad8102790 0x7fdad81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdade3e1640 1 -- 172.21.15.92:0/4282001788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad819d420 con 0x7fdad8101de0 2024-09-10T10:35:35.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdadebe2640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdad8106f10 0x7fdad819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:35.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdade3e1640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8101de0 0x7fdad8198470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdac800c890 tx=0x7fdac800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:35.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.635+0000 7fdacf7fe640 1 -- 172.21.15.92:0/4282001788 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8004220 con 0x7fdad8101de0 2024-09-10T10:35:35.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.636+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad819d710 con 0x7fdad8101de0 2024-09-10T10:35:35.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.636+0000 7fdacf7fe640 1 -- 172.21.15.92:0/4282001788 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdac80043c0 con 0x7fdad8101de0 2024-09-10T10:35:35.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.636+0000 7fdacf7fe640 1 -- 172.21.15.92:0/4282001788 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac8004a00 con 0x7fdad8101de0 2024-09-10T10:35:35.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.636+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad81a4ff0 con 0x7fdad8101de0 2024-09-10T10:35:35.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.637+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad81021c0 con 0x7fdad8101de0 2024-09-10T10:35:35.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.638+0000 7fdacf7fe640 1 -- 172.21.15.92:0/4282001788 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdac80079b0 con 0x7fdad8101de0 2024-09-10T10:35:35.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.638+0000 7fdacf7fe640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdac40a2c10 0x7fdac40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.638+0000 7fdaddbe0640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdac40a2c10 0x7fdac40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.638+0000 7fdacf7fe640 1 -- 172.21.15.92:0/4282001788 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fdac80cee80 con 0x7fdad8101de0 2024-09-10T10:35:35.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.639+0000 7fdaddbe0640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdac40a2c10 0x7fdac40a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdad81087d0 tx=0x7fdad4005b60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:35.663 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.642+0000 7fdacf7fe640 1 -- 172.21.15.92:0/4282001788 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdac8014030 con 0x7fdad8101de0 2024-09-10T10:35:35.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:35 smithi121 ceph-mon[35231]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-10T10:35:35.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.814+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdad810a150 con 0x7fdad8101de0 2024-09-10T10:35:35.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.814+0000 7fdacf7fe640 1 -- 172.21.15.92:0/4282001788 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdac809bd80 con 0x7fdad8101de0 2024-09-10T10:35:35.817 INFO:teuthology.orchestra.run.smithi092.stdout:154618822709 2024-09-10T10:35:35.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.816+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdac40a2c10 msgr2=0x7fdac40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.816+0000 7fdae0645640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdac40a2c10 0x7fdac40a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdad81087d0 tx=0x7fdad4005b60 comp rx=0 tx=0).stop 2024-09-10T10:35:35.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.816+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8101de0 msgr2=0x7fdad8198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.816+0000 7fdae0645640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8101de0 0x7fdad8198470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdac800c890 tx=0x7fdac800cd50 comp rx=0 tx=0).stop 2024-09-10T10:35:35.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.817+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 shutdown_connections 2024-09-10T10:35:35.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.817+0000 7fdae0645640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdac40a2c10 0x7fdac40a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.817+0000 7fdae0645640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdad8106f10 0x7fdad819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.817+0000 7fdae0645640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdad8102790 0x7fdad81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.817+0000 7fdae0645640 1 --2- 172.21.15.92:0/4282001788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdad8101de0 0x7fdad8198470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.817+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 >> 172.21.15.92:0/4282001788 conn(0x7fdad80fd8c0 msgr2=0x7fdad80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:35.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.817+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 shutdown_connections 2024-09-10T10:35:35.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.817+0000 7fdae0645640 1 -- 172.21.15.92:0/4282001788 wait complete. 2024-09-10T10:35:35.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.863+0000 7feded8d3640 1 -- 172.21.15.92:0/603160157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8102ef0 msgr2=0x7fede810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.863+0000 7feded8d3640 1 --2- 172.21.15.92:0/603160157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8102ef0 0x7fede810da40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fede0009900 tx=0x7fede002a480 comp rx=0 tx=0).stop 2024-09-10T10:35:35.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.863+0000 7feded8d3640 1 -- 172.21.15.92:0/603160157 shutdown_connections 2024-09-10T10:35:35.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.863+0000 7feded8d3640 1 --2- 172.21.15.92:0/603160157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8102ef0 0x7fede810da40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.863+0000 7feded8d3640 1 --2- 172.21.15.92:0/603160157 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8102570 0x7fede81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.863+0000 7feded8d3640 1 --2- 172.21.15.92:0/603160157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fede8100e20 0x7fede8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.863+0000 7feded8d3640 1 -- 172.21.15.92:0/603160157 >> 172.21.15.92:0/603160157 conn(0x7fede80fc7d0 msgr2=0x7fede80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.863+0000 7feded8d3640 1 -- 172.21.15.92:0/603160157 shutdown_connections 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.863+0000 7feded8d3640 1 -- 172.21.15.92:0/603160157 wait complete. 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.864+0000 7feded8d3640 1 Processor -- start 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.864+0000 7feded8d3640 1 -- start start 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.864+0000 7feded8d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100e20 0x7fede8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.864+0000 7feded8d3640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8102570 0x7fede81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.864+0000 7feded8d3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fede8102ef0 0x7fede819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.864+0000 7feded8d3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fede8110f80 con 0x7fede8100e20 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.864+0000 7feded8d3640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fede8110e00 con 0x7fede8102570 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.864+0000 7feded8d3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fede8111100 con 0x7fede8102ef0 2024-09-10T10:35:35.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.864+0000 7fede6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100e20 0x7fede8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100e20 0x7fede8198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57444/0 (socket says 172.21.15.92:57444) 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede6ffd640 1 -- 172.21.15.92:0/2692904084 learned_addr learned my addr 172.21.15.92:0/2692904084 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede67fc640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8102570 0x7fede81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede77fe640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fede8102ef0 0x7fede819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede6ffd640 1 -- 172.21.15.92:0/2692904084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fede8102ef0 msgr2=0x7fede819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede6ffd640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fede8102ef0 0x7fede819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede6ffd640 1 -- 172.21.15.92:0/2692904084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8102570 msgr2=0x7fede81989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede6ffd640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8102570 0x7fede81989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede6ffd640 1 -- 172.21.15.92:0/2692904084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede819d440 con 0x7fede8100e20 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede77fe640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fede8102ef0 0x7fede819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fede6ffd640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100e20 0x7fede8198490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feddc00cce0 tx=0x7feddc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:35.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fedec8d1640 1 -- 172.21.15.92:0/2692904084 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc004b20 con 0x7fede8100e20 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fedec8d1640 1 -- 172.21.15.92:0/2692904084 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feddc004cc0 con 0x7fede8100e20 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7fedec8d1640 1 -- 172.21.15.92:0/2692904084 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc00f8c0 con 0x7fede8100e20 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede819d730 con 0x7fede8100e20 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.865+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede81a5010 con 0x7fede8100e20 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.866+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede8101200 con 0x7fede8100e20 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.867+0000 7fedec8d1640 1 -- 172.21.15.92:0/2692904084 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7feddc00fa60 con 0x7fede8100e20 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.868+0000 7fedec8d1640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fedd00a2c10 0x7fedd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.868+0000 7fede67fc640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fedd00a2c10 0x7fedd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.868+0000 7fedec8d1640 1 -- 172.21.15.92:0/2692904084 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7feddc0cf1b0 con 0x7fede8100e20 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.869+0000 7fede67fc640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fedd00a2c10 0x7fedd00a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fede80fef00 tx=0x7fedd800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:35.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:35.872+0000 7fedec8d1640 1 -- 172.21.15.92:0/2692904084 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feddc014030 con 0x7fede8100e20 2024-09-10T10:35:36.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.044+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fede81997f0 con 0x7fede8100e20 2024-09-10T10:35:36.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.044+0000 7fedec8d1640 1 -- 172.21.15.92:0/2692904084 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feddc09c0b0 con 0x7fede8100e20 2024-09-10T10:35:36.046 INFO:teuthology.orchestra.run.smithi092.stdout:133143986235 2024-09-10T10:35:36.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fedd00a2c10 msgr2=0x7fedd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:36.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fedd00a2c10 0x7fedd00a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fede80fef00 tx=0x7fedd800b410 comp rx=0 tx=0).stop 2024-09-10T10:35:36.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100e20 msgr2=0x7fede8198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:36.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100e20 0x7fede8198490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feddc00cce0 tx=0x7feddc00a620 comp rx=0 tx=0).stop 2024-09-10T10:35:36.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 shutdown_connections 2024-09-10T10:35:36.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fedd00a2c10 0x7fedd00a50d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:36.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fede8102ef0 0x7fede819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:36.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fede8102570 0x7fede81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:36.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 --2- 172.21.15.92:0/2692904084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fede8100e20 0x7fede8198490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:36.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 >> 172.21.15.92:0/2692904084 conn(0x7fede80fc7d0 msgr2=0x7fede806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:36.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 shutdown_connections 2024-09-10T10:35:36.049 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:36.046+0000 7feded8d3640 1 -- 172.21.15.92:0/2692904084 wait complete. 2024-09-10T10:35:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:36 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3265004549' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T10:35:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:36 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/4282001788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T10:35:36.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:36 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2692904084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T10:35:36.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:36 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3265004549' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T10:35:36.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:36 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/4282001788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T10:35:36.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:36 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2692904084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T10:35:36.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:36 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3265004549' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T10:35:36.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:36 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/4282001788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T10:35:36.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:36 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2692904084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T10:35:36.989 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822706 got 154618822709 for osd.5 2024-09-10T10:35:36.989 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:37.563 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:37 smithi092 ceph-mon[30834]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:35:37.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:37 smithi097 ceph-mon[35213]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:35:37.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.713+0000 7f648e73c640 1 -- 172.21.15.92:0/3139042636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881036e0 msgr2=0x7f6488107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:37.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.713+0000 7f648e73c640 1 --2- 172.21.15.92:0/3139042636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881036e0 0x7f6488107b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f647c009930 tx=0x7f647c02a420 comp rx=0 tx=0).stop 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.713+0000 7f648e73c640 1 -- 172.21.15.92:0/3139042636 shutdown_connections 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.713+0000 7f648e73c640 1 --2- 172.21.15.92:0/3139042636 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f64881082a0 0x7f648810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.713+0000 7f648e73c640 1 --2- 172.21.15.92:0/3139042636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881036e0 0x7f6488107b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.713+0000 7f648e73c640 1 --2- 172.21.15.92:0/3139042636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6488102d30 0x7f6488103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.713+0000 7f648e73c640 1 -- 172.21.15.92:0/3139042636 >> 172.21.15.92:0/3139042636 conn(0x7f64880fc7d0 msgr2=0x7f64880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.713+0000 7f648e73c640 1 -- 172.21.15.92:0/3139042636 shutdown_connections 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.713+0000 7f648e73c640 1 -- 172.21.15.92:0/3139042636 wait complete. 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648e73c640 1 Processor -- start 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648e73c640 1 -- start start 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648e73c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6488102d30 0x7f6488198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648e73c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64881036e0 0x7f6488198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:37.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648e73c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881082a0 0x7f648819cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648e73c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6488112140 con 0x7f64881082a0 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648e73c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6488111fc0 con 0x7f6488102d30 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648e73c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f64881122c0 con 0x7f64881036e0 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648ccd9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881082a0 0x7f648819cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648ccd9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881082a0 0x7f648819cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57468/0 (socket says 172.21.15.92:57468) 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f648ccd9640 1 -- 172.21.15.92:0/149226832 learned_addr learned my addr 172.21.15.92:0/149226832 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f64877fe640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64881036e0 0x7f6488198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.714+0000 7f6487fff640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6488102d30 0x7f6488198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f648ccd9640 1 -- 172.21.15.92:0/149226832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64881036e0 msgr2=0x7f6488198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f648ccd9640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64881036e0 0x7f6488198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f648ccd9640 1 -- 172.21.15.92:0/149226832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6488102d30 msgr2=0x7f6488198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f648ccd9640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6488102d30 0x7f6488198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f648ccd9640 1 -- 172.21.15.92:0/149226832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648819d6b0 con 0x7f64881082a0 2024-09-10T10:35:37.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f648ccd9640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881082a0 0x7f648819cfd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f648000b970 tx=0x7f648000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f64857fa640 1 -- 172.21.15.92:0/149226832 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480019070 con 0x7f64881082a0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648819d9a0 con 0x7f64881082a0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f64857fa640 1 -- 172.21.15.92:0/149226832 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6480014440 con 0x7f64881082a0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f64857fa640 1 -- 172.21.15.92:0/149226832 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64800075d0 con 0x7f64881082a0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.715+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64881a5280 con 0x7f64881082a0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.716+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6488103190 con 0x7f64881082a0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.717+0000 7f64857fa640 1 -- 172.21.15.92:0/149226832 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f648001c070 con 0x7f64881082a0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.718+0000 7f64857fa640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f64700a2c10 0x7f64700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.718+0000 7f6487fff640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f64700a2c10 0x7f64700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.718+0000 7f64857fa640 1 -- 172.21.15.92:0/149226832 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f64800cea10 con 0x7f64881082a0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.718+0000 7f6487fff640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f64700a2c10 0x7f64700a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6478009990 tx=0x7f6478009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:37.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.721+0000 7f64857fa640 1 -- 172.21.15.92:0/149226832 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f648009b3d0 con 0x7f64881082a0 2024-09-10T10:35:37.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:37 smithi121 ceph-mon[35231]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:35:37.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.893+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f648810a2b0 con 0x7f64881082a0 2024-09-10T10:35:37.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.893+0000 7f64857fa640 1 -- 172.21.15.92:0/149226832 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f648009f6d0 con 0x7f64881082a0 2024-09-10T10:35:37.895 INFO:teuthology.orchestra.run.smithi092.stdout:322122547223 2024-09-10T10:35:37.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f64700a2c10 msgr2=0x7f64700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:37.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f64700a2c10 0x7f64700a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6478009990 tx=0x7f6478009110 comp rx=0 tx=0).stop 2024-09-10T10:35:37.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881082a0 msgr2=0x7f648819cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:37.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881082a0 0x7f648819cfd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f648000b970 tx=0x7f648000bd70 comp rx=0 tx=0).stop 2024-09-10T10:35:37.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 shutdown_connections 2024-09-10T10:35:37.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f64700a2c10 0x7f64700a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f64881082a0 0x7f648819cfd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64881036e0 0x7f6488198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 --2- 172.21.15.92:0/149226832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6488102d30 0x7f6488198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.895+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 >> 172.21.15.92:0/149226832 conn(0x7f64880fc7d0 msgr2=0x7f6488105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:37.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.896+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 shutdown_connections 2024-09-10T10:35:37.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.896+0000 7f648e73c640 1 -- 172.21.15.92:0/149226832 wait complete. 2024-09-10T10:35:37.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.933+0000 7f111b14b640 1 -- 172.21.15.92:0/3069347276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114108290 msgr2=0x7f111410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:37.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.933+0000 7f111b14b640 1 --2- 172.21.15.92:0/3069347276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114108290 0x7f111410ec30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f110c009930 tx=0x7f110c02a420 comp rx=0 tx=0).stop 2024-09-10T10:35:37.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.933+0000 7f111b14b640 1 -- 172.21.15.92:0/3069347276 shutdown_connections 2024-09-10T10:35:37.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.933+0000 7f111b14b640 1 --2- 172.21.15.92:0/3069347276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114108290 0x7f111410ec30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.933+0000 7f111b14b640 1 --2- 172.21.15.92:0/3069347276 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1114103740 0x7f1114107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.933+0000 7f111b14b640 1 --2- 172.21.15.92:0/3069347276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1114102d90 0x7f1114103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.933+0000 7f111b14b640 1 -- 172.21.15.92:0/3069347276 >> 172.21.15.92:0/3069347276 conn(0x7f11140fc7d0 msgr2=0x7f11140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:37.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 -- 172.21.15.92:0/3069347276 shutdown_connections 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 -- 172.21.15.92:0/3069347276 wait complete. 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 Processor -- start 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 -- start start 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1114102d90 0x7f11141986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114103740 0x7f1114198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1114108290 0x7f111419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1114112150 con 0x7f1114103740 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1114111fd0 con 0x7f1114102d90 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f111b14b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11141122d0 con 0x7f1114108290 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f1113fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114103740 0x7f1114198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:37.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f1113fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114103740 0x7f1114198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57486/0 (socket says 172.21.15.92:57486) 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.934+0000 7f1113fff640 1 -- 172.21.15.92:0/212104896 learned_addr learned my addr 172.21.15.92:0/212104896 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f11196e8640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1114108290 0x7f111419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1118ee7640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1114102d90 0x7f11141986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1113fff640 1 -- 172.21.15.92:0/212104896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1114108290 msgr2=0x7f111419cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1113fff640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1114108290 0x7f111419cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1113fff640 1 -- 172.21.15.92:0/212104896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1114102d90 msgr2=0x7f11141986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1113fff640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1114102d90 0x7f11141986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1113fff640 1 -- 172.21.15.92:0/212104896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111419d660 con 0x7f1114103740 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f11196e8640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1114108290 0x7f111419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1118ee7640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1114102d90 0x7f11141986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1113fff640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114103740 0x7f1114198bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f110400b9c0 tx=0x7f110400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1111ffb640 1 -- 172.21.15.92:0/212104896 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104019070 con 0x7f1114103740 2024-09-10T10:35:37.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1111ffb640 1 -- 172.21.15.92:0/212104896 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f110400cba0 con 0x7f1114103740 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111419d950 con 0x7f1114103740 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f1111ffb640 1 -- 172.21.15.92:0/212104896 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11040126b0 con 0x7f1114103740 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.935+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141a5230 con 0x7f1114103740 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.936+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11141031f0 con 0x7f1114103740 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.937+0000 7f1111ffb640 1 -- 172.21.15.92:0/212104896 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f110401c070 con 0x7f1114103740 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.938+0000 7f1111ffb640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f11000a2c10 0x7f11000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.938+0000 7f1111ffb640 1 -- 172.21.15.92:0/212104896 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f11040ce640 con 0x7f1114103740 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.938+0000 7f1118ee7640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f11000a2c10 0x7f11000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.939+0000 7f1118ee7640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f11000a2c10 0x7f11000a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f10fc006fd0 tx=0x7f10fc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:37.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:37.942+0000 7f1111ffb640 1 -- 172.21.15.92:0/212104896 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f110409b650 con 0x7f1114103740 2024-09-10T10:35:38.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.114+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f111410a2d0 con 0x7f1114103740 2024-09-10T10:35:38.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.115+0000 7f1111ffb640 1 -- 172.21.15.92:0/212104896 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f110409af50 con 0x7f1114103740 2024-09-10T10:35:38.116 INFO:teuthology.orchestra.run.smithi092.stdout:34359738446 2024-09-10T10:35:38.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f11000a2c10 msgr2=0x7f11000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:38.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f11000a2c10 0x7f11000a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f10fc006fd0 tx=0x7f10fc008040 comp rx=0 tx=0).stop 2024-09-10T10:35:38.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114103740 msgr2=0x7f1114198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:38.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114103740 0x7f1114198bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f110400b9c0 tx=0x7f110400be80 comp rx=0 tx=0).stop 2024-09-10T10:35:38.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 shutdown_connections 2024-09-10T10:35:38.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f11000a2c10 0x7f11000a50d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1114108290 0x7f111419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1114103740 0x7f1114198bf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 --2- 172.21.15.92:0/212104896 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1114102d90 0x7f11141986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 >> 172.21.15.92:0/212104896 conn(0x7f11140fc7d0 msgr2=0x7f1114105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:38.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 shutdown_connections 2024-09-10T10:35:38.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.117+0000 7f111b14b640 1 -- 172.21.15.92:0/212104896 wait complete. 2024-09-10T10:35:38.403 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:38 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/149226832' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T10:35:38.403 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:38 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/212104896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T10:35:38.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.402+0000 7fc5a25d4640 1 -- 172.21.15.92:0/1484832976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c102ef0 msgr2=0x7fc59c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:38.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.402+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/1484832976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c102ef0 0x7fc59c10da40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc594009ca0 tx=0x7fc59402a950 comp rx=0 tx=0).stop 2024-09-10T10:35:38.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.402+0000 7fc5a25d4640 1 -- 172.21.15.92:0/1484832976 shutdown_connections 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.402+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/1484832976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c102ef0 0x7fc59c10da40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.402+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/1484832976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc59c102570 0x7fc59c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.402+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/1484832976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc59c100e20 0x7fc59c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.402+0000 7fc5a25d4640 1 -- 172.21.15.92:0/1484832976 >> 172.21.15.92:0/1484832976 conn(0x7fc59c0fc7d0 msgr2=0x7fc59c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.402+0000 7fc5a25d4640 1 -- 172.21.15.92:0/1484832976 shutdown_connections 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.402+0000 7fc5a25d4640 1 -- 172.21.15.92:0/1484832976 wait complete. 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a25d4640 1 Processor -- start 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a25d4640 1 -- start start 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a25d4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c100e20 0x7fc59c1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a25d4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc59c102570 0x7fc59c197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a25d4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc59c102ef0 0x7fc59c197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:38.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a25d4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c110f80 con 0x7fc59c100e20 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a25d4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c110e00 con 0x7fc59c102570 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a25d4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c111100 con 0x7fc59c102ef0 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc59bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c100e20 0x7fc59c1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc59bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c100e20 0x7fc59c1970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57494/0 (socket says 172.21.15.92:57494) 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc59bfff640 1 -- 172.21.15.92:0/956502837 learned_addr learned my addr 172.21.15.92:0/956502837 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc593fff640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc59c102570 0x7fc59c197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a0b71640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc59c102ef0 0x7fc59c197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc59bfff640 1 -- 172.21.15.92:0/956502837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc59c102ef0 msgr2=0x7fc59c197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc59bfff640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc59c102ef0 0x7fc59c197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc59bfff640 1 -- 172.21.15.92:0/956502837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc59c102570 msgr2=0x7fc59c197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc59bfff640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc59c102570 0x7fc59c197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc59bfff640 1 -- 172.21.15.92:0/956502837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59c1a6950 con 0x7fc59c100e20 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc593fff640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc59c102570 0x7fc59c197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.403+0000 7fc5a0b71640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc59c102ef0 0x7fc59c197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.404+0000 7fc59bfff640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c100e20 0x7fc59c1970e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00d950 tx=0x7fc58c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.404+0000 7fc599ffb640 1 -- 172.21.15.92:0/956502837 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c017070 con 0x7fc59c100e20 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.404+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc59c1a6c40 con 0x7fc59c100e20 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.404+0000 7fc599ffb640 1 -- 172.21.15.92:0/956502837 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc58c009c30 con 0x7fc59c100e20 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.404+0000 7fc599ffb640 1 -- 172.21.15.92:0/956502837 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c00f6b0 con 0x7fc59c100e20 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.404+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc59c1a7180 con 0x7fc59c100e20 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.405+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc59c101200 con 0x7fc59c100e20 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.406+0000 7fc599ffb640 1 -- 172.21.15.92:0/956502837 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc58c0109d0 con 0x7fc59c100e20 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.407+0000 7fc599ffb640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc5880a2c10 0x7fc5880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:38.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.407+0000 7fc593fff640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc5880a2c10 0x7fc5880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:38.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.407+0000 7fc599ffb640 1 -- 172.21.15.92:0/956502837 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fc58c0ceda0 con 0x7fc59c100e20 2024-09-10T10:35:38.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.407+0000 7fc593fff640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc5880a2c10 0x7fc5880a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc584005fd0 tx=0x7fc584005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:38.456 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.410+0000 7fc599ffb640 1 -- 172.21.15.92:0/956502837 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc58c009de0 con 0x7fc59c100e20 2024-09-10T10:35:38.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:38 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/149226832' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T10:35:38.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:38 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/212104896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T10:35:38.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.579+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc59c1a73e0 con 0x7fc59c100e20 2024-09-10T10:35:38.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.579+0000 7fc599ffb640 1 -- 172.21.15.92:0/956502837 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc58c09bca0 con 0x7fc59c100e20 2024-09-10T10:35:38.581 INFO:teuthology.orchestra.run.smithi092.stdout:270582939682 2024-09-10T10:35:38.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.581+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc5880a2c10 msgr2=0x7fc5880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:38.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.581+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc5880a2c10 0x7fc5880a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc584005fd0 tx=0x7fc584005ea0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.581+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c100e20 msgr2=0x7fc59c1970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:38.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.581+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c100e20 0x7fc59c1970e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00d950 tx=0x7fc58c00de10 comp rx=0 tx=0).stop 2024-09-10T10:35:38.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.581+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 shutdown_connections 2024-09-10T10:35:38.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.581+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fc5880a2c10 0x7fc5880a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.581+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc59c102ef0 0x7fc59c197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.581+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc59c102570 0x7fc59c197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.581+0000 7fc5a25d4640 1 --2- 172.21.15.92:0/956502837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc59c100e20 0x7fc59c1970e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:38.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.582+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 >> 172.21.15.92:0/956502837 conn(0x7fc59c0fc7d0 msgr2=0x7fc59c106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:38.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.582+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 shutdown_connections 2024-09-10T10:35:38.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:38.582+0000 7fc5a25d4640 1 -- 172.21.15.92:0/956502837 wait complete. 2024-09-10T10:35:38.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:38 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/149226832' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T10:35:38.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:38 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/212104896' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T10:35:39.057 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738446 for osd.0 2024-09-10T10:35:39.058 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:39.566 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:39 smithi092 ceph-mon[30834]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-10T10:35:39.566 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:39 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/956502837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T10:35:39.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:39 smithi097 ceph-mon[35213]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-10T10:35:39.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:39 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/956502837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T10:35:39.595 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547222 got 322122547223 for osd.11 2024-09-10T10:35:39.595 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:39.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:39 smithi121 ceph-mon[35231]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-10T10:35:39.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:39 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/956502837' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T10:35:40.220 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986233 got 133143986235 for osd.4 2024-09-10T10:35:40.220 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:40.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.374+0000 7fd6008f1640 1 -- 172.21.15.92:0/2692236512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 msgr2=0x7fd5fc100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:40.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.374+0000 7fd6008f1640 1 --2- 172.21.15.92:0/2692236512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 0x7fd5fc100860 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009900 tx=0x7fd5ec02a410 comp rx=0 tx=0).stop 2024-09-10T10:35:40.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.374+0000 7fd6008f1640 1 -- 172.21.15.92:0/2692236512 shutdown_connections 2024-09-10T10:35:40.406 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.374+0000 7fd6008f1640 1 --2- 172.21.15.92:0/2692236512 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5fc1055b0 0x7fd5fc10d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.374+0000 7fd6008f1640 1 --2- 172.21.15.92:0/2692236512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5fc100e30 0x7fd5fc104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.374+0000 7fd6008f1640 1 --2- 172.21.15.92:0/2692236512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 0x7fd5fc100860 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.374+0000 7fd6008f1640 1 -- 172.21.15.92:0/2692236512 >> 172.21.15.92:0/2692236512 conn(0x7fd5fc077210 msgr2=0x7fd5fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.374+0000 7fd6008f1640 1 -- 172.21.15.92:0/2692236512 shutdown_connections 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.374+0000 7fd6008f1640 1 -- 172.21.15.92:0/2692236512 wait complete. 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd6008f1640 1 Processor -- start 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd6008f1640 1 -- start start 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd6008f1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 0x7fd5fc198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd6008f1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5fc100e30 0x7fd5fc1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd6008f1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5fc1055b0 0x7fd5fc19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd6008f1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc110630 con 0x7fd5fc100480 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd6008f1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1104b0 con 0x7fd5fc1055b0 2024-09-10T10:35:40.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd6008f1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1107b0 con 0x7fd5fc100e30 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fa59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 0x7fd5fc198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fa59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 0x7fd5fc198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57512/0 (socket says 172.21.15.92:57512) 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fa59c640 1 -- 172.21.15.92:0/3834880063 learned_addr learned my addr 172.21.15.92:0/3834880063 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fad9d640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5fc1055b0 0x7fd5fc19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fa59c640 1 -- 172.21.15.92:0/3834880063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5fc100e30 msgr2=0x7fd5fc1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fa59c640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5fc100e30 0x7fd5fc1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fa59c640 1 -- 172.21.15.92:0/3834880063 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5fc1055b0 msgr2=0x7fd5fc19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fa59c640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5fc1055b0 0x7fd5fc19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fa59c640 1 -- 172.21.15.92:0/3834880063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc19d430 con 0x7fd5fc100480 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fad9d640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5fc1055b0 0x7fd5fc19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.375+0000 7fd5fa59c640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 0x7fd5fc198480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec005ab0 tx=0x7fd5ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.376+0000 7fd5f37fe640 1 -- 172.21.15.92:0/3834880063 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec03f030 con 0x7fd5fc100480 2024-09-10T10:35:40.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.376+0000 7fd5f37fe640 1 -- 172.21.15.92:0/3834880063 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5ec003ce0 con 0x7fd5fc100480 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.376+0000 7fd5f37fe640 1 -- 172.21.15.92:0/3834880063 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec035070 con 0x7fd5fc100480 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.376+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5fc19d6c0 con 0x7fd5fc100480 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.376+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5fc1a5000 con 0x7fd5fc100480 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.377+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5fc101960 con 0x7fd5fc100480 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.378+0000 7fd5f37fe640 1 -- 172.21.15.92:0/3834880063 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd5ec042030 con 0x7fd5fc100480 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.378+0000 7fd5f37fe640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd5e80a2c10 0x7fd5e80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.379+0000 7fd5f9d9b640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd5e80a2c10 0x7fd5e80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.379+0000 7fd5f37fe640 1 -- 172.21.15.92:0/3834880063 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fd5ec0efaf0 con 0x7fd5fc100480 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.379+0000 7fd5f9d9b640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd5e80a2c10 0x7fd5e80a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc102e90 tx=0x7fd5e4005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:40.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.383+0000 7fd5f37fe640 1 -- 172.21.15.92:0/3834880063 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5ec0bc970 con 0x7fd5fc100480 2024-09-10T10:35:40.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.552+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd5fc1a51d0 con 0x7fd5fc100480 2024-09-10T10:35:40.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.552+0000 7fd5f37fe640 1 -- 172.21.15.92:0/3834880063 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd5ec0bc270 con 0x7fd5fc100480 2024-09-10T10:35:40.554 INFO:teuthology.orchestra.run.smithi092.stdout:55834574923 2024-09-10T10:35:40.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd5e80a2c10 msgr2=0x7fd5e80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd5e80a2c10 0x7fd5e80a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc102e90 tx=0x7fd5e4005c70 comp rx=0 tx=0).stop 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 msgr2=0x7fd5fc198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 0x7fd5fc198480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec005ab0 tx=0x7fd5ec0042f0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 shutdown_connections 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd5e80a2c10 0x7fd5e80a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd5fc1055b0 0x7fd5fc19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5fc100e30 0x7fd5fc1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 --2- 172.21.15.92:0/3834880063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5fc100480 0x7fd5fc198480 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 >> 172.21.15.92:0/3834880063 conn(0x7fd5fc077210 msgr2=0x7fd5fc103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 shutdown_connections 2024-09-10T10:35:40.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:40.554+0000 7fd6008f1640 1 -- 172.21.15.92:0/3834880063 wait complete. 2024-09-10T10:35:40.654 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:40.657 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:41.110 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168613 got 240518168614 for osd.8 2024-09-10T10:35:41.111 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:41.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:41 smithi092 ceph-mon[30834]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:35:41.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:41 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3834880063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T10:35:41.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:41 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:35:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:41 smithi097 ceph-mon[35213]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:35:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:41 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3834880063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T10:35:41.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:41 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:35:41.595 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:41 smithi121 ceph-mon[35231]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T10:35:41.595 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:41 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3834880063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T10:35:41.595 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:41 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:35:42.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.271+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2840415048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4106a80 msgr2=0x7f47b4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:42.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.271+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2840415048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4106a80 0x7f47b4106e60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009930 tx=0x7f47b002a420 comp rx=0 tx=0).stop 2024-09-10T10:35:42.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.271+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2840415048 shutdown_connections 2024-09-10T10:35:42.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.271+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2840415048 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b4101420 0x7f47b410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.271+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2840415048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b4100a80 0x7f47b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.271+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2840415048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4106a80 0x7f47b4106e60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.271+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2840415048 >> 172.21.15.92:0/2840415048 conn(0x7f47b40fc7a0 msgr2=0x7f47b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.271+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2840415048 shutdown_connections 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.271+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2840415048 wait complete. 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47bc1ba640 1 Processor -- start 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47bc1ba640 1 -- start start 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47bc1ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b4100a80 0x7f47b41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47bc1ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4101420 0x7f47b4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47bc1ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b4106a80 0x7f47b419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:42.286 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47bc1ba640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4110e80 con 0x7f47b4101420 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47bc1ba640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4110d00 con 0x7f47b4100a80 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47bc1ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4111000 con 0x7f47b4106a80 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9755640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4101420 0x7f47b4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9755640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4101420 0x7f47b4198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57532/0 (socket says 172.21.15.92:57532) 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9f56640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b4100a80 0x7f47b41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9755640 1 -- 172.21.15.92:0/2576985166 learned_addr learned my addr 172.21.15.92:0/2576985166 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47ba757640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b4106a80 0x7f47b419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9755640 1 -- 172.21.15.92:0/2576985166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b4106a80 msgr2=0x7f47b419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9755640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b4106a80 0x7f47b419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9755640 1 -- 172.21.15.92:0/2576985166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b4100a80 msgr2=0x7f47b41984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9755640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b4100a80 0x7f47b41984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.287 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9755640 1 -- 172.21.15.92:0/2576985166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b419d470 con 0x7f47b4101420 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.272+0000 7f47b9f56640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b4100a80 0x7f47b41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.273+0000 7f47b9755640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4101420 0x7f47b4198a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f47a400e9f0 tx=0x7f47a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.273+0000 7f47aaffd640 1 -- 172.21.15.92:0/2576985166 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a400cd80 con 0x7f47b4101420 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.273+0000 7f47aaffd640 1 -- 172.21.15.92:0/2576985166 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47a4005500 con 0x7f47b4101420 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.273+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b419d760 con 0x7f47b4101420 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.273+0000 7f47aaffd640 1 -- 172.21.15.92:0/2576985166 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a4010690 con 0x7f47b4101420 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.273+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b41a5040 con 0x7f47b4101420 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.274+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b4100ee0 con 0x7f47b4101420 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.275+0000 7f47aaffd640 1 -- 172.21.15.92:0/2576985166 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f47a40046c0 con 0x7f47b4101420 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.276+0000 7f47aaffd640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f47a00a2c10 0x7f47a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.276+0000 7f47b9f56640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f47a00a2c10 0x7f47a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.276+0000 7f47aaffd640 1 -- 172.21.15.92:0/2576985166 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f47a40cf5b0 con 0x7f47b4101420 2024-09-10T10:35:42.288 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.276+0000 7f47b9f56640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f47a00a2c10 0x7f47a00a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009900 tx=0x7f47b00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:42.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.280+0000 7f47aaffd640 1 -- 172.21.15.92:0/2576985166 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47a409c3b0 con 0x7f47b4101420 2024-09-10T10:35:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.459+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f47b402d7c0 con 0x7f47b4101420 2024-09-10T10:35:42.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.460+0000 7f47aaffd640 1 -- 172.21.15.92:0/2576985166 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47a409bcb0 con 0x7f47b4101420 2024-09-10T10:35:42.461 INFO:teuthology.orchestra.run.smithi092.stdout:77309411397 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f47a00a2c10 msgr2=0x7f47a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f47a00a2c10 0x7f47a00a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009900 tx=0x7f47b00058d0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4101420 msgr2=0x7f47b4198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4101420 0x7f47b4198a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f47a400e9f0 tx=0x7f47a400edf0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 shutdown_connections 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f47a00a2c10 0x7f47a00a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b4106a80 0x7f47b419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b4101420 0x7f47b4198a00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 --2- 172.21.15.92:0/2576985166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47b4100a80 0x7f47b41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:42.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 >> 172.21.15.92:0/2576985166 conn(0x7f47b40fc7a0 msgr2=0x7f47b406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:42.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 shutdown_connections 2024-09-10T10:35:42.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.462+0000 7f47bc1ba640 1 -- 172.21.15.92:0/2576985166 wait complete. 2024-09-10T10:35:42.637 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:42.638 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:43.119 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939681 got 270582939682 for osd.9 2024-09-10T10:35:43.120 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:43.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:43 smithi092 ceph-mon[30834]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 9 op/s 2024-09-10T10:35:43.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:43 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:43 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:43 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:43 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:43 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2576985166' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T10:35:43.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:43 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1985235691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T10:35:43.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 -- 172.21.15.92:0/672925094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 msgr2=0x7fb2e010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/672925094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 0x7fb2e010eaa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009ca0 tx=0x7fb2d802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 -- 172.21.15.92:0/672925094 shutdown_connections 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/672925094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 0x7fb2e010eaa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/672925094 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e01027a0 0x7fb2e01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/672925094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e0101df0 0x7fb2e01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 -- 172.21.15.92:0/672925094 >> 172.21.15.92:0/672925094 conn(0x7fb2e00fd8f0 msgr2=0x7fb2e00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 -- 172.21.15.92:0/672925094 shutdown_connections 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 -- 172.21.15.92:0/672925094 wait complete. 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.476+0000 7fb2e4a75640 1 Processor -- start 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2e4a75640 1 -- start start 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2e4a75640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e0101df0 0x7fb2e01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:43.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2e4a75640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e01027a0 0x7fb2e0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2e4a75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 0x7fb2e019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2e4a75640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0111fc0 con 0x7fb2e0106f20 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2e4a75640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0111e40 con 0x7fb2e0101df0 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2e4a75640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0112140 con 0x7fb2e01027a0 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ded9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 0x7fb2e019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ded9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 0x7fb2e019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52926/0 (socket says 172.21.15.92:52926) 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ded9d640 1 -- 172.21.15.92:0/4195715711 learned_addr learned my addr 172.21.15.92:0/4195715711 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ddd9b640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e01027a0 0x7fb2e0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ded9d640 1 -- 172.21.15.92:0/4195715711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e01027a0 msgr2=0x7fb2e0198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ded9d640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e01027a0 0x7fb2e0198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ded9d640 1 -- 172.21.15.92:0/4195715711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e0101df0 msgr2=0x7fb2e01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2de59c640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e0101df0 0x7fb2e01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:43.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ded9d640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e0101df0 0x7fb2e01984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ded9d640 1 -- 172.21.15.92:0/4195715711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e019d470 con 0x7fb2e0106f20 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ddd9b640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e01027a0 0x7fb2e0198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2ded9d640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 0x7fb2e019cd90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8031a20 tx=0x7fb2d8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.477+0000 7fb2cf7fe640 1 -- 172.21.15.92:0/4195715711 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8003c30 con 0x7fb2e0106f20 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.478+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e019d700 con 0x7fb2e0106f20 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.478+0000 7fb2cf7fe640 1 -- 172.21.15.92:0/4195715711 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2d8003dd0 con 0x7fb2e0106f20 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.478+0000 7fb2cf7fe640 1 -- 172.21.15.92:0/4195715711 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d802fcf0 con 0x7fb2e0106f20 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.478+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e01a5040 con 0x7fb2e0106f20 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.478+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e01021d0 con 0x7fb2e0106f20 2024-09-10T10:35:43.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.480+0000 7fb2cf7fe640 1 -- 172.21.15.92:0/4195715711 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb2d8004050 con 0x7fb2e0106f20 2024-09-10T10:35:43.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.480+0000 7fb2cf7fe640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb2c80a2c10 0x7fb2c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:43.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.480+0000 7fb2de59c640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb2c80a2c10 0x7fb2c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:43.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.480+0000 7fb2cf7fe640 1 -- 172.21.15.92:0/4195715711 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fb2d80f0570 con 0x7fb2e0106f20 2024-09-10T10:35:43.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.481+0000 7fb2de59c640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb2c80a2c10 0x7fb2c80a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4005fd0 tx=0x7fb2d4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:43.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.483+0000 7fb2cf7fe640 1 -- 172.21.15.92:0/4195715711 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2d80bd610 con 0x7fb2e0106f20 2024-09-10T10:35:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:43 smithi121 ceph-mon[35231]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 9 op/s 2024-09-10T10:35:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:43 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:43 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:43 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:43 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:43 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2576985166' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T10:35:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:43 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1985235691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T10:35:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:43 smithi097 ceph-mon[35213]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 9 op/s 2024-09-10T10:35:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:43 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:43 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:43 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:43 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:43 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2576985166' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T10:35:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:43 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1985235691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T10:35:43.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.655+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb2e010a160 con 0x7fb2e0106f20 2024-09-10T10:35:43.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.656+0000 7fb2cf7fe640 1 -- 172.21.15.92:0/4195715711 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb2d802fe90 con 0x7fb2e0106f20 2024-09-10T10:35:43.656 INFO:teuthology.orchestra.run.smithi092.stdout:103079215169 2024-09-10T10:35:43.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb2c80a2c10 msgr2=0x7fb2c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb2c80a2c10 0x7fb2c80a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4005fd0 tx=0x7fb2d4005850 comp rx=0 tx=0).stop 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 msgr2=0x7fb2e019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 0x7fb2e019cd90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8031a20 tx=0x7fb2d8031a50 comp rx=0 tx=0).stop 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 shutdown_connections 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fb2c80a2c10 0x7fb2c80a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2e0106f20 0x7fb2e019cd90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e01027a0 0x7fb2e0198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 --2- 172.21.15.92:0/4195715711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb2e0101df0 0x7fb2e01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 >> 172.21.15.92:0/4195715711 conn(0x7fb2e00fd8f0 msgr2=0x7fb2e00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 shutdown_connections 2024-09-10T10:35:43.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:43.658+0000 7fb2e4a75640 1 -- 172.21.15.92:0/4195715711 wait complete. 2024-09-10T10:35:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:44 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/4195715711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T10:35:44.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:44 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/4195715711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T10:35:44.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:44 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/4195715711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T10:35:44.615 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411393 got 77309411397 for osd.2 2024-09-10T10:35:44.615 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:44.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.785+0000 7faa711e7640 1 -- 172.21.15.92:0/1598737052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c1036c0 msgr2=0x7faa6c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.785+0000 7faa711e7640 1 --2- 172.21.15.92:0/1598737052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c1036c0 0x7faa6c10bbb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faa60009900 tx=0x7faa6002a480 comp rx=0 tx=0).stop 2024-09-10T10:35:44.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.785+0000 7faa711e7640 1 -- 172.21.15.92:0/1598737052 shutdown_connections 2024-09-10T10:35:44.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.785+0000 7faa711e7640 1 --2- 172.21.15.92:0/1598737052 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa6c10c180 0x7faa6c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.785+0000 7faa711e7640 1 --2- 172.21.15.92:0/1598737052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c1036c0 0x7faa6c10bbb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.785+0000 7faa711e7640 1 --2- 172.21.15.92:0/1598737052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa6c102da0 0x7faa6c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.785+0000 7faa711e7640 1 -- 172.21.15.92:0/1598737052 >> 172.21.15.92:0/1598737052 conn(0x7faa6c0fc7a0 msgr2=0x7faa6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:44.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.785+0000 7faa711e7640 1 -- 172.21.15.92:0/1598737052 shutdown_connections 2024-09-10T10:35:44.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.786+0000 7faa711e7640 1 -- 172.21.15.92:0/1598737052 wait complete. 2024-09-10T10:35:44.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.786+0000 7faa711e7640 1 Processor -- start 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa711e7640 1 -- start start 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa711e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c102da0 0x7faa6c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa711e7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa6c1036c0 0x7faa6c198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa711e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa6c10c180 0x7faa6c19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa711e7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c112020 con 0x7faa6c102da0 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa711e7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c111ea0 con 0x7faa6c1036c0 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa711e7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c1121a0 con 0x7faa6c10c180 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c102da0 0x7faa6c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c102da0 0x7faa6c1985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52940/0 (socket says 172.21.15.92:52940) 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6ad9d640 1 -- 172.21.15.92:0/3753727672 learned_addr learned my addr 172.21.15.92:0/3753727672 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6a59c640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa6c1036c0 0x7faa6c198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:44.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6b59e640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa6c10c180 0x7faa6c19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6ad9d640 1 -- 172.21.15.92:0/3753727672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa6c10c180 msgr2=0x7faa6c19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6ad9d640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa6c10c180 0x7faa6c19ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6ad9d640 1 -- 172.21.15.92:0/3753727672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa6c1036c0 msgr2=0x7faa6c198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6ad9d640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa6c1036c0 0x7faa6c198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6ad9d640 1 -- 172.21.15.92:0/3753727672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c19d590 con 0x7faa6c102da0 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.787+0000 7faa6a59c640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa6c1036c0 0x7faa6c198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.788+0000 7faa6ad9d640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c102da0 0x7faa6c1985e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00b4a0 tx=0x7faa5c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.788+0000 7faa53fff640 1 -- 172.21.15.92:0/3753727672 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c014070 con 0x7faa6c102da0 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.788+0000 7faa53fff640 1 -- 172.21.15.92:0/3753727672 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa5c010af0 con 0x7faa6c102da0 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.788+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c19d880 con 0x7faa6c102da0 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.788+0000 7faa53fff640 1 -- 172.21.15.92:0/3753727672 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c017d10 con 0x7faa6c102da0 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.788+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c1a5160 con 0x7faa6c102da0 2024-09-10T10:35:44.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.789+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6c103200 con 0x7faa6c102da0 2024-09-10T10:35:44.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.791+0000 7faa53fff640 1 -- 172.21.15.92:0/3753727672 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faa5c017070 con 0x7faa6c102da0 2024-09-10T10:35:44.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.791+0000 7faa53fff640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faa540a2c10 0x7faa540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:44.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.791+0000 7faa6a59c640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faa540a2c10 0x7faa540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:44.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.791+0000 7faa53fff640 1 -- 172.21.15.92:0/3753727672 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7faa5c0ce850 con 0x7faa6c102da0 2024-09-10T10:35:44.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.792+0000 7faa6a59c640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faa540a2c10 0x7faa540a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0feee0 tx=0x7faa60005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:44.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.795+0000 7faa53fff640 1 -- 172.21.15.92:0/3753727672 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa5c09b860 con 0x7faa6c102da0 2024-09-10T10:35:44.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.508+0000 7f51bbef7640 1 -- 172.21.15.92:0/4158839337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 msgr2=0x7f51b410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.508+0000 7f51bbef7640 1 --2- 172.21.15.92:0/4158839337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 0x7f51b410da40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009ca0 tx=0x7f51ac02a950 comp rx=0 tx=0).stop 2024-09-10T10:35:44.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.508+0000 7f51bbef7640 1 -- 172.21.15.92:0/4158839337 shutdown_connections 2024-09-10T10:35:44.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.508+0000 7f51bbef7640 1 --2- 172.21.15.92:0/4158839337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 0x7f51b410da40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.508+0000 7f51bbef7640 1 --2- 172.21.15.92:0/4158839337 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51b4102570 0x7f51b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.508+0000 7f51bbef7640 1 --2- 172.21.15.92:0/4158839337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b4100e20 0x7f51b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.964 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.508+0000 7f51bbef7640 1 -- 172.21.15.92:0/4158839337 >> 172.21.15.92:0/4158839337 conn(0x7f51b40fc7d0 msgr2=0x7f51b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.508+0000 7f51bbef7640 1 -- 172.21.15.92:0/4158839337 shutdown_connections 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.508+0000 7f51bbef7640 1 -- 172.21.15.92:0/4158839337 wait complete. 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51bbef7640 1 Processor -- start 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51bbef7640 1 -- start start 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51bbef7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b4100e20 0x7f51b41993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51bbef7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51b4102570 0x7f51b41998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51bbef7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 0x7f51b4199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51bbef7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51b4110f80 con 0x7f51b4102ef0 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51bbef7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f51b4110e00 con 0x7f51b4102570 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51bbef7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f51b4111100 con 0x7f51b4100e20 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51ba494640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 0x7f51b4199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51ba494640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 0x7f51b4199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52906/0 (socket says 172.21.15.92:52906) 2024-09-10T10:35:44.965 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51ba494640 1 -- 172.21.15.92:0/1985235691 learned_addr learned my addr 172.21.15.92:0/1985235691 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51b9c93640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b4100e20 0x7f51b41993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.509+0000 7f51b9492640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51b4102570 0x7f51b41998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51ba494640 1 -- 172.21.15.92:0/1985235691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b4100e20 msgr2=0x7f51b41993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51ba494640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b4100e20 0x7f51b41993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51ba494640 1 -- 172.21.15.92:0/1985235691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51b4102570 msgr2=0x7f51b41998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51ba494640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51b4102570 0x7f51b41998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51ba494640 1 -- 172.21.15.92:0/1985235691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b41a47b0 con 0x7f51b4102ef0 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51b9492640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51b4102570 0x7f51b41998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51ba494640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 0x7f51b4199e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f51ac02ae70 tx=0x7f51ac02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51aaffd640 1 -- 172.21.15.92:0/1985235691 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac034040 con 0x7f51b4102ef0 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51aaffd640 1 -- 172.21.15.92:0/1985235691 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51ac030920 con 0x7f51b4102ef0 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b41a4a40 con 0x7f51b4102ef0 2024-09-10T10:35:44.966 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51aaffd640 1 -- 172.21.15.92:0/1985235691 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac045480 con 0x7f51b4102ef0 2024-09-10T10:35:44.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.510+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b41a4f70 con 0x7f51b4102ef0 2024-09-10T10:35:44.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.511+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b4101200 con 0x7f51b4102ef0 2024-09-10T10:35:44.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.512+0000 7f51aaffd640 1 -- 172.21.15.92:0/1985235691 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f51ac037020 con 0x7f51b4102ef0 2024-09-10T10:35:44.967 INFO:teuthology.orchestra.run.smithi092.stdout:188978561074 2024-09-10T10:35:44.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.513+0000 7f51aaffd640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f51a00a2c90 0x7f51a00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:44.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.513+0000 7f51b9c93640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f51a00a2c90 0x7f51a00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:44.967 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.513+0000 7f51aaffd640 1 -- 172.21.15.92:0/1985235691 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f51ac0effb0 con 0x7f51b4102ef0 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.513+0000 7f51b9c93640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f51a00a2c90 0x7f51a00a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51b000bbe0 tx=0x7f51b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.516+0000 7f51aaffd640 1 -- 172.21.15.92:0/1985235691 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51ac0811b0 con 0x7f51b4102ef0 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.702+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f51b4109090 con 0x7f51b4102ef0 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.702+0000 7f51aaffd640 1 -- 172.21.15.92:0/1985235691 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f51ac0bcfc0 con 0x7f51b4102ef0 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.704+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f51a00a2c90 msgr2=0x7f51a00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.704+0000 7f51bbef7640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f51a00a2c90 0x7f51a00a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51b000bbe0 tx=0x7f51b000b390 comp rx=0 tx=0).stop 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.704+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 msgr2=0x7f51b4199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.704+0000 7f51bbef7640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 0x7f51b4199e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f51ac02ae70 tx=0x7f51ac02f5d0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.705+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 shutdown_connections 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.705+0000 7f51bbef7640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f51a00a2c90 0x7f51a00a5150 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.705+0000 7f51bbef7640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51b4102ef0 0x7f51b4199e70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.705+0000 7f51bbef7640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f51b4102570 0x7f51b41998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.968 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.705+0000 7f51bbef7640 1 --2- 172.21.15.92:0/1985235691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51b4100e20 0x7f51b41993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.705+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 >> 172.21.15.92:0/1985235691 conn(0x7f51b40fc7d0 msgr2=0x7f51b41068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:44.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.705+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 shutdown_connections 2024-09-10T10:35:44.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:42.705+0000 7f51bbef7640 1 -- 172.21.15.92:0/1985235691 wait complete. 2024-09-10T10:35:44.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.963+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7faa6c107220 con 0x7faa6c102da0 2024-09-10T10:35:44.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.964+0000 7faa53fff640 1 -- 172.21.15.92:0/3753727672 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faa5c09b160 con 0x7faa6c102da0 2024-09-10T10:35:44.969 INFO:teuthology.orchestra.run.smithi092.stdout:210453397550 2024-09-10T10:35:44.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faa540a2c10 msgr2=0x7faa540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faa540a2c10 0x7faa540a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0feee0 tx=0x7faa60005a20 comp rx=0 tx=0).stop 2024-09-10T10:35:44.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c102da0 msgr2=0x7faa6c1985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:44.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c102da0 0x7faa6c1985e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00b4a0 tx=0x7faa5c00b960 comp rx=0 tx=0).stop 2024-09-10T10:35:44.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 shutdown_connections 2024-09-10T10:35:44.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7faa540a2c10 0x7faa540a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa6c10c180 0x7faa6c19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.970 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa6c1036c0 0x7faa6c198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 --2- 172.21.15.92:0/3753727672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa6c102da0 0x7faa6c1985e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:44.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 >> 172.21.15.92:0/3753727672 conn(0x7faa6c0fc7a0 msgr2=0x7faa6c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:44.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 shutdown_connections 2024-09-10T10:35:44.971 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:44.966+0000 7faa711e7640 1 -- 172.21.15.92:0/3753727672 wait complete. 2024-09-10T10:35:45.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:45 smithi121 ceph-mon[35231]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-10T10:35:45.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:45 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3753727672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T10:35:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:45 smithi097 ceph-mon[35213]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-10T10:35:45.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:45 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3753727672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T10:35:45.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:45 smithi092 ceph-mon[30834]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-10T10:35:45.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:45 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3753727672' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T10:35:45.762 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574923 for osd.1 2024-09-10T10:35:45.763 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:45.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.924+0000 7f9db3038640 1 -- 172.21.15.92:0/3408422569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 msgr2=0x7f9dac106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:45.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.924+0000 7f9db3038640 1 --2- 172.21.15.92:0/3408422569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 0x7f9dac106e60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009930 tx=0x7f9d9c02a420 comp rx=0 tx=0).stop 2024-09-10T10:35:45.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.924+0000 7f9db3038640 1 -- 172.21.15.92:0/3408422569 shutdown_connections 2024-09-10T10:35:45.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.924+0000 7f9db3038640 1 --2- 172.21.15.92:0/3408422569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dac101420 0x7f9dac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.924+0000 7f9db3038640 1 --2- 172.21.15.92:0/3408422569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dac100a80 0x7f9dac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.924+0000 7f9db3038640 1 --2- 172.21.15.92:0/3408422569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 0x7f9dac106e60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.924+0000 7f9db3038640 1 -- 172.21.15.92:0/3408422569 >> 172.21.15.92:0/3408422569 conn(0x7f9dac0fc7a0 msgr2=0x7f9dac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.924+0000 7f9db3038640 1 -- 172.21.15.92:0/3408422569 shutdown_connections 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.924+0000 7f9db3038640 1 -- 172.21.15.92:0/3408422569 wait complete. 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 Processor -- start 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 -- start start 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dac100a80 0x7f9dac199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dac101420 0x7f9dac199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 0x7f9dac1a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac110e80 con 0x7f9dac106a80 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac110d00 con 0x7f9dac101420 2024-09-10T10:35:45.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac111000 con 0x7f9dac100a80 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db15d5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 0x7f9dac1a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db15d5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 0x7f9dac1a42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52952/0 (socket says 172.21.15.92:52952) 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db15d5640 1 -- 172.21.15.92:0/2207420273 learned_addr learned my addr 172.21.15.92:0/2207420273 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9dabfff640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dac101420 0x7f9dac199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db0dd4640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dac100a80 0x7f9dac199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db15d5640 1 -- 172.21.15.92:0/2207420273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dac100a80 msgr2=0x7f9dac199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db15d5640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dac100a80 0x7f9dac199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db15d5640 1 -- 172.21.15.92:0/2207420273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dac101420 msgr2=0x7f9dac199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db15d5640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dac101420 0x7f9dac199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db15d5640 1 -- 172.21.15.92:0/2207420273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dac1a4810 con 0x7f9dac106a80 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9dabfff640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dac101420 0x7f9dac199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:45.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db15d5640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 0x7f9dac1a42d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9da400cce0 tx=0x7f9da400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9da9ffb640 1 -- 172.21.15.92:0/2207420273 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da400f450 con 0x7f9dac106a80 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9da9ffb640 1 -- 172.21.15.92:0/2207420273 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9da400fad0 con 0x7f9dac106a80 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9da9ffb640 1 -- 172.21.15.92:0/2207420273 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4018c10 con 0x7f9dac106a80 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dac1a49e0 con 0x7f9dac106a80 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.925+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dac1a4ea0 con 0x7f9dac106a80 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.926+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dac100ee0 con 0x7f9dac106a80 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.927+0000 7f9da9ffb640 1 -- 172.21.15.92:0/2207420273 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9da400f5f0 con 0x7f9dac106a80 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.928+0000 7f9da9ffb640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f9d940a2c10 0x7f9d940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.928+0000 7f9db0dd4640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f9d940a2c10 0x7f9d940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:45.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.928+0000 7f9da9ffb640 1 -- 172.21.15.92:0/2207420273 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f9da40cf7c0 con 0x7f9dac106a80 2024-09-10T10:35:45.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.928+0000 7f9db0dd4640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f9d940a2c10 0x7f9d940a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c000c00 tx=0x7f9d9c031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:45.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:45.932+0000 7f9da9ffb640 1 -- 172.21.15.92:0/2207420273 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9da4014030 con 0x7f9dac106a80 2024-09-10T10:35:46.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.104+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f9dac108ff0 con 0x7f9dac106a80 2024-09-10T10:35:46.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.104+0000 7f9da9ffb640 1 -- 172.21.15.92:0/2207420273 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9da409c6c0 con 0x7f9dac106a80 2024-09-10T10:35:46.106 INFO:teuthology.orchestra.run.smithi092.stdout:292057776158 2024-09-10T10:35:46.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f9d940a2c10 msgr2=0x7f9d940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:46.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f9d940a2c10 0x7f9d940a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c000c00 tx=0x7f9d9c031490 comp rx=0 tx=0).stop 2024-09-10T10:35:46.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 msgr2=0x7f9dac1a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:46.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 0x7f9dac1a42d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9da400cce0 tx=0x7f9da400a620 comp rx=0 tx=0).stop 2024-09-10T10:35:46.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 shutdown_connections 2024-09-10T10:35:46.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f9d940a2c10 0x7f9d940a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:46.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac106a80 0x7f9dac1a42d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:46.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9dac101420 0x7f9dac199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:46.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 --2- 172.21.15.92:0/2207420273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9dac100a80 0x7f9dac199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:46.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 >> 172.21.15.92:0/2207420273 conn(0x7f9dac0fc7a0 msgr2=0x7f9dac0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:46.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 shutdown_connections 2024-09-10T10:35:46.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:46.106+0000 7f9db3038640 1 -- 172.21.15.92:0/2207420273 wait complete. 2024-09-10T10:35:46.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:46 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2207420273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T10:35:46.440 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215166 got 103079215169 for osd.3 2024-09-10T10:35:46.441 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:46 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2207420273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T10:35:46.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:46 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2207420273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T10:35:47.126 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776156 got 292057776158 for osd.10 2024-09-10T10:35:47.127 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:47.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:47 smithi092 ceph-mon[30834]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-10T10:35:47.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:47 smithi121 ceph-mon[35231]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-10T10:35:47.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:47 smithi097 ceph-mon[35213]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-10T10:35:47.732 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561072 got 188978561074 for osd.6 2024-09-10T10:35:47.732 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:48.338 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397547 got 210453397550 for osd.7 2024-09-10T10:35:48.338 DEBUG:teuthology.parallel:result is None 2024-09-10T10:35:48.339 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T10:35:48.339 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:35:49.110 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:49.524 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:49 smithi092 ceph-mon[30834]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:35:49.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:49 smithi121 ceph-mon[35231]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:35:49.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:49 smithi097 ceph-mon[35213]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:35:49.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.604+0000 7f0101409640 1 -- 172.21.15.92:0/1991007438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 msgr2=0x7f00fc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.604+0000 7f0101409640 1 --2- 172.21.15.92:0/1991007438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 0x7f00fc10e610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009ca0 tx=0x7f00f402a950 comp rx=0 tx=0).stop 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.605+0000 7f0101409640 1 -- 172.21.15.92:0/1991007438 shutdown_connections 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.605+0000 7f0101409640 1 --2- 172.21.15.92:0/1991007438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 0x7f00fc10e610 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.605+0000 7f0101409640 1 --2- 172.21.15.92:0/1991007438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00fc103660 0x7f00fc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.605+0000 7f0101409640 1 --2- 172.21.15.92:0/1991007438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00fc102d40 0x7f00fc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.605+0000 7f0101409640 1 -- 172.21.15.92:0/1991007438 >> 172.21.15.92:0/1991007438 conn(0x7f00fc0fc7a0 msgr2=0x7f00fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.605+0000 7f0101409640 1 -- 172.21.15.92:0/1991007438 shutdown_connections 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.605+0000 7f0101409640 1 -- 172.21.15.92:0/1991007438 wait complete. 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.605+0000 7f0101409640 1 Processor -- start 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f0101409640 1 -- start start 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f0101409640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00fc102d40 0x7f00fc1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:49.633 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f0101409640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00fc103660 0x7f00fc198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f0101409640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 0x7f00fc19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f0101409640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc111fb0 con 0x7f00fc10c170 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f0101409640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc111e30 con 0x7f00fc102d40 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f0101409640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc112130 con 0x7f00fc103660 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00fb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 0x7f00fc19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00fb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 0x7f00fc19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52964/0 (socket says 172.21.15.92:52964) 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00fb7fe640 1 -- 172.21.15.92:0/3046919012 learned_addr learned my addr 172.21.15.92:0/3046919012 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00faffd640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00fc102d40 0x7f00fc1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00fa7fc640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00fc103660 0x7f00fc198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00fb7fe640 1 -- 172.21.15.92:0/3046919012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00fc103660 msgr2=0x7f00fc198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00fb7fe640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00fc103660 0x7f00fc198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00fb7fe640 1 -- 172.21.15.92:0/3046919012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00fc102d40 msgr2=0x7f00fc1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:49.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00fb7fe640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00fc102d40 0x7f00fc1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.606+0000 7f00fb7fe640 1 -- 172.21.15.92:0/3046919012 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc19d480 con 0x7f00fc10c170 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.607+0000 7f00fb7fe640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 0x7f00fc19cda0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f00f4006010 tx=0x7f00f402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.607+0000 7f00f3fff640 1 -- 172.21.15.92:0/3046919012 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4034040 con 0x7f00fc10c170 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.607+0000 7f00f3fff640 1 -- 172.21.15.92:0/3046919012 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00f4003e00 con 0x7f00fc10c170 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.607+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc19d710 con 0x7f00fc10c170 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.607+0000 7f00f3fff640 1 -- 172.21.15.92:0/3046919012 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40456e0 con 0x7f00fc10c170 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.607+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc1a5050 con 0x7f00fc10c170 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.608+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc06b070 con 0x7f00fc10c170 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.610+0000 7f00f3fff640 1 -- 172.21.15.92:0/3046919012 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f00f4037020 con 0x7f00fc10c170 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.610+0000 7f00f3fff640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f00e80a2c10 0x7f00e80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.611+0000 7f00f3fff640 1 -- 172.21.15.92:0/3046919012 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f00f40f0180 con 0x7f00fc10c170 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.611+0000 7f00faffd640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f00e80a2c10 0x7f00e80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:49.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.611+0000 7f00faffd640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f00e80a2c10 0x7f00e80a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0058c0 tx=0x7f00ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:49.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.614+0000 7f00f3fff640 1 -- 172.21.15.92:0/3046919012 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00f40bd190 con 0x7f00fc10c170 2024-09-10T10:35:49.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.820+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00fc107250 con 0x7f00e80a2c10 2024-09-10T10:35:49.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.827+0000 7f00f3fff640 1 -- 172.21.15.92:0/3046919012 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258969 (secure 0 0 0) 0x7f00ec00fb60 con 0x7f00e80a2c10 2024-09-10T10:35:49.831 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:49.832 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-10T10:35:49.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f00e80a2c10 msgr2=0x7f00e80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:49.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f00e80a2c10 0x7f00e80a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0058c0 tx=0x7f00ec00a2d0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 msgr2=0x7f00fc19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:49.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 0x7f00fc19cda0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f00f4006010 tx=0x7f00f402f710 comp rx=0 tx=0).stop 2024-09-10T10:35:49.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 shutdown_connections 2024-09-10T10:35:49.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f00e80a2c10 0x7f00e80a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00fc10c170 0x7f00fc19cda0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00fc103660 0x7f00fc198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 --2- 172.21.15.92:0/3046919012 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f00fc102d40 0x7f00fc1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:49.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 >> 172.21.15.92:0/3046919012 conn(0x7f00fc0fc7a0 msgr2=0x7f00fc0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:49.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 shutdown_connections 2024-09-10T10:35:49.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:49.831+0000 7f0101409640 1 -- 172.21.15.92:0/3046919012 wait complete. 2024-09-10T10:35:50.552 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-10T10:35:48.140580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659727,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":667,"num_read_kb":457,"num_write":429,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368816,"kb_used_data":11232,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573008,"statfs":{"total":1151940427776,"available":1151562760192,"internally_reserved":0,"allocated":11501568,"data_stored":7237821,"data_compressed":112305,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19140,"internal_metadata":365933884},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003106"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788050+0000","last_change":"2024-09-10T10:34:44.757989+0000","last_active":"2024-09-10T10:34:55.788050+0000","last_peered":"2024-09-10T10:34:55.788050+0000","last_clean":"2024-09-10T10:34:55.788050+0000","last_became_active":"2024-09-10T10:34:44.757638+0000","last_became_peered":"2024-09-10T10:34:44.757638+0000","last_unstale":"2024-09-10T10:34:55.788050+0000","last_undegraded":"2024-09-10T10:34:55.788050+0000","last_fullsized":"2024-09-10T10:34:55.788050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:41.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807821+0000","last_change":"2024-09-10T10:34:44.750218+0000","last_active":"2024-09-10T10:34:55.807821+0000","last_peered":"2024-09-10T10:34:55.807821+0000","last_clean":"2024-09-10T10:34:55.807821+0000","last_became_active":"2024-09-10T10:34:44.749807+0000","last_became_peered":"2024-09-10T10:34:44.749807+0000","last_unstale":"2024-09-10T10:34:55.807821+0000","last_undegraded":"2024-09-10T10:34:55.807821+0000","last_fullsized":"2024-09-10T10:34:55.807821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:17.123136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806919+0000","last_change":"2024-09-10T10:34:44.756169+0000","last_active":"2024-09-10T10:34:55.806919+0000","last_peered":"2024-09-10T10:34:55.806919+0000","last_clean":"2024-09-10T10:34:55.806919+0000","last_became_active":"2024-09-10T10:34:44.755845+0000","last_became_peered":"2024-09-10T10:34:44.755845+0000","last_unstale":"2024-09-10T10:34:55.806919+0000","last_undegraded":"2024-09-10T10:34:55.806919+0000","last_fullsized":"2024-09-10T10:34:55.806919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:11.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790302+0000","last_change":"2024-09-10T10:34:44.750153+0000","last_active":"2024-09-10T10:34:55.790302+0000","last_peered":"2024-09-10T10:34:55.790302+0000","last_clean":"2024-09-10T10:34:55.790302+0000","last_became_active":"2024-09-10T10:34:44.749830+0000","last_became_peered":"2024-09-10T10:34:44.749830+0000","last_unstale":"2024-09-10T10:34:55.790302+0000","last_undegraded":"2024-09-10T10:34:55.790302+0000","last_fullsized":"2024-09-10T10:34:55.790302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:30.799158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790670+0000","last_change":"2024-09-10T10:34:44.752766+0000","last_active":"2024-09-10T10:34:55.790670+0000","last_peered":"2024-09-10T10:34:55.790670+0000","last_clean":"2024-09-10T10:34:55.790670+0000","last_became_active":"2024-09-10T10:34:44.750892+0000","last_became_peered":"2024-09-10T10:34:44.750892+0000","last_unstale":"2024-09-10T10:34:55.790670+0000","last_undegraded":"2024-09-10T10:34:55.790670+0000","last_fullsized":"2024-09-10T10:34:55.790670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:20.139995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790850+0000","last_change":"2024-09-10T10:34:44.746378+0000","last_active":"2024-09-10T10:34:55.790850+0000","last_peered":"2024-09-10T10:34:55.790850+0000","last_clean":"2024-09-10T10:34:55.790850+0000","last_became_active":"2024-09-10T10:34:44.745996+0000","last_became_peered":"2024-09-10T10:34:44.745996+0000","last_unstale":"2024-09-10T10:34:55.790850+0000","last_undegraded":"2024-09-10T10:34:55.790850+0000","last_fullsized":"2024-09-10T10:34:55.790850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:14.444518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.805589+0000","last_change":"2024-09-10T10:34:44.756457+0000","last_active":"2024-09-10T10:34:55.805589+0000","last_peered":"2024-09-10T10:34:55.805589+0000","last_clean":"2024-09-10T10:34:55.805589+0000","last_became_active":"2024-09-10T10:34:44.756017+0000","last_became_peered":"2024-09-10T10:34:44.756017+0000","last_unstale":"2024-09-10T10:34:55.805589+0000","last_undegraded":"2024-09-10T10:34:55.805589+0000","last_fullsized":"2024-09-10T10:34:55.805589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:10.421223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790142+0000","last_change":"2024-09-10T10:34:44.735096+0000","last_active":"2024-09-10T10:34:55.790142+0000","last_peered":"2024-09-10T10:34:55.790142+0000","last_clean":"2024-09-10T10:34:55.790142+0000","last_became_active":"2024-09-10T10:34:44.734810+0000","last_became_peered":"2024-09-10T10:34:44.734810+0000","last_unstale":"2024-09-10T10:34:55.790142+0000","last_undegraded":"2024-09-10T10:34:55.790142+0000","last_fullsized":"2024-09-10T10:34:55.790142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:18.094135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788046+0000","last_change":"2024-09-10T10:34:44.760336+0000","last_active":"2024-09-10T10:34:55.788046+0000","last_peered":"2024-09-10T10:34:55.788046+0000","last_clean":"2024-09-10T10:34:55.788046+0000","last_became_active":"2024-09-10T10:34:44.759995+0000","last_became_peered":"2024-09-10T10:34:44.759995+0000","last_unstale":"2024-09-10T10:34:55.788046+0000","last_undegraded":"2024-09-10T10:34:55.788046+0000","last_fullsized":"2024-09-10T10:34:55.788046+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:56.471705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791244+0000","last_change":"2024-09-10T10:34:44.748238+0000","last_active":"2024-09-10T10:34:55.791244+0000","last_peered":"2024-09-10T10:34:55.791244+0000","last_clean":"2024-09-10T10:34:55.791244+0000","last_became_active":"2024-09-10T10:34:44.747876+0000","last_became_peered":"2024-09-10T10:34:44.747876+0000","last_unstale":"2024-09-10T10:34:55.791244+0000","last_undegraded":"2024-09-10T10:34:55.791244+0000","last_fullsized":"2024-09-10T10:34:55.791244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:30:01.721300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806892+0000","last_change":"2024-09-10T10:34:44.757513+0000","last_active":"2024-09-10T10:34:55.806892+0000","last_peered":"2024-09-10T10:34:55.806892+0000","last_clean":"2024-09-10T10:34:55.806892+0000","last_became_active":"2024-09-10T10:34:44.757207+0000","last_became_peered":"2024-09-10T10:34:44.757207+0000","last_unstale":"2024-09-10T10:34:55.806892+0000","last_undegraded":"2024-09-10T10:34:55.806892+0000","last_fullsized":"2024-09-10T10:34:55.806892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:07.351617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790432+0000","last_change":"2024-09-10T10:34:44.749394+0000","last_active":"2024-09-10T10:34:55.790432+0000","last_peered":"2024-09-10T10:34:55.790432+0000","last_clean":"2024-09-10T10:34:55.790432+0000","last_became_active":"2024-09-10T10:34:44.749029+0000","last_became_peered":"2024-09-10T10:34:44.749029+0000","last_unstale":"2024-09-10T10:34:55.790432+0000","last_undegraded":"2024-09-10T10:34:55.790432+0000","last_fullsized":"2024-09-10T10:34:55.790432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:46.772305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790387+0000","last_change":"2024-09-10T10:34:44.742056+0000","last_active":"2024-09-10T10:34:55.790387+0000","last_peered":"2024-09-10T10:34:55.790387+0000","last_clean":"2024-09-10T10:34:55.790387+0000","last_became_active":"2024-09-10T10:34:44.741716+0000","last_became_peered":"2024-09-10T10:34:44.741716+0000","last_unstale":"2024-09-10T10:34:55.790387+0000","last_undegraded":"2024-09-10T10:34:55.790387+0000","last_fullsized":"2024-09-10T10:34:55.790387+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:04.112050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806807+0000","last_change":"2024-09-10T10:34:44.747573+0000","last_active":"2024-09-10T10:34:55.806807+0000","last_peered":"2024-09-10T10:34:55.806807+0000","last_clean":"2024-09-10T10:34:55.806807+0000","last_became_active":"2024-09-10T10:34:44.747284+0000","last_became_peered":"2024-09-10T10:34:44.747284+0000","last_unstale":"2024-09-10T10:34:55.806807+0000","last_undegraded":"2024-09-10T10:34:55.806807+0000","last_fullsized":"2024-09-10T10:34:55.806807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:24.567112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806649+0000","last_change":"2024-09-10T10:34:44.745494+0000","last_active":"2024-09-10T10:34:55.806649+0000","last_peered":"2024-09-10T10:34:55.806649+0000","last_clean":"2024-09-10T10:34:55.806649+0000","last_became_active":"2024-09-10T10:34:44.744525+0000","last_became_peered":"2024-09-10T10:34:44.744525+0000","last_unstale":"2024-09-10T10:34:55.806649+0000","last_undegraded":"2024-09-10T10:34:55.806649+0000","last_fullsized":"2024-09-10T10:34:55.806649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:46.120579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787378+0000","last_change":"2024-09-10T10:34:44.755247+0000","last_active":"2024-09-10T10:34:55.787378+0000","last_peered":"2024-09-10T10:34:55.787378+0000","last_clean":"2024-09-10T10:34:55.787378+0000","last_became_active":"2024-09-10T10:34:44.754897+0000","last_became_peered":"2024-09-10T10:34:44.754897+0000","last_unstale":"2024-09-10T10:34:55.787378+0000","last_undegraded":"2024-09-10T10:34:55.787378+0000","last_fullsized":"2024-09-10T10:34:55.787378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:58.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788169+0000","last_change":"2024-09-10T10:34:44.758550+0000","last_active":"2024-09-10T10:34:55.788169+0000","last_peered":"2024-09-10T10:34:55.788169+0000","last_clean":"2024-09-10T10:34:55.788169+0000","last_became_active":"2024-09-10T10:34:44.757767+0000","last_became_peered":"2024-09-10T10:34:44.757767+0000","last_unstale":"2024-09-10T10:34:55.788169+0000","last_undegraded":"2024-09-10T10:34:55.788169+0000","last_fullsized":"2024-09-10T10:34:55.788169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.937733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787366+0000","last_change":"2024-09-10T10:34:44.748830+0000","last_active":"2024-09-10T10:34:55.787366+0000","last_peered":"2024-09-10T10:34:55.787366+0000","last_clean":"2024-09-10T10:34:55.787366+0000","last_became_active":"2024-09-10T10:34:44.748518+0000","last_became_peered":"2024-09-10T10:34:44.748518+0000","last_unstale":"2024-09-10T10:34:55.787366+0000","last_undegraded":"2024-09-10T10:34:55.787366+0000","last_fullsized":"2024-09-10T10:34:55.787366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:15.786806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786493+0000","last_change":"2024-09-10T10:34:44.752523+0000","last_active":"2024-09-10T10:34:55.786493+0000","last_peered":"2024-09-10T10:34:55.786493+0000","last_clean":"2024-09-10T10:34:55.786493+0000","last_became_active":"2024-09-10T10:34:44.752153+0000","last_became_peered":"2024-09-10T10:34:44.752153+0000","last_unstale":"2024-09-10T10:34:55.786493+0000","last_undegraded":"2024-09-10T10:34:55.786493+0000","last_fullsized":"2024-09-10T10:34:55.786493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:45.826111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787609+0000","last_change":"2024-09-10T10:34:44.750249+0000","last_active":"2024-09-10T10:34:55.787609+0000","last_peered":"2024-09-10T10:34:55.787609+0000","last_clean":"2024-09-10T10:34:55.787609+0000","last_became_active":"2024-09-10T10:34:44.749812+0000","last_became_peered":"2024-09-10T10:34:44.749812+0000","last_unstale":"2024-09-10T10:34:55.787609+0000","last_undegraded":"2024-09-10T10:34:55.787609+0000","last_fullsized":"2024-09-10T10:34:55.787609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:45.584744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790439+0000","last_change":"2024-09-10T10:34:44.747529+0000","last_active":"2024-09-10T10:34:55.790439+0000","last_peered":"2024-09-10T10:34:55.790439+0000","last_clean":"2024-09-10T10:34:55.790439+0000","last_became_active":"2024-09-10T10:34:44.747183+0000","last_became_peered":"2024-09-10T10:34:44.747183+0000","last_unstale":"2024-09-10T10:34:55.790439+0000","last_undegraded":"2024-09-10T10:34:55.790439+0000","last_fullsized":"2024-09-10T10:34:55.790439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:03.813289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787588+0000","last_change":"2024-09-10T10:34:44.755879+0000","last_active":"2024-09-10T10:34:55.787588+0000","last_peered":"2024-09-10T10:34:55.787588+0000","last_clean":"2024-09-10T10:34:55.787588+0000","last_became_active":"2024-09-10T10:34:44.755470+0000","last_became_peered":"2024-09-10T10:34:44.755470+0000","last_unstale":"2024-09-10T10:34:55.787588+0000","last_undegraded":"2024-09-10T10:34:55.787588+0000","last_fullsized":"2024-09-10T10:34:55.787588+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:01.424727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790858+0000","last_change":"2024-09-10T10:34:44.748049+0000","last_active":"2024-09-10T10:34:55.790858+0000","last_peered":"2024-09-10T10:34:55.790858+0000","last_clean":"2024-09-10T10:34:55.790858+0000","last_became_active":"2024-09-10T10:34:44.747708+0000","last_became_peered":"2024-09-10T10:34:44.747708+0000","last_unstale":"2024-09-10T10:34:55.790858+0000","last_undegraded":"2024-09-10T10:34:55.790858+0000","last_fullsized":"2024-09-10T10:34:55.790858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:20.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790796+0000","last_change":"2024-09-10T10:34:44.738305+0000","last_active":"2024-09-10T10:34:55.790796+0000","last_peered":"2024-09-10T10:34:55.790796+0000","last_clean":"2024-09-10T10:34:55.790796+0000","last_became_active":"2024-09-10T10:34:44.737625+0000","last_became_peered":"2024-09-10T10:34:44.737625+0000","last_unstale":"2024-09-10T10:34:55.790796+0000","last_undegraded":"2024-09-10T10:34:55.790796+0000","last_fullsized":"2024-09-10T10:34:55.790796+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:39.578131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791523+0000","last_change":"2024-09-10T10:34:44.748021+0000","last_active":"2024-09-10T10:34:55.791523+0000","last_peered":"2024-09-10T10:34:55.791523+0000","last_clean":"2024-09-10T10:34:55.791523+0000","last_became_active":"2024-09-10T10:34:44.747632+0000","last_became_peered":"2024-09-10T10:34:44.747632+0000","last_unstale":"2024-09-10T10:34:55.791523+0000","last_undegraded":"2024-09-10T10:34:55.791523+0000","last_fullsized":"2024-09-10T10:34:55.791523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:52.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786486+0000","last_change":"2024-09-10T10:34:44.746279+0000","last_active":"2024-09-10T10:34:55.786486+0000","last_peered":"2024-09-10T10:34:55.786486+0000","last_clean":"2024-09-10T10:34:55.786486+0000","last_became_active":"2024-09-10T10:34:44.745851+0000","last_became_peered":"2024-09-10T10:34:44.745851+0000","last_unstale":"2024-09-10T10:34:55.786486+0000","last_undegraded":"2024-09-10T10:34:55.786486+0000","last_fullsized":"2024-09-10T10:34:55.786486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:49.935780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787744+0000","last_change":"2024-09-10T10:34:44.749481+0000","last_active":"2024-09-10T10:34:55.787744+0000","last_peered":"2024-09-10T10:34:55.787744+0000","last_clean":"2024-09-10T10:34:55.787744+0000","last_became_active":"2024-09-10T10:34:44.749154+0000","last_became_peered":"2024-09-10T10:34:44.749154+0000","last_unstale":"2024-09-10T10:34:55.787744+0000","last_undegraded":"2024-09-10T10:34:55.787744+0000","last_fullsized":"2024-09-10T10:34:55.787744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:28:12.250198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808905+0000","last_change":"2024-09-10T10:34:55.808905+0000","last_active":"2024-09-10T10:34:55.808905+0000","last_peered":"2024-09-10T10:34:55.808905+0000","last_clean":"2024-09-10T10:34:55.808905+0000","last_became_active":"2024-09-10T10:34:55.808450+0000","last_became_peered":"2024-09-10T10:34:55.808450+0000","last_unstale":"2024-09-10T10:34:55.808905+0000","last_undegraded":"2024-09-10T10:34:55.808905+0000","last_fullsized":"2024-09-10T10:34:55.808905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:47.506359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807586+0000","last_change":"2024-09-10T10:34:44.753638+0000","last_active":"2024-09-10T10:34:55.807586+0000","last_peered":"2024-09-10T10:34:55.807586+0000","last_clean":"2024-09-10T10:34:55.807586+0000","last_became_active":"2024-09-10T10:34:44.752423+0000","last_became_peered":"2024-09-10T10:34:44.752423+0000","last_unstale":"2024-09-10T10:34:55.807586+0000","last_undegraded":"2024-09-10T10:34:55.807586+0000","last_fullsized":"2024-09-10T10:34:55.807586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:43.842713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.785975+0000","last_change":"2024-09-10T10:34:44.745530+0000","last_active":"2024-09-10T10:34:55.785975+0000","last_peered":"2024-09-10T10:34:55.785975+0000","last_clean":"2024-09-10T10:34:55.785975+0000","last_became_active":"2024-09-10T10:34:44.744856+0000","last_became_peered":"2024-09-10T10:34:44.744856+0000","last_unstale":"2024-09-10T10:34:55.785975+0000","last_undegraded":"2024-09-10T10:34:55.785975+0000","last_fullsized":"2024-09-10T10:34:55.785975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.496321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786069+0000","last_change":"2024-09-10T10:34:44.748888+0000","last_active":"2024-09-10T10:34:55.786069+0000","last_peered":"2024-09-10T10:34:55.786069+0000","last_clean":"2024-09-10T10:34:55.786069+0000","last_became_active":"2024-09-10T10:34:44.748402+0000","last_became_peered":"2024-09-10T10:34:44.748402+0000","last_unstale":"2024-09-10T10:34:55.786069+0000","last_undegraded":"2024-09-10T10:34:55.786069+0000","last_fullsized":"2024-09-10T10:34:55.786069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:33:11.491674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.789801+0000","last_change":"2024-09-10T10:34:55.789801+0000","last_active":"2024-09-10T10:34:55.789801+0000","last_peered":"2024-09-10T10:34:55.789801+0000","last_clean":"2024-09-10T10:34:55.789801+0000","last_became_active":"2024-09-10T10:34:55.789449+0000","last_became_peered":"2024-09-10T10:34:55.789449+0000","last_unstale":"2024-09-10T10:34:55.789801+0000","last_undegraded":"2024-09-10T10:34:55.789801+0000","last_fullsized":"2024-09-10T10:34:55.789801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:24.784027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790662+0000","last_change":"2024-09-10T10:34:44.753011+0000","last_active":"2024-09-10T10:34:55.790662+0000","last_peered":"2024-09-10T10:34:55.790662+0000","last_clean":"2024-09-10T10:34:55.790662+0000","last_became_active":"2024-09-10T10:34:44.752667+0000","last_became_peered":"2024-09-10T10:34:44.752667+0000","last_unstale":"2024-09-10T10:34:55.790662+0000","last_undegraded":"2024-09-10T10:34:55.790662+0000","last_fullsized":"2024-09-10T10:34:55.790662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:44.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:44.877934+0000","last_change":"2024-09-10T10:34:42.728468+0000","last_active":"2024-09-10T10:35:44.877934+0000","last_peered":"2024-09-10T10:35:44.877934+0000","last_clean":"2024-09-10T10:35:44.877934+0000","last_became_active":"2024-09-10T10:34:42.727707+0000","last_became_peered":"2024-09-10T10:34:42.727707+0000","last_unstale":"2024-09-10T10:35:44.877934+0000","last_undegraded":"2024-09-10T10:35:44.877934+0000","last_fullsized":"2024-09-10T10:35:44.877934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.920375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791368+0000","last_change":"2024-09-10T10:34:44.743410+0000","last_active":"2024-09-10T10:34:55.791368+0000","last_peered":"2024-09-10T10:34:55.791368+0000","last_clean":"2024-09-10T10:34:55.791368+0000","last_became_active":"2024-09-10T10:34:44.743040+0000","last_became_peered":"2024-09-10T10:34:44.743040+0000","last_unstale":"2024-09-10T10:34:55.791368+0000","last_undegraded":"2024-09-10T10:34:55.791368+0000","last_fullsized":"2024-09-10T10:34:55.791368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790902+0000","last_change":"2024-09-10T10:34:42.730778+0000","last_active":"2024-09-10T10:34:55.790902+0000","last_peered":"2024-09-10T10:34:55.790902+0000","last_clean":"2024-09-10T10:34:55.790902+0000","last_became_active":"2024-09-10T10:34:42.730360+0000","last_became_peered":"2024-09-10T10:34:42.730360+0000","last_unstale":"2024-09-10T10:34:55.790902+0000","last_undegraded":"2024-09-10T10:34:55.790902+0000","last_fullsized":"2024-09-10T10:34:55.790902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:41.596309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790332+0000","last_change":"2024-09-10T10:34:42.730251+0000","last_active":"2024-09-10T10:34:55.790332+0000","last_peered":"2024-09-10T10:34:55.790332+0000","last_clean":"2024-09-10T10:34:55.790332+0000","last_became_active":"2024-09-10T10:34:42.729915+0000","last_became_peered":"2024-09-10T10:34:42.729915+0000","last_unstale":"2024-09-10T10:34:55.790332+0000","last_undegraded":"2024-09-10T10:34:55.790332+0000","last_fullsized":"2024-09-10T10:34:55.790332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:10.215793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790686+0000","last_change":"2024-09-10T10:34:44.745663+0000","last_active":"2024-09-10T10:34:55.790686+0000","last_peered":"2024-09-10T10:34:55.790686+0000","last_clean":"2024-09-10T10:34:55.790686+0000","last_became_active":"2024-09-10T10:34:44.745361+0000","last_became_peered":"2024-09-10T10:34:44.745361+0000","last_unstale":"2024-09-10T10:34:55.790686+0000","last_undegraded":"2024-09-10T10:34:55.790686+0000","last_fullsized":"2024-09-10T10:34:55.790686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:17.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810334+0000","last_change":"2024-09-10T10:34:42.731515+0000","last_active":"2024-09-10T10:34:55.810334+0000","last_peered":"2024-09-10T10:34:55.810334+0000","last_clean":"2024-09-10T10:34:55.810334+0000","last_became_active":"2024-09-10T10:34:42.731103+0000","last_became_peered":"2024-09-10T10:34:42.731103+0000","last_unstale":"2024-09-10T10:34:55.810334+0000","last_undegraded":"2024-09-10T10:34:55.810334+0000","last_fullsized":"2024-09-10T10:34:55.810334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:51.181868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787178+0000","last_change":"2024-09-10T10:34:44.740826+0000","last_active":"2024-09-10T10:34:55.787178+0000","last_peered":"2024-09-10T10:34:55.787178+0000","last_clean":"2024-09-10T10:34:55.787178+0000","last_became_active":"2024-09-10T10:34:44.740510+0000","last_became_peered":"2024-09-10T10:34:44.740510+0000","last_unstale":"2024-09-10T10:34:55.787178+0000","last_undegraded":"2024-09-10T10:34:55.787178+0000","last_fullsized":"2024-09-10T10:34:55.787178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:30:44.650840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":122,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:43.875794+0000","last_change":"2024-09-10T10:34:42.733744+0000","last_active":"2024-09-10T10:35:43.875794+0000","last_peered":"2024-09-10T10:35:43.875794+0000","last_clean":"2024-09-10T10:35:43.875794+0000","last_became_active":"2024-09-10T10:34:42.733380+0000","last_became_peered":"2024-09-10T10:34:42.733380+0000","last_unstale":"2024-09-10T10:35:43.875794+0000","last_undegraded":"2024-09-10T10:35:43.875794+0000","last_fullsized":"2024-09-10T10:35:43.875794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:39.227094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787875+0000","last_change":"2024-09-10T10:34:44.749534+0000","last_active":"2024-09-10T10:34:55.787875+0000","last_peered":"2024-09-10T10:34:55.787875+0000","last_clean":"2024-09-10T10:34:55.787875+0000","last_became_active":"2024-09-10T10:34:44.749007+0000","last_became_peered":"2024-09-10T10:34:44.749007+0000","last_unstale":"2024-09-10T10:34:55.787875+0000","last_undegraded":"2024-09-10T10:34:55.787875+0000","last_fullsized":"2024-09-10T10:34:55.787875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:48.949171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810027+0000","last_change":"2024-09-10T10:34:42.728670+0000","last_active":"2024-09-10T10:34:55.810027+0000","last_peered":"2024-09-10T10:34:55.810027+0000","last_clean":"2024-09-10T10:34:55.810027+0000","last_became_active":"2024-09-10T10:34:42.728313+0000","last_became_peered":"2024-09-10T10:34:42.728313+0000","last_unstale":"2024-09-10T10:34:55.810027+0000","last_undegraded":"2024-09-10T10:34:55.810027+0000","last_fullsized":"2024-09-10T10:34:55.810027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:43.354818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807562+0000","last_change":"2024-09-10T10:34:44.752536+0000","last_active":"2024-09-10T10:34:55.807562+0000","last_peered":"2024-09-10T10:34:55.807562+0000","last_clean":"2024-09-10T10:34:55.807562+0000","last_became_active":"2024-09-10T10:34:44.750285+0000","last_became_peered":"2024-09-10T10:34:44.750285+0000","last_unstale":"2024-09-10T10:34:55.807562+0000","last_undegraded":"2024-09-10T10:34:55.807562+0000","last_fullsized":"2024-09-10T10:34:55.807562+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:53.610166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791508+0000","last_change":"2024-09-10T10:34:42.760713+0000","last_active":"2024-09-10T10:34:55.791508+0000","last_peered":"2024-09-10T10:34:55.791508+0000","last_clean":"2024-09-10T10:34:55.791508+0000","last_became_active":"2024-09-10T10:34:42.760294+0000","last_became_peered":"2024-09-10T10:34:42.760294+0000","last_unstale":"2024-09-10T10:34:55.791508+0000","last_undegraded":"2024-09-10T10:34:55.791508+0000","last_fullsized":"2024-09-10T10:34:55.791508+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:43.687485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.795427+0000","last_change":"2024-09-10T10:34:55.795427+0000","last_active":"2024-09-10T10:34:55.795427+0000","last_peered":"2024-09-10T10:34:55.795427+0000","last_clean":"2024-09-10T10:34:55.795427+0000","last_became_active":"2024-09-10T10:34:55.795072+0000","last_became_peered":"2024-09-10T10:34:55.795072+0000","last_unstale":"2024-09-10T10:34:55.795427+0000","last_undegraded":"2024-09-10T10:34:55.795427+0000","last_fullsized":"2024-09-10T10:34:55.795427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:39.758626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'32","reported_seq":160,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:43.881350+0000","last_change":"2024-09-10T10:34:42.734059+0000","last_active":"2024-09-10T10:35:43.881350+0000","last_peered":"2024-09-10T10:35:43.881350+0000","last_clean":"2024-09-10T10:35:43.881350+0000","last_became_active":"2024-09-10T10:34:42.733589+0000","last_became_peered":"2024-09-10T10:34:42.733589+0000","last_unstale":"2024-09-10T10:35:43.881350+0000","last_undegraded":"2024-09-10T10:35:43.881350+0000","last_fullsized":"2024-09-10T10:35:43.881350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:29.257184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":113,"num_write":34,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791068+0000","last_change":"2024-09-10T10:34:44.750286+0000","last_active":"2024-09-10T10:34:55.791068+0000","last_peered":"2024-09-10T10:34:55.791068+0000","last_clean":"2024-09-10T10:34:55.791068+0000","last_became_active":"2024-09-10T10:34:44.749776+0000","last_became_peered":"2024-09-10T10:34:44.749776+0000","last_unstale":"2024-09-10T10:34:55.791068+0000","last_undegraded":"2024-09-10T10:34:55.791068+0000","last_fullsized":"2024-09-10T10:34:55.791068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:36.962707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.810651+0000","last_change":"2024-09-10T10:34:42.730667+0000","last_active":"2024-09-10T10:34:56.810651+0000","last_peered":"2024-09-10T10:34:56.810651+0000","last_clean":"2024-09-10T10:34:56.810651+0000","last_became_active":"2024-09-10T10:34:42.730299+0000","last_became_peered":"2024-09-10T10:34:42.730299+0000","last_unstale":"2024-09-10T10:34:56.810651+0000","last_undegraded":"2024-09-10T10:34:56.810651+0000","last_fullsized":"2024-09-10T10:34:56.810651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:53.313073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790409+0000","last_change":"2024-09-10T10:34:44.749059+0000","last_active":"2024-09-10T10:34:55.790409+0000","last_peered":"2024-09-10T10:34:55.790409+0000","last_clean":"2024-09-10T10:34:55.790409+0000","last_became_active":"2024-09-10T10:34:44.748770+0000","last_became_peered":"2024-09-10T10:34:44.748770+0000","last_unstale":"2024-09-10T10:34:55.790409+0000","last_undegraded":"2024-09-10T10:34:55.790409+0000","last_fullsized":"2024-09-10T10:34:55.790409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:26.992447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810381+0000","last_change":"2024-09-10T10:34:42.729171+0000","last_active":"2024-09-10T10:34:55.810381+0000","last_peered":"2024-09-10T10:34:55.810381+0000","last_clean":"2024-09-10T10:34:55.810381+0000","last_became_active":"2024-09-10T10:34:42.728432+0000","last_became_peered":"2024-09-10T10:34:42.728432+0000","last_unstale":"2024-09-10T10:34:55.810381+0000","last_undegraded":"2024-09-10T10:34:55.810381+0000","last_fullsized":"2024-09-10T10:34:55.810381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:40.513818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.805866+0000","last_change":"2024-09-10T10:34:44.746936+0000","last_active":"2024-09-10T10:34:55.805866+0000","last_peered":"2024-09-10T10:34:55.805866+0000","last_clean":"2024-09-10T10:34:55.805866+0000","last_became_active":"2024-09-10T10:34:44.746565+0000","last_became_peered":"2024-09-10T10:34:44.746565+0000","last_unstale":"2024-09-10T10:34:55.805866+0000","last_undegraded":"2024-09-10T10:34:55.805866+0000","last_fullsized":"2024-09-10T10:34:55.805866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:47.819637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:43.874368+0000","last_change":"2024-09-10T10:34:42.730369+0000","last_active":"2024-09-10T10:35:43.874368+0000","last_peered":"2024-09-10T10:35:43.874368+0000","last_clean":"2024-09-10T10:35:43.874368+0000","last_became_active":"2024-09-10T10:34:42.729917+0000","last_became_peered":"2024-09-10T10:34:42.729917+0000","last_unstale":"2024-09-10T10:35:43.874368+0000","last_undegraded":"2024-09-10T10:35:43.874368+0000","last_fullsized":"2024-09-10T10:35:43.874368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:59.882719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807035+0000","last_change":"2024-09-10T10:34:44.756160+0000","last_active":"2024-09-10T10:34:55.807035+0000","last_peered":"2024-09-10T10:34:55.807035+0000","last_clean":"2024-09-10T10:34:55.807035+0000","last_became_active":"2024-09-10T10:34:44.755811+0000","last_became_peered":"2024-09-10T10:34:44.755811+0000","last_unstale":"2024-09-10T10:34:55.807035+0000","last_undegraded":"2024-09-10T10:34:55.807035+0000","last_fullsized":"2024-09-10T10:34:55.807035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:37.299385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808007+0000","last_change":"2024-09-10T10:34:42.761084+0000","last_active":"2024-09-10T10:34:55.808007+0000","last_peered":"2024-09-10T10:34:55.808007+0000","last_clean":"2024-09-10T10:34:55.808007+0000","last_became_active":"2024-09-10T10:34:42.760223+0000","last_became_peered":"2024-09-10T10:34:42.760223+0000","last_unstale":"2024-09-10T10:34:55.808007+0000","last_undegraded":"2024-09-10T10:34:55.808007+0000","last_fullsized":"2024-09-10T10:34:55.808007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:24.001455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790499+0000","last_change":"2024-09-10T10:34:44.758495+0000","last_active":"2024-09-10T10:34:55.790499+0000","last_peered":"2024-09-10T10:34:55.790499+0000","last_clean":"2024-09-10T10:34:55.790499+0000","last_became_active":"2024-09-10T10:34:44.757701+0000","last_became_peered":"2024-09-10T10:34:44.757701+0000","last_unstale":"2024-09-10T10:34:55.790499+0000","last_undegraded":"2024-09-10T10:34:55.790499+0000","last_fullsized":"2024-09-10T10:34:55.790499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:42.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.811594+0000","last_change":"2024-09-10T10:34:55.800279+0000","last_active":"2024-09-10T10:34:56.811594+0000","last_peered":"2024-09-10T10:34:56.811594+0000","last_clean":"2024-09-10T10:34:56.811594+0000","last_became_active":"2024-09-10T10:34:55.792658+0000","last_became_peered":"2024-09-10T10:34:55.792658+0000","last_unstale":"2024-09-10T10:34:56.811594+0000","last_undegraded":"2024-09-10T10:34:56.811594+0000","last_fullsized":"2024-09-10T10:34:56.811594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:21.840613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787778+0000","last_change":"2024-09-10T10:34:44.751002+0000","last_active":"2024-09-10T10:34:55.787778+0000","last_peered":"2024-09-10T10:34:55.787778+0000","last_clean":"2024-09-10T10:34:55.787778+0000","last_became_active":"2024-09-10T10:34:44.749753+0000","last_became_peered":"2024-09-10T10:34:44.749753+0000","last_unstale":"2024-09-10T10:34:55.787778+0000","last_undegraded":"2024-09-10T10:34:55.787778+0000","last_fullsized":"2024-09-10T10:34:55.787778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:31.211448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807724+0000","last_change":"2024-09-10T10:34:42.727332+0000","last_active":"2024-09-10T10:34:55.807724+0000","last_peered":"2024-09-10T10:34:55.807724+0000","last_clean":"2024-09-10T10:34:55.807724+0000","last_became_active":"2024-09-10T10:34:42.726946+0000","last_became_peered":"2024-09-10T10:34:42.726946+0000","last_unstale":"2024-09-10T10:34:55.807724+0000","last_undegraded":"2024-09-10T10:34:55.807724+0000","last_fullsized":"2024-09-10T10:34:55.807724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:07.302005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806275+0000","last_change":"2024-09-10T10:34:44.753230+0000","last_active":"2024-09-10T10:34:55.806275+0000","last_peered":"2024-09-10T10:34:55.806275+0000","last_clean":"2024-09-10T10:34:55.806275+0000","last_became_active":"2024-09-10T10:34:44.752901+0000","last_became_peered":"2024-09-10T10:34:44.752901+0000","last_unstale":"2024-09-10T10:34:55.806275+0000","last_undegraded":"2024-09-10T10:34:55.806275+0000","last_fullsized":"2024-09-10T10:34:55.806275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:06.037445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808506+0000","last_change":"2024-09-10T10:34:42.731101+0000","last_active":"2024-09-10T10:34:55.808506+0000","last_peered":"2024-09-10T10:34:55.808506+0000","last_clean":"2024-09-10T10:34:55.808506+0000","last_became_active":"2024-09-10T10:34:42.730459+0000","last_became_peered":"2024-09-10T10:34:42.730459+0000","last_unstale":"2024-09-10T10:34:55.808506+0000","last_undegraded":"2024-09-10T10:34:55.808506+0000","last_fullsized":"2024-09-10T10:34:55.808506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:03.170940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806157+0000","last_change":"2024-09-10T10:34:44.756021+0000","last_active":"2024-09-10T10:34:55.806157+0000","last_peered":"2024-09-10T10:34:55.806157+0000","last_clean":"2024-09-10T10:34:55.806157+0000","last_became_active":"2024-09-10T10:34:44.755673+0000","last_became_peered":"2024-09-10T10:34:44.755673+0000","last_unstale":"2024-09-10T10:34:55.806157+0000","last_undegraded":"2024-09-10T10:34:55.806157+0000","last_fullsized":"2024-09-10T10:34:55.806157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:32.183967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:44.898728+0000","last_change":"2024-09-10T10:34:42.816450+0000","last_active":"2024-09-10T10:35:44.898728+0000","last_peered":"2024-09-10T10:35:44.898728+0000","last_clean":"2024-09-10T10:35:44.898728+0000","last_became_active":"2024-09-10T10:34:42.816049+0000","last_became_peered":"2024-09-10T10:34:42.816049+0000","last_unstale":"2024-09-10T10:35:44.898728+0000","last_undegraded":"2024-09-10T10:35:44.898728+0000","last_fullsized":"2024-09-10T10:35:44.898728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:54.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807005+0000","last_change":"2024-09-10T10:34:44.756769+0000","last_active":"2024-09-10T10:34:55.807005+0000","last_peered":"2024-09-10T10:34:55.807005+0000","last_clean":"2024-09-10T10:34:55.807005+0000","last_became_active":"2024-09-10T10:34:44.755873+0000","last_became_peered":"2024-09-10T10:34:44.755873+0000","last_unstale":"2024-09-10T10:34:55.807005+0000","last_undegraded":"2024-09-10T10:34:55.807005+0000","last_fullsized":"2024-09-10T10:34:55.807005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:56.481504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807659+0000","last_change":"2024-09-10T10:33:32.204576+0000","last_active":"2024-09-10T10:34:55.807659+0000","last_peered":"2024-09-10T10:34:55.807659+0000","last_clean":"2024-09-10T10:34:55.807659+0000","last_became_active":"2024-09-10T10:33:32.204173+0000","last_became_peered":"2024-09-10T10:33:32.204173+0000","last_unstale":"2024-09-10T10:34:55.807659+0000","last_undegraded":"2024-09-10T10:34:55.807659+0000","last_fullsized":"2024-09-10T10:34:55.807659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:30:07.036460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:30:07.036460+0000","last_clean_scrub_stamp":"2024-09-10T10:30:07.036460+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:27.845983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.811839+0000","last_change":"2024-09-10T10:34:42.731365+0000","last_active":"2024-09-10T10:34:56.811839+0000","last_peered":"2024-09-10T10:34:56.811839+0000","last_clean":"2024-09-10T10:34:56.811839+0000","last_became_active":"2024-09-10T10:34:42.731021+0000","last_became_peered":"2024-09-10T10:34:42.731021+0000","last_unstale":"2024-09-10T10:34:56.811839+0000","last_undegraded":"2024-09-10T10:34:56.811839+0000","last_fullsized":"2024-09-10T10:34:56.811839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:50.105188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790983+0000","last_change":"2024-09-10T10:34:44.749912+0000","last_active":"2024-09-10T10:34:55.790983+0000","last_peered":"2024-09-10T10:34:55.790983+0000","last_clean":"2024-09-10T10:34:55.790983+0000","last_became_active":"2024-09-10T10:34:44.747509+0000","last_became_peered":"2024-09-10T10:34:44.747509+0000","last_unstale":"2024-09-10T10:34:55.790983+0000","last_undegraded":"2024-09-10T10:34:55.790983+0000","last_fullsized":"2024-09-10T10:34:55.790983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:53.870350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808261+0000","last_change":"2024-09-10T10:34:42.733396+0000","last_active":"2024-09-10T10:34:55.808261+0000","last_peered":"2024-09-10T10:34:55.808261+0000","last_clean":"2024-09-10T10:34:55.808261+0000","last_became_active":"2024-09-10T10:34:42.733003+0000","last_became_peered":"2024-09-10T10:34:42.733003+0000","last_unstale":"2024-09-10T10:34:55.808261+0000","last_undegraded":"2024-09-10T10:34:55.808261+0000","last_fullsized":"2024-09-10T10:34:55.808261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:20.960255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790177+0000","last_change":"2024-09-10T10:34:44.747384+0000","last_active":"2024-09-10T10:34:55.790177+0000","last_peered":"2024-09-10T10:34:55.790177+0000","last_clean":"2024-09-10T10:34:55.790177+0000","last_became_active":"2024-09-10T10:34:44.747090+0000","last_became_peered":"2024-09-10T10:34:44.747090+0000","last_unstale":"2024-09-10T10:34:55.790177+0000","last_undegraded":"2024-09-10T10:34:55.790177+0000","last_fullsized":"2024-09-10T10:34:55.790177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:57.205351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:45.876430+0000","last_change":"2024-09-10T10:34:42.761200+0000","last_active":"2024-09-10T10:35:45.876430+0000","last_peered":"2024-09-10T10:35:45.876430+0000","last_clean":"2024-09-10T10:35:45.876430+0000","last_became_active":"2024-09-10T10:34:42.759724+0000","last_became_peered":"2024-09-10T10:34:42.759724+0000","last_unstale":"2024-09-10T10:35:45.876430+0000","last_undegraded":"2024-09-10T10:35:45.876430+0000","last_fullsized":"2024-09-10T10:35:45.876430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:29.614079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790902+0000","last_change":"2024-09-10T10:34:44.753426+0000","last_active":"2024-09-10T10:34:55.790902+0000","last_peered":"2024-09-10T10:34:55.790902+0000","last_clean":"2024-09-10T10:34:55.790902+0000","last_became_active":"2024-09-10T10:34:44.752709+0000","last_became_peered":"2024-09-10T10:34:44.752709+0000","last_unstale":"2024-09-10T10:34:55.790902+0000","last_undegraded":"2024-09-10T10:34:55.790902+0000","last_fullsized":"2024-09-10T10:34:55.790902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:44.046117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:45.877106+0000","last_change":"2024-09-10T10:34:42.729475+0000","last_active":"2024-09-10T10:35:45.877106+0000","last_peered":"2024-09-10T10:35:45.877106+0000","last_clean":"2024-09-10T10:35:45.877106+0000","last_became_active":"2024-09-10T10:34:42.729053+0000","last_became_peered":"2024-09-10T10:34:42.729053+0000","last_unstale":"2024-09-10T10:35:45.877106+0000","last_undegraded":"2024-09-10T10:35:45.877106+0000","last_fullsized":"2024-09-10T10:35:45.877106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:40.184538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.809197+0000","last_change":"2024-09-10T10:34:55.809197+0000","last_active":"2024-09-10T10:34:55.809197+0000","last_peered":"2024-09-10T10:34:55.809197+0000","last_clean":"2024-09-10T10:34:55.809197+0000","last_became_active":"2024-09-10T10:34:55.808757+0000","last_became_peered":"2024-09-10T10:34:55.808757+0000","last_unstale":"2024-09-10T10:34:55.809197+0000","last_undegraded":"2024-09-10T10:34:55.809197+0000","last_fullsized":"2024-09-10T10:34:55.809197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:15.117612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787178+0000","last_change":"2024-09-10T10:34:42.761268+0000","last_active":"2024-09-10T10:34:55.787178+0000","last_peered":"2024-09-10T10:34:55.787178+0000","last_clean":"2024-09-10T10:34:55.787178+0000","last_became_active":"2024-09-10T10:34:42.760889+0000","last_became_peered":"2024-09-10T10:34:42.760889+0000","last_unstale":"2024-09-10T10:34:55.787178+0000","last_undegraded":"2024-09-10T10:34:55.787178+0000","last_fullsized":"2024-09-10T10:34:55.787178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:46.767378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791069+0000","last_change":"2024-09-10T10:34:44.743850+0000","last_active":"2024-09-10T10:34:55.791069+0000","last_peered":"2024-09-10T10:34:55.791069+0000","last_clean":"2024-09-10T10:34:55.791069+0000","last_became_active":"2024-09-10T10:34:44.743496+0000","last_became_peered":"2024-09-10T10:34:44.743496+0000","last_unstale":"2024-09-10T10:34:55.791069+0000","last_undegraded":"2024-09-10T10:34:55.791069+0000","last_fullsized":"2024-09-10T10:34:55.791069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:48.113862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808471+0000","last_change":"2024-09-10T10:34:42.760831+0000","last_active":"2024-09-10T10:34:55.808471+0000","last_peered":"2024-09-10T10:34:55.808471+0000","last_clean":"2024-09-10T10:34:55.808471+0000","last_became_active":"2024-09-10T10:34:42.760311+0000","last_became_peered":"2024-09-10T10:34:42.760311+0000","last_unstale":"2024-09-10T10:34:55.808471+0000","last_undegraded":"2024-09-10T10:34:55.808471+0000","last_fullsized":"2024-09-10T10:34:55.808471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:31.748386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790314+0000","last_change":"2024-09-10T10:34:44.746139+0000","last_active":"2024-09-10T10:34:55.790314+0000","last_peered":"2024-09-10T10:34:55.790314+0000","last_clean":"2024-09-10T10:34:55.790314+0000","last_became_active":"2024-09-10T10:34:44.745464+0000","last_became_peered":"2024-09-10T10:34:44.745464+0000","last_unstale":"2024-09-10T10:34:55.790314+0000","last_undegraded":"2024-09-10T10:34:55.790314+0000","last_fullsized":"2024-09-10T10:34:55.790314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:17.916893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'16","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:09.747549+0000","last_change":"2024-09-10T10:34:42.726550+0000","last_active":"2024-09-10T10:35:09.747549+0000","last_peered":"2024-09-10T10:35:09.747549+0000","last_clean":"2024-09-10T10:35:09.747549+0000","last_became_active":"2024-09-10T10:34:42.726205+0000","last_became_peered":"2024-09-10T10:34:42.726205+0000","last_unstale":"2024-09-10T10:35:09.747549+0000","last_undegraded":"2024-09-10T10:35:09.747549+0000","last_fullsized":"2024-09-10T10:35:09.747549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:07.689782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791609+0000","last_change":"2024-09-10T10:34:44.743986+0000","last_active":"2024-09-10T10:34:55.791609+0000","last_peered":"2024-09-10T10:34:55.791609+0000","last_clean":"2024-09-10T10:34:55.791609+0000","last_became_active":"2024-09-10T10:34:44.743692+0000","last_became_peered":"2024-09-10T10:34:44.743692+0000","last_unstale":"2024-09-10T10:34:55.791609+0000","last_undegraded":"2024-09-10T10:34:55.791609+0000","last_fullsized":"2024-09-10T10:34:55.791609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:52.703390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807986+0000","last_change":"2024-09-10T10:34:42.816493+0000","last_active":"2024-09-10T10:34:55.807986+0000","last_peered":"2024-09-10T10:34:55.807986+0000","last_clean":"2024-09-10T10:34:55.807986+0000","last_became_active":"2024-09-10T10:34:42.816184+0000","last_became_peered":"2024-09-10T10:34:42.816184+0000","last_unstale":"2024-09-10T10:34:55.807986+0000","last_undegraded":"2024-09-10T10:34:55.807986+0000","last_fullsized":"2024-09-10T10:34:55.807986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:36.589002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807910+0000","last_change":"2024-09-10T10:34:44.753526+0000","last_active":"2024-09-10T10:34:55.807910+0000","last_peered":"2024-09-10T10:34:55.807910+0000","last_clean":"2024-09-10T10:34:55.807910+0000","last_became_active":"2024-09-10T10:34:44.753243+0000","last_became_peered":"2024-09-10T10:34:44.753243+0000","last_unstale":"2024-09-10T10:34:55.807910+0000","last_undegraded":"2024-09-10T10:34:55.807910+0000","last_fullsized":"2024-09-10T10:34:55.807910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:37.310489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787510+0000","last_change":"2024-09-10T10:34:42.760422+0000","last_active":"2024-09-10T10:34:55.787510+0000","last_peered":"2024-09-10T10:34:55.787510+0000","last_clean":"2024-09-10T10:34:55.787510+0000","last_became_active":"2024-09-10T10:34:42.759992+0000","last_became_peered":"2024-09-10T10:34:42.759992+0000","last_unstale":"2024-09-10T10:34:55.787510+0000","last_undegraded":"2024-09-10T10:34:55.787510+0000","last_fullsized":"2024-09-10T10:34:55.787510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:40.191718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790527+0000","last_change":"2024-09-10T10:34:44.748835+0000","last_active":"2024-09-10T10:34:55.790527+0000","last_peered":"2024-09-10T10:34:55.790527+0000","last_clean":"2024-09-10T10:34:55.790527+0000","last_became_active":"2024-09-10T10:34:44.748512+0000","last_became_peered":"2024-09-10T10:34:44.748512+0000","last_unstale":"2024-09-10T10:34:55.790527+0000","last_undegraded":"2024-09-10T10:34:55.790527+0000","last_fullsized":"2024-09-10T10:34:55.790527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:23.208046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808545+0000","last_change":"2024-09-10T10:34:42.730533+0000","last_active":"2024-09-10T10:34:55.808545+0000","last_peered":"2024-09-10T10:34:55.808545+0000","last_clean":"2024-09-10T10:34:55.808545+0000","last_became_active":"2024-09-10T10:34:42.730182+0000","last_became_peered":"2024-09-10T10:34:42.730182+0000","last_unstale":"2024-09-10T10:34:55.808545+0000","last_undegraded":"2024-09-10T10:34:55.808545+0000","last_fullsized":"2024-09-10T10:34:55.808545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:52.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788162+0000","last_change":"2024-09-10T10:34:44.748168+0000","last_active":"2024-09-10T10:34:55.788162+0000","last_peered":"2024-09-10T10:34:55.788162+0000","last_clean":"2024-09-10T10:34:55.788162+0000","last_became_active":"2024-09-10T10:34:44.747728+0000","last_became_peered":"2024-09-10T10:34:44.747728+0000","last_unstale":"2024-09-10T10:34:55.788162+0000","last_undegraded":"2024-09-10T10:34:55.788162+0000","last_fullsized":"2024-09-10T10:34:55.788162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:07.854731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.786661+0000","last_change":"2024-09-10T10:34:55.797384+0000","last_active":"2024-09-10T10:34:56.786661+0000","last_peered":"2024-09-10T10:34:56.786661+0000","last_clean":"2024-09-10T10:34:56.786661+0000","last_became_active":"2024-09-10T10:34:55.792994+0000","last_became_peered":"2024-09-10T10:34:55.792994+0000","last_unstale":"2024-09-10T10:34:56.786661+0000","last_undegraded":"2024-09-10T10:34:56.786661+0000","last_fullsized":"2024-09-10T10:34:56.786661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:11.161379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791002+0000","last_change":"2024-09-10T10:34:44.752488+0000","last_active":"2024-09-10T10:34:55.791002+0000","last_peered":"2024-09-10T10:34:55.791002+0000","last_clean":"2024-09-10T10:34:55.791002+0000","last_became_active":"2024-09-10T10:34:44.752172+0000","last_became_peered":"2024-09-10T10:34:44.752172+0000","last_unstale":"2024-09-10T10:34:55.791002+0000","last_undegraded":"2024-09-10T10:34:55.791002+0000","last_fullsized":"2024-09-10T10:34:55.791002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:25:18.150982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790888+0000","last_change":"2024-09-10T10:34:42.729662+0000","last_active":"2024-09-10T10:34:55.790888+0000","last_peered":"2024-09-10T10:34:55.790888+0000","last_clean":"2024-09-10T10:34:55.790888+0000","last_became_active":"2024-09-10T10:34:42.729037+0000","last_became_peered":"2024-09-10T10:34:42.729037+0000","last_unstale":"2024-09-10T10:34:55.790888+0000","last_undegraded":"2024-09-10T10:34:55.790888+0000","last_fullsized":"2024-09-10T10:34:55.790888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:19.367904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806223+0000","last_change":"2024-09-10T10:34:44.759093+0000","last_active":"2024-09-10T10:34:55.806223+0000","last_peered":"2024-09-10T10:34:55.806223+0000","last_clean":"2024-09-10T10:34:55.806223+0000","last_became_active":"2024-09-10T10:34:44.758625+0000","last_became_peered":"2024-09-10T10:34:44.758625+0000","last_unstale":"2024-09-10T10:34:55.806223+0000","last_undegraded":"2024-09-10T10:34:55.806223+0000","last_fullsized":"2024-09-10T10:34:55.806223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791414+0000","last_change":"2024-09-10T10:34:44.757373+0000","last_active":"2024-09-10T10:34:55.791414+0000","last_peered":"2024-09-10T10:34:55.791414+0000","last_clean":"2024-09-10T10:34:55.791414+0000","last_became_active":"2024-09-10T10:34:44.757048+0000","last_became_peered":"2024-09-10T10:34:44.757048+0000","last_unstale":"2024-09-10T10:34:55.791414+0000","last_undegraded":"2024-09-10T10:34:55.791414+0000","last_fullsized":"2024-09-10T10:34:55.791414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:30.438703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808480+0000","last_change":"2024-09-10T10:34:42.732645+0000","last_active":"2024-09-10T10:34:55.808480+0000","last_peered":"2024-09-10T10:34:55.808480+0000","last_clean":"2024-09-10T10:34:55.808480+0000","last_became_active":"2024-09-10T10:34:42.732342+0000","last_became_peered":"2024-09-10T10:34:42.732342+0000","last_unstale":"2024-09-10T10:34:55.808480+0000","last_undegraded":"2024-09-10T10:34:55.808480+0000","last_fullsized":"2024-09-10T10:34:55.808480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:21.866063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787603+0000","last_change":"2024-09-10T10:34:44.752039+0000","last_active":"2024-09-10T10:34:55.787603+0000","last_peered":"2024-09-10T10:34:55.787603+0000","last_clean":"2024-09-10T10:34:55.787603+0000","last_became_active":"2024-09-10T10:34:44.751706+0000","last_became_peered":"2024-09-10T10:34:44.751706+0000","last_unstale":"2024-09-10T10:34:55.787603+0000","last_undegraded":"2024-09-10T10:34:55.787603+0000","last_fullsized":"2024-09-10T10:34:55.787603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:37.775921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.810394+0000","last_change":"2024-09-10T10:34:42.729973+0000","last_active":"2024-09-10T10:34:56.810394+0000","last_peered":"2024-09-10T10:34:56.810394+0000","last_clean":"2024-09-10T10:34:56.810394+0000","last_became_active":"2024-09-10T10:34:42.729554+0000","last_became_peered":"2024-09-10T10:34:42.729554+0000","last_unstale":"2024-09-10T10:34:56.810394+0000","last_undegraded":"2024-09-10T10:34:56.810394+0000","last_fullsized":"2024-09-10T10:34:56.810394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:15.289199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807732+0000","last_change":"2024-09-10T10:34:44.756215+0000","last_active":"2024-09-10T10:34:55.807732+0000","last_peered":"2024-09-10T10:34:55.807732+0000","last_clean":"2024-09-10T10:34:55.807732+0000","last_became_active":"2024-09-10T10:34:44.755875+0000","last_became_peered":"2024-09-10T10:34:44.755875+0000","last_unstale":"2024-09-10T10:34:55.807732+0000","last_undegraded":"2024-09-10T10:34:55.807732+0000","last_fullsized":"2024-09-10T10:34:55.807732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:32.835503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791603+0000","last_change":"2024-09-10T10:34:42.760332+0000","last_active":"2024-09-10T10:34:55.791603+0000","last_peered":"2024-09-10T10:34:55.791603+0000","last_clean":"2024-09-10T10:34:55.791603+0000","last_became_active":"2024-09-10T10:34:42.759719+0000","last_became_peered":"2024-09-10T10:34:42.759719+0000","last_unstale":"2024-09-10T10:34:55.791603+0000","last_undegraded":"2024-09-10T10:34:55.791603+0000","last_fullsized":"2024-09-10T10:34:55.791603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791467+0000","last_change":"2024-09-10T10:34:44.752056+0000","last_active":"2024-09-10T10:34:55.791467+0000","last_peered":"2024-09-10T10:34:55.791467+0000","last_clean":"2024-09-10T10:34:55.791467+0000","last_became_active":"2024-09-10T10:34:44.751528+0000","last_became_peered":"2024-09-10T10:34:44.751528+0000","last_unstale":"2024-09-10T10:34:55.791467+0000","last_undegraded":"2024-09-10T10:34:55.791467+0000","last_fullsized":"2024-09-10T10:34:55.791467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:44.101379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:41.871367+0000","last_change":"2024-09-10T10:34:42.726735+0000","last_active":"2024-09-10T10:35:41.871367+0000","last_peered":"2024-09-10T10:35:41.871367+0000","last_clean":"2024-09-10T10:35:41.871367+0000","last_became_active":"2024-09-10T10:34:42.726351+0000","last_became_peered":"2024-09-10T10:34:42.726351+0000","last_unstale":"2024-09-10T10:35:41.871367+0000","last_undegraded":"2024-09-10T10:35:41.871367+0000","last_fullsized":"2024-09-10T10:35:41.871367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:20.412565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69125,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":531,"num_read_kb":338,"num_write":246,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207375,"data_compressed":4809,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281739,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547225,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776159,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":1092751,"data_compressed":37435,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939684,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":439342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":439698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1031847,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561076,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":439059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822712,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1031525,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986238,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":438920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":502895,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":502282,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":440791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64062,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64675,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64046,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:35:50.557 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T10:35:50.812 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:51.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:50 smithi092 ceph-mon[30834]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:51.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:50 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:51.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:50 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:51.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:50 smithi092 ceph-mon[30834]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:35:51.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:50 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:35:51.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:50 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:35:51.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:50 smithi092 ceph-mon[30834]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:50 smithi121 ceph-mon[35231]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:50 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:50 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:50 smithi121 ceph-mon[35231]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:35:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:50 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:35:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:50 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:35:51.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:50 smithi121 ceph-mon[35231]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:51.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.308+0000 7f77f6709640 1 -- 172.21.15.92:0/2750718229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0102d50 msgr2=0x7f77f0103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:51.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.308+0000 7f77f6709640 1 --2- 172.21.15.92:0/2750718229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0102d50 0x7f77f0103130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009900 tx=0x7f77e002a480 comp rx=0 tx=0).stop 2024-09-10T10:35:51.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.308+0000 7f77f6709640 1 -- 172.21.15.92:0/2750718229 shutdown_connections 2024-09-10T10:35:51.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.308+0000 7f77f6709640 1 --2- 172.21.15.92:0/2750718229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77f010c180 0x7f77f010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.308+0000 7f77f6709640 1 --2- 172.21.15.92:0/2750718229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77f0103670 0x7f77f010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.308+0000 7f77f6709640 1 --2- 172.21.15.92:0/2750718229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0102d50 0x7f77f0103130 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.308+0000 7f77f6709640 1 -- 172.21.15.92:0/2750718229 >> 172.21.15.92:0/2750718229 conn(0x7f77f00fc7d0 msgr2=0x7f77f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:51.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.308+0000 7f77f6709640 1 -- 172.21.15.92:0/2750718229 shutdown_connections 2024-09-10T10:35:51.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.308+0000 7f77f6709640 1 -- 172.21.15.92:0/2750718229 wait complete. 2024-09-10T10:35:51.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f6709640 1 Processor -- start 2024-09-10T10:35:51.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f6709640 1 -- start start 2024-09-10T10:35:51.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f6709640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77f0102d50 0x7f77f019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:51.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f6709640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77f0103670 0x7f77f019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:51.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f6709640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f010c180 0x7f77f019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f6709640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77f0111f80 con 0x7f77f010c180 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f6709640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f77f0111e00 con 0x7f77f0103670 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f6709640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77f0112100 con 0x7f77f0102d50 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f4ca6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f010c180 0x7f77f019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f4ca6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f010c180 0x7f77f019ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52978/0 (socket says 172.21.15.92:52978) 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77f4ca6640 1 -- 172.21.15.92:0/2534214425 learned_addr learned my addr 172.21.15.92:0/2534214425 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77effff640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77f0102d50 0x7f77f019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.309+0000 7f77ef7fe640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77f0103670 0x7f77f019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77f4ca6640 1 -- 172.21.15.92:0/2534214425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77f0102d50 msgr2=0x7f77f019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:51.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77f4ca6640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77f0102d50 0x7f77f019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77f4ca6640 1 -- 172.21.15.92:0/2534214425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77f0103670 msgr2=0x7f77f019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:51.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77f4ca6640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77f0103670 0x7f77f019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77f4ca6640 1 -- 172.21.15.92:0/2534214425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f019f620 con 0x7f77f010c180 2024-09-10T10:35:51.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77ef7fe640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77f0103670 0x7f77f019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:51.315 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77f4ca6640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f010c180 0x7f77f019ef40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f77e800eaa0 tx=0x7f77e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:51.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77ed7fa640 1 -- 172.21.15.92:0/2534214425 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e800cdb0 con 0x7f77f010c180 2024-09-10T10:35:51.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77ed7fa640 1 -- 172.21.15.92:0/2534214425 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e8005020 con 0x7f77f010c180 2024-09-10T10:35:51.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f019f910 con 0x7f77f010c180 2024-09-10T10:35:51.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77ed7fa640 1 -- 172.21.15.92:0/2534214425 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80116b0 con 0x7f77f010c180 2024-09-10T10:35:51.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.310+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f01a71f0 con 0x7f77f010c180 2024-09-10T10:35:51.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.311+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f0103130 con 0x7f77f010c180 2024-09-10T10:35:51.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.312+0000 7f77ed7fa640 1 -- 172.21.15.92:0/2534214425 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f77e8005560 con 0x7f77f010c180 2024-09-10T10:35:51.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.313+0000 7f77ed7fa640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77d80a2c90 0x7f77d80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:51.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.313+0000 7f77effff640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77d80a2c90 0x7f77d80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:51.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.313+0000 7f77ed7fa640 1 -- 172.21.15.92:0/2534214425 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f77e80cf5d0 con 0x7f77f010c180 2024-09-10T10:35:51.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.314+0000 7f77effff640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77d80a2c90 0x7f77d80a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009230 tx=0x7f77e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:51.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:50 smithi097 ceph-mon[35213]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:51.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:50 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:51.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:50 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:51.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:50 smithi097 ceph-mon[35213]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:35:51.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:50 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:35:51.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:50 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:35:51.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:50 smithi097 ceph-mon[35213]: from='mgr.14150 172.21.15.92:0/3249856143' entity='mgr.x' 2024-09-10T10:35:51.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.316+0000 7f77ed7fa640 1 -- 172.21.15.92:0/2534214425 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77e8016030 con 0x7f77f010c180 2024-09-10T10:35:51.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.481+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77f0102110 con 0x7f77d80a2c90 2024-09-10T10:35:51.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.487+0000 7f77ed7fa640 1 -- 172.21.15.92:0/2534214425 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258971 (secure 0 0 0) 0x7f77f0102110 con 0x7f77d80a2c90 2024-09-10T10:35:51.492 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:51.493 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-09-10T10:35:51.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77d80a2c90 msgr2=0x7f77d80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:51.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77d80a2c90 0x7f77d80a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009230 tx=0x7f77e00058d0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f010c180 msgr2=0x7f77f019ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:51.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f010c180 0x7f77f019ef40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f77e800eaa0 tx=0x7f77e800ef60 comp rx=0 tx=0).stop 2024-09-10T10:35:51.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 shutdown_connections 2024-09-10T10:35:51.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77d80a2c90 0x7f77d80a5150 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f010c180 0x7f77f019ef40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f77f0103670 0x7f77f019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 --2- 172.21.15.92:0/2534214425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77f0102d50 0x7f77f019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:51.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 >> 172.21.15.92:0/2534214425 conn(0x7f77f00fc7d0 msgr2=0x7f77f010d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:51.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 shutdown_connections 2024-09-10T10:35:51.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:51.490+0000 7f77f6709640 1 -- 172.21.15.92:0/2534214425 wait complete. 2024-09-10T10:35:52.224 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-10T10:35:50.141148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659727,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":692,"num_read_kb":477,"num_write":429,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":350,"ondisk_log_size":350,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368816,"kb_used_data":11232,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573008,"statfs":{"total":1151940427776,"available":1151562760192,"internally_reserved":0,"allocated":11501568,"data_stored":7237821,"data_compressed":112305,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19140,"internal_metadata":365933884},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788050+0000","last_change":"2024-09-10T10:34:44.757989+0000","last_active":"2024-09-10T10:34:55.788050+0000","last_peered":"2024-09-10T10:34:55.788050+0000","last_clean":"2024-09-10T10:34:55.788050+0000","last_became_active":"2024-09-10T10:34:44.757638+0000","last_became_peered":"2024-09-10T10:34:44.757638+0000","last_unstale":"2024-09-10T10:34:55.788050+0000","last_undegraded":"2024-09-10T10:34:55.788050+0000","last_fullsized":"2024-09-10T10:34:55.788050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:41.636786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807821+0000","last_change":"2024-09-10T10:34:44.750218+0000","last_active":"2024-09-10T10:34:55.807821+0000","last_peered":"2024-09-10T10:34:55.807821+0000","last_clean":"2024-09-10T10:34:55.807821+0000","last_became_active":"2024-09-10T10:34:44.749807+0000","last_became_peered":"2024-09-10T10:34:44.749807+0000","last_unstale":"2024-09-10T10:34:55.807821+0000","last_undegraded":"2024-09-10T10:34:55.807821+0000","last_fullsized":"2024-09-10T10:34:55.807821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:49:17.123136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806919+0000","last_change":"2024-09-10T10:34:44.756169+0000","last_active":"2024-09-10T10:34:55.806919+0000","last_peered":"2024-09-10T10:34:55.806919+0000","last_clean":"2024-09-10T10:34:55.806919+0000","last_became_active":"2024-09-10T10:34:44.755845+0000","last_became_peered":"2024-09-10T10:34:44.755845+0000","last_unstale":"2024-09-10T10:34:55.806919+0000","last_undegraded":"2024-09-10T10:34:55.806919+0000","last_fullsized":"2024-09-10T10:34:55.806919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:24:11.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790302+0000","last_change":"2024-09-10T10:34:44.750153+0000","last_active":"2024-09-10T10:34:55.790302+0000","last_peered":"2024-09-10T10:34:55.790302+0000","last_clean":"2024-09-10T10:34:55.790302+0000","last_became_active":"2024-09-10T10:34:44.749830+0000","last_became_peered":"2024-09-10T10:34:44.749830+0000","last_unstale":"2024-09-10T10:34:55.790302+0000","last_undegraded":"2024-09-10T10:34:55.790302+0000","last_fullsized":"2024-09-10T10:34:55.790302+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:30.799158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790670+0000","last_change":"2024-09-10T10:34:44.752766+0000","last_active":"2024-09-10T10:34:55.790670+0000","last_peered":"2024-09-10T10:34:55.790670+0000","last_clean":"2024-09-10T10:34:55.790670+0000","last_became_active":"2024-09-10T10:34:44.750892+0000","last_became_peered":"2024-09-10T10:34:44.750892+0000","last_unstale":"2024-09-10T10:34:55.790670+0000","last_undegraded":"2024-09-10T10:34:55.790670+0000","last_fullsized":"2024-09-10T10:34:55.790670+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:20.139995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790850+0000","last_change":"2024-09-10T10:34:44.746378+0000","last_active":"2024-09-10T10:34:55.790850+0000","last_peered":"2024-09-10T10:34:55.790850+0000","last_clean":"2024-09-10T10:34:55.790850+0000","last_became_active":"2024-09-10T10:34:44.745996+0000","last_became_peered":"2024-09-10T10:34:44.745996+0000","last_unstale":"2024-09-10T10:34:55.790850+0000","last_undegraded":"2024-09-10T10:34:55.790850+0000","last_fullsized":"2024-09-10T10:34:55.790850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:49:14.444518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.805589+0000","last_change":"2024-09-10T10:34:44.756457+0000","last_active":"2024-09-10T10:34:55.805589+0000","last_peered":"2024-09-10T10:34:55.805589+0000","last_clean":"2024-09-10T10:34:55.805589+0000","last_became_active":"2024-09-10T10:34:44.756017+0000","last_became_peered":"2024-09-10T10:34:44.756017+0000","last_unstale":"2024-09-10T10:34:55.805589+0000","last_undegraded":"2024-09-10T10:34:55.805589+0000","last_fullsized":"2024-09-10T10:34:55.805589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:30:10.421223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790142+0000","last_change":"2024-09-10T10:34:44.735096+0000","last_active":"2024-09-10T10:34:55.790142+0000","last_peered":"2024-09-10T10:34:55.790142+0000","last_clean":"2024-09-10T10:34:55.790142+0000","last_became_active":"2024-09-10T10:34:44.734810+0000","last_became_peered":"2024-09-10T10:34:44.734810+0000","last_unstale":"2024-09-10T10:34:55.790142+0000","last_undegraded":"2024-09-10T10:34:55.790142+0000","last_fullsized":"2024-09-10T10:34:55.790142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:18.094135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788046+0000","last_change":"2024-09-10T10:34:44.760336+0000","last_active":"2024-09-10T10:34:55.788046+0000","last_peered":"2024-09-10T10:34:55.788046+0000","last_clean":"2024-09-10T10:34:55.788046+0000","last_became_active":"2024-09-10T10:34:44.759995+0000","last_became_peered":"2024-09-10T10:34:44.759995+0000","last_unstale":"2024-09-10T10:34:55.788046+0000","last_undegraded":"2024-09-10T10:34:55.788046+0000","last_fullsized":"2024-09-10T10:34:55.788046+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:56.471705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791244+0000","last_change":"2024-09-10T10:34:44.748238+0000","last_active":"2024-09-10T10:34:55.791244+0000","last_peered":"2024-09-10T10:34:55.791244+0000","last_clean":"2024-09-10T10:34:55.791244+0000","last_became_active":"2024-09-10T10:34:44.747876+0000","last_became_peered":"2024-09-10T10:34:44.747876+0000","last_unstale":"2024-09-10T10:34:55.791244+0000","last_undegraded":"2024-09-10T10:34:55.791244+0000","last_fullsized":"2024-09-10T10:34:55.791244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:30:01.721300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806892+0000","last_change":"2024-09-10T10:34:44.757513+0000","last_active":"2024-09-10T10:34:55.806892+0000","last_peered":"2024-09-10T10:34:55.806892+0000","last_clean":"2024-09-10T10:34:55.806892+0000","last_became_active":"2024-09-10T10:34:44.757207+0000","last_became_peered":"2024-09-10T10:34:44.757207+0000","last_unstale":"2024-09-10T10:34:55.806892+0000","last_undegraded":"2024-09-10T10:34:55.806892+0000","last_fullsized":"2024-09-10T10:34:55.806892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:33:07.351617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790432+0000","last_change":"2024-09-10T10:34:44.749394+0000","last_active":"2024-09-10T10:34:55.790432+0000","last_peered":"2024-09-10T10:34:55.790432+0000","last_clean":"2024-09-10T10:34:55.790432+0000","last_became_active":"2024-09-10T10:34:44.749029+0000","last_became_peered":"2024-09-10T10:34:44.749029+0000","last_unstale":"2024-09-10T10:34:55.790432+0000","last_undegraded":"2024-09-10T10:34:55.790432+0000","last_fullsized":"2024-09-10T10:34:55.790432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:57:46.772305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790387+0000","last_change":"2024-09-10T10:34:44.742056+0000","last_active":"2024-09-10T10:34:55.790387+0000","last_peered":"2024-09-10T10:34:55.790387+0000","last_clean":"2024-09-10T10:34:55.790387+0000","last_became_active":"2024-09-10T10:34:44.741716+0000","last_became_peered":"2024-09-10T10:34:44.741716+0000","last_unstale":"2024-09-10T10:34:55.790387+0000","last_undegraded":"2024-09-10T10:34:55.790387+0000","last_fullsized":"2024-09-10T10:34:55.790387+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:22:04.112050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806807+0000","last_change":"2024-09-10T10:34:44.747573+0000","last_active":"2024-09-10T10:34:55.806807+0000","last_peered":"2024-09-10T10:34:55.806807+0000","last_clean":"2024-09-10T10:34:55.806807+0000","last_became_active":"2024-09-10T10:34:44.747284+0000","last_became_peered":"2024-09-10T10:34:44.747284+0000","last_unstale":"2024-09-10T10:34:55.806807+0000","last_undegraded":"2024-09-10T10:34:55.806807+0000","last_fullsized":"2024-09-10T10:34:55.806807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:24.567112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806649+0000","last_change":"2024-09-10T10:34:44.745494+0000","last_active":"2024-09-10T10:34:55.806649+0000","last_peered":"2024-09-10T10:34:55.806649+0000","last_clean":"2024-09-10T10:34:55.806649+0000","last_became_active":"2024-09-10T10:34:44.744525+0000","last_became_peered":"2024-09-10T10:34:44.744525+0000","last_unstale":"2024-09-10T10:34:55.806649+0000","last_undegraded":"2024-09-10T10:34:55.806649+0000","last_fullsized":"2024-09-10T10:34:55.806649+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:46.120579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787378+0000","last_change":"2024-09-10T10:34:44.755247+0000","last_active":"2024-09-10T10:34:55.787378+0000","last_peered":"2024-09-10T10:34:55.787378+0000","last_clean":"2024-09-10T10:34:55.787378+0000","last_became_active":"2024-09-10T10:34:44.754897+0000","last_became_peered":"2024-09-10T10:34:44.754897+0000","last_unstale":"2024-09-10T10:34:55.787378+0000","last_undegraded":"2024-09-10T10:34:55.787378+0000","last_fullsized":"2024-09-10T10:34:55.787378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:39:58.790444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788169+0000","last_change":"2024-09-10T10:34:44.758550+0000","last_active":"2024-09-10T10:34:55.788169+0000","last_peered":"2024-09-10T10:34:55.788169+0000","last_clean":"2024-09-10T10:34:55.788169+0000","last_became_active":"2024-09-10T10:34:44.757767+0000","last_became_peered":"2024-09-10T10:34:44.757767+0000","last_unstale":"2024-09-10T10:34:55.788169+0000","last_undegraded":"2024-09-10T10:34:55.788169+0000","last_fullsized":"2024-09-10T10:34:55.788169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:49.937733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787366+0000","last_change":"2024-09-10T10:34:44.748830+0000","last_active":"2024-09-10T10:34:55.787366+0000","last_peered":"2024-09-10T10:34:55.787366+0000","last_clean":"2024-09-10T10:34:55.787366+0000","last_became_active":"2024-09-10T10:34:44.748518+0000","last_became_peered":"2024-09-10T10:34:44.748518+0000","last_unstale":"2024-09-10T10:34:55.787366+0000","last_undegraded":"2024-09-10T10:34:55.787366+0000","last_fullsized":"2024-09-10T10:34:55.787366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:46:15.786806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786493+0000","last_change":"2024-09-10T10:34:44.752523+0000","last_active":"2024-09-10T10:34:55.786493+0000","last_peered":"2024-09-10T10:34:55.786493+0000","last_clean":"2024-09-10T10:34:55.786493+0000","last_became_active":"2024-09-10T10:34:44.752153+0000","last_became_peered":"2024-09-10T10:34:44.752153+0000","last_unstale":"2024-09-10T10:34:55.786493+0000","last_undegraded":"2024-09-10T10:34:55.786493+0000","last_fullsized":"2024-09-10T10:34:55.786493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:45.826111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787609+0000","last_change":"2024-09-10T10:34:44.750249+0000","last_active":"2024-09-10T10:34:55.787609+0000","last_peered":"2024-09-10T10:34:55.787609+0000","last_clean":"2024-09-10T10:34:55.787609+0000","last_became_active":"2024-09-10T10:34:44.749812+0000","last_became_peered":"2024-09-10T10:34:44.749812+0000","last_unstale":"2024-09-10T10:34:55.787609+0000","last_undegraded":"2024-09-10T10:34:55.787609+0000","last_fullsized":"2024-09-10T10:34:55.787609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:45.584744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790439+0000","last_change":"2024-09-10T10:34:44.747529+0000","last_active":"2024-09-10T10:34:55.790439+0000","last_peered":"2024-09-10T10:34:55.790439+0000","last_clean":"2024-09-10T10:34:55.790439+0000","last_became_active":"2024-09-10T10:34:44.747183+0000","last_became_peered":"2024-09-10T10:34:44.747183+0000","last_unstale":"2024-09-10T10:34:55.790439+0000","last_undegraded":"2024-09-10T10:34:55.790439+0000","last_fullsized":"2024-09-10T10:34:55.790439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:50:03.813289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787588+0000","last_change":"2024-09-10T10:34:44.755879+0000","last_active":"2024-09-10T10:34:55.787588+0000","last_peered":"2024-09-10T10:34:55.787588+0000","last_clean":"2024-09-10T10:34:55.787588+0000","last_became_active":"2024-09-10T10:34:44.755470+0000","last_became_peered":"2024-09-10T10:34:44.755470+0000","last_unstale":"2024-09-10T10:34:55.787588+0000","last_undegraded":"2024-09-10T10:34:55.787588+0000","last_fullsized":"2024-09-10T10:34:55.787588+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:01.424727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790858+0000","last_change":"2024-09-10T10:34:44.748049+0000","last_active":"2024-09-10T10:34:55.790858+0000","last_peered":"2024-09-10T10:34:55.790858+0000","last_clean":"2024-09-10T10:34:55.790858+0000","last_became_active":"2024-09-10T10:34:44.747708+0000","last_became_peered":"2024-09-10T10:34:44.747708+0000","last_unstale":"2024-09-10T10:34:55.790858+0000","last_undegraded":"2024-09-10T10:34:55.790858+0000","last_fullsized":"2024-09-10T10:34:55.790858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:20.642908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790796+0000","last_change":"2024-09-10T10:34:44.738305+0000","last_active":"2024-09-10T10:34:55.790796+0000","last_peered":"2024-09-10T10:34:55.790796+0000","last_clean":"2024-09-10T10:34:55.790796+0000","last_became_active":"2024-09-10T10:34:44.737625+0000","last_became_peered":"2024-09-10T10:34:44.737625+0000","last_unstale":"2024-09-10T10:34:55.790796+0000","last_undegraded":"2024-09-10T10:34:55.790796+0000","last_fullsized":"2024-09-10T10:34:55.790796+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:39.578131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791523+0000","last_change":"2024-09-10T10:34:44.748021+0000","last_active":"2024-09-10T10:34:55.791523+0000","last_peered":"2024-09-10T10:34:55.791523+0000","last_clean":"2024-09-10T10:34:55.791523+0000","last_became_active":"2024-09-10T10:34:44.747632+0000","last_became_peered":"2024-09-10T10:34:44.747632+0000","last_unstale":"2024-09-10T10:34:55.791523+0000","last_undegraded":"2024-09-10T10:34:55.791523+0000","last_fullsized":"2024-09-10T10:34:55.791523+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:52.448920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786486+0000","last_change":"2024-09-10T10:34:44.746279+0000","last_active":"2024-09-10T10:34:55.786486+0000","last_peered":"2024-09-10T10:34:55.786486+0000","last_clean":"2024-09-10T10:34:55.786486+0000","last_became_active":"2024-09-10T10:34:44.745851+0000","last_became_peered":"2024-09-10T10:34:44.745851+0000","last_unstale":"2024-09-10T10:34:55.786486+0000","last_undegraded":"2024-09-10T10:34:55.786486+0000","last_fullsized":"2024-09-10T10:34:55.786486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:49.935780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787744+0000","last_change":"2024-09-10T10:34:44.749481+0000","last_active":"2024-09-10T10:34:55.787744+0000","last_peered":"2024-09-10T10:34:55.787744+0000","last_clean":"2024-09-10T10:34:55.787744+0000","last_became_active":"2024-09-10T10:34:44.749154+0000","last_became_peered":"2024-09-10T10:34:44.749154+0000","last_unstale":"2024-09-10T10:34:55.787744+0000","last_undegraded":"2024-09-10T10:34:55.787744+0000","last_fullsized":"2024-09-10T10:34:55.787744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:28:12.250198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808905+0000","last_change":"2024-09-10T10:34:55.808905+0000","last_active":"2024-09-10T10:34:55.808905+0000","last_peered":"2024-09-10T10:34:55.808905+0000","last_clean":"2024-09-10T10:34:55.808905+0000","last_became_active":"2024-09-10T10:34:55.808450+0000","last_became_peered":"2024-09-10T10:34:55.808450+0000","last_unstale":"2024-09-10T10:34:55.808905+0000","last_undegraded":"2024-09-10T10:34:55.808905+0000","last_fullsized":"2024-09-10T10:34:55.808905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:47:47.506359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807586+0000","last_change":"2024-09-10T10:34:44.753638+0000","last_active":"2024-09-10T10:34:55.807586+0000","last_peered":"2024-09-10T10:34:55.807586+0000","last_clean":"2024-09-10T10:34:55.807586+0000","last_became_active":"2024-09-10T10:34:44.752423+0000","last_became_peered":"2024-09-10T10:34:44.752423+0000","last_unstale":"2024-09-10T10:34:55.807586+0000","last_undegraded":"2024-09-10T10:34:55.807586+0000","last_fullsized":"2024-09-10T10:34:55.807586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:00:43.842713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.785975+0000","last_change":"2024-09-10T10:34:44.745530+0000","last_active":"2024-09-10T10:34:55.785975+0000","last_peered":"2024-09-10T10:34:55.785975+0000","last_clean":"2024-09-10T10:34:55.785975+0000","last_became_active":"2024-09-10T10:34:44.744856+0000","last_became_peered":"2024-09-10T10:34:44.744856+0000","last_unstale":"2024-09-10T10:34:55.785975+0000","last_undegraded":"2024-09-10T10:34:55.785975+0000","last_fullsized":"2024-09-10T10:34:55.785975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:15.496321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.786069+0000","last_change":"2024-09-10T10:34:44.748888+0000","last_active":"2024-09-10T10:34:55.786069+0000","last_peered":"2024-09-10T10:34:55.786069+0000","last_clean":"2024-09-10T10:34:55.786069+0000","last_became_active":"2024-09-10T10:34:44.748402+0000","last_became_peered":"2024-09-10T10:34:44.748402+0000","last_unstale":"2024-09-10T10:34:55.786069+0000","last_undegraded":"2024-09-10T10:34:55.786069+0000","last_fullsized":"2024-09-10T10:34:55.786069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:33:11.491674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.789801+0000","last_change":"2024-09-10T10:34:55.789801+0000","last_active":"2024-09-10T10:34:55.789801+0000","last_peered":"2024-09-10T10:34:55.789801+0000","last_clean":"2024-09-10T10:34:55.789801+0000","last_became_active":"2024-09-10T10:34:55.789449+0000","last_became_peered":"2024-09-10T10:34:55.789449+0000","last_unstale":"2024-09-10T10:34:55.789801+0000","last_undegraded":"2024-09-10T10:34:55.789801+0000","last_fullsized":"2024-09-10T10:34:55.789801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:24.784027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790662+0000","last_change":"2024-09-10T10:34:44.753011+0000","last_active":"2024-09-10T10:34:55.790662+0000","last_peered":"2024-09-10T10:34:55.790662+0000","last_clean":"2024-09-10T10:34:55.790662+0000","last_became_active":"2024-09-10T10:34:44.752667+0000","last_became_peered":"2024-09-10T10:34:44.752667+0000","last_unstale":"2024-09-10T10:34:55.790662+0000","last_undegraded":"2024-09-10T10:34:55.790662+0000","last_fullsized":"2024-09-10T10:34:55.790662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:51:44.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:44.877934+0000","last_change":"2024-09-10T10:34:42.728468+0000","last_active":"2024-09-10T10:35:44.877934+0000","last_peered":"2024-09-10T10:35:44.877934+0000","last_clean":"2024-09-10T10:35:44.877934+0000","last_became_active":"2024-09-10T10:34:42.727707+0000","last_became_peered":"2024-09-10T10:34:42.727707+0000","last_unstale":"2024-09-10T10:35:44.877934+0000","last_undegraded":"2024-09-10T10:35:44.877934+0000","last_fullsized":"2024-09-10T10:35:44.877934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:42:40.920375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791368+0000","last_change":"2024-09-10T10:34:44.743410+0000","last_active":"2024-09-10T10:34:55.791368+0000","last_peered":"2024-09-10T10:34:55.791368+0000","last_clean":"2024-09-10T10:34:55.791368+0000","last_became_active":"2024-09-10T10:34:44.743040+0000","last_became_peered":"2024-09-10T10:34:44.743040+0000","last_unstale":"2024-09-10T10:34:55.791368+0000","last_undegraded":"2024-09-10T10:34:55.791368+0000","last_fullsized":"2024-09-10T10:34:55.791368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:07.790577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790902+0000","last_change":"2024-09-10T10:34:42.730778+0000","last_active":"2024-09-10T10:34:55.790902+0000","last_peered":"2024-09-10T10:34:55.790902+0000","last_clean":"2024-09-10T10:34:55.790902+0000","last_became_active":"2024-09-10T10:34:42.730360+0000","last_became_peered":"2024-09-10T10:34:42.730360+0000","last_unstale":"2024-09-10T10:34:55.790902+0000","last_undegraded":"2024-09-10T10:34:55.790902+0000","last_fullsized":"2024-09-10T10:34:55.790902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:56:41.596309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790332+0000","last_change":"2024-09-10T10:34:42.730251+0000","last_active":"2024-09-10T10:34:55.790332+0000","last_peered":"2024-09-10T10:34:55.790332+0000","last_clean":"2024-09-10T10:34:55.790332+0000","last_became_active":"2024-09-10T10:34:42.729915+0000","last_became_peered":"2024-09-10T10:34:42.729915+0000","last_unstale":"2024-09-10T10:34:55.790332+0000","last_undegraded":"2024-09-10T10:34:55.790332+0000","last_fullsized":"2024-09-10T10:34:55.790332+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:58:10.215793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790686+0000","last_change":"2024-09-10T10:34:44.745663+0000","last_active":"2024-09-10T10:34:55.790686+0000","last_peered":"2024-09-10T10:34:55.790686+0000","last_clean":"2024-09-10T10:34:55.790686+0000","last_became_active":"2024-09-10T10:34:44.745361+0000","last_became_peered":"2024-09-10T10:34:44.745361+0000","last_unstale":"2024-09-10T10:34:55.790686+0000","last_undegraded":"2024-09-10T10:34:55.790686+0000","last_fullsized":"2024-09-10T10:34:55.790686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:17.318314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810334+0000","last_change":"2024-09-10T10:34:42.731515+0000","last_active":"2024-09-10T10:34:55.810334+0000","last_peered":"2024-09-10T10:34:55.810334+0000","last_clean":"2024-09-10T10:34:55.810334+0000","last_became_active":"2024-09-10T10:34:42.731103+0000","last_became_peered":"2024-09-10T10:34:42.731103+0000","last_unstale":"2024-09-10T10:34:55.810334+0000","last_undegraded":"2024-09-10T10:34:55.810334+0000","last_fullsized":"2024-09-10T10:34:55.810334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:51.181868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787178+0000","last_change":"2024-09-10T10:34:44.740826+0000","last_active":"2024-09-10T10:34:55.787178+0000","last_peered":"2024-09-10T10:34:55.787178+0000","last_clean":"2024-09-10T10:34:55.787178+0000","last_became_active":"2024-09-10T10:34:44.740510+0000","last_became_peered":"2024-09-10T10:34:44.740510+0000","last_unstale":"2024-09-10T10:34:55.787178+0000","last_undegraded":"2024-09-10T10:34:55.787178+0000","last_fullsized":"2024-09-10T10:34:55.787178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:30:44.650840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:48.883239+0000","last_change":"2024-09-10T10:34:42.733744+0000","last_active":"2024-09-10T10:35:48.883239+0000","last_peered":"2024-09-10T10:35:48.883239+0000","last_clean":"2024-09-10T10:35:48.883239+0000","last_became_active":"2024-09-10T10:34:42.733380+0000","last_became_peered":"2024-09-10T10:34:42.733380+0000","last_unstale":"2024-09-10T10:35:48.883239+0000","last_undegraded":"2024-09-10T10:35:48.883239+0000","last_fullsized":"2024-09-10T10:35:48.883239+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:30:39.227094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787875+0000","last_change":"2024-09-10T10:34:44.749534+0000","last_active":"2024-09-10T10:34:55.787875+0000","last_peered":"2024-09-10T10:34:55.787875+0000","last_clean":"2024-09-10T10:34:55.787875+0000","last_became_active":"2024-09-10T10:34:44.749007+0000","last_became_peered":"2024-09-10T10:34:44.749007+0000","last_unstale":"2024-09-10T10:34:55.787875+0000","last_undegraded":"2024-09-10T10:34:55.787875+0000","last_fullsized":"2024-09-10T10:34:55.787875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:38:48.949171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810027+0000","last_change":"2024-09-10T10:34:42.728670+0000","last_active":"2024-09-10T10:34:55.810027+0000","last_peered":"2024-09-10T10:34:55.810027+0000","last_clean":"2024-09-10T10:34:55.810027+0000","last_became_active":"2024-09-10T10:34:42.728313+0000","last_became_peered":"2024-09-10T10:34:42.728313+0000","last_unstale":"2024-09-10T10:34:55.810027+0000","last_undegraded":"2024-09-10T10:34:55.810027+0000","last_fullsized":"2024-09-10T10:34:55.810027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:43.354818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807562+0000","last_change":"2024-09-10T10:34:44.752536+0000","last_active":"2024-09-10T10:34:55.807562+0000","last_peered":"2024-09-10T10:34:55.807562+0000","last_clean":"2024-09-10T10:34:55.807562+0000","last_became_active":"2024-09-10T10:34:44.750285+0000","last_became_peered":"2024-09-10T10:34:44.750285+0000","last_unstale":"2024-09-10T10:34:55.807562+0000","last_undegraded":"2024-09-10T10:34:55.807562+0000","last_fullsized":"2024-09-10T10:34:55.807562+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:15:53.610166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791508+0000","last_change":"2024-09-10T10:34:42.760713+0000","last_active":"2024-09-10T10:34:55.791508+0000","last_peered":"2024-09-10T10:34:55.791508+0000","last_clean":"2024-09-10T10:34:55.791508+0000","last_became_active":"2024-09-10T10:34:42.760294+0000","last_became_peered":"2024-09-10T10:34:42.760294+0000","last_unstale":"2024-09-10T10:34:55.791508+0000","last_undegraded":"2024-09-10T10:34:55.791508+0000","last_fullsized":"2024-09-10T10:34:55.791508+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:43.687485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.795427+0000","last_change":"2024-09-10T10:34:55.795427+0000","last_active":"2024-09-10T10:34:55.795427+0000","last_peered":"2024-09-10T10:34:55.795427+0000","last_clean":"2024-09-10T10:34:55.795427+0000","last_became_active":"2024-09-10T10:34:55.795072+0000","last_became_peered":"2024-09-10T10:34:55.795072+0000","last_unstale":"2024-09-10T10:34:55.795427+0000","last_undegraded":"2024-09-10T10:34:55.795427+0000","last_fullsized":"2024-09-10T10:34:55.795427+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:39.758626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'32","reported_seq":170,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:48.887673+0000","last_change":"2024-09-10T10:34:42.734059+0000","last_active":"2024-09-10T10:35:48.887673+0000","last_peered":"2024-09-10T10:35:48.887673+0000","last_clean":"2024-09-10T10:35:48.887673+0000","last_became_active":"2024-09-10T10:34:42.733589+0000","last_became_peered":"2024-09-10T10:34:42.733589+0000","last_unstale":"2024-09-10T10:35:48.887673+0000","last_undegraded":"2024-09-10T10:35:48.887673+0000","last_fullsized":"2024-09-10T10:35:48.887673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:12:29.257184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62310,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":118,"num_write":34,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791068+0000","last_change":"2024-09-10T10:34:44.750286+0000","last_active":"2024-09-10T10:34:55.791068+0000","last_peered":"2024-09-10T10:34:55.791068+0000","last_clean":"2024-09-10T10:34:55.791068+0000","last_became_active":"2024-09-10T10:34:44.749776+0000","last_became_peered":"2024-09-10T10:34:44.749776+0000","last_unstale":"2024-09-10T10:34:55.791068+0000","last_undegraded":"2024-09-10T10:34:55.791068+0000","last_fullsized":"2024-09-10T10:34:55.791068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:36.962707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.810651+0000","last_change":"2024-09-10T10:34:42.730667+0000","last_active":"2024-09-10T10:34:56.810651+0000","last_peered":"2024-09-10T10:34:56.810651+0000","last_clean":"2024-09-10T10:34:56.810651+0000","last_became_active":"2024-09-10T10:34:42.730299+0000","last_became_peered":"2024-09-10T10:34:42.730299+0000","last_unstale":"2024-09-10T10:34:56.810651+0000","last_undegraded":"2024-09-10T10:34:56.810651+0000","last_fullsized":"2024-09-10T10:34:56.810651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:53.313073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790409+0000","last_change":"2024-09-10T10:34:44.749059+0000","last_active":"2024-09-10T10:34:55.790409+0000","last_peered":"2024-09-10T10:34:55.790409+0000","last_clean":"2024-09-10T10:34:55.790409+0000","last_became_active":"2024-09-10T10:34:44.748770+0000","last_became_peered":"2024-09-10T10:34:44.748770+0000","last_unstale":"2024-09-10T10:34:55.790409+0000","last_undegraded":"2024-09-10T10:34:55.790409+0000","last_fullsized":"2024-09-10T10:34:55.790409+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:46:26.992447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.810381+0000","last_change":"2024-09-10T10:34:42.729171+0000","last_active":"2024-09-10T10:34:55.810381+0000","last_peered":"2024-09-10T10:34:55.810381+0000","last_clean":"2024-09-10T10:34:55.810381+0000","last_became_active":"2024-09-10T10:34:42.728432+0000","last_became_peered":"2024-09-10T10:34:42.728432+0000","last_unstale":"2024-09-10T10:34:55.810381+0000","last_undegraded":"2024-09-10T10:34:55.810381+0000","last_fullsized":"2024-09-10T10:34:55.810381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:40.513818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.805866+0000","last_change":"2024-09-10T10:34:44.746936+0000","last_active":"2024-09-10T10:34:55.805866+0000","last_peered":"2024-09-10T10:34:55.805866+0000","last_clean":"2024-09-10T10:34:55.805866+0000","last_became_active":"2024-09-10T10:34:44.746565+0000","last_became_peered":"2024-09-10T10:34:44.746565+0000","last_unstale":"2024-09-10T10:34:55.805866+0000","last_undegraded":"2024-09-10T10:34:55.805866+0000","last_fullsized":"2024-09-10T10:34:55.805866+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:47.819637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:43.874368+0000","last_change":"2024-09-10T10:34:42.730369+0000","last_active":"2024-09-10T10:35:43.874368+0000","last_peered":"2024-09-10T10:35:43.874368+0000","last_clean":"2024-09-10T10:35:43.874368+0000","last_became_active":"2024-09-10T10:34:42.729917+0000","last_became_peered":"2024-09-10T10:34:42.729917+0000","last_unstale":"2024-09-10T10:35:43.874368+0000","last_undegraded":"2024-09-10T10:35:43.874368+0000","last_fullsized":"2024-09-10T10:35:43.874368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:12:59.882719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807035+0000","last_change":"2024-09-10T10:34:44.756160+0000","last_active":"2024-09-10T10:34:55.807035+0000","last_peered":"2024-09-10T10:34:55.807035+0000","last_clean":"2024-09-10T10:34:55.807035+0000","last_became_active":"2024-09-10T10:34:44.755811+0000","last_became_peered":"2024-09-10T10:34:44.755811+0000","last_unstale":"2024-09-10T10:34:55.807035+0000","last_undegraded":"2024-09-10T10:34:55.807035+0000","last_fullsized":"2024-09-10T10:34:55.807035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:22:37.299385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808007+0000","last_change":"2024-09-10T10:34:42.761084+0000","last_active":"2024-09-10T10:34:55.808007+0000","last_peered":"2024-09-10T10:34:55.808007+0000","last_clean":"2024-09-10T10:34:55.808007+0000","last_became_active":"2024-09-10T10:34:42.760223+0000","last_became_peered":"2024-09-10T10:34:42.760223+0000","last_unstale":"2024-09-10T10:34:55.808007+0000","last_undegraded":"2024-09-10T10:34:55.808007+0000","last_fullsized":"2024-09-10T10:34:55.808007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:00:24.001455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790499+0000","last_change":"2024-09-10T10:34:44.758495+0000","last_active":"2024-09-10T10:34:55.790499+0000","last_peered":"2024-09-10T10:34:55.790499+0000","last_clean":"2024-09-10T10:34:55.790499+0000","last_became_active":"2024-09-10T10:34:44.757701+0000","last_became_peered":"2024-09-10T10:34:44.757701+0000","last_unstale":"2024-09-10T10:34:55.790499+0000","last_undegraded":"2024-09-10T10:34:55.790499+0000","last_fullsized":"2024-09-10T10:34:55.790499+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:42.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.811594+0000","last_change":"2024-09-10T10:34:55.800279+0000","last_active":"2024-09-10T10:34:56.811594+0000","last_peered":"2024-09-10T10:34:56.811594+0000","last_clean":"2024-09-10T10:34:56.811594+0000","last_became_active":"2024-09-10T10:34:55.792658+0000","last_became_peered":"2024-09-10T10:34:55.792658+0000","last_unstale":"2024-09-10T10:34:56.811594+0000","last_undegraded":"2024-09-10T10:34:56.811594+0000","last_fullsized":"2024-09-10T10:34:56.811594+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:45:21.840613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787778+0000","last_change":"2024-09-10T10:34:44.751002+0000","last_active":"2024-09-10T10:34:55.787778+0000","last_peered":"2024-09-10T10:34:55.787778+0000","last_clean":"2024-09-10T10:34:55.787778+0000","last_became_active":"2024-09-10T10:34:44.749753+0000","last_became_peered":"2024-09-10T10:34:44.749753+0000","last_unstale":"2024-09-10T10:34:55.787778+0000","last_undegraded":"2024-09-10T10:34:55.787778+0000","last_fullsized":"2024-09-10T10:34:55.787778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:10:31.211448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807724+0000","last_change":"2024-09-10T10:34:42.727332+0000","last_active":"2024-09-10T10:34:55.807724+0000","last_peered":"2024-09-10T10:34:55.807724+0000","last_clean":"2024-09-10T10:34:55.807724+0000","last_became_active":"2024-09-10T10:34:42.726946+0000","last_became_peered":"2024-09-10T10:34:42.726946+0000","last_unstale":"2024-09-10T10:34:55.807724+0000","last_undegraded":"2024-09-10T10:34:55.807724+0000","last_fullsized":"2024-09-10T10:34:55.807724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:07.302005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806275+0000","last_change":"2024-09-10T10:34:44.753230+0000","last_active":"2024-09-10T10:34:55.806275+0000","last_peered":"2024-09-10T10:34:55.806275+0000","last_clean":"2024-09-10T10:34:55.806275+0000","last_became_active":"2024-09-10T10:34:44.752901+0000","last_became_peered":"2024-09-10T10:34:44.752901+0000","last_unstale":"2024-09-10T10:34:55.806275+0000","last_undegraded":"2024-09-10T10:34:55.806275+0000","last_fullsized":"2024-09-10T10:34:55.806275+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:06.037445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808506+0000","last_change":"2024-09-10T10:34:42.731101+0000","last_active":"2024-09-10T10:34:55.808506+0000","last_peered":"2024-09-10T10:34:55.808506+0000","last_clean":"2024-09-10T10:34:55.808506+0000","last_became_active":"2024-09-10T10:34:42.730459+0000","last_became_peered":"2024-09-10T10:34:42.730459+0000","last_unstale":"2024-09-10T10:34:55.808506+0000","last_undegraded":"2024-09-10T10:34:55.808506+0000","last_fullsized":"2024-09-10T10:34:55.808506+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:08:03.170940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806157+0000","last_change":"2024-09-10T10:34:44.756021+0000","last_active":"2024-09-10T10:34:55.806157+0000","last_peered":"2024-09-10T10:34:55.806157+0000","last_clean":"2024-09-10T10:34:55.806157+0000","last_became_active":"2024-09-10T10:34:44.755673+0000","last_became_peered":"2024-09-10T10:34:44.755673+0000","last_unstale":"2024-09-10T10:34:55.806157+0000","last_undegraded":"2024-09-10T10:34:55.806157+0000","last_fullsized":"2024-09-10T10:34:55.806157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:32.183967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:44.898728+0000","last_change":"2024-09-10T10:34:42.816450+0000","last_active":"2024-09-10T10:35:44.898728+0000","last_peered":"2024-09-10T10:35:44.898728+0000","last_clean":"2024-09-10T10:35:44.898728+0000","last_became_active":"2024-09-10T10:34:42.816049+0000","last_became_peered":"2024-09-10T10:34:42.816049+0000","last_unstale":"2024-09-10T10:35:44.898728+0000","last_undegraded":"2024-09-10T10:35:44.898728+0000","last_fullsized":"2024-09-10T10:35:44.898728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:54.662888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807005+0000","last_change":"2024-09-10T10:34:44.756769+0000","last_active":"2024-09-10T10:34:55.807005+0000","last_peered":"2024-09-10T10:34:55.807005+0000","last_clean":"2024-09-10T10:34:55.807005+0000","last_became_active":"2024-09-10T10:34:44.755873+0000","last_became_peered":"2024-09-10T10:34:44.755873+0000","last_unstale":"2024-09-10T10:34:55.807005+0000","last_undegraded":"2024-09-10T10:34:55.807005+0000","last_fullsized":"2024-09-10T10:34:55.807005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:04:56.481504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807659+0000","last_change":"2024-09-10T10:33:32.204576+0000","last_active":"2024-09-10T10:34:55.807659+0000","last_peered":"2024-09-10T10:34:55.807659+0000","last_clean":"2024-09-10T10:34:55.807659+0000","last_became_active":"2024-09-10T10:33:32.204173+0000","last_became_peered":"2024-09-10T10:33:32.204173+0000","last_unstale":"2024-09-10T10:34:55.807659+0000","last_undegraded":"2024-09-10T10:34:55.807659+0000","last_fullsized":"2024-09-10T10:34:55.807659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:30:07.036460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:30:07.036460+0000","last_clean_scrub_stamp":"2024-09-10T10:30:07.036460+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:42:27.845983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.811839+0000","last_change":"2024-09-10T10:34:42.731365+0000","last_active":"2024-09-10T10:34:56.811839+0000","last_peered":"2024-09-10T10:34:56.811839+0000","last_clean":"2024-09-10T10:34:56.811839+0000","last_became_active":"2024-09-10T10:34:42.731021+0000","last_became_peered":"2024-09-10T10:34:42.731021+0000","last_unstale":"2024-09-10T10:34:56.811839+0000","last_undegraded":"2024-09-10T10:34:56.811839+0000","last_fullsized":"2024-09-10T10:34:56.811839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:50.105188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790983+0000","last_change":"2024-09-10T10:34:44.749912+0000","last_active":"2024-09-10T10:34:55.790983+0000","last_peered":"2024-09-10T10:34:55.790983+0000","last_clean":"2024-09-10T10:34:55.790983+0000","last_became_active":"2024-09-10T10:34:44.747509+0000","last_became_peered":"2024-09-10T10:34:44.747509+0000","last_unstale":"2024-09-10T10:34:55.790983+0000","last_undegraded":"2024-09-10T10:34:55.790983+0000","last_fullsized":"2024-09-10T10:34:55.790983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:15:53.870350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808261+0000","last_change":"2024-09-10T10:34:42.733396+0000","last_active":"2024-09-10T10:34:55.808261+0000","last_peered":"2024-09-10T10:34:55.808261+0000","last_clean":"2024-09-10T10:34:55.808261+0000","last_became_active":"2024-09-10T10:34:42.733003+0000","last_became_peered":"2024-09-10T10:34:42.733003+0000","last_unstale":"2024-09-10T10:34:55.808261+0000","last_undegraded":"2024-09-10T10:34:55.808261+0000","last_fullsized":"2024-09-10T10:34:55.808261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:20.960255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790177+0000","last_change":"2024-09-10T10:34:44.747384+0000","last_active":"2024-09-10T10:34:55.790177+0000","last_peered":"2024-09-10T10:34:55.790177+0000","last_clean":"2024-09-10T10:34:55.790177+0000","last_became_active":"2024-09-10T10:34:44.747090+0000","last_became_peered":"2024-09-10T10:34:44.747090+0000","last_unstale":"2024-09-10T10:34:55.790177+0000","last_undegraded":"2024-09-10T10:34:55.790177+0000","last_fullsized":"2024-09-10T10:34:55.790177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:57.205351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:45.876430+0000","last_change":"2024-09-10T10:34:42.761200+0000","last_active":"2024-09-10T10:35:45.876430+0000","last_peered":"2024-09-10T10:35:45.876430+0000","last_clean":"2024-09-10T10:35:45.876430+0000","last_became_active":"2024-09-10T10:34:42.759724+0000","last_became_peered":"2024-09-10T10:34:42.759724+0000","last_unstale":"2024-09-10T10:35:45.876430+0000","last_undegraded":"2024-09-10T10:35:45.876430+0000","last_fullsized":"2024-09-10T10:35:45.876430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:29.614079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790902+0000","last_change":"2024-09-10T10:34:44.753426+0000","last_active":"2024-09-10T10:34:55.790902+0000","last_peered":"2024-09-10T10:34:55.790902+0000","last_clean":"2024-09-10T10:34:55.790902+0000","last_became_active":"2024-09-10T10:34:44.752709+0000","last_became_peered":"2024-09-10T10:34:44.752709+0000","last_unstale":"2024-09-10T10:34:55.790902+0000","last_undegraded":"2024-09-10T10:34:55.790902+0000","last_fullsized":"2024-09-10T10:34:55.790902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:44.046117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:45.877106+0000","last_change":"2024-09-10T10:34:42.729475+0000","last_active":"2024-09-10T10:35:45.877106+0000","last_peered":"2024-09-10T10:35:45.877106+0000","last_clean":"2024-09-10T10:35:45.877106+0000","last_became_active":"2024-09-10T10:34:42.729053+0000","last_became_peered":"2024-09-10T10:34:42.729053+0000","last_unstale":"2024-09-10T10:35:45.877106+0000","last_undegraded":"2024-09-10T10:35:45.877106+0000","last_fullsized":"2024-09-10T10:35:45.877106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:40.184538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.809197+0000","last_change":"2024-09-10T10:34:55.809197+0000","last_active":"2024-09-10T10:34:55.809197+0000","last_peered":"2024-09-10T10:34:55.809197+0000","last_clean":"2024-09-10T10:34:55.809197+0000","last_became_active":"2024-09-10T10:34:55.808757+0000","last_became_peered":"2024-09-10T10:34:55.808757+0000","last_unstale":"2024-09-10T10:34:55.809197+0000","last_undegraded":"2024-09-10T10:34:55.809197+0000","last_fullsized":"2024-09-10T10:34:55.809197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:15.117612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787178+0000","last_change":"2024-09-10T10:34:42.761268+0000","last_active":"2024-09-10T10:34:55.787178+0000","last_peered":"2024-09-10T10:34:55.787178+0000","last_clean":"2024-09-10T10:34:55.787178+0000","last_became_active":"2024-09-10T10:34:42.760889+0000","last_became_peered":"2024-09-10T10:34:42.760889+0000","last_unstale":"2024-09-10T10:34:55.787178+0000","last_undegraded":"2024-09-10T10:34:55.787178+0000","last_fullsized":"2024-09-10T10:34:55.787178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:46.767378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791069+0000","last_change":"2024-09-10T10:34:44.743850+0000","last_active":"2024-09-10T10:34:55.791069+0000","last_peered":"2024-09-10T10:34:55.791069+0000","last_clean":"2024-09-10T10:34:55.791069+0000","last_became_active":"2024-09-10T10:34:44.743496+0000","last_became_peered":"2024-09-10T10:34:44.743496+0000","last_unstale":"2024-09-10T10:34:55.791069+0000","last_undegraded":"2024-09-10T10:34:55.791069+0000","last_fullsized":"2024-09-10T10:34:55.791069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:29:48.113862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808471+0000","last_change":"2024-09-10T10:34:42.760831+0000","last_active":"2024-09-10T10:34:55.808471+0000","last_peered":"2024-09-10T10:34:55.808471+0000","last_clean":"2024-09-10T10:34:55.808471+0000","last_became_active":"2024-09-10T10:34:42.760311+0000","last_became_peered":"2024-09-10T10:34:42.760311+0000","last_unstale":"2024-09-10T10:34:55.808471+0000","last_undegraded":"2024-09-10T10:34:55.808471+0000","last_fullsized":"2024-09-10T10:34:55.808471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:36:31.748386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790314+0000","last_change":"2024-09-10T10:34:44.746139+0000","last_active":"2024-09-10T10:34:55.790314+0000","last_peered":"2024-09-10T10:34:55.790314+0000","last_clean":"2024-09-10T10:34:55.790314+0000","last_became_active":"2024-09-10T10:34:44.745464+0000","last_became_peered":"2024-09-10T10:34:44.745464+0000","last_unstale":"2024-09-10T10:34:55.790314+0000","last_undegraded":"2024-09-10T10:34:55.790314+0000","last_fullsized":"2024-09-10T10:34:55.790314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:17.916893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'16","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:09.747549+0000","last_change":"2024-09-10T10:34:42.726550+0000","last_active":"2024-09-10T10:35:09.747549+0000","last_peered":"2024-09-10T10:35:09.747549+0000","last_clean":"2024-09-10T10:35:09.747549+0000","last_became_active":"2024-09-10T10:34:42.726205+0000","last_became_peered":"2024-09-10T10:34:42.726205+0000","last_unstale":"2024-09-10T10:35:09.747549+0000","last_undegraded":"2024-09-10T10:35:09.747549+0000","last_fullsized":"2024-09-10T10:35:09.747549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:31:07.689782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791609+0000","last_change":"2024-09-10T10:34:44.743986+0000","last_active":"2024-09-10T10:34:55.791609+0000","last_peered":"2024-09-10T10:34:55.791609+0000","last_clean":"2024-09-10T10:34:55.791609+0000","last_became_active":"2024-09-10T10:34:44.743692+0000","last_became_peered":"2024-09-10T10:34:44.743692+0000","last_unstale":"2024-09-10T10:34:55.791609+0000","last_undegraded":"2024-09-10T10:34:55.791609+0000","last_fullsized":"2024-09-10T10:34:55.791609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:30:52.703390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807986+0000","last_change":"2024-09-10T10:34:42.816493+0000","last_active":"2024-09-10T10:34:55.807986+0000","last_peered":"2024-09-10T10:34:55.807986+0000","last_clean":"2024-09-10T10:34:55.807986+0000","last_became_active":"2024-09-10T10:34:42.816184+0000","last_became_peered":"2024-09-10T10:34:42.816184+0000","last_unstale":"2024-09-10T10:34:55.807986+0000","last_undegraded":"2024-09-10T10:34:55.807986+0000","last_fullsized":"2024-09-10T10:34:55.807986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:15:36.589002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807910+0000","last_change":"2024-09-10T10:34:44.753526+0000","last_active":"2024-09-10T10:34:55.807910+0000","last_peered":"2024-09-10T10:34:55.807910+0000","last_clean":"2024-09-10T10:34:55.807910+0000","last_became_active":"2024-09-10T10:34:44.753243+0000","last_became_peered":"2024-09-10T10:34:44.753243+0000","last_unstale":"2024-09-10T10:34:55.807910+0000","last_undegraded":"2024-09-10T10:34:55.807910+0000","last_fullsized":"2024-09-10T10:34:55.807910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:37.310489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787510+0000","last_change":"2024-09-10T10:34:42.760422+0000","last_active":"2024-09-10T10:34:55.787510+0000","last_peered":"2024-09-10T10:34:55.787510+0000","last_clean":"2024-09-10T10:34:55.787510+0000","last_became_active":"2024-09-10T10:34:42.759992+0000","last_became_peered":"2024-09-10T10:34:42.759992+0000","last_unstale":"2024-09-10T10:34:55.787510+0000","last_undegraded":"2024-09-10T10:34:55.787510+0000","last_fullsized":"2024-09-10T10:34:55.787510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:21:40.191718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790527+0000","last_change":"2024-09-10T10:34:44.748835+0000","last_active":"2024-09-10T10:34:55.790527+0000","last_peered":"2024-09-10T10:34:55.790527+0000","last_clean":"2024-09-10T10:34:55.790527+0000","last_became_active":"2024-09-10T10:34:44.748512+0000","last_became_peered":"2024-09-10T10:34:44.748512+0000","last_unstale":"2024-09-10T10:34:55.790527+0000","last_undegraded":"2024-09-10T10:34:55.790527+0000","last_fullsized":"2024-09-10T10:34:55.790527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:21:23.208046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808545+0000","last_change":"2024-09-10T10:34:42.730533+0000","last_active":"2024-09-10T10:34:55.808545+0000","last_peered":"2024-09-10T10:34:55.808545+0000","last_clean":"2024-09-10T10:34:55.808545+0000","last_became_active":"2024-09-10T10:34:42.730182+0000","last_became_peered":"2024-09-10T10:34:42.730182+0000","last_unstale":"2024-09-10T10:34:55.808545+0000","last_undegraded":"2024-09-10T10:34:55.808545+0000","last_fullsized":"2024-09-10T10:34:55.808545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:52.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.788162+0000","last_change":"2024-09-10T10:34:44.748168+0000","last_active":"2024-09-10T10:34:55.788162+0000","last_peered":"2024-09-10T10:34:55.788162+0000","last_clean":"2024-09-10T10:34:55.788162+0000","last_became_active":"2024-09-10T10:34:44.747728+0000","last_became_peered":"2024-09-10T10:34:44.747728+0000","last_unstale":"2024-09-10T10:34:55.788162+0000","last_undegraded":"2024-09-10T10:34:55.788162+0000","last_fullsized":"2024-09-10T10:34:55.788162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:07:07.854731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.786661+0000","last_change":"2024-09-10T10:34:55.797384+0000","last_active":"2024-09-10T10:34:56.786661+0000","last_peered":"2024-09-10T10:34:56.786661+0000","last_clean":"2024-09-10T10:34:56.786661+0000","last_became_active":"2024-09-10T10:34:55.792994+0000","last_became_peered":"2024-09-10T10:34:55.792994+0000","last_unstale":"2024-09-10T10:34:56.786661+0000","last_undegraded":"2024-09-10T10:34:56.786661+0000","last_fullsized":"2024-09-10T10:34:56.786661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:11.161379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791002+0000","last_change":"2024-09-10T10:34:44.752488+0000","last_active":"2024-09-10T10:34:55.791002+0000","last_peered":"2024-09-10T10:34:55.791002+0000","last_clean":"2024-09-10T10:34:55.791002+0000","last_became_active":"2024-09-10T10:34:44.752172+0000","last_became_peered":"2024-09-10T10:34:44.752172+0000","last_unstale":"2024-09-10T10:34:55.791002+0000","last_undegraded":"2024-09-10T10:34:55.791002+0000","last_fullsized":"2024-09-10T10:34:55.791002+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:25:18.150982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.790888+0000","last_change":"2024-09-10T10:34:42.729662+0000","last_active":"2024-09-10T10:34:55.790888+0000","last_peered":"2024-09-10T10:34:55.790888+0000","last_clean":"2024-09-10T10:34:55.790888+0000","last_became_active":"2024-09-10T10:34:42.729037+0000","last_became_peered":"2024-09-10T10:34:42.729037+0000","last_unstale":"2024-09-10T10:34:55.790888+0000","last_undegraded":"2024-09-10T10:34:55.790888+0000","last_fullsized":"2024-09-10T10:34:55.790888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:19.367904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.806223+0000","last_change":"2024-09-10T10:34:44.759093+0000","last_active":"2024-09-10T10:34:55.806223+0000","last_peered":"2024-09-10T10:34:55.806223+0000","last_clean":"2024-09-10T10:34:55.806223+0000","last_became_active":"2024-09-10T10:34:44.758625+0000","last_became_peered":"2024-09-10T10:34:44.758625+0000","last_unstale":"2024-09-10T10:34:55.806223+0000","last_undegraded":"2024-09-10T10:34:55.806223+0000","last_fullsized":"2024-09-10T10:34:55.806223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791414+0000","last_change":"2024-09-10T10:34:44.757373+0000","last_active":"2024-09-10T10:34:55.791414+0000","last_peered":"2024-09-10T10:34:55.791414+0000","last_clean":"2024-09-10T10:34:55.791414+0000","last_became_active":"2024-09-10T10:34:44.757048+0000","last_became_peered":"2024-09-10T10:34:44.757048+0000","last_unstale":"2024-09-10T10:34:55.791414+0000","last_undegraded":"2024-09-10T10:34:55.791414+0000","last_fullsized":"2024-09-10T10:34:55.791414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:05:30.438703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.808480+0000","last_change":"2024-09-10T10:34:42.732645+0000","last_active":"2024-09-10T10:34:55.808480+0000","last_peered":"2024-09-10T10:34:55.808480+0000","last_clean":"2024-09-10T10:34:55.808480+0000","last_became_active":"2024-09-10T10:34:42.732342+0000","last_became_peered":"2024-09-10T10:34:42.732342+0000","last_unstale":"2024-09-10T10:34:55.808480+0000","last_undegraded":"2024-09-10T10:34:55.808480+0000","last_fullsized":"2024-09-10T10:34:55.808480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:43:21.866063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.787603+0000","last_change":"2024-09-10T10:34:44.752039+0000","last_active":"2024-09-10T10:34:55.787603+0000","last_peered":"2024-09-10T10:34:55.787603+0000","last_clean":"2024-09-10T10:34:55.787603+0000","last_became_active":"2024-09-10T10:34:44.751706+0000","last_became_peered":"2024-09-10T10:34:44.751706+0000","last_unstale":"2024-09-10T10:34:55.787603+0000","last_undegraded":"2024-09-10T10:34:55.787603+0000","last_fullsized":"2024-09-10T10:34:55.787603+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:05:37.775921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:56.810394+0000","last_change":"2024-09-10T10:34:42.729973+0000","last_active":"2024-09-10T10:34:56.810394+0000","last_peered":"2024-09-10T10:34:56.810394+0000","last_clean":"2024-09-10T10:34:56.810394+0000","last_became_active":"2024-09-10T10:34:42.729554+0000","last_became_peered":"2024-09-10T10:34:42.729554+0000","last_unstale":"2024-09-10T10:34:56.810394+0000","last_undegraded":"2024-09-10T10:34:56.810394+0000","last_fullsized":"2024-09-10T10:34:56.810394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:15.289199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.807732+0000","last_change":"2024-09-10T10:34:44.756215+0000","last_active":"2024-09-10T10:34:55.807732+0000","last_peered":"2024-09-10T10:34:55.807732+0000","last_clean":"2024-09-10T10:34:55.807732+0000","last_became_active":"2024-09-10T10:34:44.755875+0000","last_became_peered":"2024-09-10T10:34:44.755875+0000","last_unstale":"2024-09-10T10:34:55.807732+0000","last_undegraded":"2024-09-10T10:34:55.807732+0000","last_fullsized":"2024-09-10T10:34:55.807732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:32.835503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791603+0000","last_change":"2024-09-10T10:34:42.760332+0000","last_active":"2024-09-10T10:34:55.791603+0000","last_peered":"2024-09-10T10:34:55.791603+0000","last_clean":"2024-09-10T10:34:55.791603+0000","last_became_active":"2024-09-10T10:34:42.759719+0000","last_became_peered":"2024-09-10T10:34:42.759719+0000","last_unstale":"2024-09-10T10:34:55.791603+0000","last_undegraded":"2024-09-10T10:34:55.791603+0000","last_fullsized":"2024-09-10T10:34:55.791603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:19:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:34:55.791467+0000","last_change":"2024-09-10T10:34:44.752056+0000","last_active":"2024-09-10T10:34:55.791467+0000","last_peered":"2024-09-10T10:34:55.791467+0000","last_clean":"2024-09-10T10:34:55.791467+0000","last_became_active":"2024-09-10T10:34:44.751528+0000","last_became_peered":"2024-09-10T10:34:44.751528+0000","last_unstale":"2024-09-10T10:34:55.791467+0000","last_undegraded":"2024-09-10T10:34:55.791467+0000","last_fullsized":"2024-09-10T10:34:55.791467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:43.716661+0000","last_clean_scrub_stamp":"2024-09-10T10:34:43.716661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:44.101379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T10:35:46.877879+0000","last_change":"2024-09-10T10:34:42.726735+0000","last_active":"2024-09-10T10:35:46.877879+0000","last_peered":"2024-09-10T10:35:46.877879+0000","last_clean":"2024-09-10T10:35:46.877879+0000","last_became_active":"2024-09-10T10:34:42.726351+0000","last_became_peered":"2024-09-10T10:34:42.726351+0000","last_unstale":"2024-09-10T10:35:46.877879+0000","last_undegraded":"2024-09-10T10:35:46.877879+0000","last_fullsized":"2024-09-10T10:35:46.877879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T10:34:41.707655+0000","last_clean_scrub_stamp":"2024-09-10T10:34:41.707655+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:20.412565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69125,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":556,"num_read_kb":358,"num_write":246,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":207375,"data_compressed":4809,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281739,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547226,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":439827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1064960,"data_stored":1092751,"data_compressed":37435,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":439342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":439698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1031847,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561076,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":439059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822712,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1031525,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986238,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":917504,"data_stored":438920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":438884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":502895,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":502282,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":937984,"data_stored":440791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34193,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35832,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":64062,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64675,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64046,"data_compressed":1603,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T10:35:52.228 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T10:35:52.228 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T10:35:52.228 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T10:35:52.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T10:35:52.473 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 -- 172.21.15.92:0/2952417030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968102790 msgr2=0x7f89681067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 --2- 172.21.15.92:0/2952417030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968102790 0x7f89681067e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8958009900 tx=0x7f895802a410 comp rx=0 tx=0).stop 2024-09-10T10:35:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 -- 172.21.15.92:0/2952417030 shutdown_connections 2024-09-10T10:35:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 --2- 172.21.15.92:0/2952417030 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968106f10 0x7f896810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 --2- 172.21.15.92:0/2952417030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968102790 0x7f89681067e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:52.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 --2- 172.21.15.92:0/2952417030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8968101de0 0x7f89681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 -- 172.21.15.92:0/2952417030 >> 172.21.15.92:0/2952417030 conn(0x7f89680fd8c0 msgr2=0x7f89680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 -- 172.21.15.92:0/2952417030 shutdown_connections 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 -- 172.21.15.92:0/2952417030 wait complete. 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 Processor -- start 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 -- start start 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8968101de0 0x7f8968198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968102790 0x7f89681989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.951+0000 7f896f83f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968106f10 0x7f896819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896f83f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8968111f90 con 0x7f8968106f10 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896f83f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8968111e10 con 0x7f8968102790 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896f83f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8968112110 con 0x7f8968101de0 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896dddc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968106f10 0x7f896819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:52.975 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896dddc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968106f10 0x7f896819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46182/0 (socket says 172.21.15.92:46182) 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896dddc640 1 -- 172.21.15.92:0/350984360 learned_addr learned my addr 172.21.15.92:0/350984360 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896cdda640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968102790 0x7f89681989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896d5db640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8968101de0 0x7f8968198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896dddc640 1 -- 172.21.15.92:0/350984360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8968101de0 msgr2=0x7f8968198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896dddc640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8968101de0 0x7f8968198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896dddc640 1 -- 172.21.15.92:0/350984360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968102790 msgr2=0x7f89681989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896dddc640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968102790 0x7f89681989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896dddc640 1 -- 172.21.15.92:0/350984360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896819d440 con 0x7f8968106f10 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896dddc640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968106f10 0x7f896819cd60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f896000eaa0 tx=0x7f896000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f895e7fc640 1 -- 172.21.15.92:0/350984360 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896000cdb0 con 0x7f8968106f10 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f895e7fc640 1 -- 172.21.15.92:0/350984360 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8960005020 con 0x7f8968106f10 2024-09-10T10:35:52.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896819d730 con 0x7f8968106f10 2024-09-10T10:35:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f895e7fc640 1 -- 172.21.15.92:0/350984360 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89600116b0 con 0x7f8968106f10 2024-09-10T10:35:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.952+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89681a5010 con 0x7f8968106f10 2024-09-10T10:35:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.953+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89681021c0 con 0x7f8968106f10 2024-09-10T10:35:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.954+0000 7f895e7fc640 1 -- 172.21.15.92:0/350984360 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8960005560 con 0x7f8968106f10 2024-09-10T10:35:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.955+0000 7f895e7fc640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f89540a2c10 0x7f89540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.955+0000 7f896d5db640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f89540a2c10 0x7f89540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.955+0000 7f895e7fc640 1 -- 172.21.15.92:0/350984360 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f89600cf350 con 0x7f8968106f10 2024-09-10T10:35:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.956+0000 7f896d5db640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f89540a2c10 0x7f89540a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8964009890 tx=0x7f8964008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:52.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:52.959+0000 7f895e7fc640 1 -- 172.21.15.92:0/350984360 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8960016030 con 0x7f8968106f10 2024-09-10T10:35:53.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.165+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f896810a150 con 0x7f8968106f10 2024-09-10T10:35:53.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.165+0000 7f895e7fc640 1 -- 172.21.15.92:0/350984360 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f896009c250 con 0x7f8968106f10 2024-09-10T10:35:53.167 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:53.167 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T10:35:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f89540a2c10 msgr2=0x7f89540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f89540a2c10 0x7f89540a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8964009890 tx=0x7f8964008040 comp rx=0 tx=0).stop 2024-09-10T10:35:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968106f10 msgr2=0x7f896819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968106f10 0x7f896819cd60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f896000eaa0 tx=0x7f896000ef60 comp rx=0 tx=0).stop 2024-09-10T10:35:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 shutdown_connections 2024-09-10T10:35:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f89540a2c10 0x7f89540a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8968106f10 0x7f896819cd60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8968102790 0x7f89681989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:53.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 --2- 172.21.15.92:0/350984360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8968101de0 0x7f8968198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:53.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 >> 172.21.15.92:0/350984360 conn(0x7f89680fd8c0 msgr2=0x7f89680fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:53.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 shutdown_connections 2024-09-10T10:35:53.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:53.167+0000 7f896f83f640 1 -- 172.21.15.92:0/350984360 wait complete. 2024-09-10T10:35:53.538 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:53 smithi092 ceph-mon[30834]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:53.538 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:53 smithi092 ceph-mon[30834]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:35:53.538 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:53 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/350984360' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T10:35:53.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:53 smithi121 ceph-mon[35231]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:53 smithi121 ceph-mon[35231]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:35:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:53 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/350984360' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T10:35:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:53 smithi097 ceph-mon[35213]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T10:35:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:53 smithi097 ceph-mon[35213]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:35:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:53 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/350984360' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T10:35:53.885 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T10:35:53.885 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:35:54.131 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.588+0000 7f05cd797640 1 -- 172.21.15.92:0/3429522399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 msgr2=0x7f05c81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.588+0000 7f05cd797640 1 --2- 172.21.15.92:0/3429522399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 0x7f05c81021c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009900 tx=0x7f05b802a410 comp rx=0 tx=0).stop 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.588+0000 7f05cd797640 1 -- 172.21.15.92:0/3429522399 shutdown_connections 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.588+0000 7f05cd797640 1 --2- 172.21.15.92:0/3429522399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05c8106f10 0x7f05c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.588+0000 7f05cd797640 1 --2- 172.21.15.92:0/3429522399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05c8102790 0x7f05c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.588+0000 7f05cd797640 1 --2- 172.21.15.92:0/3429522399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 0x7f05c81021c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.588+0000 7f05cd797640 1 -- 172.21.15.92:0/3429522399 >> 172.21.15.92:0/3429522399 conn(0x7f05c80fd8c0 msgr2=0x7f05c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.588+0000 7f05cd797640 1 -- 172.21.15.92:0/3429522399 shutdown_connections 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.588+0000 7f05cd797640 1 -- 172.21.15.92:0/3429522399 wait complete. 2024-09-10T10:35:54.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.589+0000 7f05cd797640 1 Processor -- start 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.589+0000 7f05cd797640 1 -- start start 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.589+0000 7f05cd797640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 0x7f05c8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.589+0000 7f05cd797640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05c8102790 0x7f05c81988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.589+0000 7f05cd797640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05c8106f10 0x7f05c819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.589+0000 7f05cd797640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05c8111f70 con 0x7f05c8101de0 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.589+0000 7f05cd797640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f05c8111df0 con 0x7f05c8106f10 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.589+0000 7f05cd797640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f05c81120f0 con 0x7f05c8102790 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.589+0000 7f05c6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 0x7f05c8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 0x7f05c8198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46190/0 (socket says 172.21.15.92:46190) 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c6ffd640 1 -- 172.21.15.92:0/534845871 learned_addr learned my addr 172.21.15.92:0/534845871 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c77fe640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05c8106f10 0x7f05c819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:54.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05be7fc640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05c8102790 0x7f05c81988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c6ffd640 1 -- 172.21.15.92:0/534845871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05c8102790 msgr2=0x7f05c81988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c6ffd640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05c8102790 0x7f05c81988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c6ffd640 1 -- 172.21.15.92:0/534845871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05c8106f10 msgr2=0x7f05c819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c6ffd640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05c8106f10 0x7f05c819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c6ffd640 1 -- 172.21.15.92:0/534845871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c819d340 con 0x7f05c8101de0 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05be7fc640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05c8102790 0x7f05c81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c6ffd640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 0x7f05c8198390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f05b8006010 tx=0x7f05b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c4ff9640 1 -- 172.21.15.92:0/534845871 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b803f030 con 0x7f05c8101de0 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c819d5d0 con 0x7f05c8101de0 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c4ff9640 1 -- 172.21.15.92:0/534845871 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05b8003ce0 con 0x7f05c8101de0 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05c4ff9640 1 -- 172.21.15.92:0/534845871 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8035070 con 0x7f05c8101de0 2024-09-10T10:35:54.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.590+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c81a4f10 con 0x7f05c8101de0 2024-09-10T10:35:54.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.591+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c81032c0 con 0x7f05c8101de0 2024-09-10T10:35:54.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.592+0000 7f05c4ff9640 1 -- 172.21.15.92:0/534845871 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f05b8042030 con 0x7f05c8101de0 2024-09-10T10:35:54.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.593+0000 7f05c4ff9640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f05b40a2c10 0x7f05b40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:54.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.593+0000 7f05be7fc640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f05b40a2c10 0x7f05b40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:54.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.593+0000 7f05c4ff9640 1 -- 172.21.15.92:0/534845871 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f05b80ef790 con 0x7f05c8101de0 2024-09-10T10:35:54.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.593+0000 7f05be7fc640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f05b40a2c10 0x7f05b40a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05c81088e0 tx=0x7f05b0005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:54.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.597+0000 7f05c4ff9640 1 -- 172.21.15.92:0/534845871 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05b80bc750 con 0x7f05c8101de0 2024-09-10T10:35:54.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.810+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05c810a0f0 con 0x7f05c8101de0 2024-09-10T10:35:54.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.811+0000 7f05c4ff9640 1 -- 172.21.15.92:0/534845871 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7f05b80bc050 con 0x7f05c8101de0 2024-09-10T10:35:54.812 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:54.812 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"btime":"2024-09-10T10:34:56:804663+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:34:45.351151+0000","modified":"2024-09-10T10:34:56.804641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24472,"mds_1":24451,"mds_2":24445,"mds_3":24431,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/15499972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":15499972},{"type":"v1","addr":"172.21.15.92:6841","nonce":15499972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24359":{"gid":24359,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24386":{"gid":24386,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":15,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"b","rank":3,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6839/2331166625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6838","nonce":2331166625},{"type":"v1","addr":"172.21.15.97:6839","nonce":2331166625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24451,24445,24431,24424]},"id":1}]} 2024-09-10T10:35:54.813 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2024-09-10T10:35:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f05b40a2c10 msgr2=0x7f05b40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f05b40a2c10 0x7f05b40a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f05c81088e0 tx=0x7f05b0005d90 comp rx=0 tx=0).stop 2024-09-10T10:35:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 msgr2=0x7f05c8198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 0x7f05c8198390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f05b8006010 tx=0x7f05b80042f0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 shutdown_connections 2024-09-10T10:35:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f05b40a2c10 0x7f05b40a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f05c8106f10 0x7f05c819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05c8102790 0x7f05c81988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 --2- 172.21.15.92:0/534845871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05c8101de0 0x7f05c8198390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:54.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.813+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 >> 172.21.15.92:0/534845871 conn(0x7f05c80fd8c0 msgr2=0x7f05c80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:54.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.814+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 shutdown_connections 2024-09-10T10:35:54.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:54.814+0000 7f05cd797640 1 -- 172.21.15.92:0/534845871 wait complete. 2024-09-10T10:35:55.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:55 smithi092 ceph-mon[30834]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:35:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:55 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/534845871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:35:55.519 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:35:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:55 smithi121 ceph-mon[35231]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:35:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:55 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/534845871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:35:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:55 smithi097 ceph-mon[35213]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:35:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:55 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/534845871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:35:55.766 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 -- 172.21.15.92:0/1512731184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 msgr2=0x7f65a810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 --2- 172.21.15.92:0/1512731184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 0x7f65a810d950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009cd0 tx=0x7f65a002a8e0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 -- 172.21.15.92:0/1512731184 shutdown_connections 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 --2- 172.21.15.92:0/1512731184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 0x7f65a810d950 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 --2- 172.21.15.92:0/1512731184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65a8100a80 0x7f65a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 --2- 172.21.15.92:0/1512731184 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a8106a80 0x7f65a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 -- 172.21.15.92:0/1512731184 >> 172.21.15.92:0/1512731184 conn(0x7f65a80fc7a0 msgr2=0x7f65a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 -- 172.21.15.92:0/1512731184 shutdown_connections 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 -- 172.21.15.92:0/1512731184 wait complete. 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.266+0000 7f65af008640 1 Processor -- start 2024-09-10T10:35:56.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65af008640 1 -- start start 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65af008640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a8100a80 0x7f65a8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65af008640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 0x7f65a8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65af008640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65a8106a80 0x7f65a819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65af008640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8111fa0 con 0x7f65a8101420 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65af008640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8111e20 con 0x7f65a8100a80 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65af008640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8112120 con 0x7f65a8106a80 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 0x7f65a8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 0x7f65a8198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46214/0 (socket says 172.21.15.92:46214) 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a7fff640 1 -- 172.21.15.92:0/219729638 learned_addr learned my addr 172.21.15.92:0/219729638 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65acda4640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a8100a80 0x7f65a8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65ad5a5640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65a8106a80 0x7f65a819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a7fff640 1 -- 172.21.15.92:0/219729638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65a8106a80 msgr2=0x7f65a819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:56.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a7fff640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65a8106a80 0x7f65a819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a7fff640 1 -- 172.21.15.92:0/219729638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a8100a80 msgr2=0x7f65a8198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a7fff640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a8100a80 0x7f65a8198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a7fff640 1 -- 172.21.15.92:0/219729638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a819d3d0 con 0x7f65a8101420 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a7fff640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 0x7f65a8198960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f659400d770 tx=0x7f659400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a5ffb640 1 -- 172.21.15.92:0/219729638 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594017070 con 0x7f65a8101420 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a5ffb640 1 -- 172.21.15.92:0/219729638 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6594005500 con 0x7f65a8101420 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65a5ffb640 1 -- 172.21.15.92:0/219729638 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594004e00 con 0x7f65a8101420 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.267+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a819d6c0 con 0x7f65a8101420 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.268+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a81a4fa0 con 0x7f65a8101420 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.269+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a8100ee0 con 0x7f65a8101420 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.270+0000 7f65a5ffb640 1 -- 172.21.15.92:0/219729638 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6594004fa0 con 0x7f65a8101420 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.270+0000 7f65a5ffb640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f65980a2c90 0x7f65980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:56.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.271+0000 7f65acda4640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f65980a2c90 0x7f65980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.271+0000 7f65a5ffb640 1 -- 172.21.15.92:0/219729638 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f65940ceaa0 con 0x7f65a8101420 2024-09-10T10:35:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.271+0000 7f65acda4640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f65980a2c90 0x7f65980a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f659c00bb60 tx=0x7f659c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:56.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.275+0000 7f65a5ffb640 1 -- 172.21.15.92:0/219729638 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f659409b9a0 con 0x7f65a8101420 2024-09-10T10:35:56.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.475+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65a8109070 con 0x7f65a8101420 2024-09-10T10:35:56.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.476+0000 7f65a5ffb640 1 -- 172.21.15.92:0/219729638 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7f659409b2a0 con 0x7f65a8101420 2024-09-10T10:35:56.478 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:56.478 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"btime":"2024-09-10T10:34:56:804663+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:34:45.351151+0000","modified":"2024-09-10T10:34:56.804641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24472,"mds_1":24451,"mds_2":24445,"mds_3":24431,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/15499972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":15499972},{"type":"v1","addr":"172.21.15.92:6841","nonce":15499972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24359":{"gid":24359,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24386":{"gid":24386,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":15,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"b","rank":3,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6839/2331166625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6838","nonce":2331166625},{"type":"v1","addr":"172.21.15.97:6839","nonce":2331166625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24451,24445,24431,24424]},"id":1}]} 2024-09-10T10:35:56.478 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2024-09-10T10:35:56.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f65980a2c90 msgr2=0x7f65980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:56.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f65980a2c90 0x7f65980a5150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f659c00bb60 tx=0x7f659c00b390 comp rx=0 tx=0).stop 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 msgr2=0x7f65a8198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 0x7f65a8198960 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f659400d770 tx=0x7f659400dc30 comp rx=0 tx=0).stop 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 shutdown_connections 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f65980a2c90 0x7f65980a5150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65a8106a80 0x7f65a819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a8101420 0x7f65a8198960 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 --2- 172.21.15.92:0/219729638 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f65a8100a80 0x7f65a8198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 >> 172.21.15.92:0/219729638 conn(0x7f65a80fc7a0 msgr2=0x7f65a80fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 shutdown_connections 2024-09-10T10:35:56.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:56.478+0000 7f65af008640 1 -- 172.21.15.92:0/219729638 wait complete. 2024-09-10T10:35:57.209 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:35:57.456 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:57.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:57 smithi121 ceph-mon[35231]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T10:35:57.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:57 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/219729638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:35:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:57 smithi097 ceph-mon[35213]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T10:35:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:57 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/219729638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:35:57.577 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:57 smithi092 ceph-mon[30834]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T10:35:57.577 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:57 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/219729638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:35:57.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.968+0000 7f664bb16640 1 -- 172.21.15.92:0/1425908992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644101de0 msgr2=0x7f66441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:57.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.968+0000 7f664bb16640 1 --2- 172.21.15.92:0/1425908992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644101de0 0x7f66441021c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6638009900 tx=0x7f663802a410 comp rx=0 tx=0).stop 2024-09-10T10:35:57.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.968+0000 7f664bb16640 1 -- 172.21.15.92:0/1425908992 shutdown_connections 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.968+0000 7f664bb16640 1 --2- 172.21.15.92:0/1425908992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6644106f10 0x7f664410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.968+0000 7f664bb16640 1 --2- 172.21.15.92:0/1425908992 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6644102790 0x7f66441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.968+0000 7f664bb16640 1 --2- 172.21.15.92:0/1425908992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644101de0 0x7f66441021c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.968+0000 7f664bb16640 1 -- 172.21.15.92:0/1425908992 >> 172.21.15.92:0/1425908992 conn(0x7f66440fd8c0 msgr2=0x7f66440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.968+0000 7f664bb16640 1 -- 172.21.15.92:0/1425908992 shutdown_connections 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.968+0000 7f664bb16640 1 -- 172.21.15.92:0/1425908992 wait complete. 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664bb16640 1 Processor -- start 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664bb16640 1 -- start start 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664bb16640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6644101de0 0x7f66440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664bb16640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6644102790 0x7f6644074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664bb16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644106f10 0x7f6644074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:57.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664bb16640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6644112060 con 0x7f6644106f10 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664bb16640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6644111ee0 con 0x7f6644101de0 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664bb16640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f66441121e0 con 0x7f6644102790 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664a0b3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644106f10 0x7f6644074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664a0b3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644106f10 0x7f6644074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46224/0 (socket says 172.21.15.92:46224) 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664a0b3640 1 -- 172.21.15.92:0/2169537412 learned_addr learned my addr 172.21.15.92:0/2169537412 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f66490b1640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6644102790 0x7f6644074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664a0b3640 1 -- 172.21.15.92:0/2169537412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6644102790 msgr2=0x7f6644074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664a0b3640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6644102790 0x7f6644074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664a0b3640 1 -- 172.21.15.92:0/2169537412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6644101de0 msgr2=0x7f66440744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664a0b3640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6644101de0 0x7f66440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664a0b3640 1 -- 172.21.15.92:0/2169537412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66441a6a80 con 0x7f6644106f10 2024-09-10T10:35:57.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f66490b1640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6644102790 0x7f6644074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f664a0b3640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644106f10 0x7f6644074f70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f663c00b970 tx=0x7f663c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.969+0000 7f6636ffd640 1 -- 172.21.15.92:0/2169537412 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c019070 con 0x7f6644106f10 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.970+0000 7f6636ffd640 1 -- 172.21.15.92:0/2169537412 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f663c00cb40 con 0x7f6644106f10 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.970+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66441a6d70 con 0x7f6644106f10 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.970+0000 7f6636ffd640 1 -- 172.21.15.92:0/2169537412 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c007650 con 0x7f6644106f10 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.970+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66441a72b0 con 0x7f6644106f10 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.970+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6644102240 con 0x7f6644106f10 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.972+0000 7f6636ffd640 1 -- 172.21.15.92:0/2169537412 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f663c01c070 con 0x7f6644106f10 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.972+0000 7f6636ffd640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66300a2c90 0x7f66300a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.972+0000 7f66498b2640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66300a2c90 0x7f66300a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.972+0000 7f6636ffd640 1 -- 172.21.15.92:0/2169537412 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f663c0cea10 con 0x7f6644106f10 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.973+0000 7f66498b2640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66300a2c90 0x7f66300a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f66380096c0 tx=0x7f6638000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:57.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:57.976+0000 7f6636ffd640 1 -- 172.21.15.92:0/2169537412 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f663c09ba20 con 0x7f6644106f10 2024-09-10T10:35:58.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.143+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f664402d7c0 con 0x7f6644106f10 2024-09-10T10:35:58.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.145+0000 7f6636ffd640 1 -- 172.21.15.92:0/2169537412 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22594 (secure 0 0 0) 0x7f663c09b320 con 0x7f6644106f10 2024-09-10T10:35:58.146 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:58.147 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":83,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:34:55.779980+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:34:41.056656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:34:43.485327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:35:58.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66300a2c90 msgr2=0x7f66300a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66300a2c90 0x7f66300a5150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f66380096c0 tx=0x7f6638000bc0 comp rx=0 tx=0).stop 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644106f10 msgr2=0x7f6644074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644106f10 0x7f6644074f70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f663c00b970 tx=0x7f663c00be30 comp rx=0 tx=0).stop 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 shutdown_connections 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66300a2c90 0x7f66300a5150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6644106f10 0x7f6644074f70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6644102790 0x7f6644074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 --2- 172.21.15.92:0/2169537412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6644101de0 0x7f66440744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 >> 172.21.15.92:0/2169537412 conn(0x7f66440fd8c0 msgr2=0x7f66440fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 shutdown_connections 2024-09-10T10:35:58.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:58.147+0000 7f664bb16640 1 -- 172.21.15.92:0/2169537412 wait complete. 2024-09-10T10:35:58.528 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:58 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2169537412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:58.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:58 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2169537412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:58 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2169537412' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:35:58.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:35:59.110 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:35:59.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:35:59 smithi092 ceph-mon[30834]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:35:59.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:35:59 smithi121 ceph-mon[35231]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:35:59.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:35:59 smithi097 ceph-mon[35213]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:35:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.571+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/1185784794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34108290 msgr2=0x7f6f3410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.571+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/1185784794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34108290 0x7f6f3410ec30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009930 tx=0x7f6f2c02a420 comp rx=0 tx=0).stop 2024-09-10T10:35:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.571+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/1185784794 shutdown_connections 2024-09-10T10:35:59.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.571+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/1185784794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34108290 0x7f6f3410ec30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.571+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/1185784794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f34103740 0x7f6f34107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.571+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/1185784794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f34102d90 0x7f6f34103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.571+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/1185784794 >> 172.21.15.92:0/1185784794 conn(0x7f6f340fc7d0 msgr2=0x7f6f340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.571+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/1185784794 shutdown_connections 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.571+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/1185784794 wait complete. 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f3b3bd640 1 Processor -- start 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f3b3bd640 1 -- start start 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f3b3bd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f34102d90 0x7f6f341009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f3b3bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34103740 0x7f6f34100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f3b3bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f34108290 0x7f6f34101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f3b3bd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6f341120d0 con 0x7f6f34103740 2024-09-10T10:35:59.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f3b3bd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6f34111f50 con 0x7f6f34102d90 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f3b3bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f34112250 con 0x7f6f34108290 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f38958640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34103740 0x7f6f34100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f38958640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34103740 0x7f6f34100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46250/0 (socket says 172.21.15.92:46250) 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f38958640 1 -- 172.21.15.92:0/2438183176 learned_addr learned my addr 172.21.15.92:0/2438183176 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f39159640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f34102d90 0x7f6f341009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f3995a640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f34108290 0x7f6f34101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f38958640 1 -- 172.21.15.92:0/2438183176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f34108290 msgr2=0x7f6f34101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f38958640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f34108290 0x7f6f34101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f38958640 1 -- 172.21.15.92:0/2438183176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f34102d90 msgr2=0x7f6f341009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f38958640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f34102d90 0x7f6f341009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f38958640 1 -- 172.21.15.92:0/2438183176 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f341a69d0 con 0x7f6f34103740 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f39159640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f34102d90 0x7f6f341009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:35:59.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f38958640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34103740 0x7f6f34100f30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800c970 tx=0x7f6f2800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.572+0000 7f6f327fc640 1 -- 172.21.15.92:0/2438183176 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28014070 con 0x7f6f34103740 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.573+0000 7f6f327fc640 1 -- 172.21.15.92:0/2438183176 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f28004440 con 0x7f6f34103740 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.573+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f341a6cc0 con 0x7f6f34103740 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.573+0000 7f6f327fc640 1 -- 172.21.15.92:0/2438183176 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800f450 con 0x7f6f34103740 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.573+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f341a71f0 con 0x7f6f34103740 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.574+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f3406a7f0 con 0x7f6f34103740 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.575+0000 7f6f327fc640 1 -- 172.21.15.92:0/2438183176 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6f28017070 con 0x7f6f34103740 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.576+0000 7f6f327fc640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6f1c0a2c90 0x7f6f1c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.576+0000 7f6f39159640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6f1c0a2c90 0x7f6f1c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.576+0000 7f6f327fc640 1 -- 172.21.15.92:0/2438183176 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f6f280cf330 con 0x7f6f34103740 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.576+0000 7f6f39159640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6f1c0a2c90 0x7f6f1c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009fa0 tx=0x7f6f24009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:35:59.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.579+0000 7f6f327fc640 1 -- 172.21.15.92:0/2438183176 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f2801e020 con 0x7f6f34103740 2024-09-10T10:35:59.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.778+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f34103170 con 0x7f6f34103740 2024-09-10T10:35:59.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.779+0000 7f6f327fc640 1 -- 172.21.15.92:0/2438183176 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7f6f34103170 con 0x7f6f34103740 2024-09-10T10:35:59.781 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:35:59.781 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"btime":"2024-09-10T10:34:56:804663+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:34:45.351151+0000","modified":"2024-09-10T10:34:56.804641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24472,"mds_1":24451,"mds_2":24445,"mds_3":24431,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/15499972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":15499972},{"type":"v1","addr":"172.21.15.92:6841","nonce":15499972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24359":{"gid":24359,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24386":{"gid":24386,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":15,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"b","rank":3,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6839/2331166625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6838","nonce":2331166625},{"type":"v1","addr":"172.21.15.97:6839","nonce":2331166625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24451,24445,24431,24424]},"id":1}]} 2024-09-10T10:35:59.782 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2024-09-10T10:35:59.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6f1c0a2c90 msgr2=0x7f6f1c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6f1c0a2c90 0x7f6f1c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009fa0 tx=0x7f6f24009570 comp rx=0 tx=0).stop 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34103740 msgr2=0x7f6f34100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34103740 0x7f6f34100f30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800c970 tx=0x7f6f2800ce30 comp rx=0 tx=0).stop 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 shutdown_connections 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f6f1c0a2c90 0x7f6f1c0a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f34108290 0x7f6f34101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f34103740 0x7f6f34100f30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 --2- 172.21.15.92:0/2438183176 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6f34102d90 0x7f6f341009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 >> 172.21.15.92:0/2438183176 conn(0x7f6f340fc7d0 msgr2=0x7f6f340fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 shutdown_connections 2024-09-10T10:35:59.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:35:59.782+0000 7f6f3b3bd640 1 -- 172.21.15.92:0/2438183176 wait complete. 2024-09-10T10:36:00.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:00 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2438183176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:36:00.426 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T10:34:45.351151+0000', 'modified': '2024-09-10T10:34:56.804641+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24472, 'mds_1': 24451, 'mds_2': 24445, 'mds_3': 24431, 'mds_4': 24424}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14619': {'gid': 14619, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6839/1641635662', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 1641635662}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 1641635662}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6841/15499972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6840', 'nonce': 15499972}, {'type': 'v1', 'addr': '172.21.15.92:6841', 'nonce': 15499972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24359': {'gid': 24359, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.97:6833/2610071582', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6832', 'nonce': 2610071582}, {'type': 'v1', 'addr': '172.21.15.97:6833', 'nonce': 2610071582}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24386': {'gid': 24386, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.97:6835/9514508', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6834', 'nonce': 9514508}, {'type': 'v1', 'addr': '172.21.15.97:6835', 'nonce': 9514508}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24407': {'gid': 24407, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.97:6837/4081108899', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6836', 'nonce': 4081108899}, {'type': 'v1', 'addr': '172.21.15.97:6837', 'nonce': 4081108899}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.121:6833/4152552339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 4152552339}, {'type': 'v1', 'addr': '172.21.15.121:6833', 'nonce': 4152552339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'b', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.97:6839/2331166625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6838', 'nonce': 2331166625}, {'type': 'v1', 'addr': '172.21.15.97:6839', 'nonce': 2331166625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.121:6835/2121443701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 2121443701}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 2121443701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.121:6837/332654710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6836', 'nonce': 332654710}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 332654710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.121:6839/3692560393', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 3692560393}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 3692560393}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24472, 24451, 24445, 24431, 24424]} 2024-09-10T10:36:00.426 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T10:36:00.426 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.l status 2024-09-10T10:36:00.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:00 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2438183176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:36:00.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:00 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2438183176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:36:00.670 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:01.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 -- 172.21.15.92:0/2248957460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4014102da0 msgr2=0x7f4014103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:01.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 --2- 172.21.15.92:0/2248957460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4014102da0 0x7f4014103180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4008009900 tx=0x7f400802a480 comp rx=0 tx=0).stop 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 -- 172.21.15.92:0/2248957460 shutdown_connections 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 --2- 172.21.15.92:0/2248957460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f401410c180 0x7f401410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 --2- 172.21.15.92:0/2248957460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40141036c0 0x7f401410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 --2- 172.21.15.92:0/2248957460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4014102da0 0x7f4014103180 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 -- 172.21.15.92:0/2248957460 >> 172.21.15.92:0/2248957460 conn(0x7f40140fc7a0 msgr2=0x7f40140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 -- 172.21.15.92:0/2248957460 shutdown_connections 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 -- 172.21.15.92:0/2248957460 wait complete. 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 Processor -- start 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 -- start start 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4014102da0 0x7f4014198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.148+0000 7f401b820640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40141036c0 0x7f40141989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f401b820640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f401410c180 0x7f401419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f401b820640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4014111fa0 con 0x7f401410c180 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f401b820640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4014111e20 con 0x7f40141036c0 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f401b820640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4014112120 con 0x7f4014102da0 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4019dbd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f401410c180 0x7f401419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4019dbd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f401410c180 0x7f401419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46278/0 (socket says 172.21.15.92:46278) 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4019dbd640 1 -- 172.21.15.92:0/3934498681 learned_addr learned my addr 172.21.15.92:0/3934498681 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4018dbb640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40141036c0 0x7f40141989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4019dbd640 1 -- 172.21.15.92:0/3934498681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4014102da0 msgr2=0x7f4014198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f40195bc640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4014102da0 0x7f4014198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4019dbd640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4014102da0 0x7f4014198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4019dbd640 1 -- 172.21.15.92:0/3934498681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40141036c0 msgr2=0x7f40141989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:01.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4019dbd640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40141036c0 0x7f40141989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4019dbd640 1 -- 172.21.15.92:0/3934498681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401419d430 con 0x7f401410c180 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4018dbb640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40141036c0 0x7f40141989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f4019dbd640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f401410c180 0x7f401419cd50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f400c00b970 tx=0x7f400c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f40067fc640 1 -- 172.21.15.92:0/3934498681 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c019070 con 0x7f401410c180 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f40067fc640 1 -- 172.21.15.92:0/3934498681 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f400c00cb40 con 0x7f401410c180 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f401b820640 1 -- 172.21.15.92:0/3934498681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401419d720 con 0x7f401410c180 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f40067fc640 1 -- 172.21.15.92:0/3934498681 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c007650 con 0x7f401410c180 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.149+0000 7f401b820640 1 -- 172.21.15.92:0/3934498681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40141a5000 con 0x7f401410c180 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.151+0000 7f40067fc640 1 -- 172.21.15.92:0/3934498681 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f400c01c070 con 0x7f401410c180 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f401dbf9740 1 Processor -- start 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f401dbf9740 1 -- start start 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f40067fc640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40000a2c10 0x7f40000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 0x55b6230d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230d0fc0 0x55b6230d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f401dbf9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b623028090 con 0x55b6230c18b0 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f401dbf9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b622fcfa70 con 0x55b6230d0fc0 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f401dbf9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b623024050 con 0x55b6230c21d0 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f4018dbb640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40000a2c10 0x7f40000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f40195bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f40195bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46286/0 (socket says 172.21.15.92:46286) 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.152+0000 7f40195bc640 1 -- 172.21.15.92:0/2047089649 learned_addr learned my addr 172.21.15.92:0/2047089649 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f40067fc640 1 -- 172.21.15.92:0/3934498681 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f400c0ce650 con 0x7f401410c180 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f4018dbb640 1 --2- 172.21.15.92:0/2047089649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 0x55b6230d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f4019dbd640 1 --2- 172.21.15.92:0/2047089649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230d0fc0 0x55b6230d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f40195bc640 1 -- 172.21.15.92:0/2047089649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 msgr2=0x55b6230d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f40195bc640 1 --2- 172.21.15.92:0/2047089649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 0x55b6230d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f40195bc640 1 -- 172.21.15.92:0/2047089649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230d0fc0 msgr2=0x55b6230d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f40195bc640 1 --2- 172.21.15.92:0/2047089649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230d0fc0 0x55b6230d33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f40195bc640 1 -- 172.21.15.92:0/2047089649 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b622fdc130 con 0x55b6230c18b0 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f4018dbb640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40000a2c10 0x7f40000a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4010005d00 tx=0x7f4010009740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f40195bc640 1 --2- 172.21.15.92:0/2047089649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230c1c90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4008006010 tx=0x7f4008031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e36bcccbe70e17f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f3fff7fe640 1 -- 172.21.15.92:0/2047089649 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400803f070 con 0x55b6230c18b0 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f3fff7fe640 1 -- 172.21.15.92:0/2047089649 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40080317b0 con 0x55b6230c18b0 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.153+0000 7f3fff7fe640 1 -- 172.21.15.92:0/2047089649 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4008035070 con 0x55b6230c18b0 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 -- 172.21.15.92:0/2047089649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 msgr2=0x55b6230c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 --2- 172.21.15.92:0/2047089649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230c1c90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4008006010 tx=0x7f4008031510 comp rx=0 tx=0).stop 2024-09-10T10:36:01.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 -- 172.21.15.92:0/2047089649 shutdown_connections 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 --2- 172.21.15.92:0/2047089649 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230d0fc0 0x55b6230d33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 --2- 172.21.15.92:0/2047089649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 0x55b6230d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 --2- 172.21.15.92:0/2047089649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230c1c90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 -- 172.21.15.92:0/2047089649 >> 172.21.15.92:0/2047089649 conn(0x55b6230bdf60 msgr2=0x55b6230be340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 -- 172.21.15.92:0/2047089649 shutdown_connections 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 -- 172.21.15.92:0/2047089649 wait complete. 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 -- start start 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.154+0000 7f401dbf9740 1 Processor -- start 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 0x55b6230cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 0x55b6230ce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f401dbf9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b6230d3b90 con 0x55b6230c18b0 2024-09-10T10:36:01.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f401dbf9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b622fe2f20 con 0x55b6230c21d0 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f401dbf9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b6230d3d10 con 0x55b6230d0fc0 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f401dbf9740 10 client.0 _ll_register_callbacks cb 0x55b622fac030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f40195bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f40195bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230d0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46290/0 (socket says 172.21.15.92:46290) 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f40195bc640 1 -- 172.21.15.92:0/1133756503 learned_addr learned my addr 172.21.15.92:0/1133756503 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f4018dbb640 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 0x55b6230cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f4019dbd640 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 0x55b6230ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f40195bc640 1 -- 172.21.15.92:0/1133756503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 msgr2=0x55b6230ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f40195bc640 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 0x55b6230ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f40195bc640 1 -- 172.21.15.92:0/1133756503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 msgr2=0x55b6230cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f40195bc640 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 0x55b6230cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f40195bc640 1 -- 172.21.15.92:0/1133756503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b622d992b0 con 0x55b6230c18b0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f40195bc640 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230d0790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4008005ab0 tx=0x7f400802abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d06cc9ddeac5f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.155+0000 7f3ffcff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f3ffcff9640 1 -- 172.21.15.92:0/1133756503 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400803f070 con 0x55b6230c18b0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f3ffcff9640 1 -- 172.21.15.92:0/1133756503 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f4008004050 con 0x55b6230c18b0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f401dbf9740 1 -- 172.21.15.92:0/1133756503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40080317b0 con 0x55b6230c18b0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f3ffcff9640 1 -- 172.21.15.92:0/1133756503 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4008035040 con 0x55b6230c18b0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f401dbf9740 10 client.14982 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f401dbf9740 1 -- 172.21.15.92:0/1133756503 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b6230df450 con 0x55b6230c18b0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f3ffcff9640 1 -- 172.21.15.92:0/1133756503 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40080317b0 con 0x55b6230c18b0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f3ffcff9640 1 -- 172.21.15.92:0/1133756503 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f40080046c0 con 0x55b6230c18b0 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f401dbf9740 10 client.14982 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f401dbf9740 10 client.14982 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-10T10:36:01.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f401dbf9740 20 client.14982 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f401dbf9740 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x55b6230e15e0 0x55b6230e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f401dbf9740 4 client.14982 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.156+0000 7f401dbf9740 1 -- 172.21.15.92:0/1133756503 --> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b623035600 con 0x55b6230e15e0 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.157+0000 7f4018dbb640 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x55b6230e15e0 0x55b6230e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.157+0000 7f4018dbb640 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x55b6230e15e0 0x55b6230e2a50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=81ef5f0b8cd6aca6 server_cookie=d616b6e7022c7fdd in_seq=0 out_seq=0 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.157+0000 7f3ffcff9640 10 client.14982 ms_handle_connect on v2:172.21.15.121:6832/4152552339 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f3ffcff9640 1 -- 172.21.15.92:0/1133756503 <== mds.4 v2:172.21.15.121:6832/4152552339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b623035600 con 0x55b6230e15e0 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f3ffcff9640 10 client.14982 handle_command_reply: tid=0 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 client.14982 shutdown 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 -- 172.21.15.92:0/1133756503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 msgr2=0x55b6230d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230d0790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4008005ab0 tx=0x7f400802abf0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 -- 172.21.15.92:0/1133756503 shutdown_connections 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x55b6230e15e0 0x55b6230e2a50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 0x55b6230ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f3ffcff9640 0 client.14982 ms_handle_reset on v2:172.21.15.121:6832/4152552339 2024-09-10T10:36:01.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 0x55b6230cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 --2- 172.21.15.92:0/1133756503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230d0790 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 -- 172.21.15.92:0/1133756503 >> 172.21.15.92:0/1133756503 conn(0x55b6230bdf60 msgr2=0x55b6230c3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:01.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 -- 172.21.15.92:0/1133756503 shutdown_connections 2024-09-10T10:36:01.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 1 -- 172.21.15.92:0/1133756503 wait complete. 2024-09-10T10:36:01.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.158+0000 7f401dbf9740 20 client.14982 trim_cache size 0 max 16384 2024-09-10T10:36:01.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f401dbf9740 1 Processor -- start 2024-09-10T10:36:01.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f401dbf9740 1 -- start start 2024-09-10T10:36:01.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c18b0 0x55b6230e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 0x55b6230e07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230d0fc0 0x55b6230b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f401dbf9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b6230e0d90 con 0x55b6230d0fc0 2024-09-10T10:36:01.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f401dbf9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b6230e1460 con 0x55b6230c18b0 2024-09-10T10:36:01.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f401dbf9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b6230e1b30 con 0x55b6230c21d0 2024-09-10T10:36:01.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f4019dbd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230d0fc0 0x55b6230b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f4019dbd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230d0fc0 0x55b6230b8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46298/0 (socket says 172.21.15.92:46298) 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f4019dbd640 1 -- 172.21.15.92:0/2638867661 learned_addr learned my addr 172.21.15.92:0/2638867661 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f40195bc640 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c18b0 0x55b6230e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f4019dbd640 1 -- 172.21.15.92:0/2638867661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 msgr2=0x55b6230e07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f4018dbb640 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 0x55b6230e07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f4019dbd640 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 0x55b6230e07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f4019dbd640 1 -- 172.21.15.92:0/2638867661 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c18b0 msgr2=0x55b6230e2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f4019dbd640 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c18b0 0x55b6230e2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f4019dbd640 1 -- 172.21.15.92:0/2638867661 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6230c2000 con 0x55b6230d0fc0 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.176+0000 7f40195bc640 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c18b0 0x55b6230e2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:01.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f4019dbd640 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230d0fc0 0x55b6230b8ce0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f400c00b940 tx=0x7f400c00e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73394c8fa10409 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f3ffeffd640 1 -- 172.21.15.92:0/2638867661 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c018360 con 0x55b6230d0fc0 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f3ffeffd640 1 -- 172.21.15.92:0/2638867661 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f400c0185a0 con 0x55b6230d0fc0 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f3ffeffd640 1 -- 172.21.15.92:0/2638867661 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c0ce350 con 0x55b6230d0fc0 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f401dbf9740 1 -- 172.21.15.92:0/2638867661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230d0fc0 msgr2=0x55b6230b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f401dbf9740 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230d0fc0 0x55b6230b8ce0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f400c00b940 tx=0x7f400c00e040 comp rx=0 tx=0).stop 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f401dbf9740 1 -- 172.21.15.92:0/2638867661 shutdown_connections 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f401dbf9740 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230d0fc0 0x55b6230b8ce0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f401dbf9740 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230c21d0 0x55b6230e07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f401dbf9740 1 --2- 172.21.15.92:0/2638867661 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c18b0 0x55b6230e2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f401dbf9740 1 -- 172.21.15.92:0/2638867661 >> 172.21.15.92:0/2638867661 conn(0x55b6230bdf60 msgr2=0x55b6230c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f401dbf9740 1 -- 172.21.15.92:0/2638867661 shutdown_connections 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.177+0000 7f401dbf9740 1 -- 172.21.15.92:0/2638867661 wait complete. 2024-09-10T10:36:01.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f401dbf9740 1 -- start start 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f401dbf9740 1 Processor -- start 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 0x55b6230ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f401dbf9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 0x55b6230cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f401dbf9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b6230e28d0 con 0x55b6230c18b0 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f401dbf9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b6230e2200 con 0x55b6230c21d0 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f401dbf9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b6230e2fa0 con 0x55b6230d0fc0 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f401dbf9740 10 client.0 _ll_register_callbacks cb 0x7f400c097200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f40195bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f40195bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230eb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46306/0 (socket says 172.21.15.92:46306) 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f40195bc640 1 -- 172.21.15.92:0/4194342126 learned_addr learned my addr 172.21.15.92:0/4194342126 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.178+0000 7f4019dbd640 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 0x55b6230cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f4018dbb640 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 0x55b6230ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f40195bc640 1 -- 172.21.15.92:0/4194342126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 msgr2=0x55b6230cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f40195bc640 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 0x55b6230cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f40195bc640 1 -- 172.21.15.92:0/4194342126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 msgr2=0x55b6230ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f40195bc640 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 0x55b6230ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f40195bc640 1 -- 172.21.15.92:0/4194342126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6230cb100 con 0x55b6230c18b0 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f4018dbb640 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 0x55b6230ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f40195bc640 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230eb1b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4008000c00 tx=0x7f40080051a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa0df7e76e1cbf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f3ffcff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f3ffcff9640 1 -- 172.21.15.92:0/4194342126 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400803f070 con 0x55b6230c18b0 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f3ffcff9640 1 -- 172.21.15.92:0/4194342126 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f4008031b70 con 0x55b6230c18b0 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f401dbf9740 1 -- 172.21.15.92:0/4194342126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400c0185a0 con 0x55b6230c18b0 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f3ffcff9640 1 -- 172.21.15.92:0/4194342126 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4008061050 con 0x55b6230c18b0 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f401dbf9740 10 client.14988 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:01.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f401dbf9740 1 -- 172.21.15.92:0/4194342126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b6230e9a10 con 0x55b6230c18b0 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f3ffcff9640 1 -- 172.21.15.92:0/4194342126 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f400c0185a0 con 0x55b6230c18b0 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.179+0000 7f3ffcff9640 1 -- 172.21.15.92:0/4194342126 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f400803ba60 con 0x55b6230c18b0 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f401dbf9740 10 client.14988 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f401dbf9740 10 client.14988 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f401dbf9740 20 client.14988 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f401dbf9740 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x55b623150590 0x55b62314f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f401dbf9740 4 client.14988 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f401dbf9740 1 -- 172.21.15.92:0/4194342126 --> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] -- command(tid 0: {"prefix": "status"}) -- 0x55b62302fb10 con 0x55b623150590 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f4018dbb640 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x55b623150590 0x55b62314f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f4018dbb640 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x55b623150590 0x55b62314f2a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2daca2b18b288df5 server_cookie=9986d0a15dbd5c35 in_seq=0 out_seq=0 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f3ffcff9640 10 client.14988 ms_handle_connect on v2:172.21.15.121:6832/4152552339 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f3ffcff9640 1 -- 172.21.15.92:0/4194342126 <== mds.4 v2:172.21.15.121:6832/4152552339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b62302fb10 con 0x55b623150590 2024-09-10T10:36:01.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f3ffcff9640 10 client.14988 handle_command_reply: tid=0 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.180+0000 7f401dbf9740 1 client.14988 shutdown 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 -- 172.21.15.92:0/4194342126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 msgr2=0x55b6230eb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230eb1b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4008000c00 tx=0x7f40080051a0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 -- 172.21.15.92:0/4194342126 shutdown_connections 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x55b623150590 0x55b62314f2a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6230d0fc0 0x55b6230cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b6230c21d0 0x55b6230ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 --2- 172.21.15.92:0/4194342126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b6230c18b0 0x55b6230eb1b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 -- 172.21.15.92:0/4194342126 >> 172.21.15.92:0/4194342126 conn(0x55b6230bdf60 msgr2=0x55b6230c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f3ffcff9640 0 client.14988 ms_handle_reset on v2:172.21.15.121:6832/4152552339 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 -- 172.21.15.92:0/4194342126 shutdown_connections 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 1 -- 172.21.15.92:0/4194342126 wait complete. 2024-09-10T10:36:01.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401dbf9740 20 client.14988 trim_cache size 0 max 16384 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 4, 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24424, 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 65.383030637000005, 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:01.192 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:01.193 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:01.193 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 117.541173525 2024-09-10T10:36:01.193 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:01.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 -- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40000a2c10 msgr2=0x7f40000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:01.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40000a2c10 0x7f40000a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4010005d00 tx=0x7f4010009740 comp rx=0 tx=0).stop 2024-09-10T10:36:01.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 -- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f401410c180 msgr2=0x7f401419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:01.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f401410c180 0x7f401419cd50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f400c00b970 tx=0x7f400c00be30 comp rx=0 tx=0).stop 2024-09-10T10:36:01.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 -- 172.21.15.92:0/3934498681 shutdown_connections 2024-09-10T10:36:01.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f40000a2c10 0x7f40000a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f401410c180 0x7f401419cd50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f40141036c0 0x7f40141989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 --2- 172.21.15.92:0/3934498681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4014102da0 0x7f4014198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:01.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.181+0000 7f401b820640 1 -- 172.21.15.92:0/3934498681 >> 172.21.15.92:0/3934498681 conn(0x7f40140fc7a0 msgr2=0x7f40140fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:01.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.182+0000 7f401b820640 1 -- 172.21.15.92:0/3934498681 shutdown_connections 2024-09-10T10:36:01.194 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:01.182+0000 7f401b820640 1 -- 172.21.15.92:0/3934498681 wait complete. 2024-09-10T10:36:01.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:01 smithi092 ceph-mon[30834]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:36:01.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:01 smithi121 ceph-mon[35231]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:36:01.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:01 smithi097 ceph-mon[35213]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:36:01.893 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T10:36:02.139 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:02.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 -- 172.21.15.92:0/2108030918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54106a80 msgr2=0x7f2e54106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:02.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/2108030918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54106a80 0x7f2e54106e60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009930 tx=0x7f2e4402a420 comp rx=0 tx=0).stop 2024-09-10T10:36:02.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 -- 172.21.15.92:0/2108030918 shutdown_connections 2024-09-10T10:36:02.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/2108030918 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e54101420 0x7f2e5410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/2108030918 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e54100a80 0x7f2e54100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/2108030918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54106a80 0x7f2e54106e60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 -- 172.21.15.92:0/2108030918 >> 172.21.15.92:0/2108030918 conn(0x7f2e540fc7a0 msgr2=0x7f2e540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 -- 172.21.15.92:0/2108030918 shutdown_connections 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 -- 172.21.15.92:0/2108030918 wait complete. 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.615+0000 7f2e5a32e640 1 Processor -- start 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e5a32e640 1 -- start start 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e5a32e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e54100a80 0x7f2e541983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e5a32e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54101420 0x7f2e54198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e5a32e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e54106a80 0x7f2e5419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e5a32e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e54110e80 con 0x7f2e54101420 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e5a32e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e54110d00 con 0x7f2e54106a80 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e5a32e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2e54111000 con 0x7f2e54100a80 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54101420 0x7f2e54198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54101420 0x7f2e54198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60186/0 (socket says 172.21.15.92:60186) 2024-09-10T10:36:02.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e537fe640 1 -- 172.21.15.92:0/985372311 learned_addr learned my addr 172.21.15.92:0/985372311 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e53fff640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e54100a80 0x7f2e541983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e588cb640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e54106a80 0x7f2e5419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e537fe640 1 -- 172.21.15.92:0/985372311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e54100a80 msgr2=0x7f2e541983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e537fe640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e54100a80 0x7f2e541983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e537fe640 1 -- 172.21.15.92:0/985372311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e54106a80 msgr2=0x7f2e5419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e537fe640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e54106a80 0x7f2e5419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.616+0000 7f2e537fe640 1 -- 172.21.15.92:0/985372311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5419d390 con 0x7f2e54101420 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.617+0000 7f2e537fe640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54101420 0x7f2e54198920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c890 tx=0x7f2e3c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.617+0000 7f2e517fa640 1 -- 172.21.15.92:0/985372311 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c004220 con 0x7f2e54101420 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.617+0000 7f2e517fa640 1 -- 172.21.15.92:0/985372311 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3c0043c0 con 0x7f2e54101420 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.617+0000 7f2e5a32e640 1 -- 172.21.15.92:0/985372311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5419d680 con 0x7f2e54101420 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.617+0000 7f2e517fa640 1 -- 172.21.15.92:0/985372311 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0049e0 con 0x7f2e54101420 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.617+0000 7f2e5a32e640 1 -- 172.21.15.92:0/985372311 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e541a4f60 con 0x7f2e54101420 2024-09-10T10:36:02.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.619+0000 7f2e517fa640 1 -- 172.21.15.92:0/985372311 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2e3c0079b0 con 0x7f2e54101420 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.619+0000 7f2e5c707740 1 Processor -- start 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.619+0000 7f2e5c707740 1 -- start start 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e517fa640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2e400a2c90 0x7f2e400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e5c707740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5651e120a090 con 0x5651e12a42f0 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e5c707740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5651e11b1a70 con 0x5651e12a39d0 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e5c707740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5651e1206050 con 0x5651e12aebb0 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e588cb640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2e400a2c90 0x7f2e400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e517fa640 1 -- 172.21.15.92:0/985372311 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f2e3c0cf140 con 0x7f2e54101420 2024-09-10T10:36:02.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ae670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60198/0 (socket says 172.21.15.92:60198) 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e537fe640 1 -- 172.21.15.92:0/1033752575 learned_addr learned my addr 172.21.15.92:0/1033752575 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e53fff640 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e588cb640 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e537fe640 1 -- 172.21.15.92:0/1033752575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 msgr2=0x5651e12b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e537fe640 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e537fe640 1 -- 172.21.15.92:0/1033752575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 msgr2=0x5651e12a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e537fe640 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e537fe640 1 -- 172.21.15.92:0/1033752575 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e11be130 con 0x5651e12a42f0 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e588cb640 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e53fff640 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e588cb640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2e400a2c90 0x7f2e400a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c005fd0 tx=0x7f2e4c010740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:02.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e537fe640 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ae670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c09b5f0 tx=0x7f2e3c09b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1202b07895150075 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e4a7fc640 1 -- 172.21.15.92:0/1033752575 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c09b8f0 con 0x5651e12a42f0 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e4a7fc640 1 -- 172.21.15.92:0/1033752575 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3c09fbf0 con 0x5651e12a42f0 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.620+0000 7f2e4a7fc640 1 -- 172.21.15.92:0/1033752575 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c00e3b0 con 0x5651e12a42f0 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 -- 172.21.15.92:0/1033752575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 msgr2=0x5651e12ae670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ae670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c09b5f0 tx=0x7f2e3c09b430 comp rx=0 tx=0).stop 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 -- 172.21.15.92:0/1033752575 shutdown_connections 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ae670 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1033752575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 -- 172.21.15.92:0/1033752575 >> 172.21.15.92:0/1033752575 conn(0x5651e129ff60 msgr2=0x5651e12a0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 -- 172.21.15.92:0/1033752575 shutdown_connections 2024-09-10T10:36:02.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 -- 172.21.15.92:0/1033752575 wait complete. 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.621+0000 7f2e5c707740 1 -- start start 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e5c707740 1 Processor -- start 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e5c707740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5651e12b1780 con 0x5651e12a42f0 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e5c707740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5651e11c4f20 con 0x5651e12a39d0 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e5c707740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5651e12b1900 con 0x5651e12aebb0 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e5c707740 10 client.0 _ll_register_callbacks cb 0x5651e118e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ab720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60210/0 (socket says 172.21.15.92:60210) 2024-09-10T10:36:02.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e537fe640 1 -- 172.21.15.92:0/1985017363 learned_addr learned my addr 172.21.15.92:0/1985017363 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e53fff640 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e588cb640 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e537fe640 1 -- 172.21.15.92:0/1985017363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 msgr2=0x5651e12abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e537fe640 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e537fe640 1 -- 172.21.15.92:0/1985017363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 msgr2=0x5651e12ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e537fe640 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e537fe640 1 -- 172.21.15.92:0/1985017363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651e0f7b2b0 con 0x5651e12a42f0 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e588cb640 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e53fff640 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e537fe640 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ab720 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c004610 tx=0x7f2e3c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f287609f61a00f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:02.644 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.622+0000 7f2e337fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e337fe640 1 -- 172.21.15.92:0/1985017363 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0b9060 con 0x5651e12a42f0 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e337fe640 1 -- 172.21.15.92:0/1985017363 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f2e3c00e3b0 con 0x5651e12a42f0 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e5c707740 1 -- 172.21.15.92:0/1985017363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e3c09fbf0 con 0x5651e12a42f0 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e337fe640 1 -- 172.21.15.92:0/1985017363 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2e3c0ba250 con 0x5651e12a42f0 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e5c707740 10 client.15000 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e5c707740 1 -- 172.21.15.92:0/1985017363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5651e12b1780 con 0x5651e12a42f0 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e337fe640 1 -- 172.21.15.92:0/1985017363 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3c09fbf0 con 0x5651e12a42f0 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e337fe640 1 -- 172.21.15.92:0/1985017363 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2e3c09cb70 con 0x5651e12a42f0 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e5c707740 10 client.15000 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e5c707740 10 client.15000 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e5c707740 20 client.15000 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:02.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x5651e12bf150 0x5651e12c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e5c707740 4 client.15000 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e5c707740 1 -- 172.21.15.92:0/1985017363 --> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651e1217600 con 0x5651e12bf150 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.623+0000 7f2e53fff640 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x5651e12bf150 0x5651e12c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.624+0000 7f2e337fe640 10 client.15000 ms_handle_connect on v2:172.21.15.97:6838/2331166625 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.624+0000 7f2e53fff640 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x5651e12bf150 0x5651e12c05c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e432f389095d3cd0 server_cookie=fb811ea14603534d in_seq=0 out_seq=0 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e337fe640 1 -- 172.21.15.92:0/1985017363 <== mds.3 v2:172.21.15.97:6838/2331166625 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651e1217600 con 0x5651e12bf150 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e337fe640 10 client.15000 handle_command_reply: tid=0 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 client.15000 shutdown 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 -- 172.21.15.92:0/1985017363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 msgr2=0x5651e12ab720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ab720 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c004610 tx=0x7f2e3c020000 comp rx=0 tx=0).stop 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 -- 172.21.15.92:0/1985017363 shutdown_connections 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x5651e12bf150 0x5651e12c05c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12aebb0 0x5651e12abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a42f0 0x5651e12ab720 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1985017363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a39d0 0x5651e12ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 -- 172.21.15.92:0/1985017363 >> 172.21.15.92:0/1985017363 conn(0x5651e129ff60 msgr2=0x5651e12a5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e337fe640 0 client.15000 ms_handle_reset on v2:172.21.15.97:6838/2331166625 2024-09-10T10:36:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 -- 172.21.15.92:0/1985017363 shutdown_connections 2024-09-10T10:36:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 1 -- 172.21.15.92:0/1985017363 wait complete. 2024-09-10T10:36:02.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.625+0000 7f2e5c707740 20 client.15000 trim_cache size 0 max 16384 2024-09-10T10:36:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e5c707740 1 Processor -- start 2024-09-10T10:36:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e5c707740 1 -- start start 2024-09-10T10:36:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a39d0 0x5651e12bf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a42f0 0x5651e12c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12aebb0 0x5651e12c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e5c707740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5651e12be900 con 0x5651e12a39d0 2024-09-10T10:36:02.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e5c707740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5651e12befd0 con 0x5651e12aebb0 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e5c707740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5651e12bf6a0 con 0x5651e12a42f0 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e53fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a39d0 0x5651e12bf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e53fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a39d0 0x5651e12bf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60220/0 (socket says 172.21.15.92:60220) 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e53fff640 1 -- 172.21.15.92:0/1333887108 learned_addr learned my addr 172.21.15.92:0/1333887108 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e537fe640 1 --2- 172.21.15.92:0/1333887108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a42f0 0x5651e12c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e53fff640 1 -- 172.21.15.92:0/1333887108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a42f0 msgr2=0x5651e12c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e53fff640 1 --2- 172.21.15.92:0/1333887108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a42f0 0x5651e12c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e53fff640 1 -- 172.21.15.92:0/1333887108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12aebb0 msgr2=0x5651e12c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e53fff640 1 --2- 172.21.15.92:0/1333887108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12aebb0 0x5651e12c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e53fff640 1 -- 172.21.15.92:0/1333887108 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e12a10f0 con 0x5651e12a39d0 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.643+0000 7f2e53fff640 1 --2- 172.21.15.92:0/1333887108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a39d0 0x5651e12bf820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009900 tx=0x7f2e440058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228e06d12a8b9228 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e49ffb640 1 -- 172.21.15.92:0/1333887108 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4404a070 con 0x5651e12a39d0 2024-09-10T10:36:02.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e49ffb640 1 -- 172.21.15.92:0/1333887108 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e44004240 con 0x5651e12a39d0 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e49ffb640 1 -- 172.21.15.92:0/1333887108 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44035040 con 0x5651e12a39d0 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e5c707740 1 -- 172.21.15.92:0/1333887108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a39d0 msgr2=0x5651e12bf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1333887108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a39d0 0x5651e12bf820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009900 tx=0x7f2e440058d0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e5c707740 1 -- 172.21.15.92:0/1333887108 shutdown_connections 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1333887108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12aebb0 0x5651e12c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1333887108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a42f0 0x5651e12c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e5c707740 1 --2- 172.21.15.92:0/1333887108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12a39d0 0x5651e12bf820 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e5c707740 1 -- 172.21.15.92:0/1333887108 >> 172.21.15.92:0/1333887108 conn(0x5651e129ff60 msgr2=0x5651e12be1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e5c707740 1 -- 172.21.15.92:0/1333887108 shutdown_connections 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.644+0000 7f2e5c707740 1 -- 172.21.15.92:0/1333887108 wait complete. 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e5c707740 1 -- start start 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e5c707740 1 Processor -- start 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a39d0 0x5651e12c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a42f0 0x5651e12c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e5c707740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12aebb0 0x5651e1327850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e5c707740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5651e12c0440 con 0x5651e12aebb0 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e5c707740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5651e12bfd70 con 0x5651e12a42f0 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e5c707740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5651e12c0b10 con 0x5651e12a39d0 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e5c707740 10 client.0 _ll_register_callbacks cb 0x7f2e3c09b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e588cb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12aebb0 0x5651e1327850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e588cb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12aebb0 0x5651e1327850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60224/0 (socket says 172.21.15.92:60224) 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e588cb640 1 -- 172.21.15.92:0/454607663 learned_addr learned my addr 172.21.15.92:0/454607663 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e53fff640 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a39d0 0x5651e12c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.645+0000 7f2e537fe640 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a42f0 0x5651e12c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e588cb640 1 -- 172.21.15.92:0/454607663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a39d0 msgr2=0x5651e12c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e588cb640 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a39d0 0x5651e12c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e588cb640 1 -- 172.21.15.92:0/454607663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a42f0 msgr2=0x5651e12c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e588cb640 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a42f0 0x5651e12c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e588cb640 1 -- 172.21.15.92:0/454607663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651e1327d90 con 0x5651e12aebb0 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e588cb640 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12aebb0 0x5651e1327850 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c010c40 tx=0x7f2e4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d80c4cc6bfb3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e337fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e337fe640 1 -- 172.21.15.92:0/454607663 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c020620 con 0x5651e12aebb0 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e5c707740 1 -- 172.21.15.92:0/454607663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e44004240 con 0x5651e12aebb0 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e337fe640 1 -- 172.21.15.92:0/454607663 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f2e4c0207c0 con 0x5651e12aebb0 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e337fe640 1 -- 172.21.15.92:0/454607663 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2e4c012e50 con 0x5651e12aebb0 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e5c707740 10 client.15006 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:02.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e5c707740 1 -- 172.21.15.92:0/454607663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5651e13290b0 con 0x5651e12aebb0 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e337fe640 1 -- 172.21.15.92:0/454607663 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e44004240 con 0x5651e12aebb0 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e337fe640 1 -- 172.21.15.92:0/454607663 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2e4c00f040 con 0x5651e12aebb0 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.646+0000 7f2e5c707740 10 client.15006 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e5c707740 10 client.15006 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e5c707740 20 client.15006 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e5c707740 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x5651e132dc80 0x5651e132c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e5c707740 4 client.15006 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e5c707740 1 -- 172.21.15.92:0/454607663 --> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] -- command(tid 0: {"prefix": "status"}) -- 0x5651e1211b10 con 0x5651e132dc80 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e53fff640 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x5651e132dc80 0x5651e132c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e337fe640 10 client.15006 ms_handle_connect on v2:172.21.15.97:6838/2331166625 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e53fff640 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x5651e132dc80 0x5651e132c990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c66c4118409d74f5 server_cookie=4703a17362ad5da in_seq=0 out_seq=0 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e337fe640 1 -- 172.21.15.92:0/454607663 <== mds.3 v2:172.21.15.97:6838/2331166625 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5651e1211b10 con 0x5651e132dc80 2024-09-10T10:36:02.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e337fe640 10 client.15006 handle_command_reply: tid=0 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.647+0000 7f2e5c707740 1 client.15006 shutdown 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 -- 172.21.15.92:0/454607663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12aebb0 msgr2=0x5651e1327850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12aebb0 0x5651e1327850 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c010c40 tx=0x7f2e4c004a40 comp rx=0 tx=0).stop 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 -- 172.21.15.92:0/454607663 shutdown_connections 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x5651e132dc80 0x5651e132c990 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5651e12aebb0 0x5651e1327850 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5651e12a42f0 0x5651e12c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 --2- 172.21.15.92:0/454607663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5651e12a39d0 0x5651e12c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 -- 172.21.15.92:0/454607663 >> 172.21.15.92:0/454607663 conn(0x5651e129ff60 msgr2=0x5651e12acf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e337fe640 0 client.15006 ms_handle_reset on v2:172.21.15.97:6838/2331166625 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 -- 172.21.15.92:0/454607663 shutdown_connections 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 1 -- 172.21.15.92:0/454607663 wait complete. 2024-09-10T10:36:02.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5c707740 20 client.15006 trim_cache size 0 max 16384 2024-09-10T10:36:02.659 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:02.659 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:02.659 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 3, 2024-09-10T10:36:02.659 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24431, 2024-09-10T10:36:02.659 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:02.659 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:02.659 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:02.659 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 67.868224085999998, 2024-09-10T10:36:02.659 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:02.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:02.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:02.660 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 87.695752885000005 2024-09-10T10:36:02.660 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:02.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5a32e640 1 -- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2e400a2c90 msgr2=0x7f2e400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:02.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2e400a2c90 0x7f2e400a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c005fd0 tx=0x7f2e4c010740 comp rx=0 tx=0).stop 2024-09-10T10:36:02.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5a32e640 1 -- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54101420 msgr2=0x7f2e54198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:02.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.648+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54101420 0x7f2e54198920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c890 tx=0x7f2e3c00cd50 comp rx=0 tx=0).stop 2024-09-10T10:36:02.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.649+0000 7f2e5a32e640 1 -- 172.21.15.92:0/985372311 shutdown_connections 2024-09-10T10:36:02.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.649+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2e400a2c90 0x7f2e400a5150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.649+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e54106a80 0x7f2e5419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.649+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e54101420 0x7f2e54198920 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.649+0000 7f2e5a32e640 1 --2- 172.21.15.92:0/985372311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e54100a80 0x7f2e541983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:02.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.649+0000 7f2e5a32e640 1 -- 172.21.15.92:0/985372311 >> 172.21.15.92:0/985372311 conn(0x7f2e540fc7a0 msgr2=0x7f2e5406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:02.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.649+0000 7f2e5a32e640 1 -- 172.21.15.92:0/985372311 shutdown_connections 2024-09-10T10:36:02.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:02.649+0000 7f2e5a32e640 1 -- 172.21.15.92:0/985372311 wait complete. 2024-09-10T10:36:03.342 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:03 smithi092 ceph-mon[30834]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:36:03.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T10:36:03.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:03 smithi121 ceph-mon[35231]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:36:03.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:03 smithi097 ceph-mon[35213]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:36:03.612 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:04.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 -- 172.21.15.92:0/1214559739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102570 msgr2=0x7f7db81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 --2- 172.21.15.92:0/1214559739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102570 0x7f7db81029b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009900 tx=0x7f7da002a480 comp rx=0 tx=0).stop 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 -- 172.21.15.92:0/1214559739 shutdown_connections 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 --2- 172.21.15.92:0/1214559739 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7db8102ef0 0x7f7db810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 --2- 172.21.15.92:0/1214559739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102570 0x7f7db81029b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 --2- 172.21.15.92:0/1214559739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7db8100e20 0x7f7db8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 -- 172.21.15.92:0/1214559739 >> 172.21.15.92:0/1214559739 conn(0x7f7db80fc7d0 msgr2=0x7f7db80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 -- 172.21.15.92:0/1214559739 shutdown_connections 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 -- 172.21.15.92:0/1214559739 wait complete. 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 Processor -- start 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.100+0000 7f7dbe106640 1 -- start start 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7dbe106640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7db8100e20 0x7f7db80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7dbe106640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7db8102570 0x7f7db80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7dbe106640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102ef0 0x7f7db80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7dbe106640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8110f80 con 0x7f7db8102ef0 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7dbe106640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8110e00 con 0x7f7db8102570 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7dbe106640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8111100 con 0x7f7db8100e20 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102ef0 0x7f7db80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7db8100e20 0x7f7db80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102ef0 0x7f7db80fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60242/0 (socket says 172.21.15.92:60242) 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db7fff640 1 -- 172.21.15.92:0/586973126 learned_addr learned my addr 172.21.15.92:0/586973126 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7daeffd640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7db8102570 0x7f7db80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db7fff640 1 -- 172.21.15.92:0/586973126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7db8100e20 msgr2=0x7f7db80fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db7fff640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7db8100e20 0x7f7db80fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db7fff640 1 -- 172.21.15.92:0/586973126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7db8102570 msgr2=0x7f7db80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db7fff640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7db8102570 0x7f7db80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db7fff640 1 -- 172.21.15.92:0/586973126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db81a69e0 con 0x7f7db8102ef0 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7daeffd640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7db8102570 0x7f7db80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db7fff640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102ef0 0x7f7db80fd700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7db000cad0 tx=0x7f7db000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db57fa640 1 -- 172.21.15.92:0/586973126 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db000ae20 con 0x7f7db8102ef0 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db57fa640 1 -- 172.21.15.92:0/586973126 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db0005020 con 0x7f7db8102ef0 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7dbe106640 1 -- 172.21.15.92:0/586973126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db81a6cd0 con 0x7f7db8102ef0 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7db57fa640 1 -- 172.21.15.92:0/586973126 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db000f6f0 con 0x7f7db8102ef0 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.101+0000 7f7dbe106640 1 -- 172.21.15.92:0/586973126 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db81a71c0 con 0x7f7db8102ef0 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7db57fa640 1 -- 172.21.15.92:0/586973126 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7db00051d0 con 0x7f7db8102ef0 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7dc04df740 1 Processor -- start 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7dc04df740 1 -- start start 2024-09-10T10:36:04.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 0x55b841ed5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed62f0 0x55b841ee0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841ee2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7dc04df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b841e3c090 con 0x55b841ed62f0 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7dc04df740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b841de3a70 con 0x55b841ee0bb0 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7dc04df740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b841e38050 con 0x55b841ed59d0 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7db77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed62f0 0x55b841ee0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7daeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 0x55b841ed5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7db77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed62f0 0x55b841ee0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60248/0 (socket says 172.21.15.92:60248) 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7db77fe640 1 -- 172.21.15.92:0/989052933 learned_addr learned my addr 172.21.15.92:0/989052933 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.104+0000 7f7daeffd640 1 --2- 172.21.15.92:0/989052933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841ee2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7db57fa640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7da40a2c10 0x7f7da40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7db77fe640 1 -- 172.21.15.92:0/989052933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 msgr2=0x55b841ed5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7db77fe640 1 --2- 172.21.15.92:0/989052933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 0x55b841ed5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7db77fe640 1 -- 172.21.15.92:0/989052933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 msgr2=0x55b841ee2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7db77fe640 1 --2- 172.21.15.92:0/989052933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841ee2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7db77fe640 1 -- 172.21.15.92:0/989052933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b841df0130 con 0x55b841ed62f0 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7daeffd640 1 --2- 172.21.15.92:0/989052933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841ee2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7db7fff640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7da40a2c10 0x7f7da40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7db77fe640 1 --2- 172.21.15.92:0/989052933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed62f0 0x55b841ee0670 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009d20 tx=0x7f7da8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d570314f9bad5ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7db57fa640 1 -- 172.21.15.92:0/586973126 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f7db00cf0c0 con 0x7f7db8102ef0 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7dadffb640 1 -- 172.21.15.92:0/989052933 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da801e070 con 0x55b841ed62f0 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7dadffb640 1 -- 172.21.15.92:0/989052933 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da8009e10 con 0x55b841ed62f0 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.105+0000 7f7dadffb640 1 -- 172.21.15.92:0/989052933 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8018910 con 0x55b841ed62f0 2024-09-10T10:36:04.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 -- 172.21.15.92:0/989052933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed62f0 msgr2=0x55b841ee0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7db7fff640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7da40a2c10 0x7f7da40a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7db009b5c0 tx=0x7f7db006e980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 --2- 172.21.15.92:0/989052933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed62f0 0x55b841ee0670 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009d20 tx=0x7f7da8011810 comp rx=0 tx=0).stop 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 -- 172.21.15.92:0/989052933 shutdown_connections 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 --2- 172.21.15.92:0/989052933 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841ee2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 --2- 172.21.15.92:0/989052933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed62f0 0x55b841ee0670 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 --2- 172.21.15.92:0/989052933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 0x55b841ed5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 -- 172.21.15.92:0/989052933 >> 172.21.15.92:0/989052933 conn(0x55b841ed1f60 msgr2=0x55b841ed2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 -- 172.21.15.92:0/989052933 shutdown_connections 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 -- 172.21.15.92:0/989052933 wait complete. 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.106+0000 7f7dc04df740 1 -- start start 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7dc04df740 1 Processor -- start 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841ee0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 0x55b841edd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841eddcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7dc04df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b841ee3780 con 0x55b841ed59d0 2024-09-10T10:36:04.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7dc04df740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b841df6f20 con 0x55b841ee0bb0 2024-09-10T10:36:04.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7dc04df740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b841ee3900 con 0x55b841ed62f0 2024-09-10T10:36:04.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7dc04df740 10 client.0 _ll_register_callbacks cb 0x55b841dc0030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:04.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7daeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841ee0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7daeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841ee0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60264/0 (socket says 172.21.15.92:60264) 2024-09-10T10:36:04.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7daeffd640 1 -- 172.21.15.92:0/1660708765 learned_addr learned my addr 172.21.15.92:0/1660708765 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:04.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7db77fe640 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 0x55b841edd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7daeffd640 1 -- 172.21.15.92:0/1660708765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 msgr2=0x55b841edd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7daeffd640 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 0x55b841edd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7daeffd640 1 -- 172.21.15.92:0/1660708765 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 msgr2=0x55b841eddcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7daeffd640 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841eddcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7daeffd640 1 -- 172.21.15.92:0/1660708765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b841bad2b0 con 0x55b841ed59d0 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7daeffd640 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841ee0430 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7da0005c40 tx=0x7f7da0003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f00ec3def296bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7d96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1660708765 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0035040 con 0x55b841ed59d0 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1660708765 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f7da0031540 con 0x55b841ed59d0 2024-09-10T10:36:04.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.107+0000 7f7dc04df740 1 -- 172.21.15.92:0/1660708765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da8009e10 con 0x55b841ed59d0 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1660708765 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7da0050050 con 0x55b841ed59d0 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7dc04df740 10 client.15018 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7dc04df740 1 -- 172.21.15.92:0/1660708765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b841eef090 con 0x55b841ed59d0 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1660708765 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da8009e10 con 0x55b841ed59d0 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1660708765 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7da003a040 con 0x55b841ed59d0 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7dc04df740 10 client.15018 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7dc04df740 10 client.15018 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7dc04df740 20 client.15018 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x55b841ef1650 0x55b841ef2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7dc04df740 4 client.15018 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7dc04df740 1 -- 172.21.15.92:0/1660708765 --> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b841e49600 con 0x55b841ef1650 2024-09-10T10:36:04.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7db77fe640 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x55b841ef1650 0x55b841ef2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.108+0000 7f7db77fe640 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x55b841ef1650 0x55b841ef2ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b88b6dc4b18c3ab server_cookie=3e6fe0c94c5eda17 in_seq=0 out_seq=0 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7d96ffd640 10 client.15018 ms_handle_connect on v2:172.21.15.121:6834/2121443701 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1660708765 <== mds.2 v2:172.21.15.121:6834/2121443701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b841e49600 con 0x55b841ef1650 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7d96ffd640 10 client.15018 handle_command_reply: tid=0 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 client.15018 shutdown 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 -- 172.21.15.92:0/1660708765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 msgr2=0x55b841ee0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841ee0430 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7da0005c40 tx=0x7f7da0003960 comp rx=0 tx=0).stop 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 -- 172.21.15.92:0/1660708765 shutdown_connections 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x55b841ef1650 0x55b841ef2ac0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841eddcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 0x55b841edd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7d96ffd640 0 client.15018 ms_handle_reset on v2:172.21.15.121:6834/2121443701 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1660708765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841ee0430 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 -- 172.21.15.92:0/1660708765 >> 172.21.15.92:0/1660708765 conn(0x55b841ed1f60 msgr2=0x55b841ed7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 -- 172.21.15.92:0/1660708765 shutdown_connections 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.109+0000 7f7dc04df740 1 -- 172.21.15.92:0/1660708765 wait complete. 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.110+0000 7f7dc04df740 20 client.15018 trim_cache size 0 max 16384 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7dc04df740 1 Processor -- start 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7dc04df740 1 -- start start 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 0x55b841ef2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ed62f0 0x55b841ed0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ee0bb0 0x55b841eda9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7dc04df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b841ef0e00 con 0x55b841ee0bb0 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7dc04df740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b841ef14d0 con 0x55b841ed62f0 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7dc04df740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b841ef1ba0 con 0x55b841ed59d0 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7daeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ee0bb0 0x55b841eda9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7daeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ee0bb0 0x55b841eda9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60274/0 (socket says 172.21.15.92:60274) 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7daeffd640 1 -- 172.21.15.92:0/313220542 learned_addr learned my addr 172.21.15.92:0/313220542 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7daeffd640 1 --2- 172.21.15.92:0/313220542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 0x55b841ef2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7db77fe640 1 --2- 172.21.15.92:0/313220542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ed62f0 0x55b841ed0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7daeffd640 1 -- 172.21.15.92:0/313220542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 msgr2=0x55b841ef2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7daeffd640 1 --2- 172.21.15.92:0/313220542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 0x55b841ef2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7daeffd640 1 -- 172.21.15.92:0/313220542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ed62f0 msgr2=0x55b841ed0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7daeffd640 1 --2- 172.21.15.92:0/313220542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ed62f0 0x55b841ed0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.127+0000 7f7daeffd640 1 -- 172.21.15.92:0/313220542 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b841ee07a0 con 0x55b841ee0bb0 2024-09-10T10:36:04.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7daeffd640 1 --2- 172.21.15.92:0/313220542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ee0bb0 0x55b841eda9e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7da003dd00 tx=0x7f7da002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e6b24b69ee8552 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dad7fa640 1 -- 172.21.15.92:0/313220542 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0035040 con 0x55b841ee0bb0 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dad7fa640 1 -- 172.21.15.92:0/313220542 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da004d020 con 0x55b841ee0bb0 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dad7fa640 1 -- 172.21.15.92:0/313220542 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0004920 con 0x55b841ee0bb0 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dc04df740 1 -- 172.21.15.92:0/313220542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ee0bb0 msgr2=0x55b841eda9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dc04df740 1 --2- 172.21.15.92:0/313220542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ee0bb0 0x55b841eda9e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7da003dd00 tx=0x7f7da002a480 comp rx=0 tx=0).stop 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dc04df740 1 -- 172.21.15.92:0/313220542 shutdown_connections 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dc04df740 1 --2- 172.21.15.92:0/313220542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ee0bb0 0x55b841eda9e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dc04df740 1 --2- 172.21.15.92:0/313220542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ed62f0 0x55b841ed0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dc04df740 1 --2- 172.21.15.92:0/313220542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed59d0 0x55b841ef2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.128+0000 7f7dc04df740 1 -- 172.21.15.92:0/313220542 >> 172.21.15.92:0/313220542 conn(0x55b841ed1f60 msgr2=0x55b841ed07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:04.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 -- 172.21.15.92:0/313220542 shutdown_connections 2024-09-10T10:36:04.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 -- 172.21.15.92:0/313220542 wait complete. 2024-09-10T10:36:04.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 -- start start 2024-09-10T10:36:04.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 Processor -- start 2024-09-10T10:36:04.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841efb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 0x55b841ef67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841ef6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b841ef2940 con 0x55b841ed59d0 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b841ef2270 con 0x55b841ee0bb0 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b841ef3010 con 0x55b841ed62f0 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7dc04df740 10 client.0 _ll_register_callbacks cb 0x7f7da0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7daeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841efb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7daeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841efb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60278/0 (socket says 172.21.15.92:60278) 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7daeffd640 1 -- 172.21.15.92:0/1718862273 learned_addr learned my addr 172.21.15.92:0/1718862273 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.129+0000 7f7db77fe640 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 0x55b841ef67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7daeffd640 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841ef6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7daeffd640 1 -- 172.21.15.92:0/1718862273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 msgr2=0x55b841ef67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7daeffd640 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 0x55b841ef67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7daeffd640 1 -- 172.21.15.92:0/1718862273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 msgr2=0x55b841ef6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7daeffd640 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841ef6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7daeffd640 1 -- 172.21.15.92:0/1718862273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b841ef74d0 con 0x55b841ed59d0 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7db77fe640 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 0x55b841ef67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7daeffd640 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841efb480 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009850 tx=0x7f7da003d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601e6d3b5ab26ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7d96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1718862273 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0035040 con 0x55b841ed59d0 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1718862273 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f7da0005240 con 0x55b841ed59d0 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7dc04df740 1 -- 172.21.15.92:0/1718862273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da004d020 con 0x55b841ed59d0 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1718862273 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7da0005440 con 0x55b841ed59d0 2024-09-10T10:36:04.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7dc04df740 10 client.15024 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7dc04df740 1 -- 172.21.15.92:0/1718862273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b841f5bd10 con 0x55b841ed59d0 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.130+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1718862273 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7da004d020 con 0x55b841ed59d0 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1718862273 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f7da0031540 con 0x55b841ed59d0 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7dc04df740 10 client.15024 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7dc04df740 10 client.15024 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7dc04df740 20 client.15024 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x55b841f60510 0x55b841f5f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7dc04df740 4 client.15024 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7dc04df740 1 -- 172.21.15.92:0/1718862273 --> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] -- command(tid 0: {"prefix": "status"}) -- 0x55b841e43b10 con 0x55b841f60510 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7db77fe640 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x55b841f60510 0x55b841f5f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7db77fe640 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x55b841f60510 0x55b841f5f220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9bf041998506ee5e server_cookie=e08718110861605c in_seq=0 out_seq=0 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7d96ffd640 10 client.15024 ms_handle_connect on v2:172.21.15.121:6834/2121443701 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7d96ffd640 1 -- 172.21.15.92:0/1718862273 <== mds.2 v2:172.21.15.121:6834/2121443701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b841e43b10 con 0x55b841f60510 2024-09-10T10:36:04.151 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7d96ffd640 10 client.15024 handle_command_reply: tid=0 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.131+0000 7f7dc04df740 1 client.15024 shutdown 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 -- 172.21.15.92:0/1718862273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 msgr2=0x55b841efb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841efb480 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009850 tx=0x7f7da003d710 comp rx=0 tx=0).stop 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 -- 172.21.15.92:0/1718862273 shutdown_connections 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x55b841f60510 0x55b841f5f220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b841ee0bb0 0x55b841ef6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b841ed62f0 0x55b841ef67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7d96ffd640 0 client.15024 ms_handle_reset on v2:172.21.15.121:6834/2121443701 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 --2- 172.21.15.92:0/1718862273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b841ed59d0 0x55b841efb480 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 -- 172.21.15.92:0/1718862273 >> 172.21.15.92:0/1718862273 conn(0x55b841ed1f60 msgr2=0x55b841ed1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 -- 172.21.15.92:0/1718862273 shutdown_connections 2024-09-10T10:36:04.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 1 -- 172.21.15.92:0/1718862273 wait complete. 2024-09-10T10:36:04.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dc04df740 20 client.15024 trim_cache size 0 max 16384 2024-09-10T10:36:04.153 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:04.153 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:04.153 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2024-09-10T10:36:04.153 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24445, 2024-09-10T10:36:04.153 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:04.154 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:04.154 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:04.154 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 70.362730878999997, 2024-09-10T10:36:04.154 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:04.154 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:04.154 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:04.154 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 106.096734686 2024-09-10T10:36:04.154 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:04.155 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dbe106640 1 -- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7da40a2c10 msgr2=0x7f7da40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dbe106640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7da40a2c10 0x7f7da40a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7db009b5c0 tx=0x7f7db006e980 comp rx=0 tx=0).stop 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dbe106640 1 -- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102ef0 msgr2=0x7f7db80fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.132+0000 7f7dbe106640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102ef0 0x7f7db80fd700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7db000cad0 tx=0x7f7db000cf90 comp rx=0 tx=0).stop 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.133+0000 7f7dbe106640 1 -- 172.21.15.92:0/586973126 shutdown_connections 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.133+0000 7f7dbe106640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7da40a2c10 0x7f7da40a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.133+0000 7f7dbe106640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7db8102ef0 0x7f7db80fd700 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.133+0000 7f7dbe106640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7db8102570 0x7f7db80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.133+0000 7f7dbe106640 1 --2- 172.21.15.92:0/586973126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7db8100e20 0x7f7db80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.133+0000 7f7dbe106640 1 -- 172.21.15.92:0/586973126 >> 172.21.15.92:0/586973126 conn(0x7f7db80fc7d0 msgr2=0x7f7db8069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.133+0000 7f7dbe106640 1 -- 172.21.15.92:0/586973126 shutdown_connections 2024-09-10T10:36:04.156 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:04.133+0000 7f7dbe106640 1 -- 172.21.15.92:0/586973126 wait complete. 2024-09-10T10:36:04.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T10:36:05.056 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:05.521 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:05 smithi092 ceph-mon[30834]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:36:05.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:05 smithi121 ceph-mon[35231]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:36:05.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:05 smithi097 ceph-mon[35213]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:36:05.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.600+0000 7fa48b40c640 1 -- 172.21.15.92:0/1554719774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa484100e30 msgr2=0x7fa484104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:05.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.600+0000 7fa48b40c640 1 --2- 172.21.15.92:0/1554719774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa484100e30 0x7fa484104e80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa47400aa10 tx=0x7fa47402b720 comp rx=0 tx=0).stop 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.600+0000 7fa48b40c640 1 -- 172.21.15.92:0/1554719774 shutdown_connections 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.600+0000 7fa48b40c640 1 --2- 172.21.15.92:0/1554719774 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa4841055b0 0x7fa48410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.600+0000 7fa48b40c640 1 --2- 172.21.15.92:0/1554719774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa484100e30 0x7fa484104e80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.600+0000 7fa48b40c640 1 --2- 172.21.15.92:0/1554719774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa484100480 0x7fa484100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.600+0000 7fa48b40c640 1 -- 172.21.15.92:0/1554719774 >> 172.21.15.92:0/1554719774 conn(0x7fa484077210 msgr2=0x7fa4840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.600+0000 7fa48b40c640 1 -- 172.21.15.92:0/1554719774 shutdown_connections 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.600+0000 7fa48b40c640 1 -- 172.21.15.92:0/1554719774 wait complete. 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa48b40c640 1 Processor -- start 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa48b40c640 1 -- start start 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa48b40c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa484100480 0x7fa484196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa48b40c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa484100e30 0x7fa484196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa48b40c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4841055b0 0x7fa48419ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa48b40c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa48410fe30 con 0x7fa4841055b0 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa48b40c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa48410fcb0 con 0x7fa484100e30 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa48b40c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa48410ffb0 con 0x7fa484100480 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4899a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4841055b0 0x7fa48419ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4899a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4841055b0 0x7fa48419ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60300/0 (socket says 172.21.15.92:60300) 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4899a9640 1 -- 172.21.15.92:0/3198555086 learned_addr learned my addr 172.21.15.92:0/3198555086 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4891a8640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa484100480 0x7fa484196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4889a7640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa484100e30 0x7fa484196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4899a9640 1 -- 172.21.15.92:0/3198555086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa484100480 msgr2=0x7fa484196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4899a9640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa484100480 0x7fa484196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4899a9640 1 -- 172.21.15.92:0/3198555086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa484100e30 msgr2=0x7fa484196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4899a9640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa484100e30 0x7fa484196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4899a9640 1 -- 172.21.15.92:0/3198555086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48419b3e0 con 0x7fa4841055b0 2024-09-10T10:36:05.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.601+0000 7fa4891a8640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa484100480 0x7fa484196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.602+0000 7fa4899a9640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4841055b0 0x7fa48419ad00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00b970 tx=0x7fa47c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.602+0000 7fa47a7fc640 1 -- 172.21.15.92:0/3198555086 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c019070 con 0x7fa4841055b0 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.602+0000 7fa48b40c640 1 -- 172.21.15.92:0/3198555086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48419b6d0 con 0x7fa4841055b0 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.602+0000 7fa47a7fc640 1 -- 172.21.15.92:0/3198555086 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa47c00cb40 con 0x7fa4841055b0 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.602+0000 7fa47a7fc640 1 -- 172.21.15.92:0/3198555086 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c007650 con 0x7fa4841055b0 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.602+0000 7fa48b40c640 1 -- 172.21.15.92:0/3198555086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4841a2fb0 con 0x7fa4841055b0 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.604+0000 7fa47a7fc640 1 -- 172.21.15.92:0/3198555086 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa47c01c070 con 0x7fa4841055b0 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa48d7e5740 1 Processor -- start 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa48d7e5740 1 -- start start 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa47a7fc640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa4700a2c10 0x7fa4700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743343be0 0x55e743343fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e743344500 0x55e74334e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e74334edc0 0x55e7433511b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e7432a8090 con 0x55e743343be0 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e74324fa70 con 0x55e74334edc0 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e7432a4050 con 0x55e743344500 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4891a8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743343be0 0x55e743343fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4889a7640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa4700a2c10 0x7fa4700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4891a8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743343be0 0x55e743343fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60316/0 (socket says 172.21.15.92:60316) 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4891a8640 1 -- 172.21.15.92:0/437909832 learned_addr learned my addr 172.21.15.92:0/437909832 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa47a7fc640 1 -- 172.21.15.92:0/3198555086 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fa47c0ce730 con 0x7fa4841055b0 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4899a9640 1 --2- 172.21.15.92:0/437909832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e74334edc0 0x55e7433511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4891a8640 1 -- 172.21.15.92:0/437909832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e743344500 msgr2=0x55e74334e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4891a8640 1 --2- 172.21.15.92:0/437909832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e743344500 0x55e74334e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4891a8640 1 -- 172.21.15.92:0/437909832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e74334edc0 msgr2=0x55e7433511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4891a8640 1 --2- 172.21.15.92:0/437909832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e74334edc0 0x55e7433511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4891a8640 1 -- 172.21.15.92:0/437909832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74325c130 con 0x55e743343be0 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4899a9640 1 --2- 172.21.15.92:0/437909832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e74334edc0 0x55e7433511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4889a7640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa4700a2c10 0x7fa4700a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ff880 tx=0x7fa474030e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.605+0000 7fa4891a8640 1 --2- 172.21.15.92:0/437909832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743343be0 0x55e743343fc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa480007850 tx=0x7fa480007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dede51f9b03a155d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa46f7fe640 1 -- 172.21.15.92:0/437909832 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48000d950 con 0x55e743343be0 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa46f7fe640 1 -- 172.21.15.92:0/437909832 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa480018070 con 0x55e743343be0 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa46f7fe640 1 -- 172.21.15.92:0/437909832 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4800123e0 con 0x55e743343be0 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa48d7e5740 1 -- 172.21.15.92:0/437909832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743343be0 msgr2=0x55e743343fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/437909832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743343be0 0x55e743343fc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa480007850 tx=0x7fa480007d10 comp rx=0 tx=0).stop 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa48d7e5740 1 -- 172.21.15.92:0/437909832 shutdown_connections 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/437909832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e74334edc0 0x55e7433511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/437909832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e743344500 0x55e74334e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/437909832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743343be0 0x55e743343fc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa48d7e5740 1 -- 172.21.15.92:0/437909832 >> 172.21.15.92:0/437909832 conn(0x55e743340170 msgr2=0x55e743340550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa48d7e5740 1 -- 172.21.15.92:0/437909832 shutdown_connections 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.606+0000 7fa48d7e5740 1 -- 172.21.15.92:0/437909832 wait complete. 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa48d7e5740 1 -- start start 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa48d7e5740 1 Processor -- start 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e74334e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e74334be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e743351990 con 0x55e743344500 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e743262f20 con 0x55e743343be0 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e743351b10 con 0x55e74334edc0 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa48d7e5740 10 client.0 _ll_register_callbacks cb 0x55e74322c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa4889a7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa4889a7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60322/0 (socket says 172.21.15.92:60322) 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.607+0000 7fa4889a7640 1 -- 172.21.15.92:0/2458180832 learned_addr learned my addr 172.21.15.92:0/2458180832 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa4899a9640 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e74334be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa4891a8640 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e74334e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa4889a7640 1 -- 172.21.15.92:0/2458180832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 msgr2=0x55e74334be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa4889a7640 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e74334be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa4889a7640 1 -- 172.21.15.92:0/2458180832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 msgr2=0x55e74334e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa4889a7640 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e74334e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.629 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa4889a7640 1 -- 172.21.15.92:0/2458180832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7430192b0 con 0x55e743344500 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa4891a8640 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e74334e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa4889a7640 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa47400aa10 tx=0x7fa47400a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8eda79311767af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa46cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa46cff9640 1 -- 172.21.15.92:0/2458180832 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474036040 con 0x55e743344500 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa46cff9640 1 -- 172.21.15.92:0/2458180832 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fa474003b80 con 0x55e743344500 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2458180832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa480018070 con 0x55e743344500 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa46cff9640 1 -- 172.21.15.92:0/2458180832 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa474003d80 con 0x55e743344500 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa48d7e5740 10 client.15036 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2458180832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e74335d130 con 0x55e743344500 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.608+0000 7fa46cff9640 1 -- 172.21.15.92:0/2458180832 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa480018070 con 0x55e743344500 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa46cff9640 1 -- 172.21.15.92:0/2458180832 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa47400b040 con 0x55e743344500 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa48d7e5740 10 client.15036 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:05.630 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa48d7e5740 10 client.15036 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa48d7e5740 20 client.15036 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55e74335f7d0 0x55e743360c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa48d7e5740 4 client.15036 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2458180832 --> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7432b5600 con 0x55e74335f7d0 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa4891a8640 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55e74335f7d0 0x55e743360c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa46cff9640 10 client.15036 ms_handle_connect on v2:172.21.15.121:6836/332654710 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.609+0000 7fa4891a8640 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55e74335f7d0 0x55e743360c40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f3a617406bf3b46 server_cookie=127e87e8981f9754 in_seq=0 out_seq=0 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa46cff9640 1 -- 172.21.15.92:0/2458180832 <== mds.1 v2:172.21.15.121:6836/332654710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7432b5600 con 0x55e74335f7d0 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa46cff9640 10 client.15036 handle_command_reply: tid=0 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 client.15036 shutdown 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2458180832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 msgr2=0x55e74334b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa47400aa10 tx=0x7fa47400a370 comp rx=0 tx=0).stop 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2458180832 shutdown_connections 2024-09-10T10:36:05.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55e74335f7d0 0x55e743360c40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e74334be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa46cff9640 0 client.15036 ms_handle_reset on v2:172.21.15.121:6836/332654710 2024-09-10T10:36:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2458180832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e74334e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2458180832 >> 172.21.15.92:0/2458180832 conn(0x55e743340170 msgr2=0x55e743345e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2458180832 shutdown_connections 2024-09-10T10:36:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2458180832 wait complete. 2024-09-10T10:36:05.632 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.610+0000 7fa48d7e5740 20 client.15036 trim_cache size 0 max 16384 2024-09-10T10:36:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa48d7e5740 1 Processor -- start 2024-09-10T10:36:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa48d7e5740 1 -- start start 2024-09-10T10:36:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e743360c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e74334bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e74335ef80 con 0x55e743344500 2024-09-10T10:36:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e74335f650 con 0x55e743343be0 2024-09-10T10:36:05.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e74335fd20 con 0x55e74334edc0 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4889a7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4889a7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60334/0 (socket says 172.21.15.92:60334) 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4889a7640 1 -- 172.21.15.92:0/666147027 learned_addr learned my addr 172.21.15.92:0/666147027 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4899a9640 1 --2- 172.21.15.92:0/666147027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e74334bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4889a7640 1 -- 172.21.15.92:0/666147027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 msgr2=0x55e74334bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4889a7640 1 --2- 172.21.15.92:0/666147027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e74334bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4889a7640 1 -- 172.21.15.92:0/666147027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 msgr2=0x55e743360c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4889a7640 1 --2- 172.21.15.92:0/666147027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e743360c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4889a7640 1 -- 172.21.15.92:0/666147027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e743349e30 con 0x55e743344500 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.628+0000 7fa4899a9640 1 --2- 172.21.15.92:0/666147027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e74334bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa4889a7640 1 --2- 172.21.15.92:0/666147027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa474031040 tx=0x7fa47402b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac771d65ce7c6f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:05.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa46effd640 1 -- 172.21.15.92:0/666147027 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474030a60 con 0x55e743344500 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa46effd640 1 -- 172.21.15.92:0/666147027 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa474047040 con 0x55e743344500 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa46effd640 1 -- 172.21.15.92:0/666147027 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47403ebc0 con 0x55e743344500 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa48d7e5740 1 -- 172.21.15.92:0/666147027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 msgr2=0x55e74334b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/666147027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa474031040 tx=0x7fa47402b720 comp rx=0 tx=0).stop 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa48d7e5740 1 -- 172.21.15.92:0/666147027 shutdown_connections 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/666147027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e74334bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/666147027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e74334b8a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/666147027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e743360c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.629+0000 7fa48d7e5740 1 -- 172.21.15.92:0/666147027 >> 172.21.15.92:0/666147027 conn(0x55e743340170 msgr2=0x55e743338ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 -- 172.21.15.92:0/666147027 shutdown_connections 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 -- 172.21.15.92:0/666147027 wait complete. 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 -- start start 2024-09-10T10:36:05.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 Processor -- start 2024-09-10T10:36:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e743369220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e743369760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e743348370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e743360ac0 con 0x55e743344500 2024-09-10T10:36:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e7433603f0 con 0x55e743343be0 2024-09-10T10:36:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e743361190 con 0x55e74334edc0 2024-09-10T10:36:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa48d7e5740 10 client.0 _ll_register_callbacks cb 0x7fa47400a890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa4889a7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e743369760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa4889a7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e743369760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60340/0 (socket says 172.21.15.92:60340) 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.630+0000 7fa4889a7640 1 -- 172.21.15.92:0/2502141860 learned_addr learned my addr 172.21.15.92:0/2502141860 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa4899a9640 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e743348370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa4891a8640 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e743369220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa4889a7640 1 -- 172.21.15.92:0/2502141860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 msgr2=0x55e743348370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa4889a7640 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e743348370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa4889a7640 1 -- 172.21.15.92:0/2502141860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 msgr2=0x55e743369220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa4889a7640 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e743369220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa4889a7640 1 -- 172.21.15.92:0/2502141860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e743348ba0 con 0x55e743344500 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa4889a7640 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e743369760 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa474006010 tx=0x7fa474003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5a899872973974 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa46cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa46cff9640 1 -- 172.21.15.92:0/2502141860 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47404b8b0 con 0x55e743344500 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa46cff9640 1 -- 172.21.15.92:0/2502141860 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fa47400c070 con 0x55e743344500 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2502141860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa474047040 con 0x55e743344500 2024-09-10T10:36:05.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa46cff9640 1 -- 172.21.15.92:0/2502141860 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa47403e480 con 0x55e743344500 2024-09-10T10:36:05.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa48d7e5740 10 client.15042 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:05.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2502141860 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e743368b70 con 0x55e743344500 2024-09-10T10:36:05.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.631+0000 7fa46cff9640 1 -- 172.21.15.92:0/2502141860 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa474047040 con 0x55e743344500 2024-09-10T10:36:05.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa46cff9640 1 -- 172.21.15.92:0/2502141860 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa47405f4c0 con 0x55e743344500 2024-09-10T10:36:05.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa48d7e5740 10 client.15042 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:05.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa48d7e5740 10 client.15042 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T10:36:05.642 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa48d7e5740 20 client.15042 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55e7433ce210 0x55e7433ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa48d7e5740 4 client.15042 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2502141860 --> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] -- command(tid 0: {"prefix": "status"}) -- 0x55e7432afb10 con 0x55e7433ce210 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa4891a8640 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55e7433ce210 0x55e7433ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa46cff9640 10 client.15042 ms_handle_connect on v2:172.21.15.121:6836/332654710 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa4891a8640 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55e7433ce210 0x55e7433ccf20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=44ff05ea71c1ce4 server_cookie=61a304f2a4aabbf in_seq=0 out_seq=0 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.632+0000 7fa46cff9640 1 -- 172.21.15.92:0/2502141860 <== mds.1 v2:172.21.15.121:6836/332654710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55e7432afb10 con 0x55e7433ce210 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa46cff9640 10 client.15042 handle_command_reply: tid=0 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 client.15042 shutdown 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2502141860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 msgr2=0x55e743369760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e743369760 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa474006010 tx=0x7fa474003a50 comp rx=0 tx=0).stop 2024-09-10T10:36:05.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2502141860 shutdown_connections 2024-09-10T10:36:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55e7433ce210 0x55e7433ccf20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e74334edc0 0x55e743348370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e743344500 0x55e743369760 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 --2- 172.21.15.92:0/2502141860 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e743343be0 0x55e743369220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa46cff9640 0 client.15042 ms_handle_reset on v2:172.21.15.121:6836/332654710 2024-09-10T10:36:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2502141860 >> 172.21.15.92:0/2502141860 conn(0x55e743340170 msgr2=0x55e74334b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2502141860 shutdown_connections 2024-09-10T10:36:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 1 -- 172.21.15.92:0/2502141860 wait complete. 2024-09-10T10:36:05.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48d7e5740 20 client.15042 trim_cache size 0 max 16384 2024-09-10T10:36:05.647 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:05.647 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:05.647 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2024-09-10T10:36:05.647 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24451, 2024-09-10T10:36:05.647 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:05.647 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:05.647 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:05.647 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 72.870661626, 2024-09-10T10:36:05.648 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:05.648 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:05.648 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:05.648 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 104.908369775 2024-09-10T10:36:05.648 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48b40c640 1 -- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa4700a2c10 msgr2=0x7fa4700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48b40c640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa4700a2c10 0x7fa4700a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ff880 tx=0x7fa474030e30 comp rx=0 tx=0).stop 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48b40c640 1 -- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4841055b0 msgr2=0x7fa48419ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.633+0000 7fa48b40c640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4841055b0 0x7fa48419ad00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00b970 tx=0x7fa47c00be30 comp rx=0 tx=0).stop 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.634+0000 7fa48b40c640 1 -- 172.21.15.92:0/3198555086 shutdown_connections 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.634+0000 7fa48b40c640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa4700a2c10 0x7fa4700a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.634+0000 7fa48b40c640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4841055b0 0x7fa48419ad00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.634+0000 7fa48b40c640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa484100e30 0x7fa484196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.634+0000 7fa48b40c640 1 --2- 172.21.15.92:0/3198555086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa484100480 0x7fa484196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:05.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.634+0000 7fa48b40c640 1 -- 172.21.15.92:0/3198555086 >> 172.21.15.92:0/3198555086 conn(0x7fa484077210 msgr2=0x7fa484103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:05.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.634+0000 7fa48b40c640 1 -- 172.21.15.92:0/3198555086 shutdown_connections 2024-09-10T10:36:05.650 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:05.634+0000 7fa48b40c640 1 -- 172.21.15.92:0/3198555086 wait complete. 2024-09-10T10:36:06.303 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T10:36:06.547 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/3000617599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88102dd0 msgr2=0x7f2a881031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/3000617599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88102dd0 0x7f2a881031b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009cd0 tx=0x7f2a7802a8d0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/3000617599 shutdown_connections 2024-09-10T10:36:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/3000617599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88108300 0x7f2a8810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/3000617599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a88103780 0x7f2a88107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/3000617599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88102dd0 0x7f2a881031b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/3000617599 >> 172.21.15.92:0/3000617599 conn(0x7f2a880fc7d0 msgr2=0x7f2a880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:07.081 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/3000617599 shutdown_connections 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/3000617599 wait complete. 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 Processor -- start 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.054+0000 7f2a8fdb9640 1 -- start start 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8fdb9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102dd0 0x7f2a88198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8fdb9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a88103780 0x7f2a88198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8fdb9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88108300 0x7f2a8819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8fdb9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88112110 con 0x7f2a88108300 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8fdb9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88111f90 con 0x7f2a88103780 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8fdb9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88112290 con 0x7f2a88102dd0 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8e356640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88108300 0x7f2a8819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8e356640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88108300 0x7f2a8819cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60360/0 (socket says 172.21.15.92:60360) 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8e356640 1 -- 172.21.15.92:0/324837980 learned_addr learned my addr 172.21.15.92:0/324837980 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:07.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8db55640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102dd0 0x7f2a88198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8d354640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a88103780 0x7f2a88198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8e356640 1 -- 172.21.15.92:0/324837980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102dd0 msgr2=0x7f2a88198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8e356640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102dd0 0x7f2a88198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8e356640 1 -- 172.21.15.92:0/324837980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a88103780 msgr2=0x7f2a88198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8e356640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a88103780 0x7f2a88198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8e356640 1 -- 172.21.15.92:0/324837980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8819d5c0 con 0x7f2a88108300 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8e356640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88108300 0x7f2a8819cee0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009fd0 tx=0x7f2a8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a86ffd640 1 -- 172.21.15.92:0/324837980 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80011830 con 0x7f2a88108300 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a86ffd640 1 -- 172.21.15.92:0/324837980 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a80016070 con 0x7f2a88108300 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a86ffd640 1 -- 172.21.15.92:0/324837980 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000f2e0 con 0x7f2a88108300 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/324837980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8819d8b0 con 0x7f2a88108300 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.055+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/324837980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a881a5190 con 0x7f2a88108300 2024-09-10T10:36:07.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a86ffd640 1 -- 172.21.15.92:0/324837980 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2a800119d0 con 0x7f2a88108300 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a92192740 1 Processor -- start 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a92192740 1 -- start start 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a92192740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd68db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a92192740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd73670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a92192740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd75fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a92192740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b38fccf090 con 0x55b38fd73bb0 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a92192740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b38fc76a70 con 0x55b38fd692f0 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a92192740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b38fccb050 con 0x55b38fd689d0 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a8d354640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd75fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a8d354640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd75fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60362/0 (socket says 172.21.15.92:60362) 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a8d354640 1 -- 172.21.15.92:0/1536083302 learned_addr learned my addr 172.21.15.92:0/1536083302 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:07.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a8db55640 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd73670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.058+0000 7f2a86ffd640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2a700a2c90 0x7f2a700a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8d354640 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd68db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8e356640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2a700a2c90 0x7f2a700a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8db55640 1 -- 172.21.15.92:0/1536083302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 msgr2=0x55b38fd68db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8db55640 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd68db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8db55640 1 -- 172.21.15.92:0/1536083302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 msgr2=0x55b38fd75fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8db55640 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd75fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8db55640 1 -- 172.21.15.92:0/1536083302 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b38fc83130 con 0x55b38fd692f0 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8d354640 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd68db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a86ffd640 1 -- 172.21.15.92:0/324837980 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f2a800ce4d0 con 0x7f2a88108300 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8db55640 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd73670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a78006010 tx=0x7f2a78005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e628d0616a93354 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a8e356640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2a700a2c90 0x7f2a700a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a800977b0 tx=0x7f2a8006dea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:07.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a6ffff640 1 -- 172.21.15.92:0/1536083302 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78031d70 con 0x55b38fd692f0 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a6ffff640 1 -- 172.21.15.92:0/1536083302 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a78036030 con 0x55b38fd692f0 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.059+0000 7f2a6ffff640 1 -- 172.21.15.92:0/1536083302 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78004330 con 0x55b38fd692f0 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 -- 172.21.15.92:0/1536083302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 msgr2=0x55b38fd73670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd73670 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a78006010 tx=0x7f2a78005fa0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 -- 172.21.15.92:0/1536083302 shutdown_connections 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd75fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd73670 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 --2- 172.21.15.92:0/1536083302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd68db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 -- 172.21.15.92:0/1536083302 >> 172.21.15.92:0/1536083302 conn(0x55b38fd64f60 msgr2=0x55b38fd65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 -- 172.21.15.92:0/1536083302 shutdown_connections 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 -- 172.21.15.92:0/1536083302 wait complete. 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.060+0000 7f2a92192740 1 -- start start 2024-09-10T10:36:07.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a92192740 1 Processor -- start 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a92192740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd73360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a92192740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a92192740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd70bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a92192740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b38fd76780 con 0x55b38fd73bb0 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a92192740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b38fc89f20 con 0x55b38fd692f0 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a92192740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b38fd76900 con 0x55b38fd689d0 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a92192740 10 client.0 _ll_register_callbacks cb 0x55b38fc53030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8d354640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd70bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8d354640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd70bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60366/0 (socket says 172.21.15.92:60366) 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8d354640 1 -- 172.21.15.92:0/1750005654 learned_addr learned my addr 172.21.15.92:0/1750005654 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8db55640 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8d354640 1 -- 172.21.15.92:0/1750005654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 msgr2=0x55b38fd73360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8d354640 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd73360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8d354640 1 -- 172.21.15.92:0/1750005654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 msgr2=0x55b38fd706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8d354640 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8d354640 1 -- 172.21.15.92:0/1750005654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b38fa402b0 con 0x55b38fd73bb0 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.061+0000 7f2a8db55640 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a8d354640 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd70bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00bff0 tx=0x7f2a7c012ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ec20086aa75d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/1750005654 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c011c70 con 0x55b38fd73bb0 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/1750005654 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f2a7c005020 con 0x55b38fd73bb0 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a92192740 1 -- 172.21.15.92:0/1750005654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a78036030 con 0x55b38fd73bb0 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/1750005654 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2a7c011e10 con 0x55b38fd73bb0 2024-09-10T10:36:07.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a92192740 10 client.15054 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a92192740 1 -- 172.21.15.92:0/1750005654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b38fd81ff0 con 0x55b38fd73bb0 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/1750005654 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a78036030 con 0x55b38fd73bb0 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/1750005654 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2a7c01c070 con 0x55b38fd73bb0 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a92192740 10 client.15054 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a92192740 10 client.15054 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a92192740 20 client.15054 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a92192740 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55b38fd84600 0x55b38fd85a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a92192740 4 client.15054 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.062+0000 7f2a92192740 1 -- 172.21.15.92:0/1750005654 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b38fcdc600 con 0x55b38fd84600 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.063+0000 7f2a8db55640 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55b38fd84600 0x55b38fd85a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.063+0000 7f2a8db55640 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55b38fd84600 0x55b38fd85a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5aca9f95ee79cc2 server_cookie=7de03b8fa14db0fd in_seq=0 out_seq=0 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.063+0000 7f2a6d7fa640 10 client.15054 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/1750005654 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b38fcdc600 con 0x55b38fd84600 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a6d7fa640 10 client.15054 handle_command_reply: tid=0 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 client.15054 shutdown 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 -- 172.21.15.92:0/1750005654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 msgr2=0x55b38fd70bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd70bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00bff0 tx=0x7f2a7c012ca0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 -- 172.21.15.92:0/1750005654 shutdown_connections 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd70bf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55b38fd84600 0x55b38fd85a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 --2- 172.21.15.92:0/1750005654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd73360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a6d7fa640 0 client.15054 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 -- 172.21.15.92:0/1750005654 >> 172.21.15.92:0/1750005654 conn(0x55b38fd64f60 msgr2=0x55b38fd6ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:07.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 -- 172.21.15.92:0/1750005654 shutdown_connections 2024-09-10T10:36:07.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 1 -- 172.21.15.92:0/1750005654 wait complete. 2024-09-10T10:36:07.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.064+0000 7f2a92192740 20 client.15054 trim_cache size 0 max 16384 2024-09-10T10:36:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a92192740 1 Processor -- start 2024-09-10T10:36:07.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a92192740 1 -- start start 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a92192740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd85a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a92192740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd65340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a92192740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd6ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a92192740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b38fd83db0 con 0x55b38fd73bb0 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a92192740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b38fd84480 con 0x55b38fd692f0 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a92192740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b38fd84b50 con 0x55b38fd689d0 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8d354640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd6ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8d354640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd6ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60370/0 (socket says 172.21.15.92:60370) 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8d354640 1 -- 172.21.15.92:0/1074102412 learned_addr learned my addr 172.21.15.92:0/1074102412 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8db55640 1 --2- 172.21.15.92:0/1074102412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd65340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8d354640 1 --2- 172.21.15.92:0/1074102412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd85a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8d354640 1 -- 172.21.15.92:0/1074102412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 msgr2=0x55b38fd85a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8d354640 1 --2- 172.21.15.92:0/1074102412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd85a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8d354640 1 -- 172.21.15.92:0/1074102412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 msgr2=0x55b38fd65340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8d354640 1 --2- 172.21.15.92:0/1074102412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd65340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.082+0000 7f2a8d354640 1 -- 172.21.15.92:0/1074102412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b38fd64d90 con 0x55b38fd73bb0 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a8d354640 1 --2- 172.21.15.92:0/1074102412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd6ef80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0124d0 tx=0x7f2a7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94cd5126140da1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a6f7fe640 1 -- 172.21.15.92:0/1074102412 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c02d070 con 0x55b38fd73bb0 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a6f7fe640 1 -- 172.21.15.92:0/1074102412 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a7c004230 con 0x55b38fd73bb0 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a6f7fe640 1 -- 172.21.15.92:0/1074102412 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c027660 con 0x55b38fd73bb0 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a92192740 1 -- 172.21.15.92:0/1074102412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 msgr2=0x55b38fd6ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a92192740 1 --2- 172.21.15.92:0/1074102412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd6ef80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0124d0 tx=0x7f2a7c0046c0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a92192740 1 -- 172.21.15.92:0/1074102412 shutdown_connections 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a92192740 1 --2- 172.21.15.92:0/1074102412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd73bb0 0x55b38fd6ef80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a92192740 1 --2- 172.21.15.92:0/1074102412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd692f0 0x55b38fd65340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.083+0000 7f2a92192740 1 --2- 172.21.15.92:0/1074102412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd85a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 -- 172.21.15.92:0/1074102412 >> 172.21.15.92:0/1074102412 conn(0x55b38fd64f60 msgr2=0x55b38fd70670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 -- 172.21.15.92:0/1074102412 shutdown_connections 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 -- 172.21.15.92:0/1074102412 wait complete. 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 -- start start 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 Processor -- start 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd8e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd692f0 0x55b38fd895c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd73bb0 0x55b38fd89b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b38fd858f0 con 0x55b38fd692f0 2024-09-10T10:36:07.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55b38fd85220 con 0x55b38fd73bb0 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b38fd85fc0 con 0x55b38fd689d0 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a92192740 10 client.0 _ll_register_callbacks cb 0x7f2a7c00bd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a8db55640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd692f0 0x55b38fd895c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a8db55640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd692f0 0x55b38fd895c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60376/0 (socket says 172.21.15.92:60376) 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.084+0000 7f2a8db55640 1 -- 172.21.15.92:0/3770213546 learned_addr learned my addr 172.21.15.92:0/3770213546 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a8d354640 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd73bb0 0x55b38fd89b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a8d354640 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd8e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a8db55640 1 -- 172.21.15.92:0/3770213546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 msgr2=0x55b38fd8e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a8db55640 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd8e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a8db55640 1 -- 172.21.15.92:0/3770213546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd73bb0 msgr2=0x55b38fd89b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a8db55640 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd73bb0 0x55b38fd89b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a8db55640 1 -- 172.21.15.92:0/3770213546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b38fd8a0c0 con 0x55b38fd692f0 2024-09-10T10:36:07.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a8d354640 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd8e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a8db55640 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd692f0 0x55b38fd895c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a78006010 tx=0x7f2a78009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec95cf030c4024ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/3770213546 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7804a040 con 0x55b38fd692f0 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/3770213546 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f2a78003b70 con 0x55b38fd692f0 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a92192740 1 -- 172.21.15.92:0/3770213546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a7c004230 con 0x55b38fd692f0 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/3770213546 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2a78060050 con 0x55b38fd692f0 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a92192740 10 client.15060 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a92192740 1 -- 172.21.15.92:0/3770213546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b38fdeeae0 con 0x55b38fd692f0 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.085+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/3770213546 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a7c004230 con 0x55b38fd692f0 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/3770213546 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2a78043070 con 0x55b38fd692f0 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a92192740 10 client.15060 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:07.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a92192740 10 client.15060 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a92192740 20 client.15060 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a92192740 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55b38fdf31a0 0x55b38fdf1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a92192740 4 client.15060 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a92192740 1 -- 172.21.15.92:0/3770213546 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "status"}) -- 0x55b38fcd6b10 con 0x55b38fdf31a0 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a8d354640 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55b38fdf31a0 0x55b38fdf1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a6d7fa640 10 client.15060 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.086+0000 7f2a8d354640 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55b38fdf31a0 0x55b38fdf1eb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a4e7e3f8588410 server_cookie=7fef3a69660caa78 in_seq=0 out_seq=0 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a6d7fa640 1 -- 172.21.15.92:0/3770213546 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b38fcd6b10 con 0x55b38fdf31a0 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a6d7fa640 10 client.15060 handle_command_reply: tid=0 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 client.15060 shutdown 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 -- 172.21.15.92:0/3770213546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd692f0 msgr2=0x55b38fd895c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:07.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd692f0 0x55b38fd895c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a78006010 tx=0x7f2a78009800 comp rx=0 tx=0).stop 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 -- 172.21.15.92:0/3770213546 shutdown_connections 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55b38fdf31a0 0x55b38fdf1eb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55b38fd73bb0 0x55b38fd89b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b38fd692f0 0x55b38fd895c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a6d7fa640 0 client.15060 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 --2- 172.21.15.92:0/3770213546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38fd689d0 0x55b38fd8e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 -- 172.21.15.92:0/3770213546 >> 172.21.15.92:0/3770213546 conn(0x55b38fd64f60 msgr2=0x55b38fd6eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 -- 172.21.15.92:0/3770213546 shutdown_connections 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 1 -- 172.21.15.92:0/3770213546 wait complete. 2024-09-10T10:36:07.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a92192740 20 client.15060 trim_cache size 0 max 16384 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24472, 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 81.349074517999995, 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:07.103 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 101.02985190299999 2024-09-10T10:36:07.104 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2a700a2c90 msgr2=0x7f2a700a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2a700a2c90 0x7f2a700a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a800977b0 tx=0x7f2a8006dea0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88108300 msgr2=0x7f2a8819cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.087+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88108300 0x7f2a8819cee0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009fd0 tx=0x7f2a8000b8e0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.088+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/324837980 shutdown_connections 2024-09-10T10:36:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.088+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f2a700a2c90 0x7f2a700a5150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.088+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a88108300 0x7f2a8819cee0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.088+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a88103780 0x7f2a88198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.088+0000 7f2a8fdb9640 1 --2- 172.21.15.92:0/324837980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102dd0 0x7f2a88198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.088+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/324837980 >> 172.21.15.92:0/324837980 conn(0x7f2a880fc7d0 msgr2=0x7f2a88105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.088+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/324837980 shutdown_connections 2024-09-10T10:36:07.105 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:07.088+0000 7f2a8fdb9640 1 -- 172.21.15.92:0/324837980 wait complete. 2024-09-10T10:36:07.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:07 smithi121 ceph-mon[35231]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T10:36:07.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:07 smithi097 ceph-mon[35213]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T10:36:07.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:07 smithi092 ceph-mon[30834]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T10:36:07.746 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T10:36:07.746 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:36:07.764 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:36:07.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T10:36:08.008 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:08.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/3593605475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74102e00 msgr2=0x7f7c74103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/3593605475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74102e00 0x7f7c74103280 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009900 tx=0x7f7c5c02a410 comp rx=0 tx=0).stop 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/3593605475 shutdown_connections 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/3593605475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c741037c0 0x7f7c7410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/3593605475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74102e00 0x7f7c74103280 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/3593605475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c74101c00 0x7f7c74102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/3593605475 >> 172.21.15.92:0/3593605475 conn(0x7f7c740fd390 msgr2=0x7f7c740ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/3593605475 shutdown_connections 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/3593605475 wait complete. 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.542+0000 7f7c7a3ab640 1 Processor -- start 2024-09-10T10:36:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c7a3ab640 1 -- start start 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c7a3ab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c74101c00 0x7f7c74197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c7a3ab640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c74102e00 0x7f7c741983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c7a3ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741037c0 0x7f7c7419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c7a3ab640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7410d860 con 0x7f7c741037c0 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c7a3ab640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7410d6e0 con 0x7f7c74102e00 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c7a3ab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7410d9e0 con 0x7f7c74101c00 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c78948640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741037c0 0x7f7c7419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c78948640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741037c0 0x7f7c7419f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60400/0 (socket says 172.21.15.92:60400) 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c78948640 1 -- 172.21.15.92:0/2153621688 learned_addr learned my addr 172.21.15.92:0/2153621688 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:08.566 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c74102e00 0x7f7c741983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c73fff640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c74101c00 0x7f7c74197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c78948640 1 -- 172.21.15.92:0/2153621688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c74101c00 msgr2=0x7f7c74197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c78948640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c74101c00 0x7f7c74197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c78948640 1 -- 172.21.15.92:0/2153621688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c74102e00 msgr2=0x7f7c741983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c78948640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c74102e00 0x7f7c741983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c78948640 1 -- 172.21.15.92:0/2153621688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7419fab0 con 0x7f7c741037c0 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c73fff640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c74101c00 0x7f7c74197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c78948640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741037c0 0x7f7c7419f440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00cce0 tx=0x7f7c6c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c71ffb640 1 -- 172.21.15.92:0/2153621688 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00f450 con 0x7f7c741037c0 2024-09-10T10:36:08.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.543+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7419fda0 con 0x7f7c741037c0 2024-09-10T10:36:08.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.544+0000 7f7c71ffb640 1 -- 172.21.15.92:0/2153621688 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c6c00fad0 con 0x7f7c741037c0 2024-09-10T10:36:08.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.544+0000 7f7c71ffb640 1 -- 172.21.15.92:0/2153621688 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c018c10 con 0x7f7c741037c0 2024-09-10T10:36:08.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.544+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c741a0250 con 0x7f7c741037c0 2024-09-10T10:36:08.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.545+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c74108fd0 con 0x7f7c741037c0 2024-09-10T10:36:08.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.546+0000 7f7c71ffb640 1 -- 172.21.15.92:0/2153621688 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7c6c00f5f0 con 0x7f7c741037c0 2024-09-10T10:36:08.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.547+0000 7f7c71ffb640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7c600a2c40 0x7f7c600a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:08.568 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.547+0000 7f7c73fff640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7c600a2c40 0x7f7c600a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:08.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.547+0000 7f7c71ffb640 1 -- 172.21.15.92:0/2153621688 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f7c6c0cf8a0 con 0x7f7c741037c0 2024-09-10T10:36:08.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.547+0000 7f7c73fff640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7c600a2c40 0x7f7c600a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c74102c60 tx=0x7f7c64005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:08.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.550+0000 7f7c71ffb640 1 -- 172.21.15.92:0/2153621688 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c6c014030 con 0x7f7c741037c0 2024-09-10T10:36:08.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.729+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f7c74062630 con 0x7f7c600a2c40 2024-09-10T10:36:08.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.730+0000 7f7c71ffb640 1 -- 172.21.15.92:0/2153621688 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f7c74062630 con 0x7f7c600a2c40 2024-09-10T10:36:08.732 INFO:teuthology.orchestra.run.smithi092.stdout:Backend: cephadm 2024-09-10T10:36:08.732 INFO:teuthology.orchestra.run.smithi092.stdout:Available: Yes 2024-09-10T10:36:08.732 INFO:teuthology.orchestra.run.smithi092.stdout:Paused: No 2024-09-10T10:36:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7c600a2c40 msgr2=0x7f7c600a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7c600a2c40 0x7f7c600a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7c74102c60 tx=0x7f7c64005d30 comp rx=0 tx=0).stop 2024-09-10T10:36:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741037c0 msgr2=0x7f7c7419f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741037c0 0x7f7c7419f440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00cce0 tx=0x7f7c6c00a620 comp rx=0 tx=0).stop 2024-09-10T10:36:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 shutdown_connections 2024-09-10T10:36:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f7c600a2c40 0x7f7c600a5100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741037c0 0x7f7c7419f440 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7c74102e00 0x7f7c741983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 --2- 172.21.15.92:0/2153621688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c74101c00 0x7f7c74197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:08.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 >> 172.21.15.92:0/2153621688 conn(0x7f7c740fd390 msgr2=0x7f7c741061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 shutdown_connections 2024-09-10T10:36:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:08.732+0000 7f7c7a3ab640 1 -- 172.21.15.92:0/2153621688 wait complete. 2024-09-10T10:36:09.412 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:09 smithi092 ceph-mon[30834]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:36:09.439 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T10:36:09.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:09 smithi121 ceph-mon[35231]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:36:09.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:09 smithi097 ceph-mon[35213]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:36:09.679 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:10.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.169+0000 7f587f34d640 1 -- 172.21.15.92:0/3257342341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878101490 msgr2=0x7f5878101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:10.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.169+0000 7f587f34d640 1 --2- 172.21.15.92:0/3257342341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878101490 0x7f5878101910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5868009900 tx=0x7f586802a410 comp rx=0 tx=0).stop 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.169+0000 7f587f34d640 1 -- 172.21.15.92:0/3257342341 shutdown_connections 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.169+0000 7f587f34d640 1 --2- 172.21.15.92:0/3257342341 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5878101e50 0x7f58781086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.169+0000 7f587f34d640 1 --2- 172.21.15.92:0/3257342341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878101490 0x7f5878101910 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.169+0000 7f587f34d640 1 --2- 172.21.15.92:0/3257342341 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878100290 0x7f5878100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.169+0000 7f587f34d640 1 -- 172.21.15.92:0/3257342341 >> 172.21.15.92:0/3257342341 conn(0x7f58780fba40 msgr2=0x7f58780fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.169+0000 7f587f34d640 1 -- 172.21.15.92:0/3257342341 shutdown_connections 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.169+0000 7f587f34d640 1 -- 172.21.15.92:0/3257342341 wait complete. 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587f34d640 1 Processor -- start 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587f34d640 1 -- start start 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587f34d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878100290 0x7f5878197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587f34d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878101490 0x7f5878197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:10.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587f34d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5878101e50 0x7f587819e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587f34d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f587810c010 con 0x7f5878100290 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587f34d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f587810be90 con 0x7f5878101490 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587f34d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f587810c190 con 0x7f5878101e50 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587d0e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878100290 0x7f5878197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587d0e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878100290 0x7f5878197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60420/0 (socket says 172.21.15.92:60420) 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587d0e9640 1 -- 172.21.15.92:0/103954333 learned_addr learned my addr 172.21.15.92:0/103954333 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587c8e8640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878101490 0x7f5878197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587d0e9640 1 -- 172.21.15.92:0/103954333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5878101e50 msgr2=0x7f587819e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587d0e9640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5878101e50 0x7f587819e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587d0e9640 1 -- 172.21.15.92:0/103954333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878101490 msgr2=0x7f5878197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587d0e9640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878101490 0x7f5878197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.192 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587d0e9640 1 -- 172.21.15.92:0/103954333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58780fd2b0 con 0x7f5878100290 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.170+0000 7f587d0e9640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878100290 0x7f5878197000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f587400b450 tx=0x7f587400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.171+0000 7f586e7fc640 1 -- 172.21.15.92:0/103954333 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5874015020 con 0x7f5878100290 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.171+0000 7f586e7fc640 1 -- 172.21.15.92:0/103954333 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5874011d70 con 0x7f5878100290 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.171+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58780fd5a0 con 0x7f5878100290 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.171+0000 7f586e7fc640 1 -- 172.21.15.92:0/103954333 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587400f340 con 0x7f5878100290 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.171+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58780fdb60 con 0x7f5878100290 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.172+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5878107d10 con 0x7f5878100290 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.173+0000 7f586e7fc640 1 -- 172.21.15.92:0/103954333 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5874018020 con 0x7f5878100290 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.173+0000 7f586e7fc640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f58640a2c40 0x7f58640a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.174+0000 7f587c8e8640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f58640a2c40 0x7f58640a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.174+0000 7f586e7fc640 1 -- 172.21.15.92:0/103954333 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f58740ceae0 con 0x7f5878100290 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.174+0000 7f587c8e8640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f58640a2c40 0x7f58640a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5878198520 tx=0x7f58680314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:10.193 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.178+0000 7f586e7fc640 1 -- 172.21.15.92:0/103954333 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f587401f020 con 0x7f5878100290 2024-09-10T10:36:10.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:10 smithi092 ceph-mon[30834]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:10.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.359+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f587802d930 con 0x7f58640a2c40 2024-09-10T10:36:10.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.372+0000 7f586e7fc640 1 -- 172.21.15.92:0/103954333 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f587802d930 con 0x7f58640a2c40 2024-09-10T10:36:10.374 INFO:teuthology.orchestra.run.smithi092.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T10:36:10.374 INFO:teuthology.orchestra.run.smithi092.stdout:mds.a smithi092 running (98s) 20s ago 98s 16.9M - 19.1.1-305-g1cf819b7 41d671128357 10ee7b374e51 2024-09-10T10:36:10.374 INFO:teuthology.orchestra.run.smithi092.stdout:mds.b smithi097 running (95s) 28s ago 95s 19.3M - 19.1.1-305-g1cf819b7 41d671128357 3ffb6fb77e35 2024-09-10T10:36:10.375 INFO:teuthology.orchestra.run.smithi092.stdout:mds.c smithi121 running (110s) 28s ago 109s 20.0M - 19.1.1-305-g1cf819b7 41d671128357 0d2c7a22d4f3 2024-09-10T10:36:10.375 INFO:teuthology.orchestra.run.smithi092.stdout:mds.d smithi092 running (117s) 20s ago 117s 16.5M - 19.1.1-305-g1cf819b7 41d671128357 e0172f59930c 2024-09-10T10:36:10.375 INFO:teuthology.orchestra.run.smithi092.stdout:mds.e smithi097 running (115s) 28s ago 114s 16.1M - 19.1.1-305-g1cf819b7 41d671128357 40985850e5ce 2024-09-10T10:36:10.375 INFO:teuthology.orchestra.run.smithi092.stdout:mds.f smithi121 running (112s) 28s ago 112s 19.4M - 19.1.1-305-g1cf819b7 41d671128357 6bb8c45fcf49 2024-09-10T10:36:10.375 INFO:teuthology.orchestra.run.smithi092.stdout:mds.g smithi092 running (101s) 20s ago 100s 19.1M - 19.1.1-305-g1cf819b7 41d671128357 edd545cebd5c 2024-09-10T10:36:10.375 INFO:teuthology.orchestra.run.smithi092.stdout:mds.h smithi097 running (107s) 28s ago 106s 18.1M - 19.1.1-305-g1cf819b7 41d671128357 bb73635fbcac 2024-09-10T10:36:10.375 INFO:teuthology.orchestra.run.smithi092.stdout:mds.i smithi121 running (104s) 28s ago 104s 25.6M - 19.1.1-305-g1cf819b7 41d671128357 2f90512ba3dd 2024-09-10T10:36:10.376 INFO:teuthology.orchestra.run.smithi092.stdout:mds.j smithi092 running (2m) 20s ago 2m 13.6M - 19.1.1-305-g1cf819b7 41d671128357 d21554bd25e8 2024-09-10T10:36:10.376 INFO:teuthology.orchestra.run.smithi092.stdout:mds.k smithi097 running (2m) 28s ago 2m 17.0M - 19.1.1-305-g1cf819b7 41d671128357 1b0d84ec6d76 2024-09-10T10:36:10.376 INFO:teuthology.orchestra.run.smithi092.stdout:mds.l smithi121 running (2m) 28s ago 2m 17.7M - 19.1.1-305-g1cf819b7 41d671128357 4a0a8c05093e 2024-09-10T10:36:10.376 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.x smithi092 *:9283,8765 running (8m) 20s ago 8m 509M - 19.1.1-305-g1cf819b7 41d671128357 69cf79c28a62 2024-09-10T10:36:10.376 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.y smithi097 *:8443,8765 running (7m) 28s ago 7m 442M - 19.1.1-305-g1cf819b7 41d671128357 0932454f5526 2024-09-10T10:36:10.376 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.z smithi121 *:8443,8765 running (7m) 28s ago 7m 443M - 19.1.1-305-g1cf819b7 41d671128357 3fa7b94a051c 2024-09-10T10:36:10.377 INFO:teuthology.orchestra.run.smithi092.stdout:mon.a smithi092 running (8m) 20s ago 9m 50.8M 2048M 19.1.1-305-g1cf819b7 41d671128357 46dfc501a658 2024-09-10T10:36:10.377 INFO:teuthology.orchestra.run.smithi092.stdout:mon.b smithi097 running (7m) 28s ago 7m 40.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 530a778e5ad0 2024-09-10T10:36:10.377 INFO:teuthology.orchestra.run.smithi092.stdout:mon.c smithi121 running (7m) 28s ago 7m 39.7M 2048M 19.1.1-305-g1cf819b7 41d671128357 8822ad9ce996 2024-09-10T10:36:10.377 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 smithi092 running (7m) 20s ago 7m 47.8M 4272M 19.1.1-305-g1cf819b7 41d671128357 303b0c8bbd28 2024-09-10T10:36:10.377 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 smithi097 running (6m) 28s ago 6m 58.2M 4272M 19.1.1-305-g1cf819b7 41d671128357 79fd89126b60 2024-09-10T10:36:10.377 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 smithi121 running (6m) 28s ago 6m 46.3M 4271M 19.1.1-305-g1cf819b7 41d671128357 fbc5c529a85f 2024-09-10T10:36:10.377 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 smithi092 running (5m) 20s ago 5m 42.8M 4272M 19.1.1-305-g1cf819b7 41d671128357 70903068c197 2024-09-10T10:36:10.378 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 smithi097 running (5m) 28s ago 5m 53.5M 4272M 19.1.1-305-g1cf819b7 41d671128357 a1b7ab3794c4 2024-09-10T10:36:10.378 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 smithi121 running (4m) 28s ago 4m 44.4M 4271M 19.1.1-305-g1cf819b7 41d671128357 ab70d792f479 2024-09-10T10:36:10.379 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 smithi092 running (4m) 20s ago 4m 55.2M 4272M 19.1.1-305-g1cf819b7 41d671128357 fe39c0867d13 2024-09-10T10:36:10.379 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 smithi097 running (4m) 28s ago 4m 56.1M 4272M 19.1.1-305-g1cf819b7 41d671128357 5ac2b594af89 2024-09-10T10:36:10.379 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 smithi121 running (3m) 28s ago 3m 52.3M 4271M 19.1.1-305-g1cf819b7 41d671128357 998aa81b4769 2024-09-10T10:36:10.379 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 smithi092 running (3m) 20s ago 3m 52.4M 4272M 19.1.1-305-g1cf819b7 41d671128357 c39f031ed49e 2024-09-10T10:36:10.379 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 smithi097 running (2m) 28s ago 2m 53.4M 4272M 19.1.1-305-g1cf819b7 41d671128357 f593411ca959 2024-09-10T10:36:10.379 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 smithi121 running (2m) 28s ago 2m 54.8M 4271M 19.1.1-305-g1cf819b7 41d671128357 354bb65fdc0e 2024-09-10T10:36:10.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f58640a2c40 msgr2=0x7f58640a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:10.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f58640a2c40 0x7f58640a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5878198520 tx=0x7f58680314a0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878100290 msgr2=0x7f5878197000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:10.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878100290 0x7f5878197000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f587400b450 tx=0x7f587400b910 comp rx=0 tx=0).stop 2024-09-10T10:36:10.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 shutdown_connections 2024-09-10T10:36:10.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f58640a2c40 0x7f58640a5100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5878101e50 0x7f587819e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5878101490 0x7f5878197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 --2- 172.21.15.92:0/103954333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5878100290 0x7f5878197000 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:10.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 >> 172.21.15.92:0/103954333 conn(0x7f58780fba40 msgr2=0x7f5878104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:10.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 shutdown_connections 2024-09-10T10:36:10.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:10.374+0000 7f587f34d640 1 -- 172.21.15.92:0/103954333 wait complete. 2024-09-10T10:36:10.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:10 smithi121 ceph-mon[35231]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:10.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:10 smithi097 ceph-mon[35213]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:11.098 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T10:36:11.342 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:11.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:11 smithi092 ceph-mon[30834]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:36:11.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:11 smithi121 ceph-mon[35231]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:36:11.573 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:11 smithi097 ceph-mon[35213]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:36:11.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.836+0000 7f781a8f4640 1 -- 172.21.15.92:0/2543472823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 msgr2=0x7f7814109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:11.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.836+0000 7f781a8f4640 1 --2- 172.21.15.92:0/2543472823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 0x7f7814109d50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f780c009ca0 tx=0x7f780c02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:36:11.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.836+0000 7f781a8f4640 1 -- 172.21.15.92:0/2543472823 shutdown_connections 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.836+0000 7f781a8f4640 1 --2- 172.21.15.92:0/2543472823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 0x7f7814109d50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.836+0000 7f781a8f4640 1 --2- 172.21.15.92:0/2543472823 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7814104fd0 0x7f78141073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.836+0000 7f781a8f4640 1 --2- 172.21.15.92:0/2543472823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f78141026a0 0x7f7814104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.836+0000 7f781a8f4640 1 -- 172.21.15.92:0/2543472823 >> 172.21.15.92:0/2543472823 conn(0x7f78140fc2a0 msgr2=0x7f78140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.836+0000 7f781a8f4640 1 -- 172.21.15.92:0/2543472823 shutdown_connections 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.836+0000 7f781a8f4640 1 -- 172.21.15.92:0/2543472823 wait complete. 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f781a8f4640 1 Processor -- start 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f781a8f4640 1 -- start start 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f781a8f4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78141026a0 0x7f7814197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f781a8f4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7814104fd0 0x7f7814198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f781a8f4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 0x7f781419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f781a8f4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f781410d8a0 con 0x7f7814107900 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f781a8f4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f781410d720 con 0x7f78141026a0 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f781a8f4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f781410da20 con 0x7f7814104fd0 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f7818e91640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 0x7f781419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f7818e91640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 0x7f781419f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60444/0 (socket says 172.21.15.92:60444) 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f7818e91640 1 -- 172.21.15.92:0/3972762833 learned_addr learned my addr 172.21.15.92:0/3972762833 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f78137fe640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7814104fd0 0x7f7814198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f7818e91640 1 -- 172.21.15.92:0/3972762833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7814104fd0 msgr2=0x7f7814198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.837+0000 7f7813fff640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78141026a0 0x7f7814197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f7818e91640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7814104fd0 0x7f7814198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f7818e91640 1 -- 172.21.15.92:0/3972762833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78141026a0 msgr2=0x7f7814197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f7818e91640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78141026a0 0x7f7814197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f7818e91640 1 -- 172.21.15.92:0/3972762833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781419faf0 con 0x7f7814107900 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f7813fff640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78141026a0 0x7f7814197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f7818e91640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 0x7f781419f480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f780c005e30 tx=0x7f780c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f78117fa640 1 -- 172.21.15.92:0/3972762833 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c003c30 con 0x7f7814107900 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781419fd80 con 0x7f7814107900 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f78117fa640 1 -- 172.21.15.92:0/3972762833 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f780c003dd0 con 0x7f7814107900 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f78117fa640 1 -- 172.21.15.92:0/3972762833 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c02fde0 con 0x7f7814107900 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.838+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78141a0290 con 0x7f7814107900 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.839+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78140fdd90 con 0x7f7814107900 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.840+0000 7f78117fa640 1 -- 172.21.15.92:0/3972762833 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f780c004050 con 0x7f7814107900 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.841+0000 7f78117fa640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77fc0a2c40 0x7f77fc0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.841+0000 7f7813fff640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77fc0a2c40 0x7f77fc0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.841+0000 7f78117fa640 1 -- 172.21.15.92:0/3972762833 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f780c0f0290 con 0x7f7814107900 2024-09-10T10:36:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.841+0000 7f7813fff640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77fc0a2c40 0x7f77fc0a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78040058c0 tx=0x7f7804005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:11.845+0000 7f78117fa640 1 -- 172.21.15.92:0/3972762833 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f780c0bd2a0 con 0x7f7814107900 2024-09-10T10:36:12.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.018+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f7814062630 con 0x7f77fc0a2c40 2024-09-10T10:36:12.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.024+0000 7f78117fa640 1 -- 172.21.15.92:0/3972762833 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f7814062630 con 0x7f77fc0a2c40 2024-09-10T10:36:12.026 INFO:teuthology.orchestra.run.smithi092.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T10:36:12.026 INFO:teuthology.orchestra.run.smithi092.stdout:mds.all 12/12 29s ago 2m smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi097=b;smithi097=e;smithi097=h;smithi097=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-09-10T10:36:12.026 INFO:teuthology.orchestra.run.smithi092.stdout:mgr 3/3 29s ago 7m smithi092=x;smithi097=y;smithi121=z;count:3 2024-09-10T10:36:12.026 INFO:teuthology.orchestra.run.smithi092.stdout:mon 3/3 29s ago 7m smithi092:172.21.15.92=a;smithi097:172.21.15.97=b;smithi121:172.21.15.121=c;count:3 2024-09-10T10:36:12.026 INFO:teuthology.orchestra.run.smithi092.stdout:osd 12 29s ago - 2024-09-10T10:36:12.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77fc0a2c40 msgr2=0x7f77fc0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77fc0a2c40 0x7f77fc0a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78040058c0 tx=0x7f7804005d30 comp rx=0 tx=0).stop 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 msgr2=0x7f781419f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 0x7f781419f480 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f780c005e30 tx=0x7f780c031ee0 comp rx=0 tx=0).stop 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 shutdown_connections 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f77fc0a2c40 0x7f77fc0a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7814107900 0x7f781419f480 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7814104fd0 0x7f7814198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 --2- 172.21.15.92:0/3972762833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f78141026a0 0x7f7814197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 >> 172.21.15.92:0/3972762833 conn(0x7f78140fc2a0 msgr2=0x7f7814102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 shutdown_connections 2024-09-10T10:36:12.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:12.026+0000 7f781a8f4640 1 -- 172.21.15.92:0/3972762833 wait complete. 2024-09-10T10:36:12.345 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:12 smithi092 ceph-mon[30834]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:12.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:12 smithi121 ceph-mon[35231]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:12.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:12 smithi097 ceph-mon[35213]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:12.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T10:36:12.913 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:13.332 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:13 smithi092 ceph-mon[30834]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:13.333 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:13 smithi092 ceph-mon[30834]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:36:13.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 -- 172.21.15.92:0/1922544178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174102700 msgr2=0x7f5174104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:13.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 --2- 172.21.15.92:0/1922544178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174102700 0x7f5174104af0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5164009900 tx=0x7f516402a410 comp rx=0 tx=0).stop 2024-09-10T10:36:13.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 -- 172.21.15.92:0/1922544178 shutdown_connections 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 --2- 172.21.15.92:0/1922544178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5174107960 0x7f5174109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 --2- 172.21.15.92:0/1922544178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5174105030 0x7f5174107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 --2- 172.21.15.92:0/1922544178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174102700 0x7f5174104af0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 -- 172.21.15.92:0/1922544178 >> 172.21.15.92:0/1922544178 conn(0x7f51740fc2a0 msgr2=0x7f51740fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 -- 172.21.15.92:0/1922544178 shutdown_connections 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 -- 172.21.15.92:0/1922544178 wait complete. 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 Processor -- start 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.413+0000 7f5179e43640 1 -- start start 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5179e43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5174102700 0x7f5174102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5179e43640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174105030 0x7f51741006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:13.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5179e43640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5174107960 0x7f5174100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5179e43640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f517410d8c0 con 0x7f5174105030 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5179e43640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f517410d740 con 0x7f5174107960 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5179e43640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f517410da40 con 0x7f5174102700 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5172ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174105030 0x7f51741006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5172ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174105030 0x7f51741006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41986/0 (socket says 172.21.15.92:41986) 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5172ffd640 1 -- 172.21.15.92:0/3688937711 learned_addr learned my addr 172.21.15.92:0/3688937711 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5173fff640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5174107960 0x7f5174100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f51737fe640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5174102700 0x7f5174102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5172ffd640 1 -- 172.21.15.92:0/3688937711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5174102700 msgr2=0x7f5174102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:13.443 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5172ffd640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5174102700 0x7f5174102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5172ffd640 1 -- 172.21.15.92:0/3688937711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5174107960 msgr2=0x7f5174100bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5172ffd640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5174107960 0x7f5174100bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5172ffd640 1 -- 172.21.15.92:0/3688937711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51741014b0 con 0x7f5174105030 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5172ffd640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174105030 0x7f51741006b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f516800c970 tx=0x7f516800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5170ff9640 1 -- 172.21.15.92:0/3688937711 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168007bb0 con 0x7f5174105030 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51741a20d0 con 0x7f5174105030 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5170ff9640 1 -- 172.21.15.92:0/3688937711 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5168007d50 con 0x7f5174105030 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5170ff9640 1 -- 172.21.15.92:0/3688937711 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51680187a0 con 0x7f5174105030 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.414+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51741a2590 con 0x7f5174105030 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.415+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51740fdd90 con 0x7f5174105030 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.416+0000 7f5170ff9640 1 -- 172.21.15.92:0/3688937711 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f516800f450 con 0x7f5174105030 2024-09-10T10:36:13.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.417+0000 7f5170ff9640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f515c0a2c10 0x7f515c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:13.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.417+0000 7f51737fe640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f515c0a2c10 0x7f515c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:13.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.417+0000 7f5170ff9640 1 -- 172.21.15.92:0/3688937711 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f51680cf0f0 con 0x7f5174105030 2024-09-10T10:36:13.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.417+0000 7f51737fe640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f515c0a2c10 0x7f515c0a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5164000c00 tx=0x7f51640315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:13.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.421+0000 7f5170ff9640 1 -- 172.21.15.92:0/3688937711 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5168014030 con 0x7f5174105030 2024-09-10T10:36:13.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:13 smithi121 ceph-mon[35231]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:13.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:13 smithi121 ceph-mon[35231]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:36:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:13 smithi097 ceph-mon[35213]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:13.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:13 smithi097 ceph-mon[35213]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:36:13.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.591+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5174062630 con 0x7f515c0a2c10 2024-09-10T10:36:13.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.592+0000 7f5170ff9640 1 -- 172.21.15.92:0/3688937711 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f5174062630 con 0x7f515c0a2c10 2024-09-10T10:36:13.594 INFO:teuthology.orchestra.run.smithi092.stdout:HOST ADDR LABELS STATUS 2024-09-10T10:36:13.594 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 172.21.15.92 2024-09-10T10:36:13.594 INFO:teuthology.orchestra.run.smithi092.stdout:smithi097 172.21.15.97 2024-09-10T10:36:13.594 INFO:teuthology.orchestra.run.smithi092.stdout:smithi121 172.21.15.121 2024-09-10T10:36:13.594 INFO:teuthology.orchestra.run.smithi092.stdout:3 hosts in cluster 2024-09-10T10:36:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f515c0a2c10 msgr2=0x7f515c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f515c0a2c10 0x7f515c0a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5164000c00 tx=0x7f51640315d0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174105030 msgr2=0x7f51741006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174105030 0x7f51741006b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f516800c970 tx=0x7f516800ce30 comp rx=0 tx=0).stop 2024-09-10T10:36:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 shutdown_connections 2024-09-10T10:36:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f515c0a2c10 0x7f515c0a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5174107960 0x7f5174100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5174105030 0x7f51741006b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 --2- 172.21.15.92:0/3688937711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5174102700 0x7f5174102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:13.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 >> 172.21.15.92:0/3688937711 conn(0x7f51740fc2a0 msgr2=0x7f5174103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:13.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 shutdown_connections 2024-09-10T10:36:13.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:13.594+0000 7f5179e43640 1 -- 172.21.15.92:0/3688937711 wait complete. 2024-09-10T10:36:14.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T10:36:14.550 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:15.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.054+0000 7f0fb43f2640 1 -- 172.21.15.92:0/2400963107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac102660 msgr2=0x7f0fac104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:15.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.054+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/2400963107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac102660 0x7f0fac104a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009900 tx=0x7f0fa802a410 comp rx=0 tx=0).stop 2024-09-10T10:36:15.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.054+0000 7f0fb43f2640 1 -- 172.21.15.92:0/2400963107 shutdown_connections 2024-09-10T10:36:15.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.054+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/2400963107 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fac1078c0 0x7f0fac109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.054+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/2400963107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fac104f90 0x7f0fac107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.084 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.054+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/2400963107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac102660 0x7f0fac104a50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.054+0000 7f0fb43f2640 1 -- 172.21.15.92:0/2400963107 >> 172.21.15.92:0/2400963107 conn(0x7f0fac0fc280 msgr2=0x7f0fac0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.054+0000 7f0fb43f2640 1 -- 172.21.15.92:0/2400963107 shutdown_connections 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.054+0000 7f0fb43f2640 1 -- 172.21.15.92:0/2400963107 wait complete. 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb43f2640 1 Processor -- start 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb43f2640 1 -- start start 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb43f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fac102660 0x7f0fac197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb43f2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac104f90 0x7f0fac198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb43f2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fac1078c0 0x7f0fac19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb43f2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac10d890 con 0x7f0fac104f90 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb43f2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac10d710 con 0x7f0fac1078c0 2024-09-10T10:36:15.085 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb43f2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac10da10 con 0x7f0fac102660 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb198d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac104f90 0x7f0fac198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb198d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac104f90 0x7f0fac198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42016/0 (socket says 172.21.15.92:42016) 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb198d640 1 -- 172.21.15.92:0/1618957394 learned_addr learned my addr 172.21.15.92:0/1618957394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb298f640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fac1078c0 0x7f0fac19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.055+0000 7f0fb218e640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fac102660 0x7f0fac197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fb198d640 1 -- 172.21.15.92:0/1618957394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fac102660 msgr2=0x7f0fac197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fb198d640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fac102660 0x7f0fac197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fb198d640 1 -- 172.21.15.92:0/1618957394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fac1078c0 msgr2=0x7f0fac19f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fb198d640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fac1078c0 0x7f0fac19f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fb198d640 1 -- 172.21.15.92:0/1618957394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac19fb50 con 0x7f0fac104f90 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fb198d640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac104f90 0x7f0fac198460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00d740 tx=0x7f0f9c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:15.086 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fa37fe640 1 -- 172.21.15.92:0/1618957394 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c017070 con 0x7f0fac104f90 2024-09-10T10:36:15.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fac19fe40 con 0x7f0fac104f90 2024-09-10T10:36:15.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fac1a02f0 con 0x7f0fac104f90 2024-09-10T10:36:15.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.056+0000 7f0fa37fe640 1 -- 172.21.15.92:0/1618957394 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f9c00de50 con 0x7f0fac104f90 2024-09-10T10:36:15.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.057+0000 7f0fa37fe640 1 -- 172.21.15.92:0/1618957394 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c004e00 con 0x7f0fac104f90 2024-09-10T10:36:15.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.058+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fac0fdd70 con 0x7f0fac104f90 2024-09-10T10:36:15.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.059+0000 7f0fa37fe640 1 -- 172.21.15.92:0/1618957394 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0f9c004fa0 con 0x7f0fac104f90 2024-09-10T10:36:15.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.059+0000 7f0fa37fe640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f980a2cc0 0x7f0f980a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:15.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.059+0000 7f0fb218e640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f980a2cc0 0x7f0f980a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:15.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.059+0000 7f0fa37fe640 1 -- 172.21.15.92:0/1618957394 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f0f9c0ce920 con 0x7f0fac104f90 2024-09-10T10:36:15.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.060+0000 7f0fb218e640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f980a2cc0 0x7f0f980a5180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80314e0 tx=0x7f0fa8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:15.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.063+0000 7f0fa37fe640 1 -- 172.21.15.92:0/1618957394 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f9c09b1d0 con 0x7f0fac104f90 2024-09-10T10:36:15.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.239+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 --> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f0fac062630 con 0x7f0f980a2cc0 2024-09-10T10:36:15.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.240+0000 7f0fa37fe640 1 -- 172.21.15.92:0/1618957394 <== mgr.14150 v2:172.21.15.92:6800/2834815615 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f0fac062630 con 0x7f0f980a2cc0 2024-09-10T10:36:15.242 INFO:teuthology.orchestra.run.smithi092.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T10:36:15.242 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T10:36:15.242 INFO:teuthology.orchestra.run.smithi092.stdout:smithi097 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013T400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T10:36:15.242 INFO:teuthology.orchestra.run.smithi092.stdout:smithi121 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T10:36:15.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f980a2cc0 msgr2=0x7f0f980a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:15.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f980a2cc0 0x7f0f980a5180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80314e0 tx=0x7f0fa8000bc0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac104f90 msgr2=0x7f0fac198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:15.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac104f90 0x7f0fac198460 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00d740 tx=0x7f0f9c00dc00 comp rx=0 tx=0).stop 2024-09-10T10:36:15.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 shutdown_connections 2024-09-10T10:36:15.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f0f980a2cc0 0x7f0f980a5180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0fac1078c0 0x7f0fac19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0fac104f90 0x7f0fac198460 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 --2- 172.21.15.92:0/1618957394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fac102660 0x7f0fac197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:15.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 >> 172.21.15.92:0/1618957394 conn(0x7f0fac0fc280 msgr2=0x7f0fac103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:15.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 shutdown_connections 2024-09-10T10:36:15.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:15.242+0000 7f0fb43f2640 1 -- 172.21.15.92:0/1618957394 wait complete. 2024-09-10T10:36:15.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:15 smithi121 ceph-mon[35231]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:15.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:15 smithi121 ceph-mon[35231]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:36:15.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:15 smithi097 ceph-mon[35213]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:15.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:15 smithi097 ceph-mon[35213]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:36:15.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:15 smithi092 ceph-mon[30834]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:15.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:15 smithi092 ceph-mon[30834]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:36:15.942 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T10:36:15.952 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:36:15.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T10:36:16.196 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:16.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:16 smithi121 ceph-mon[35231]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:16.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:16 smithi097 ceph-mon[35213]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:16.585 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:16 smithi092 ceph-mon[30834]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:16.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.663+0000 7fd01b34a640 1 -- 172.21.15.92:0/3853478384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014107900 msgr2=0x7fd014109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:16.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.663+0000 7fd01b34a640 1 --2- 172.21.15.92:0/3853478384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014107900 0x7fd014109d50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009ca0 tx=0x7fd00c02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.663+0000 7fd01b34a640 1 -- 172.21.15.92:0/3853478384 shutdown_connections 2024-09-10T10:36:16.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.663+0000 7fd01b34a640 1 --2- 172.21.15.92:0/3853478384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014107900 0x7fd014109d50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.663+0000 7fd01b34a640 1 --2- 172.21.15.92:0/3853478384 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd014104fd0 0x7fd0141073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.663+0000 7fd01b34a640 1 --2- 172.21.15.92:0/3853478384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0141026a0 0x7fd014104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.663+0000 7fd01b34a640 1 -- 172.21.15.92:0/3853478384 >> 172.21.15.92:0/3853478384 conn(0x7fd0140fc2a0 msgr2=0x7fd0140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:16.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.663+0000 7fd01b34a640 1 -- 172.21.15.92:0/3853478384 shutdown_connections 2024-09-10T10:36:16.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.663+0000 7fd01b34a640 1 -- 172.21.15.92:0/3853478384 wait complete. 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd01b34a640 1 Processor -- start 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd01b34a640 1 -- start start 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd01b34a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0141026a0 0x7fd014102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd01b34a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014104fd0 0x7fd014100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd01b34a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd014107900 0x7fd014100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd01b34a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd01410d8c0 con 0x7fd014104fd0 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd01b34a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd01410d740 con 0x7fd0141026a0 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd01b34a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd01410da40 con 0x7fd014107900 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd0188e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014104fd0 0x7fd014100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd0188e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014104fd0 0x7fd014100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42020/0 (socket says 172.21.15.92:42020) 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.664+0000 7fd0188e5640 1 -- 172.21.15.92:0/768504412 learned_addr learned my addr 172.21.15.92:0/768504412 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:16.687 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd0198e7640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd014107900 0x7fd014100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd0190e6640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0141026a0 0x7fd014102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd0188e5640 1 -- 172.21.15.92:0/768504412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd014107900 msgr2=0x7fd014100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd0188e5640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd014107900 0x7fd014100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd0188e5640 1 -- 172.21.15.92:0/768504412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0141026a0 msgr2=0x7fd014102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd0188e5640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0141026a0 0x7fd014102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd0188e5640 1 -- 172.21.15.92:0/768504412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd014101450 con 0x7fd014104fd0 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd0188e5640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014104fd0 0x7fd014100650 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd00400d770 tx=0x7fd00400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd00a7fc640 1 -- 172.21.15.92:0/768504412 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004017070 con 0x7fd014104fd0 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0141a2080 con 0x7fd014104fd0 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd00a7fc640 1 -- 172.21.15.92:0/768504412 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd004009c30 con 0x7fd014104fd0 2024-09-10T10:36:16.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd00a7fc640 1 -- 172.21.15.92:0/768504412 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00400f620 con 0x7fd014104fd0 2024-09-10T10:36:16.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.665+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0141a2590 con 0x7fd014104fd0 2024-09-10T10:36:16.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.666+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0140fdd90 con 0x7fd014104fd0 2024-09-10T10:36:16.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.667+0000 7fd00a7fc640 1 -- 172.21.15.92:0/768504412 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd00401a070 con 0x7fd014104fd0 2024-09-10T10:36:16.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.668+0000 7fd00a7fc640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd0000a2c10 0x7fd0000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:16.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.668+0000 7fd0190e6640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd0000a2c10 0x7fd0000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:16.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.668+0000 7fd00a7fc640 1 -- 172.21.15.92:0/768504412 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fd0040cebd0 con 0x7fd014104fd0 2024-09-10T10:36:16.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.669+0000 7fd0190e6640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd0000a2c10 0x7fd0000a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd010005fd0 tx=0x7fd01000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:16.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.672+0000 7fd00a7fc640 1 -- 172.21.15.92:0/768504412 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd004009de0 con 0x7fd014104fd0 2024-09-10T10:36:16.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.875+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd01402d7c0 con 0x7fd014104fd0 2024-09-10T10:36:16.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.876+0000 7fd00a7fc640 1 -- 172.21.15.92:0/768504412 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3119 (secure 0 0 0) 0x7fd00409b380 con 0x7fd014104fd0 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:e27 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:btime 2024-09-10T10:34:56:804663+0000 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:legacy client fscid: 1 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:Filesystem 'cephfs' (1) 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:fs_name cephfs 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 27 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T10:36:16.878 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-09-10T10:34:45.351151+0000 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2024-09-10T10:34:56.804641+0000 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:tableserver 0 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:root 0 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:session_timeout 300 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:session_autoclose 300 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:max_file_size 1099511627776 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:max_xattr_size 65536 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:required_client_features {} 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure 0 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure_osd_epoch 0 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T10:36:16.879 INFO:teuthology.orchestra.run.smithi092.stdout:max_mds 5 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:in 0,1,2,3,4 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:up {0=24472,1=24451,2=24445,3=24431,4=24424} 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:failed 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:damaged 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:stopped 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:data_pools [3] 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:metadata_pool 2 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:inline_data disabled 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:balancer 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:bal_rank_mask -1 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:standby_count_wanted 0 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:qdb_cluster leader: 24472 members: 24472,24451,24445,24431,24424 2024-09-10T10:36:16.880 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.i{0:24472} state up:active seq 6 addr [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.h{0:24407} state up:standby-replay seq 1 addr [v2:172.21.15.97:6836/4081108899,v1:172.21.15.97:6837/4081108899] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c{1:24451} state up:active seq 10 addr [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.e{1:24386} state up:standby-replay seq 1 addr [v2:172.21.15.97:6834/9514508,v1:172.21.15.97:6835/9514508] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.f{2:24445} state up:active seq 10 addr [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.k{2:24359} state up:standby-replay seq 1 addr [v2:172.21.15.97:6832/2610071582,v1:172.21.15.97:6833/2610071582] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b{3:24431} state up:active seq 6 addr [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a{3:14625} state up:standby-replay seq 1 addr [v2:172.21.15.92:6840/15499972,v1:172.21.15.92:6841/15499972] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.l{4:24424} state up:active seq 15 addr [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.g{4:14619} state up:standby-replay seq 1 addr [v2:172.21.15.92:6838/1641635662,v1:172.21.15.92:6839/1641635662] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout:Standby daemons: 2024-09-10T10:36:16.881 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:16.882 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.j{-1:14553} state up:standby seq 1 addr [v2:172.21.15.92:6834/3858072371,v1:172.21.15.92:6835/3858072371] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.882 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d{-1:14565} state up:standby seq 1 addr [v2:172.21.15.92:6836/1435061291,v1:172.21.15.92:6837/1435061291] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T10:36:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2024-09-10T10:36:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd0000a2c10 msgr2=0x7fd0000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd0000a2c10 0x7fd0000a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd010005fd0 tx=0x7fd01000b390 comp rx=0 tx=0).stop 2024-09-10T10:36:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014104fd0 msgr2=0x7fd014100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:16.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014104fd0 0x7fd014100650 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd00400d770 tx=0x7fd00400dc30 comp rx=0 tx=0).stop 2024-09-10T10:36:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 shutdown_connections 2024-09-10T10:36:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fd0000a2c10 0x7fd0000a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd014107900 0x7fd014100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd014104fd0 0x7fd014100650 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 --2- 172.21.15.92:0/768504412 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd0141026a0 0x7fd014102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 >> 172.21.15.92:0/768504412 conn(0x7fd0140fc2a0 msgr2=0x7fd014102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 shutdown_connections 2024-09-10T10:36:16.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:16.878+0000 7fd01b34a640 1 -- 172.21.15.92:0/768504412 wait complete. 2024-09-10T10:36:17.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:17 smithi121 ceph-mon[35231]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T10:36:17.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:17 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/768504412' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:36:17.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:17 smithi097 ceph-mon[35213]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T10:36:17.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:17 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/768504412' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:36:17.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:17 smithi092 ceph-mon[30834]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T10:36:17.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:17 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/768504412' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T10:36:17.610 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T10:36:17.852 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.327+0000 7f1ea5945640 1 -- 172.21.15.92:0/1417072828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 msgr2=0x7f1ea0102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.327+0000 7f1ea5945640 1 --2- 172.21.15.92:0/1417072828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 0x7f1ea0102000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009900 tx=0x7f1e9402a410 comp rx=0 tx=0).stop 2024-09-10T10:36:18.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.327+0000 7f1ea5945640 1 -- 172.21.15.92:0/1417072828 shutdown_connections 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.327+0000 7f1ea5945640 1 --2- 172.21.15.92:0/1417072828 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea01037c0 0x7f1ea010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.327+0000 7f1ea5945640 1 --2- 172.21.15.92:0/1417072828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ea0102e00 0x7f1ea0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.327+0000 7f1ea5945640 1 --2- 172.21.15.92:0/1417072828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 0x7f1ea0102000 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.327+0000 7f1ea5945640 1 -- 172.21.15.92:0/1417072828 >> 172.21.15.92:0/1417072828 conn(0x7f1ea00fd390 msgr2=0x7f1ea00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.327+0000 7f1ea5945640 1 -- 172.21.15.92:0/1417072828 shutdown_connections 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.327+0000 7f1ea5945640 1 -- 172.21.15.92:0/1417072828 wait complete. 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.328+0000 7f1ea5945640 1 Processor -- start 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.328+0000 7f1ea5945640 1 -- start start 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.328+0000 7f1ea5945640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 0x7f1ea0197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.328+0000 7f1ea5945640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ea0102e00 0x7f1ea0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.328+0000 7f1ea5945640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea01037c0 0x7f1ea019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.328+0000 7f1ea5945640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea010d880 con 0x7f1ea0101c00 2024-09-10T10:36:18.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.328+0000 7f1ea5945640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea010d700 con 0x7f1ea01037c0 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.328+0000 7f1ea5945640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea010da00 con 0x7f1ea0102e00 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 0x7f1ea0197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 0x7f1ea0197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42046/0 (socket says 172.21.15.92:42046) 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9effd640 1 -- 172.21.15.92:0/3852374095 learned_addr learned my addr 172.21.15.92:0/3852374095 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9e7fc640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ea0102e00 0x7f1ea0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9f7fe640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea01037c0 0x7f1ea019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9effd640 1 -- 172.21.15.92:0/3852374095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ea0102e00 msgr2=0x7f1ea0198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9effd640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ea0102e00 0x7f1ea0198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9effd640 1 -- 172.21.15.92:0/3852374095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea01037c0 msgr2=0x7f1ea019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9effd640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea01037c0 0x7f1ea019f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9effd640 1 -- 172.21.15.92:0/3852374095 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea019fb40 con 0x7f1ea0101c00 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1e9effd640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 0x7f1ea0197f10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1e94031610 tx=0x7f1e940043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1ea4943640 1 -- 172.21.15.92:0/3852374095 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9403f030 con 0x7f1ea0101c00 2024-09-10T10:36:18.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea019fdd0 con 0x7f1ea0101c00 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1ea4943640 1 -- 172.21.15.92:0/3852374095 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e94003ce0 con 0x7f1ea0101c00 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1ea4943640 1 -- 172.21.15.92:0/3852374095 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94035070 con 0x7f1ea0101c00 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.329+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea01a0220 con 0x7f1ea0101c00 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.330+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea0109070 con 0x7f1ea0101c00 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.331+0000 7f1ea4943640 1 -- 172.21.15.92:0/3852374095 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1e94042030 con 0x7f1ea0101c00 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.332+0000 7f1ea4943640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1e880a2c40 0x7f1e880a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.332+0000 7f1e9e7fc640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1e880a2c40 0x7f1e880a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.332+0000 7f1ea4943640 1 -- 172.21.15.92:0/3852374095 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f1e940ef620 con 0x7f1ea0101c00 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.332+0000 7f1e9e7fc640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1e880a2c40 0x7f1e880a5100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0199430 tx=0x7f1e9000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:18.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.336+0000 7f1ea4943640 1 -- 172.21.15.92:0/3852374095 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e940bc520 con 0x7f1ea0101c00 2024-09-10T10:36:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.511+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f1ea002d970 con 0x7f1ea0101c00 2024-09-10T10:36:18.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.512+0000 7f1ea4943640 1 -- 172.21.15.92:0/3852374095 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5219 (secure 0 0 0) 0x7f1e940bbe20 con 0x7f1ea0101c00 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 83 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-09-10T10:27:09.104347+0000 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2024-09-10T10:34:55.779980+0000 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:crush_version 26 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:full_ratio 0.95 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:backfillfull_ratio 0.9 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:nearfull_ratio 0.85 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:require_min_compat_client luminous 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:min_compat_client luminous 2024-09-10T10:36:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:require_osd_release squid 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:stretch_mode_enabled false 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:max_osd 12 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 up in weight 1 up_from 8 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6802/2143150260,v1:172.21.15.92:6803/2143150260] [v2:172.21.15.92:6804/2143150260,v1:172.21.15.92:6805/2143150260] exists,up c1c3ff3a-9a5b-4d65-83f1-22fda2993201 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 up in weight 1 up_from 13 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6800/3508346445,v1:172.21.15.97:6801/3508346445] [v2:172.21.15.97:6802/3508346445,v1:172.21.15.97:6803/3508346445] exists,up 618212b8-db9b-4682-8a6b-f021f814c0e0 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 up in weight 1 up_from 18 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6800/1231693534,v1:172.21.15.121:6801/1231693534] [v2:172.21.15.121:6802/1231693534,v1:172.21.15.121:6803/1231693534] exists,up a872b862-b9b4-48e9-8130-87c1c7e5ef36 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 up in weight 1 up_from 24 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6810/3638563027,v1:172.21.15.92:6811/3638563027] [v2:172.21.15.92:6812/3638563027,v1:172.21.15.92:6813/3638563027] exists,up f1315d40-d449-4284-901e-5526d9ea4bd1 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 up in weight 1 up_from 31 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6808/1960503640,v1:172.21.15.97:6809/1960503640] [v2:172.21.15.97:6810/1960503640,v1:172.21.15.97:6811/1960503640] exists,up 5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 up in weight 1 up_from 36 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6808/2173743717,v1:172.21.15.121:6809/2173743717] [v2:172.21.15.121:6810/2173743717,v1:172.21.15.121:6811/2173743717] exists,up 9f4ef1d2-3f17-44ca-8abe-d0f137a688ad 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 up in weight 1 up_from 44 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6818/4073590316,v1:172.21.15.92:6819/4073590316] [v2:172.21.15.92:6820/4073590316,v1:172.21.15.92:6821/4073590316] exists,up 8e1ea615-df4a-4948-b6a9-39323edfed2c 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 up in weight 1 up_from 49 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6816/2587554904,v1:172.21.15.97:6817/2587554904] [v2:172.21.15.97:6818/2587554904,v1:172.21.15.97:6819/2587554904] exists,up 62e6ec88-d78d-4759-b4b9-37a846ef4a46 2024-09-10T10:36:18.514 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 up in weight 1 up_from 56 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6816/852392331,v1:172.21.15.121:6817/852392331] [v2:172.21.15.121:6818/852392331,v1:172.21.15.121:6819/852392331] exists,up 2925118a-dd87-43bb-b3a2-43938fa103e1 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 up in weight 1 up_from 63 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6826/1628602922,v1:172.21.15.92:6827/1628602922] [v2:172.21.15.92:6828/1628602922,v1:172.21.15.92:6829/1628602922] exists,up 478185a7-99a3-4808-8a0a-5ebf8e201b37 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 up in weight 1 up_from 68 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6824/4185201186,v1:172.21.15.97:6825/4185201186] [v2:172.21.15.97:6826/4185201186,v1:172.21.15.97:6827/4185201186] exists,up 7573d9e2-f7cd-4c9c-8939-54e13784e11e 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 up in weight 1 up_from 75 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6824/328137928,v1:172.21.15.121:6825/328137928] [v2:172.21.15.121:6826/328137928,v1:172.21.15.121:6827/328137928] exists,up 8e24d820-116a-48eb-a6de-fbe19ab78cf7 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.a [2,11] 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.f [8,11] 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.3 [4,9] 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.14 [4,6] 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.20 [5,9] 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.24 [4,9] 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/896601966 expires 2024-09-11T10:27:54.047303+0000 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/3917916504 expires 2024-09-11T10:27:54.047303+0000 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/1855060807 expires 2024-09-11T10:27:54.047303+0000 2024-09-10T10:36:18.515 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/140795142 expires 2024-09-11T10:27:54.047303+0000 2024-09-10T10:36:18.516 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/2836317933 expires 2024-09-11T10:27:30.810536+0000 2024-09-10T10:36:18.516 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/2836317933 expires 2024-09-11T10:27:30.810536+0000 2024-09-10T10:36:18.516 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/2939690439 expires 2024-09-11T10:27:30.810536+0000 2024-09-10T10:36:18.516 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/2311894425 expires 2024-09-11T10:27:30.810536+0000 2024-09-10T10:36:18.516 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/1855060807 expires 2024-09-11T10:27:54.047303+0000 2024-09-10T10:36:18.516 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/1111474699 expires 2024-09-11T10:27:30.810536+0000 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1e880a2c40 msgr2=0x7f1e880a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1e880a2c40 0x7f1e880a5100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0199430 tx=0x7f1e9000b390 comp rx=0 tx=0).stop 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 msgr2=0x7f1ea0197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 0x7f1ea0197f10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1e94031610 tx=0x7f1e940043b0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 shutdown_connections 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f1e880a2c40 0x7f1e880a5100 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1ea01037c0 0x7f1ea019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ea0102e00 0x7f1ea0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 --2- 172.21.15.92:0/3852374095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea0101c00 0x7f1ea0197f10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 >> 172.21.15.92:0/3852374095 conn(0x7f1ea00fd390 msgr2=0x7f1ea0106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 shutdown_connections 2024-09-10T10:36:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:18.515+0000 7f1ea5945640 1 -- 172.21.15.92:0/3852374095 wait complete. 2024-09-10T10:36:19.366 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T10:36:19.378 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:36:19.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:19 smithi121 ceph-mon[35231]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:36:19.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:19 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3852374095' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T10:36:19.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:19 smithi097 ceph-mon[35213]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:36:19.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:19 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3852374095' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T10:36:19.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:19 smithi092 ceph-mon[30834]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T10:36:19.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:19 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3852374095' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T10:36:19.625 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.093+0000 7f61e9dbf640 1 -- 172.21.15.92:0/1223479196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e41027a0 msgr2=0x7f61e41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.093+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/1223479196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e41027a0 0x7f61e41067f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009900 tx=0x7f61cc02a410 comp rx=0 tx=0).stop 2024-09-10T10:36:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.093+0000 7f61e9dbf640 1 -- 172.21.15.92:0/1223479196 shutdown_connections 2024-09-10T10:36:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.093+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/1223479196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e4106f20 0x7f61e410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:20.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.093+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/1223479196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e41027a0 0x7f61e41067f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.093+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/1223479196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61e4101df0 0x7f61e41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.093+0000 7f61e9dbf640 1 -- 172.21.15.92:0/1223479196 >> 172.21.15.92:0/1223479196 conn(0x7f61e40fd8f0 msgr2=0x7f61e40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.093+0000 7f61e9dbf640 1 -- 172.21.15.92:0/1223479196 shutdown_connections 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.093+0000 7f61e9dbf640 1 -- 172.21.15.92:0/1223479196 wait complete. 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e9dbf640 1 Processor -- start 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e9dbf640 1 -- start start 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e9dbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4101df0 0x7f61e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e9dbf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61e41027a0 0x7f61e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e9dbf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e4106f20 0x7f61e4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e9dbf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4112020 con 0x7f61e4101df0 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e9dbf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4111ea0 con 0x7f61e41027a0 2024-09-10T10:36:20.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e9dbf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41121a0 con 0x7f61e4106f20 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4101df0 0x7f61e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4101df0 0x7f61e40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42068/0 (socket says 172.21.15.92:42068) 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e37fe640 1 -- 172.21.15.92:0/3251345429 learned_addr learned my addr 172.21.15.92:0/3251345429 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61dbfff640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61e41027a0 0x7f61e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e37fe640 1 -- 172.21.15.92:0/3251345429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e4106f20 msgr2=0x7f61e4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e3fff640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e4106f20 0x7f61e4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e37fe640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e4106f20 0x7f61e4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e37fe640 1 -- 172.21.15.92:0/3251345429 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61e41027a0 msgr2=0x7f61e4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e37fe640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61e41027a0 0x7f61e4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e37fe640 1 -- 172.21.15.92:0/3251345429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e41a6a40 con 0x7f61e4101df0 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e3fff640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e4106f20 0x7f61e4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:20.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.094+0000 7f61e37fe640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4101df0 0x7f61e40744f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b4a0 tx=0x7f61d400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.095+0000 7f61e17fa640 1 -- 172.21.15.92:0/3251345429 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4014070 con 0x7f61e4101df0 2024-09-10T10:36:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.095+0000 7f61e17fa640 1 -- 172.21.15.92:0/3251345429 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d4010af0 con 0x7f61e4101df0 2024-09-10T10:36:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.095+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e41a6d30 con 0x7f61e4101df0 2024-09-10T10:36:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.095+0000 7f61e17fa640 1 -- 172.21.15.92:0/3251345429 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4017d10 con 0x7f61e4101df0 2024-09-10T10:36:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.095+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e41a7210 con 0x7f61e4101df0 2024-09-10T10:36:20.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.096+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e4102250 con 0x7f61e4101df0 2024-09-10T10:36:20.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.097+0000 7f61e17fa640 1 -- 172.21.15.92:0/3251345429 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f61d4017070 con 0x7f61e4101df0 2024-09-10T10:36:20.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.098+0000 7f61e17fa640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f61d00a2c10 0x7f61d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:20.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.098+0000 7f61dbfff640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f61d00a2c10 0x7f61d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:20.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.098+0000 7f61e17fa640 1 -- 172.21.15.92:0/3251345429 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f61d40ce3e0 con 0x7f61e4101df0 2024-09-10T10:36:20.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.098+0000 7f61dbfff640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f61d00a2c10 0x7f61d00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f61e4075f80 tx=0x7f61cc031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:20.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.102+0000 7f61e17fa640 1 -- 172.21.15.92:0/3251345429 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61d409b3f0 con 0x7f61e4101df0 2024-09-10T10:36:20.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.303+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61e402d7c0 con 0x7f61e4101df0 2024-09-10T10:36:20.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.304+0000 7f61e17fa640 1 -- 172.21.15.92:0/3251345429 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7f61d409acf0 con 0x7f61e4101df0 2024-09-10T10:36:20.305 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:20.305 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"btime":"2024-09-10T10:34:56:804663+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:34:45.351151+0000","modified":"2024-09-10T10:34:56.804641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24472,"mds_1":24451,"mds_2":24445,"mds_3":24431,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/15499972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":15499972},{"type":"v1","addr":"172.21.15.92:6841","nonce":15499972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24359":{"gid":24359,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24386":{"gid":24386,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":15,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"b","rank":3,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6839/2331166625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6838","nonce":2331166625},{"type":"v1","addr":"172.21.15.97:6839","nonce":2331166625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24451,24445,24431,24424]},"id":1}]} 2024-09-10T10:36:20.306 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2024-09-10T10:36:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f61d00a2c10 msgr2=0x7f61d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f61d00a2c10 0x7f61d00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f61e4075f80 tx=0x7f61cc031490 comp rx=0 tx=0).stop 2024-09-10T10:36:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4101df0 msgr2=0x7f61e40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4101df0 0x7f61e40744f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f61d400b4a0 tx=0x7f61d400b960 comp rx=0 tx=0).stop 2024-09-10T10:36:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 shutdown_connections 2024-09-10T10:36:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f61d00a2c10 0x7f61d00a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e4106f20 0x7f61e4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:20.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f61e41027a0 0x7f61e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:20.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 --2- 172.21.15.92:0/3251345429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61e4101df0 0x7f61e40744f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:20.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 >> 172.21.15.92:0/3251345429 conn(0x7f61e40fd8f0 msgr2=0x7f61e40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:20.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.306+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 shutdown_connections 2024-09-10T10:36:20.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:20.307+0000 7f61e9dbf640 1 -- 172.21.15.92:0/3251345429 wait complete. 2024-09-10T10:36:20.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:36:21.213 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:21.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:21 smithi121 ceph-mon[35231]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:36:21.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:21 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3251345429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:36:21.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:21 smithi097 ceph-mon[35213]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:36:21.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:21 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3251345429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:36:21.605 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:21 smithi092 ceph-mon[30834]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T10:36:21.605 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:21 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3251345429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:36:21.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.681+0000 7fa67446b640 1 -- 172.21.15.92:0/2592680807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 msgr2=0x7fa66c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:21.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.681+0000 7fa67446b640 1 --2- 172.21.15.92:0/2592680807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 0x7fa66c10e610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa664009ca0 tx=0x7fa66402a950 comp rx=0 tx=0).stop 2024-09-10T10:36:21.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.681+0000 7fa67446b640 1 -- 172.21.15.92:0/2592680807 shutdown_connections 2024-09-10T10:36:21.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.681+0000 7fa67446b640 1 --2- 172.21.15.92:0/2592680807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 0x7fa66c10e610 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:21.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.681+0000 7fa67446b640 1 --2- 172.21.15.92:0/2592680807 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa66c103660 0x7fa66c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:21.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.681+0000 7fa67446b640 1 --2- 172.21.15.92:0/2592680807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa66c102d40 0x7fa66c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.681+0000 7fa67446b640 1 -- 172.21.15.92:0/2592680807 >> 172.21.15.92:0/2592680807 conn(0x7fa66c0fc7a0 msgr2=0x7fa66c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.681+0000 7fa67446b640 1 -- 172.21.15.92:0/2592680807 shutdown_connections 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.681+0000 7fa67446b640 1 -- 172.21.15.92:0/2592680807 wait complete. 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa67446b640 1 Processor -- start 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa67446b640 1 -- start start 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa67446b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa66c102d40 0x7fa66c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa67446b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa66c103660 0x7fa66c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa67446b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 0x7fa66c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa67446b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c112030 con 0x7fa66c10c170 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa67446b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c111eb0 con 0x7fa66c103660 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa67446b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c1121b0 con 0x7fa66c102d40 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa672a08640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 0x7fa66c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:21.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa672a08640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 0x7fa66c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42082/0 (socket says 172.21.15.92:42082) 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.682+0000 7fa672a08640 1 -- 172.21.15.92:0/23414274 learned_addr learned my addr 172.21.15.92:0/23414274 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa672207640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa66c102d40 0x7fa66c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa671a06640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa66c103660 0x7fa66c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa672a08640 1 -- 172.21.15.92:0/23414274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa66c102d40 msgr2=0x7fa66c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa672a08640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa66c102d40 0x7fa66c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa672a08640 1 -- 172.21.15.92:0/23414274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa66c103660 msgr2=0x7fa66c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa672a08640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa66c103660 0x7fa66c198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa672a08640 1 -- 172.21.15.92:0/23414274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c19d5f0 con 0x7fa66c10c170 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa672a08640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 0x7fa66c19cf10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa664006010 tx=0x7fa66402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa6637fe640 1 -- 172.21.15.92:0/23414274 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664034040 con 0x7fa66c10c170 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa6637fe640 1 -- 172.21.15.92:0/23414274 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa664003e00 con 0x7fa66c10c170 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa6637fe640 1 -- 172.21.15.92:0/23414274 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6640456e0 con 0x7fa66c10c170 2024-09-10T10:36:21.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c19d880 con 0x7fa66c10c170 2024-09-10T10:36:21.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.683+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c1a51c0 con 0x7fa66c10c170 2024-09-10T10:36:21.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.684+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa66c06b070 con 0x7fa66c10c170 2024-09-10T10:36:21.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.685+0000 7fa6637fe640 1 -- 172.21.15.92:0/23414274 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa664037020 con 0x7fa66c10c170 2024-09-10T10:36:21.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.686+0000 7fa6637fe640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa6580a2c10 0x7fa6580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:21.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.686+0000 7fa672207640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa6580a2c10 0x7fa6580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:21.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.686+0000 7fa6637fe640 1 -- 172.21.15.92:0/23414274 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fa6640f0210 con 0x7fa66c10c170 2024-09-10T10:36:21.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.686+0000 7fa672207640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa6580a2c10 0x7fa6580a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa668009890 tx=0x7fa668008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:21.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.690+0000 7fa6637fe640 1 -- 172.21.15.92:0/23414274 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6640bd220 con 0x7fa66c10c170 2024-09-10T10:36:21.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.891+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa66c107210 con 0x7fa66c10c170 2024-09-10T10:36:21.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.892+0000 7fa6637fe640 1 -- 172.21.15.92:0/23414274 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7fa6640bcb20 con 0x7fa66c10c170 2024-09-10T10:36:21.894 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:21.894 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":27,"btime":"2024-09-10T10:34:56:804663+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:34:45.351151+0000","modified":"2024-09-10T10:34:56.804641+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24472,"mds_1":24451,"mds_2":24445,"mds_3":24431,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/15499972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":15499972},{"type":"v1","addr":"172.21.15.92:6841","nonce":15499972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24359":{"gid":24359,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24386":{"gid":24386,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6837/4081108899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":4081108899},{"type":"v1","addr":"172.21.15.97:6837","nonce":4081108899}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":15,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"b","rank":3,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6839/2331166625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6838","nonce":2331166625},{"type":"v1","addr":"172.21.15.97:6839","nonce":2331166625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24451,24445,24431,24424]},"id":1}]} 2024-09-10T10:36:21.894 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 27 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa6580a2c10 msgr2=0x7fa6580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa6580a2c10 0x7fa6580a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa668009890 tx=0x7fa668008040 comp rx=0 tx=0).stop 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 msgr2=0x7fa66c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 0x7fa66c19cf10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa664006010 tx=0x7fa66402f710 comp rx=0 tx=0).stop 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 shutdown_connections 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa6580a2c10 0x7fa6580a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa66c10c170 0x7fa66c19cf10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa66c103660 0x7fa66c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 --2- 172.21.15.92:0/23414274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa66c102d40 0x7fa66c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 >> 172.21.15.92:0/23414274 conn(0x7fa66c0fc7a0 msgr2=0x7fa66c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:21.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 shutdown_connections 2024-09-10T10:36:21.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:21.894+0000 7fa67446b640 1 -- 172.21.15.92:0/23414274 wait complete. 2024-09-10T10:36:22.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:22 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/23414274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:36:22.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:22 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/23414274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:36:22.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:22 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/23414274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:36:22.768 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:36:23.015 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:23.423 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:23 smithi092 ceph-mon[30834]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:36:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.501+0000 7fdb0ac81640 1 -- 172.21.15.92:0/1192081798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102570 msgr2=0x7fdb041029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.501+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/1192081798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102570 0x7fdb041029b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009900 tx=0x7fdaf002a480 comp rx=0 tx=0).stop 2024-09-10T10:36:23.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.501+0000 7fdb0ac81640 1 -- 172.21.15.92:0/1192081798 shutdown_connections 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.501+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/1192081798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb04102ef0 0x7fdb0410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.501+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/1192081798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102570 0x7fdb041029b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.501+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/1192081798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb04100e20 0x7fdb04101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.501+0000 7fdb0ac81640 1 -- 172.21.15.92:0/1192081798 >> 172.21.15.92:0/1192081798 conn(0x7fdb040fc7d0 msgr2=0x7fdb040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.501+0000 7fdb0ac81640 1 -- 172.21.15.92:0/1192081798 shutdown_connections 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.501+0000 7fdb0ac81640 1 -- 172.21.15.92:0/1192081798 wait complete. 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0ac81640 1 Processor -- start 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0ac81640 1 -- start start 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0ac81640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb04100e20 0x7fdb0419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0ac81640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb04102570 0x7fdb0419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0ac81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102ef0 0x7fdb0419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:23.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0ac81640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04110f80 con 0x7fdb04102ef0 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0ac81640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04110e00 con 0x7fdb04100e20 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0ac81640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04111100 con 0x7fdb04102570 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0921e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102ef0 0x7fdb0419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0921e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102ef0 0x7fdb0419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45350/0 (socket says 172.21.15.92:45350) 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0921e640 1 -- 172.21.15.92:0/781292063 learned_addr learned my addr 172.21.15.92:0/781292063 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb08a1d640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb04100e20 0x7fdb0419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb03fff640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb04102570 0x7fdb0419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0921e640 1 -- 172.21.15.92:0/781292063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb04102570 msgr2=0x7fdb0419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0921e640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb04102570 0x7fdb0419ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0921e640 1 -- 172.21.15.92:0/781292063 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb04100e20 msgr2=0x7fdb0419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0921e640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb04100e20 0x7fdb0419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:23.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb0921e640 1 -- 172.21.15.92:0/781292063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0419f6c0 con 0x7fdb04102ef0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.502+0000 7fdb03fff640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb04102570 0x7fdb0419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.503+0000 7fdb0921e640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102ef0 0x7fdb0419efe0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00d750 tx=0x7fdafc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.503+0000 7fdb01ffb640 1 -- 172.21.15.92:0/781292063 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc017070 con 0x7fdb04102ef0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.503+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0419f9b0 con 0x7fdb04102ef0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.503+0000 7fdb01ffb640 1 -- 172.21.15.92:0/781292063 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdafc005500 con 0x7fdb04102ef0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.503+0000 7fdb01ffb640 1 -- 172.21.15.92:0/781292063 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc004d90 con 0x7fdb04102ef0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.503+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb041a7290 con 0x7fdb04102ef0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.504+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb04101200 con 0x7fdb04102ef0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.505+0000 7fdb01ffb640 1 -- 172.21.15.92:0/781292063 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdafc004f30 con 0x7fdb04102ef0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.506+0000 7fdb01ffb640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdaf40a2c10 0x7fdaf40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.506+0000 7fdb08a1d640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdaf40a2c10 0x7fdaf40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.506+0000 7fdb01ffb640 1 -- 172.21.15.92:0/781292063 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fdafc0ceec0 con 0x7fdb04102ef0 2024-09-10T10:36:23.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.506+0000 7fdb08a1d640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdaf40a2c10 0x7fdaf40a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8005fd0 tx=0x7fdaf8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:23.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.509+0000 7fdb01ffb640 1 -- 172.21.15.92:0/781292063 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdafc09bdc0 con 0x7fdb04102ef0 2024-09-10T10:36:23.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:23 smithi121 ceph-mon[35231]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:36:23.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:23 smithi097 ceph-mon[35213]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T10:36:23.678 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.676+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb041a7460 con 0x7fdb04102ef0 2024-09-10T10:36:23.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.678+0000 7fdb01ffb640 1 -- 172.21.15.92:0/781292063 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22594 (secure 0 0 0) 0x7fdafc09b6c0 con 0x7fdb04102ef0 2024-09-10T10:36:23.679 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:23.680 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":83,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:34:55.779980+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:34:41.056656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:34:43.485327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:36:23.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdaf40a2c10 msgr2=0x7fdaf40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:23.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdaf40a2c10 0x7fdaf40a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8005fd0 tx=0x7fdaf8009500 comp rx=0 tx=0).stop 2024-09-10T10:36:23.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102ef0 msgr2=0x7fdb0419efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:23.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102ef0 0x7fdb0419efe0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00d750 tx=0x7fdafc00dc10 comp rx=0 tx=0).stop 2024-09-10T10:36:23.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 shutdown_connections 2024-09-10T10:36:23.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fdaf40a2c10 0x7fdaf40a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:23.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb04102ef0 0x7fdb0419efe0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:23.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb04102570 0x7fdb0419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:23.682 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 --2- 172.21.15.92:0/781292063 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb04100e20 0x7fdb0419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:23.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 >> 172.21.15.92:0/781292063 conn(0x7fdb040fc7d0 msgr2=0x7fdb0406a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:23.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 shutdown_connections 2024-09-10T10:36:23.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:23.680+0000 7fdb0ac81640 1 -- 172.21.15.92:0/781292063 wait complete. 2024-09-10T10:36:24.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T10:34:45.351151+0000', 'modified': '2024-09-10T10:34:56.804641+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24472, 'mds_1': 24451, 'mds_2': 24445, 'mds_3': 24431, 'mds_4': 24424}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14619': {'gid': 14619, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6839/1641635662', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 1641635662}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 1641635662}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14625': {'gid': 14625, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6841/15499972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6840', 'nonce': 15499972}, {'type': 'v1', 'addr': '172.21.15.92:6841', 'nonce': 15499972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24359': {'gid': 24359, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.97:6833/2610071582', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6832', 'nonce': 2610071582}, {'type': 'v1', 'addr': '172.21.15.97:6833', 'nonce': 2610071582}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24386': {'gid': 24386, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.97:6835/9514508', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6834', 'nonce': 9514508}, {'type': 'v1', 'addr': '172.21.15.97:6835', 'nonce': 9514508}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24407': {'gid': 24407, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.97:6837/4081108899', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6836', 'nonce': 4081108899}, {'type': 'v1', 'addr': '172.21.15.97:6837', 'nonce': 4081108899}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.121:6833/4152552339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6832', 'nonce': 4152552339}, {'type': 'v1', 'addr': '172.21.15.121:6833', 'nonce': 4152552339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'b', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.97:6839/2331166625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6838', 'nonce': 2331166625}, {'type': 'v1', 'addr': '172.21.15.97:6839', 'nonce': 2331166625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'f', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.121:6835/2121443701', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 2121443701}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 2121443701}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'c', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.121:6837/332654710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6836', 'nonce': 332654710}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 332654710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.121:6839/3692560393', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 3692560393}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 3692560393}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24472, 'qdb_cluster': [24472, 24451, 24445, 24431, 24424]} 2024-09-10T10:36:24.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T10:36:24.374 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.l status 2024-09-10T10:36:24.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:24 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/781292063' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:36:24.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:24 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/781292063' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:36:24.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:24 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/781292063' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:36:24.617 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:25.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.096+0000 7f747f05d640 1 -- 172.21.15.92:0/3283728181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478106f20 msgr2=0x7f747810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:25.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.096+0000 7f747f05d640 1 --2- 172.21.15.92:0/3283728181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478106f20 0x7f747810eaa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7470009ca0 tx=0x7f747002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.096+0000 7f747f05d640 1 -- 172.21.15.92:0/3283728181 shutdown_connections 2024-09-10T10:36:25.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.096+0000 7f747f05d640 1 --2- 172.21.15.92:0/3283728181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478106f20 0x7f747810eaa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.096+0000 7f747f05d640 1 --2- 172.21.15.92:0/3283728181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74781027a0 0x7f74781067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.096+0000 7f747f05d640 1 --2- 172.21.15.92:0/3283728181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7478101df0 0x7f74781021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.096+0000 7f747f05d640 1 -- 172.21.15.92:0/3283728181 >> 172.21.15.92:0/3283728181 conn(0x7f74780fd8b0 msgr2=0x7f74780ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.096+0000 7f747f05d640 1 -- 172.21.15.92:0/3283728181 shutdown_connections 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.096+0000 7f747f05d640 1 -- 172.21.15.92:0/3283728181 wait complete. 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747f05d640 1 Processor -- start 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747f05d640 1 -- start start 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747f05d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478101df0 0x7f7478198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747f05d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74781027a0 0x7f7478198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747f05d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7478106f20 0x7f747819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747f05d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7478111f80 con 0x7f7478101df0 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747f05d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7478111e00 con 0x7f74781027a0 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747f05d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7478112100 con 0x7f7478106f20 2024-09-10T10:36:25.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747cdf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478101df0 0x7f7478198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747cdf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478101df0 0x7f7478198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45364/0 (socket says 172.21.15.92:45364) 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747cdf9640 1 -- 172.21.15.92:0/1919328218 learned_addr learned my addr 172.21.15.92:0/1919328218 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f746ffff640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74781027a0 0x7f7478198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747cdf9640 1 -- 172.21.15.92:0/1919328218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7478106f20 msgr2=0x7f747819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747cdf9640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7478106f20 0x7f747819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747cdf9640 1 -- 172.21.15.92:0/1919328218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74781027a0 msgr2=0x7f7478198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747cdf9640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74781027a0 0x7f7478198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f747cdf9640 1 -- 172.21.15.92:0/1919328218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747819d2d0 con 0x7f7478101df0 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.097+0000 7f746ffff640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74781027a0 0x7f7478198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.098+0000 7f747cdf9640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478101df0 0x7f7478198320 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f747400c920 tx=0x7f747400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.098+0000 7f746dffb640 1 -- 172.21.15.92:0/1919328218 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474007c70 con 0x7f7478101df0 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.098+0000 7f746dffb640 1 -- 172.21.15.92:0/1919328218 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7474007e10 con 0x7f7478101df0 2024-09-10T10:36:25.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.098+0000 7f747f05d640 1 -- 172.21.15.92:0/1919328218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747819d5c0 con 0x7f7478101df0 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.098+0000 7f746dffb640 1 -- 172.21.15.92:0/1919328218 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474018890 con 0x7f7478101df0 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.098+0000 7f747f05d640 1 -- 172.21.15.92:0/1919328218 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74781a4ea0 con 0x7f7478101df0 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f746dffb640 1 -- 172.21.15.92:0/1919328218 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f7474018a70 con 0x7f7478101df0 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f7481436740 1 Processor -- start 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f7481436740 1 -- start start 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f7481436740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e9899d0 0x561a8e989db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f7481436740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e994670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f7481436740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 0x561a8e996fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f7481436740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a8e8f0090 con 0x561a8e98a2f0 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f7481436740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561a8e897a70 con 0x561a8e994bb0 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f7481436740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561a8e8ec050 con 0x561a8e9899d0 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f746dffb640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74600a2c00 0x7f74600a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f747cdf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e994670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.101+0000 7f747d5fa640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74600a2c00 0x7f74600a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747d5fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e9899d0 0x561a8e989db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747cdf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e994670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45376/0 (socket says 172.21.15.92:45376) 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747cdf9640 1 -- 172.21.15.92:0/2611082851 learned_addr learned my addr 172.21.15.92:0/2611082851 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f746dffb640 1 -- 172.21.15.92:0/1919328218 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f74740cf100 con 0x7f7478101df0 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f746ffff640 1 --2- 172.21.15.92:0/2611082851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 0x561a8e996fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747cdf9640 1 -- 172.21.15.92:0/2611082851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e9899d0 msgr2=0x561a8e989db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747cdf9640 1 --2- 172.21.15.92:0/2611082851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e9899d0 0x561a8e989db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747cdf9640 1 -- 172.21.15.92:0/2611082851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 msgr2=0x561a8e996fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747cdf9640 1 --2- 172.21.15.92:0/2611082851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 0x561a8e996fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747cdf9640 1 -- 172.21.15.92:0/2611082851 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8e8a4130 con 0x561a8e98a2f0 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747d5fa640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74600a2c00 0x7f74600a50c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f747002f540 tx=0x7f7470005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:25.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f747cdf9640 1 --2- 172.21.15.92:0/2611082851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e994670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f74740ccca0 tx=0x7f74740c6590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b40d15c0bdef633 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f745effd640 1 -- 172.21.15.92:0/2611082851 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74740a3fd0 con 0x561a8e98a2f0 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f745effd640 1 -- 172.21.15.92:0/2611082851 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7474066ae0 con 0x561a8e98a2f0 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.102+0000 7f745effd640 1 -- 172.21.15.92:0/2611082851 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74740a3370 con 0x561a8e98a2f0 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 -- 172.21.15.92:0/2611082851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 msgr2=0x561a8e994670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 --2- 172.21.15.92:0/2611082851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e994670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f74740ccca0 tx=0x7f74740c6590 comp rx=0 tx=0).stop 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 -- 172.21.15.92:0/2611082851 shutdown_connections 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 --2- 172.21.15.92:0/2611082851 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 0x561a8e996fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 --2- 172.21.15.92:0/2611082851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e994670 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 --2- 172.21.15.92:0/2611082851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e9899d0 0x561a8e989db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 -- 172.21.15.92:0/2611082851 >> 172.21.15.92:0/2611082851 conn(0x561a8e985f60 msgr2=0x561a8e986340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 -- 172.21.15.92:0/2611082851 shutdown_connections 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 -- 172.21.15.92:0/2611082851 wait complete. 2024-09-10T10:36:25.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 -- start start 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.103+0000 7f7481436740 1 Processor -- start 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f7481436740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9944c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f7481436740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e98a2f0 0x561a8e991810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f7481436740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 0x561a8e991d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f7481436740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a8e997780 con 0x561a8e9899d0 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f7481436740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561a8e8aaf20 con 0x561a8e98a2f0 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f7481436740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561a8e997900 con 0x561a8e994bb0 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f7481436740 10 client.0 _ll_register_callbacks cb 0x561a8e874030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747cdf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747cdf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9944c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45382/0 (socket says 172.21.15.92:45382) 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747cdf9640 1 -- 172.21.15.92:0/851628228 learned_addr learned my addr 172.21.15.92:0/851628228 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f746ffff640 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e98a2f0 0x561a8e991810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747d5fa640 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 0x561a8e991d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747cdf9640 1 -- 172.21.15.92:0/851628228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 msgr2=0x561a8e991d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747cdf9640 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 0x561a8e991d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747cdf9640 1 -- 172.21.15.92:0/851628228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e98a2f0 msgr2=0x561a8e991810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747cdf9640 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e98a2f0 0x561a8e991810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747cdf9640 1 -- 172.21.15.92:0/851628228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a8e6612b0 con 0x561a8e9899d0 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747d5fa640 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 0x561a8e991d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f747cdf9640 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9944c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7474097e60 tx=0x7f74740a3fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890ef8aac79578ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f7457fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.104+0000 7f7457fff640 1 -- 172.21.15.92:0/851628228 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747407e020 con 0x561a8e9899d0 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7457fff640 1 -- 172.21.15.92:0/851628228 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f7474018d60 con 0x561a8e9899d0 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7481436740 1 -- 172.21.15.92:0/851628228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7474066ae0 con 0x561a8e9899d0 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7457fff640 1 -- 172.21.15.92:0/851628228 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f747409c100 con 0x561a8e9899d0 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7481436740 10 client.15132 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7481436740 1 -- 172.21.15.92:0/851628228 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561a8e9a3100 con 0x561a8e9899d0 2024-09-10T10:36:25.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7457fff640 1 -- 172.21.15.92:0/851628228 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74740a4670 con 0x561a8e9899d0 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7457fff640 1 -- 172.21.15.92:0/851628228 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f74740a25a0 con 0x561a8e9899d0 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7481436740 10 client.15132 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7481436740 10 client.15132 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7481436740 20 client.15132 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7481436740 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x561a8e9a4450 0x561a8e9a6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7481436740 4 client.15132 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f7481436740 1 -- 172.21.15.92:0/851628228 --> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7474066ae0 con 0x561a8e9a4450 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.105+0000 7f746ffff640 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x561a8e9a4450 0x561a8e9a6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.106+0000 7f7457fff640 10 client.15132 ms_handle_connect on v2:172.21.15.121:6832/4152552339 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.106+0000 7f746ffff640 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x561a8e9a4450 0x561a8e9a6630 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=db677de2e158fe29 server_cookie=b16a22641849e014 in_seq=0 out_seq=0 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.106+0000 7f7457fff640 1 -- 172.21.15.92:0/851628228 <== mds.4 v2:172.21.15.121:6832/4152552339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7474066ae0 con 0x561a8e9a4450 2024-09-10T10:36:25.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.106+0000 7f7457fff640 10 client.15132 handle_command_reply: tid=0 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.106+0000 7f7481436740 1 client.15132 shutdown 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 -- 172.21.15.92:0/851628228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 msgr2=0x561a8e9944c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9944c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7474097e60 tx=0x7f74740a3fd0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 -- 172.21.15.92:0/851628228 shutdown_connections 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x561a8e9a4450 0x561a8e9a6630 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 0x561a8e991d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e98a2f0 0x561a8e991810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 --2- 172.21.15.92:0/851628228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9944c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7457fff640 0 client.15132 ms_handle_reset on v2:172.21.15.121:6832/4152552339 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 -- 172.21.15.92:0/851628228 >> 172.21.15.92:0/851628228 conn(0x561a8e985f60 msgr2=0x561a8e98bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 -- 172.21.15.92:0/851628228 shutdown_connections 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 1 -- 172.21.15.92:0/851628228 wait complete. 2024-09-10T10:36:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.107+0000 7f7481436740 20 client.15132 trim_cache size 0 max 16384 2024-09-10T10:36:25.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.124+0000 7f7481436740 1 Processor -- start 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.124+0000 7f7481436740 1 -- start start 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.124+0000 7f7481436740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.124+0000 7f7481436740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e98a2f0 0x561a8e9a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.124+0000 7f7481436740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 0x561a8e986340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.124+0000 7f7481436740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a8e9a4970 con 0x561a8e9899d0 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.124+0000 7f7481436740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561a8e9a5040 con 0x561a8e994bb0 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.124+0000 7f7481436740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561a8e9a5710 con 0x561a8e98a2f0 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747cdf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747cdf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9a4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45386/0 (socket says 172.21.15.92:45386) 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747cdf9640 1 -- 172.21.15.92:0/112253269 learned_addr learned my addr 172.21.15.92:0/112253269 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f746ffff640 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e98a2f0 0x561a8e9a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747cdf9640 1 -- 172.21.15.92:0/112253269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e98a2f0 msgr2=0x561a8e9a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747d5fa640 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 0x561a8e986340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747cdf9640 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e98a2f0 0x561a8e9a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747cdf9640 1 -- 172.21.15.92:0/112253269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 msgr2=0x561a8e986340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747cdf9640 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 0x561a8e986340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747cdf9640 1 -- 172.21.15.92:0/112253269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8e992920 con 0x561a8e9899d0 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747d5fa640 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 0x561a8e986340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f747cdf9640 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9a4af0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f747400cfd0 tx=0x7f7474000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84a292f58865285 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f745e7fc640 1 -- 172.21.15.92:0/112253269 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74740a4670 con 0x561a8e9899d0 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f745e7fc640 1 -- 172.21.15.92:0/112253269 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7474018d60 con 0x561a8e9899d0 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.125+0000 7f745e7fc640 1 -- 172.21.15.92:0/112253269 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747409bc60 con 0x561a8e9899d0 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 -- 172.21.15.92:0/112253269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 msgr2=0x561a8e9a4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9a4af0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f747400cfd0 tx=0x7f7474000bc0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 -- 172.21.15.92:0/112253269 shutdown_connections 2024-09-10T10:36:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e994bb0 0x561a8e986340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e98a2f0 0x561a8e9a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 --2- 172.21.15.92:0/112253269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e9899d0 0x561a8e9a4af0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 -- 172.21.15.92:0/112253269 >> 172.21.15.92:0/112253269 conn(0x561a8e985f60 msgr2=0x561a8e990990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 -- 172.21.15.92:0/112253269 shutdown_connections 2024-09-10T10:36:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 -- 172.21.15.92:0/112253269 wait complete. 2024-09-10T10:36:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 -- start start 2024-09-10T10:36:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.126+0000 7f7481436740 1 Processor -- start 2024-09-10T10:36:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7481436740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e9899d0 0x561a8e9aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7481436740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e9aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7481436740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 0x561a8e9aa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7481436740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a8e9a64b0 con 0x561a8e98a2f0 2024-09-10T10:36:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7481436740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561a8e9a5de0 con 0x561a8e9899d0 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7481436740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561a8e9a6b80 con 0x561a8e994bb0 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7481436740 10 client.0 _ll_register_callbacks cb 0x7f746800b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f746ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e9aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f746ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e9aa0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45400/0 (socket says 172.21.15.92:45400) 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f746ffff640 1 -- 172.21.15.92:0/3580545759 learned_addr learned my addr 172.21.15.92:0/3580545759 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f747cdf9640 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e9899d0 0x561a8e9aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f747d5fa640 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 0x561a8e9aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f746ffff640 1 -- 172.21.15.92:0/3580545759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 msgr2=0x561a8e9aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f746ffff640 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 0x561a8e9aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f746ffff640 1 -- 172.21.15.92:0/3580545759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e9899d0 msgr2=0x561a8e9aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f746ffff640 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e9899d0 0x561a8e9aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f746ffff640 1 -- 172.21.15.92:0/3580545759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a8e9aab40 con 0x561a8e98a2f0 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f746ffff640 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e9aa0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7468005fd0 tx=0x7f7468011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8c50a5b7d5567b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:25.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7457fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7457fff640 1 -- 172.21.15.92:0/3580545759 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468020020 con 0x561a8e98a2f0 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7457fff640 1 -- 172.21.15.92:0/3580545759 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f7468004440 con 0x561a8e98a2f0 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.127+0000 7f7481436740 1 -- 172.21.15.92:0/3580545759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7474018d60 con 0x561a8e98a2f0 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7457fff640 1 -- 172.21.15.92:0/3580545759 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f74680035f0 con 0x561a8e98a2f0 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7481436740 10 client.15138 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7481436740 1 -- 172.21.15.92:0/3580545759 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561a8ea0f5f0 con 0x561a8e98a2f0 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7457fff640 1 -- 172.21.15.92:0/3580545759 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7474018d60 con 0x561a8e98a2f0 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7457fff640 1 -- 172.21.15.92:0/3580545759 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f746801c7f0 con 0x561a8e98a2f0 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7481436740 10 client.15138 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7481436740 10 client.15138 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7481436740 20 client.15138 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7481436740 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x561a8ea14180 0x561a8ea12e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:25.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7481436740 4 client.15138 mds_command: new command op to 24424 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f7481436740 1 -- 172.21.15.92:0/3580545759 --> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] -- command(tid 0: {"prefix": "status"}) -- 0x561a8e8fd600 con 0x561a8ea14180 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.128+0000 7f747cdf9640 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x561a8ea14180 0x561a8ea12e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f747cdf9640 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x561a8ea14180 0x561a8ea12e90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=74196b719155e2a4 server_cookie=d07b3940d1ee3621 in_seq=0 out_seq=0 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7457fff640 10 client.15138 ms_handle_connect on v2:172.21.15.121:6832/4152552339 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7457fff640 1 -- 172.21.15.92:0/3580545759 <== mds.4 v2:172.21.15.121:6832/4152552339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561a8e8fd600 con 0x561a8ea14180 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7457fff640 10 client.15138 handle_command_reply: tid=0 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 client.15138 shutdown 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 -- 172.21.15.92:0/3580545759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 msgr2=0x561a8e9aa0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e9aa0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7468005fd0 tx=0x7f7468011810 comp rx=0 tx=0).stop 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 -- 172.21.15.92:0/3580545759 shutdown_connections 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.121:6832/4152552339,v1:172.21.15.121:6833/4152552339] conn(0x561a8ea14180 0x561a8ea12e90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a8e994bb0 0x561a8e9aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a8e98a2f0 0x561a8e9aa0c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 --2- 172.21.15.92:0/3580545759 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561a8e9899d0 0x561a8e9aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 -- 172.21.15.92:0/3580545759 >> 172.21.15.92:0/3580545759 conn(0x561a8e985f60 msgr2=0x561a8e986340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7457fff640 0 client.15138 ms_handle_reset on v2:172.21.15.121:6832/4152552339 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 -- 172.21.15.92:0/3580545759 shutdown_connections 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 1 -- 172.21.15.92:0/3580545759 wait complete. 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.129+0000 7f7481436740 20 client.15138 trim_cache size 0 max 16384 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 4, 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24424, 2024-09-10T10:36:25.137 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:25.138 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:25.138 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:25.138 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 89.331676552999994, 2024-09-10T10:36:25.138 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:25.138 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:25.138 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:25.138 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 141.489817303 2024-09-10T10:36:25.138 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 -- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74600a2c00 msgr2=0x7f74600a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74600a2c00 0x7f74600a50c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f747002f540 tx=0x7f7470005fd0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 -- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478101df0 msgr2=0x7f7478198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478101df0 0x7f7478198320 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f747400c920 tx=0x7f747400cde0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 -- 172.21.15.92:0/1919328218 shutdown_connections 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74600a2c00 0x7f74600a50c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7478106f20 0x7f747819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74781027a0 0x7f7478198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 --2- 172.21.15.92:0/1919328218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7478101df0 0x7f7478198320 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:25.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 -- 172.21.15.92:0/1919328218 >> 172.21.15.92:0/1919328218 conn(0x7f74780fd8b0 msgr2=0x7f74780ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:25.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 -- 172.21.15.92:0/1919328218 shutdown_connections 2024-09-10T10:36:25.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:25.130+0000 7f747f05d640 1 -- 172.21.15.92:0/1919328218 wait complete. 2024-09-10T10:36:25.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:25 smithi121 ceph-mon[35231]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:36:25.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:25 smithi121 ceph-mon[35231]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T10:36:25.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:25 smithi097 ceph-mon[35213]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:36:25.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:25 smithi097 ceph-mon[35213]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T10:36:25.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:25 smithi092 ceph-mon[30834]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T10:36:25.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:25 smithi092 ceph-mon[30834]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T10:36:25.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T10:36:26.062 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:26.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 -- 172.21.15.92:0/2418123578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468100a80 msgr2=0x7f4468100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 --2- 172.21.15.92:0/2418123578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468100a80 0x7f4468100ee0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4450009930 tx=0x7f445002a420 comp rx=0 tx=0).stop 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 -- 172.21.15.92:0/2418123578 shutdown_connections 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 --2- 172.21.15.92:0/2418123578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4468101420 0x7f446810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 --2- 172.21.15.92:0/2418123578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468100a80 0x7f4468100ee0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 --2- 172.21.15.92:0/2418123578 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4468106a80 0x7f4468106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 -- 172.21.15.92:0/2418123578 >> 172.21.15.92:0/2418123578 conn(0x7f44680fc7a0 msgr2=0x7f44680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 -- 172.21.15.92:0/2418123578 shutdown_connections 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 -- 172.21.15.92:0/2418123578 wait complete. 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.562+0000 7f446dcf1640 1 Processor -- start 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f446dcf1640 1 -- start start 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f446dcf1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4468100a80 0x7f4468199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f446dcf1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4468101420 0x7f4468199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f446dcf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468106a80 0x7f44681a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f446dcf1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4468110ec0 con 0x7f4468106a80 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f446dcf1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4468110d40 con 0x7f4468101420 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f446dcf1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4468111040 con 0x7f4468100a80 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f4467fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468106a80 0x7f44681a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f4467fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468106a80 0x7f44681a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45414/0 (socket says 172.21.15.92:45414) 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f4467fff640 1 -- 172.21.15.92:0/4140384407 learned_addr learned my addr 172.21.15.92:0/4140384407 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f44677fe640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4468100a80 0x7f4468199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f445effd640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4468101420 0x7f4468199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f4467fff640 1 -- 172.21.15.92:0/4140384407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4468100a80 msgr2=0x7f4468199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f4467fff640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4468100a80 0x7f4468199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f4467fff640 1 -- 172.21.15.92:0/4140384407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4468101420 msgr2=0x7f4468199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f4467fff640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4468101420 0x7f4468199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.563+0000 7f4467fff640 1 -- 172.21.15.92:0/4140384407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44681a4910 con 0x7f4468106a80 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.564+0000 7f4467fff640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468106a80 0x7f44681a43d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f446000eaa0 tx=0x7f446000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.564+0000 7f44657fa640 1 -- 172.21.15.92:0/4140384407 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460004d20 con 0x7f4468106a80 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.564+0000 7f44657fa640 1 -- 172.21.15.92:0/4140384407 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4460005020 con 0x7f4468106a80 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.564+0000 7f446dcf1640 1 -- 172.21.15.92:0/4140384407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44681a4ae0 con 0x7f4468106a80 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.564+0000 7f44657fa640 1 -- 172.21.15.92:0/4140384407 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44600116d0 con 0x7f4468106a80 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.564+0000 7f446dcf1640 1 -- 172.21.15.92:0/4140384407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44681a4ff0 con 0x7f4468106a80 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.566+0000 7f44657fa640 1 -- 172.21.15.92:0/4140384407 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f44600051d0 con 0x7f4468106a80 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.566+0000 7f44700ca740 1 Processor -- start 2024-09-10T10:36:26.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.566+0000 7f44700ca740 1 -- start start 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.566+0000 7f44700ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41b9d0 0x55894e41bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f44700ca740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 0x55894e426670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f44700ca740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e428fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f44700ca740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55894e382090 con 0x55894e426bb0 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f44700ca740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55894e329a70 con 0x55894e41c2f0 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f44700ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55894e37e050 con 0x55894e41b9d0 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e428fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e428fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45418/0 (socket says 172.21.15.92:45418) 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 -- 172.21.15.92:0/1301362760 learned_addr learned my addr 172.21.15.92:0/1301362760 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:26.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f44677fe640 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 0x55894e426670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41b9d0 0x55894e41bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 -- 172.21.15.92:0/1301362760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41b9d0 msgr2=0x55894e41bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41b9d0 0x55894e41bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 -- 172.21.15.92:0/1301362760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 msgr2=0x55894e426670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 0x55894e426670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f44657fa640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f44540a2c00 0x7f44540a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 -- 172.21.15.92:0/1301362760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894e336130 con 0x55894e426bb0 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f44677fe640 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 0x55894e426670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f4467fff640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f44540a2c00 0x7f44540a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445effd640 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e428fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4450009930 tx=0x7f44500056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7df2f98fc14ade server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:26.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f44657fa640 1 -- 172.21.15.92:0/4140384407 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f44600cf130 con 0x7f4468106a80 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445dffb640 1 -- 172.21.15.92:0/1301362760 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450035040 con 0x55894e426bb0 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445dffb640 1 -- 172.21.15.92:0/1301362760 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4450004030 con 0x55894e426bb0 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.567+0000 7f445dffb640 1 -- 172.21.15.92:0/1301362760 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450003b60 con 0x55894e426bb0 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f44700ca740 1 -- 172.21.15.92:0/1301362760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 msgr2=0x55894e428fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f44700ca740 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e428fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4450009930 tx=0x7f44500056d0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f4467fff640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f44540a2c00 0x7f44540a50c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4460097e90 tx=0x7f446006eaf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f44700ca740 1 -- 172.21.15.92:0/1301362760 shutdown_connections 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f44700ca740 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e428fa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f44700ca740 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 0x55894e426670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f44700ca740 1 --2- 172.21.15.92:0/1301362760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41b9d0 0x55894e41bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f44700ca740 1 -- 172.21.15.92:0/1301362760 >> 172.21.15.92:0/1301362760 conn(0x55894e417f60 msgr2=0x55894e418340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f44700ca740 1 -- 172.21.15.92:0/1301362760 shutdown_connections 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.568+0000 7f44700ca740 1 -- 172.21.15.92:0/1301362760 wait complete. 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f44700ca740 1 -- start start 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f44700ca740 1 Processor -- start 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f44700ca740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 0x55894e4263f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f44700ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41c2f0 0x55894e423740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f44700ca740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e423c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f44700ca740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55894e429780 con 0x55894e426bb0 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f44700ca740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55894e33cf20 con 0x55894e41b9d0 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f44700ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55894e429900 con 0x55894e41c2f0 2024-09-10T10:36:26.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f44700ca740 10 client.0 _ll_register_callbacks cb 0x55894e306030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f445effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e423c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f445effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e423c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45422/0 (socket says 172.21.15.92:45422) 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f445effd640 1 -- 172.21.15.92:0/2734134192 learned_addr learned my addr 172.21.15.92:0/2734134192 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.569+0000 7f445effd640 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 0x55894e4263f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44677fe640 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41c2f0 0x55894e423740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f445effd640 1 -- 172.21.15.92:0/2734134192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41c2f0 msgr2=0x55894e423740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f445effd640 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41c2f0 0x55894e423740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f445effd640 1 -- 172.21.15.92:0/2734134192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 msgr2=0x55894e4263f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f445effd640 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 0x55894e4263f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f445effd640 1 -- 172.21.15.92:0/2734134192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894e0f32b0 con 0x55894e426bb0 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f445effd640 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e423c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4450001eb0 tx=0x7f44500037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8101061ed0ab2ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:26.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f4446ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f4446ffd640 1 -- 172.21.15.92:0/2734134192 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450035070 con 0x55894e426bb0 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f4446ffd640 1 -- 172.21.15.92:0/2734134192 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f4450044030 con 0x55894e426bb0 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44700ca740 1 -- 172.21.15.92:0/2734134192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4450004030 con 0x55894e426bb0 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f4446ffd640 1 -- 172.21.15.92:0/2734134192 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f445005c050 con 0x55894e426bb0 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44700ca740 10 client.15150 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44700ca740 1 -- 172.21.15.92:0/2734134192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55894e435070 con 0x55894e426bb0 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f4446ffd640 1 -- 172.21.15.92:0/2734134192 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4450004030 con 0x55894e426bb0 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f4446ffd640 1 -- 172.21.15.92:0/2734134192 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f445003a040 con 0x55894e426bb0 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44700ca740 10 client.15150 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44700ca740 10 client.15150 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:36:26.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44700ca740 20 client.15150 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44700ca740 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x55894e4363c0 0x55894e4385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44700ca740 4 client.15150 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.570+0000 7f44700ca740 1 -- 172.21.15.92:0/2734134192 --> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55894e38f600 con 0x55894e4363c0 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.571+0000 7f44677fe640 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x55894e4363c0 0x55894e4385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.571+0000 7f44677fe640 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x55894e4363c0 0x55894e4385c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=591ddffa8c414feb server_cookie=ada1ff241665ebb3 in_seq=0 out_seq=0 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.571+0000 7f4446ffd640 10 client.15150 ms_handle_connect on v2:172.21.15.97:6838/2331166625 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f4446ffd640 1 -- 172.21.15.92:0/2734134192 <== mds.3 v2:172.21.15.97:6838/2331166625 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55894e38f600 con 0x55894e4363c0 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f4446ffd640 10 client.15150 handle_command_reply: tid=0 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 client.15150 shutdown 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 -- 172.21.15.92:0/2734134192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 msgr2=0x55894e423c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e423c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4450001eb0 tx=0x7f44500037a0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 -- 172.21.15.92:0/2734134192 shutdown_connections 2024-09-10T10:36:26.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x55894e4363c0 0x55894e4385c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e423c80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41c2f0 0x55894e423740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f4446ffd640 0 client.15150 ms_handle_reset on v2:172.21.15.97:6838/2331166625 2024-09-10T10:36:26.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 --2- 172.21.15.92:0/2734134192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 0x55894e4263f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 -- 172.21.15.92:0/2734134192 >> 172.21.15.92:0/2734134192 conn(0x55894e417f60 msgr2=0x55894e41dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:26.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 -- 172.21.15.92:0/2734134192 shutdown_connections 2024-09-10T10:36:26.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 1 -- 172.21.15.92:0/2734134192 wait complete. 2024-09-10T10:36:26.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.572+0000 7f44700ca740 20 client.15150 trim_cache size 0 max 16384 2024-09-10T10:36:26.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f44700ca740 1 Processor -- start 2024-09-10T10:36:26.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f44700ca740 1 -- start start 2024-09-10T10:36:26.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f44700ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41b9d0 0x55894e4385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f44700ca740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 0x55894e437820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.599 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f44700ca740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e436a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f44700ca740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55894e436900 con 0x55894e426bb0 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f44700ca740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55894e436fd0 con 0x55894e41c2f0 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f44700ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55894e4376a0 con 0x55894e41b9d0 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f445effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e436a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f445effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e436a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45430/0 (socket says 172.21.15.92:45430) 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f445effd640 1 -- 172.21.15.92:0/2729662086 learned_addr learned my addr 172.21.15.92:0/2729662086 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f445effd640 1 -- 172.21.15.92:0/2729662086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41b9d0 msgr2=0x55894e4385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f445effd640 1 --2- 172.21.15.92:0/2729662086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41b9d0 0x55894e4385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.590+0000 7f445effd640 1 -- 172.21.15.92:0/2729662086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 msgr2=0x55894e437820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f445effd640 1 --2- 172.21.15.92:0/2729662086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 0x55894e437820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f445effd640 1 -- 172.21.15.92:0/2729662086 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894e426010 con 0x55894e426bb0 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f445effd640 1 --2- 172.21.15.92:0/2729662086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e436a80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4450031bf0 tx=0x7f44500056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80155213ef6c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:26.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f445d7fa640 1 -- 172.21.15.92:0/2729662086 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450035040 con 0x55894e426bb0 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f445d7fa640 1 -- 172.21.15.92:0/2729662086 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4450031840 con 0x55894e426bb0 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f445d7fa640 1 -- 172.21.15.92:0/2729662086 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4450054b50 con 0x55894e426bb0 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f44700ca740 1 -- 172.21.15.92:0/2729662086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 msgr2=0x55894e436a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f44700ca740 1 --2- 172.21.15.92:0/2729662086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e436a80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4450031bf0 tx=0x7f44500056d0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f44700ca740 1 -- 172.21.15.92:0/2729662086 shutdown_connections 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f44700ca740 1 --2- 172.21.15.92:0/2729662086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e426bb0 0x55894e436a80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f44700ca740 1 --2- 172.21.15.92:0/2729662086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41c2f0 0x55894e437820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f44700ca740 1 --2- 172.21.15.92:0/2729662086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e41b9d0 0x55894e4385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.591+0000 7f44700ca740 1 -- 172.21.15.92:0/2729662086 >> 172.21.15.92:0/2729662086 conn(0x55894e417f60 msgr2=0x55894e418340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 -- 172.21.15.92:0/2729662086 shutdown_connections 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 -- 172.21.15.92:0/2729662086 wait complete. 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 -- start start 2024-09-10T10:36:26.601 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 Processor -- start 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 0x55894e440ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e41c2f0 0x55894e441020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e426bb0 0x55894e439ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55894e438440 con 0x55894e41c2f0 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55894e437d70 con 0x55894e41b9d0 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55894e438b10 con 0x55894e426bb0 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44700ca740 10 client.0 _ll_register_callbacks cb 0x7f4450032e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.592+0000 7f44677fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e41c2f0 0x55894e441020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44677fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e41c2f0 0x55894e441020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45436/0 (socket says 172.21.15.92:45436) 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44677fe640 1 -- 172.21.15.92:0/997261027 learned_addr learned my addr 172.21.15.92:0/997261027 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f445effd640 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e426bb0 0x55894e439ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f445effd640 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 0x55894e440ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.602 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44677fe640 1 -- 172.21.15.92:0/997261027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e426bb0 msgr2=0x55894e439ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44677fe640 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e426bb0 0x55894e439ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44677fe640 1 -- 172.21.15.92:0/997261027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 msgr2=0x55894e440ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44677fe640 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 0x55894e440ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44677fe640 1 -- 172.21.15.92:0/997261027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55894e43a6f0 con 0x55894e41c2f0 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44677fe640 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e41c2f0 0x55894e441020 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4458000c00 tx=0x7f4458017440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e225e9e2c721b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f4446ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f4446ffd640 1 -- 172.21.15.92:0/997261027 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458017e10 con 0x55894e41c2f0 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f4446ffd640 1 -- 172.21.15.92:0/997261027 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f44580059c0 con 0x55894e41c2f0 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44700ca740 1 -- 172.21.15.92:0/997261027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4450031840 con 0x55894e41c2f0 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f4446ffd640 1 -- 172.21.15.92:0/997261027 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f445802d050 con 0x55894e41c2f0 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44700ca740 10 client.15156 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:26.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.593+0000 7f44700ca740 1 -- 172.21.15.92:0/997261027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55894e43f180 con 0x55894e41c2f0 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.594+0000 7f4446ffd640 1 -- 172.21.15.92:0/997261027 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4450031840 con 0x55894e41c2f0 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.594+0000 7f4446ffd640 1 -- 172.21.15.92:0/997261027 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f445801d270 con 0x55894e41c2f0 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.594+0000 7f44700ca740 10 client.15156 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.594+0000 7f44700ca740 10 client.15156 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.594+0000 7f44700ca740 20 client.15156 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.594+0000 7f44700ca740 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x55894e4a5ff0 0x55894e4a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.594+0000 7f44700ca740 4 client.15156 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.594+0000 7f44700ca740 1 -- 172.21.15.92:0/997261027 --> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] -- command(tid 0: {"prefix": "status"}) -- 0x55894e389b10 con 0x55894e4a5ff0 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.594+0000 7f445effd640 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x55894e4a5ff0 0x55894e4a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f4446ffd640 10 client.15156 ms_handle_connect on v2:172.21.15.97:6838/2331166625 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f445effd640 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x55894e4a5ff0 0x55894e4a4d00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ce747e0aca2f7471 server_cookie=2e8ad0587cbe361f in_seq=0 out_seq=0 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f4446ffd640 1 -- 172.21.15.92:0/997261027 <== mds.3 v2:172.21.15.97:6838/2331166625 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55894e389b10 con 0x55894e4a5ff0 2024-09-10T10:36:26.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f4446ffd640 10 client.15156 handle_command_reply: tid=0 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 client.15156 shutdown 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 -- 172.21.15.92:0/997261027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e41c2f0 msgr2=0x55894e441020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e41c2f0 0x55894e441020 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4458000c00 tx=0x7f4458017440 comp rx=0 tx=0).stop 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 -- 172.21.15.92:0/997261027 shutdown_connections 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.97:6838/2331166625,v1:172.21.15.97:6839/2331166625] conn(0x55894e4a5ff0 0x55894e4a4d00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55894e426bb0 0x55894e439ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55894e41c2f0 0x55894e441020 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 --2- 172.21.15.92:0/997261027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55894e41b9d0 0x55894e440ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 -- 172.21.15.92:0/997261027 >> 172.21.15.92:0/997261027 conn(0x55894e417f60 msgr2=0x55894e41e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f4446ffd640 0 client.15156 ms_handle_reset on v2:172.21.15.97:6838/2331166625 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 -- 172.21.15.92:0/997261027 shutdown_connections 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 1 -- 172.21.15.92:0/997261027 wait complete. 2024-09-10T10:36:26.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.595+0000 7f44700ca740 20 client.15156 trim_cache size 0 max 16384 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 3, 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24431, 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 91.815571324999993, 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:26.606 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:26.607 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:26.607 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 111.643097549 2024-09-10T10:36:26.607 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:26.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 -- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f44540a2c00 msgr2=0x7f44540a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:26.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f44540a2c00 0x7f44540a50c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4460097e90 tx=0x7f446006eaf0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 -- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468106a80 msgr2=0x7f44681a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:26.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468106a80 0x7f44681a43d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f446000eaa0 tx=0x7f446000eea0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 -- 172.21.15.92:0/4140384407 shutdown_connections 2024-09-10T10:36:26.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f44540a2c00 0x7f44540a50c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4468106a80 0x7f44681a43d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4468101420 0x7f4468199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 --2- 172.21.15.92:0/4140384407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4468100a80 0x7f4468199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:26.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 -- 172.21.15.92:0/4140384407 >> 172.21.15.92:0/4140384407 conn(0x7f44680fc7a0 msgr2=0x7f44680fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:26.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 -- 172.21.15.92:0/4140384407 shutdown_connections 2024-09-10T10:36:26.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:26.596+0000 7f446dcf1640 1 -- 172.21.15.92:0/4140384407 wait complete. 2024-09-10T10:36:27.386 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T10:36:27.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:27 smithi121 ceph-mon[35231]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T10:36:27.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:27 smithi097 ceph-mon[35213]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T10:36:27.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:27 smithi092 ceph-mon[30834]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T10:36:27.630 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:28.122 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 -- 172.21.15.92:0/1115273923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919810c170 msgr2=0x7f919810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:28.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 --2- 172.21.15.92:0/1115273923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919810c170 0x7f919810e610 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9190009ca0 tx=0x7f919002a950 comp rx=0 tx=0).stop 2024-09-10T10:36:28.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 -- 172.21.15.92:0/1115273923 shutdown_connections 2024-09-10T10:36:28.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 --2- 172.21.15.92:0/1115273923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f919810c170 0x7f919810e610 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 --2- 172.21.15.92:0/1115273923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9198103660 0x7f919810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 --2- 172.21.15.92:0/1115273923 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9198102d40 0x7f9198103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 -- 172.21.15.92:0/1115273923 >> 172.21.15.92:0/1115273923 conn(0x7f91980fc7a0 msgr2=0x7f91980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:28.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 -- 172.21.15.92:0/1115273923 shutdown_connections 2024-09-10T10:36:28.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 -- 172.21.15.92:0/1115273923 wait complete. 2024-09-10T10:36:28.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.088+0000 7f919d7a1640 1 Processor -- start 2024-09-10T10:36:28.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f919d7a1640 1 -- start start 2024-09-10T10:36:28.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f919d7a1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9198102d40 0x7f9198198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f919d7a1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9198103660 0x7f91981989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f919d7a1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f919810c170 0x7f919819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f919d7a1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9198111fb0 con 0x7f9198103660 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f919d7a1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9198111e30 con 0x7f919810c170 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f919d7a1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9198112130 con 0x7f9198102d40 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f91967fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9198103660 0x7f91981989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f91967fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9198103660 0x7f91981989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45454/0 (socket says 172.21.15.92:45454) 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f91967fc640 1 -- 172.21.15.92:0/3034229122 learned_addr learned my addr 172.21.15.92:0/3034229122 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f9196ffd640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9198102d40 0x7f9198198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f91977fe640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f919810c170 0x7f919819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f91967fc640 1 -- 172.21.15.92:0/3034229122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9198102d40 msgr2=0x7f9198198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f91967fc640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9198102d40 0x7f9198198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f91967fc640 1 -- 172.21.15.92:0/3034229122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f919810c170 msgr2=0x7f919819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f91967fc640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f919810c170 0x7f919819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.089+0000 7f91967fc640 1 -- 172.21.15.92:0/3034229122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919819d420 con 0x7f9198103660 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.090+0000 7f91967fc640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9198103660 0x7f91981989b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f918800b3f0 tx=0x7f918800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.090+0000 7f917ffff640 1 -- 172.21.15.92:0/3034229122 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188015020 con 0x7f9198103660 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.090+0000 7f917ffff640 1 -- 172.21.15.92:0/3034229122 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9188011d10 con 0x7f9198103660 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.090+0000 7f919d7a1640 1 -- 172.21.15.92:0/3034229122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919819d710 con 0x7f9198103660 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.090+0000 7f917ffff640 1 -- 172.21.15.92:0/3034229122 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918800f2e0 con 0x7f9198103660 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.090+0000 7f919d7a1640 1 -- 172.21.15.92:0/3034229122 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91981a4ff0 con 0x7f9198103660 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f917ffff640 1 -- 172.21.15.92:0/3034229122 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f9188018020 con 0x7f9198103660 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f919fb7a740 1 Processor -- start 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f919fb7a740 1 -- start start 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73db9d0 0x560ac73dbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac73e8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f919fb7a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ac7342090 con 0x560ac73dc2f0 2024-09-10T10:36:28.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f919fb7a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560ac72e9a70 con 0x560ac73e6bb0 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f919fb7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560ac733e050 con 0x560ac73db9d0 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f9196ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f9196ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45466/0 (socket says 172.21.15.92:45466) 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f9196ffd640 1 -- 172.21.15.92:0/327428531 learned_addr learned my addr 172.21.15.92:0/327428531 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f91967fc640 1 --2- 172.21.15.92:0/327428531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac73e8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f917ffff640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91800a2c00 0x7f91800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f9196ffd640 1 -- 172.21.15.92:0/327428531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73db9d0 msgr2=0x560ac73dbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f9196ffd640 1 --2- 172.21.15.92:0/327428531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73db9d0 0x560ac73dbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f9196ffd640 1 -- 172.21.15.92:0/327428531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 msgr2=0x560ac73e8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f9196ffd640 1 --2- 172.21.15.92:0/327428531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac73e8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f9196ffd640 1 -- 172.21.15.92:0/327428531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac72f6130 con 0x560ac73dc2f0 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f91967fc640 1 --2- 172.21.15.92:0/327428531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac73e8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.093+0000 7f91977fe640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91800a2c00 0x7f91800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.094+0000 7f917ffff640 1 -- 172.21.15.92:0/3034229122 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f91880ce710 con 0x7f9198103660 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.094+0000 7f9196ffd640 1 --2- 172.21.15.92:0/327428531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e6670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f918c00ac20 tx=0x7f918c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6223b9ff2682ed9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.094+0000 7f917d7fa640 1 -- 172.21.15.92:0/327428531 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c01d070 con 0x560ac73dc2f0 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.094+0000 7f917d7fa640 1 -- 172.21.15.92:0/327428531 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f918c018b20 con 0x560ac73dc2f0 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.094+0000 7f917d7fa640 1 -- 172.21.15.92:0/327428531 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c010c00 con 0x560ac73dc2f0 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.094+0000 7f919fb7a740 1 -- 172.21.15.92:0/327428531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 msgr2=0x560ac73e6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.094+0000 7f919fb7a740 1 --2- 172.21.15.92:0/327428531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e6670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f918c00ac20 tx=0x7f918c00f790 comp rx=0 tx=0).stop 2024-09-10T10:36:28.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.094+0000 7f91977fe640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91800a2c00 0x7f91800a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f919002ae70 tx=0x7f9190005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.094+0000 7f919fb7a740 1 -- 172.21.15.92:0/327428531 shutdown_connections 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 --2- 172.21.15.92:0/327428531 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac73e8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 --2- 172.21.15.92:0/327428531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e6670 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 --2- 172.21.15.92:0/327428531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73db9d0 0x560ac73dbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 -- 172.21.15.92:0/327428531 >> 172.21.15.92:0/327428531 conn(0x560ac73d7f60 msgr2=0x560ac73d8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 -- 172.21.15.92:0/327428531 shutdown_connections 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 -- 172.21.15.92:0/327428531 wait complete. 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 -- start start 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 Processor -- start 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73db9d0 0x560ac73e6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73e6bb0 0x560ac73e3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ac73e9780 con 0x560ac73dc2f0 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560ac72fcf20 con 0x560ac73db9d0 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560ac73e9900 con 0x560ac73e6bb0 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f919fb7a740 10 client.0 _ll_register_callbacks cb 0x560ac72c6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f91967fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f91967fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45472/0 (socket says 172.21.15.92:45472) 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f91967fc640 1 -- 172.21.15.92:0/2480701019 learned_addr learned my addr 172.21.15.92:0/2480701019 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f9196ffd640 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73db9d0 0x560ac73e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f91977fe640 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73e6bb0 0x560ac73e3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.095+0000 7f91967fc640 1 -- 172.21.15.92:0/2480701019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73e6bb0 msgr2=0x560ac73e3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f91967fc640 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73e6bb0 0x560ac73e3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f91967fc640 1 -- 172.21.15.92:0/2480701019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73db9d0 msgr2=0x560ac73e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f91967fc640 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73db9d0 0x560ac73e6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f91967fc640 1 -- 172.21.15.92:0/2480701019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac70b32b0 con 0x560ac73dc2f0 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f91977fe640 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73e6bb0 0x560ac73e3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f91967fc640 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e37d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9188000c00 tx=0x7f9188010eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b994c996c84156d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f917aff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f917aff5640 1 -- 172.21.15.92:0/2480701019 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880bb0e0 con 0x560ac73dc2f0 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f917aff5640 1 -- 172.21.15.92:0/2480701019 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f9188010510 con 0x560ac73dc2f0 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f919fb7a740 1 -- 172.21.15.92:0/2480701019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f918c018b20 con 0x560ac73dc2f0 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f917aff5640 1 -- 172.21.15.92:0/2480701019 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f918809b010 con 0x560ac73dc2f0 2024-09-10T10:36:28.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f919fb7a740 10 client.15168 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f919fb7a740 1 -- 172.21.15.92:0/2480701019 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560ac73f50d0 con 0x560ac73dc2f0 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f917aff5640 1 -- 172.21.15.92:0/2480701019 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f918c018b20 con 0x560ac73dc2f0 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f917aff5640 1 -- 172.21.15.92:0/2480701019 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9188095b80 con 0x560ac73dc2f0 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f919fb7a740 10 client.15168 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f919fb7a740 10 client.15168 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f919fb7a740 20 client.15168 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x560ac73f76d0 0x560ac73f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f919fb7a740 4 client.15168 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.096+0000 7f919fb7a740 1 -- 172.21.15.92:0/2480701019 --> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ac734f600 con 0x560ac73f76d0 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.097+0000 7f9196ffd640 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x560ac73f76d0 0x560ac73f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.097+0000 7f9196ffd640 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x560ac73f76d0 0x560ac73f8b40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=827bcc5d115efb45 server_cookie=a86f8b76449e6c12 in_seq=0 out_seq=0 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.097+0000 7f917aff5640 10 client.15168 ms_handle_connect on v2:172.21.15.121:6834/2121443701 2024-09-10T10:36:28.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f917aff5640 1 -- 172.21.15.92:0/2480701019 <== mds.2 v2:172.21.15.121:6834/2121443701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ac734f600 con 0x560ac73f76d0 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f917aff5640 10 client.15168 handle_command_reply: tid=0 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 client.15168 shutdown 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 -- 172.21.15.92:0/2480701019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 msgr2=0x560ac73e37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e37d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9188000c00 tx=0x7f9188010eb0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 -- 172.21.15.92:0/2480701019 shutdown_connections 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x560ac73f76d0 0x560ac73f8b40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73e6bb0 0x560ac73e3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73dc2f0 0x560ac73e37d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2480701019 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73db9d0 0x560ac73e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f917aff5640 0 client.15168 ms_handle_reset on v2:172.21.15.121:6834/2121443701 2024-09-10T10:36:28.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 -- 172.21.15.92:0/2480701019 >> 172.21.15.92:0/2480701019 conn(0x560ac73d7f60 msgr2=0x560ac73ddc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:28.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 -- 172.21.15.92:0/2480701019 shutdown_connections 2024-09-10T10:36:28.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 1 -- 172.21.15.92:0/2480701019 wait complete. 2024-09-10T10:36:28.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.098+0000 7f919fb7a740 20 client.15168 trim_cache size 0 max 16384 2024-09-10T10:36:28.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.115+0000 7f919fb7a740 1 Processor -- start 2024-09-10T10:36:28.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.115+0000 7f919fb7a740 1 -- start start 2024-09-10T10:36:28.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73db9d0 0x560ac73f7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 0x560ac73f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.134 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73e6bb0 0x560ac73e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f919fb7a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ac73f6e80 con 0x560ac73e6bb0 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f919fb7a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560ac73f7550 con 0x560ac73db9d0 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f919fb7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560ac73f7c20 con 0x560ac73dc2f0 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f91977fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73e6bb0 0x560ac73e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f91977fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73e6bb0 0x560ac73e3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45476/0 (socket says 172.21.15.92:45476) 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f91977fe640 1 -- 172.21.15.92:0/3096252642 learned_addr learned my addr 172.21.15.92:0/3096252642 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f91977fe640 1 -- 172.21.15.92:0/3096252642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 msgr2=0x560ac73f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f91977fe640 1 --2- 172.21.15.92:0/3096252642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 0x560ac73f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f91977fe640 1 -- 172.21.15.92:0/3096252642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73db9d0 msgr2=0x560ac73f7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f91977fe640 1 --2- 172.21.15.92:0/3096252642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73db9d0 0x560ac73f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f91977fe640 1 -- 172.21.15.92:0/3096252642 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac73db800 con 0x560ac73e6bb0 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f91977fe640 1 --2- 172.21.15.92:0/3096252642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73e6bb0 0x560ac73e3090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f919002fc90 tx=0x7f919003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28f75d386c71494 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:28.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f917cff9640 1 -- 172.21.15.92:0/3096252642 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190034070 con 0x560ac73e6bb0 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f917cff9640 1 -- 172.21.15.92:0/3096252642 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9190003e50 con 0x560ac73e6bb0 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.116+0000 7f917cff9640 1 -- 172.21.15.92:0/3096252642 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91900306a0 con 0x560ac73e6bb0 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 -- 172.21.15.92:0/3096252642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73e6bb0 msgr2=0x560ac73e3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 --2- 172.21.15.92:0/3096252642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73e6bb0 0x560ac73e3090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f919002fc90 tx=0x7f919003d000 comp rx=0 tx=0).stop 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 -- 172.21.15.92:0/3096252642 shutdown_connections 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 --2- 172.21.15.92:0/3096252642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73e6bb0 0x560ac73e3090 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 --2- 172.21.15.92:0/3096252642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 0x560ac73f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 --2- 172.21.15.92:0/3096252642 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73db9d0 0x560ac73f7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 -- 172.21.15.92:0/3096252642 >> 172.21.15.92:0/3096252642 conn(0x560ac73d7f60 msgr2=0x560ac73e3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 -- 172.21.15.92:0/3096252642 shutdown_connections 2024-09-10T10:36:28.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 -- 172.21.15.92:0/3096252642 wait complete. 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.117+0000 7f919fb7a740 1 -- start start 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f919fb7a740 1 Processor -- start 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73db9d0 0x560ac74005e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 0x560ac7400b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f919fb7a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac745cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f919fb7a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ac73f89c0 con 0x560ac73db9d0 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f919fb7a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560ac73f82f0 con 0x560ac73e6bb0 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f919fb7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560ac73f9090 con 0x560ac73dc2f0 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f919fb7a740 10 client.0 _ll_register_callbacks cb 0x7f918800b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f9196ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73db9d0 0x560ac74005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f9196ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73db9d0 0x560ac74005e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45492/0 (socket says 172.21.15.92:45492) 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f9196ffd640 1 -- 172.21.15.92:0/2461729867 learned_addr learned my addr 172.21.15.92:0/2461729867 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:28.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f91967fc640 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 0x560ac7400b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f9196ffd640 1 -- 172.21.15.92:0/2461729867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 msgr2=0x560ac7400b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f91977fe640 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac745cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f9196ffd640 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 0x560ac7400b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f9196ffd640 1 -- 172.21.15.92:0/2461729867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 msgr2=0x560ac745cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f9196ffd640 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac745cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f9196ffd640 1 -- 172.21.15.92:0/2461729867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac745d470 con 0x560ac73db9d0 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f91967fc640 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 0x560ac7400b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f91977fe640 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac745cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f9196ffd640 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73db9d0 0x560ac74005e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f918c00ac20 tx=0x7f918c010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1196e9eccf543934 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.118+0000 7f917aff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:28.138 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f917aff5640 1 -- 172.21.15.92:0/2461729867 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c01d040 con 0x560ac73db9d0 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f917aff5640 1 -- 172.21.15.92:0/2461729867 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f918c005450 con 0x560ac73db9d0 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f919fb7a740 1 -- 172.21.15.92:0/2461729867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9190003e50 con 0x560ac73db9d0 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f917aff5640 1 -- 172.21.15.92:0/2461729867 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f918c005650 con 0x560ac73db9d0 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f919fb7a740 10 client.15174 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f919fb7a740 1 -- 172.21.15.92:0/2461729867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560ac7465950 con 0x560ac73db9d0 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f917aff5640 1 -- 172.21.15.92:0/2461729867 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9190003e50 con 0x560ac73db9d0 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f917aff5640 1 -- 172.21.15.92:0/2461729867 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f918c004660 con 0x560ac73db9d0 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f919fb7a740 10 client.15174 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f919fb7a740 10 client.15174 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f919fb7a740 20 client.15174 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x560ac746a240 0x560ac7468f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f919fb7a740 4 client.15174 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.119+0000 7f919fb7a740 1 -- 172.21.15.92:0/2461729867 --> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] -- command(tid 0: {"prefix": "status"}) -- 0x560ac7349b10 con 0x560ac746a240 2024-09-10T10:36:28.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f91967fc640 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x560ac746a240 0x560ac7468f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f917aff5640 10 client.15174 ms_handle_connect on v2:172.21.15.121:6834/2121443701 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f91967fc640 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x560ac746a240 0x560ac7468f50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3cc9541f983f72e7 server_cookie=abbe8dee27b88e27 in_seq=0 out_seq=0 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f917aff5640 1 -- 172.21.15.92:0/2461729867 <== mds.2 v2:172.21.15.121:6834/2121443701 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x560ac7349b10 con 0x560ac746a240 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f917aff5640 10 client.15174 handle_command_reply: tid=0 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 client.15174 shutdown 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 -- 172.21.15.92:0/2461729867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73db9d0 msgr2=0x560ac74005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73db9d0 0x560ac74005e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f918c00ac20 tx=0x7f918c010660 comp rx=0 tx=0).stop 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 -- 172.21.15.92:0/2461729867 shutdown_connections 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.121:6834/2121443701,v1:172.21.15.121:6835/2121443701] conn(0x560ac746a240 0x560ac7468f50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ac73e6bb0 0x560ac745cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ac73dc2f0 0x560ac7400b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 --2- 172.21.15.92:0/2461729867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ac73db9d0 0x560ac74005e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 -- 172.21.15.92:0/2461729867 >> 172.21.15.92:0/2461729867 conn(0x560ac73d7f60 msgr2=0x560ac73e1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:28.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f917aff5640 0 client.15174 ms_handle_reset on v2:172.21.15.121:6834/2121443701 2024-09-10T10:36:28.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 -- 172.21.15.92:0/2461729867 shutdown_connections 2024-09-10T10:36:28.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 1 -- 172.21.15.92:0/2461729867 wait complete. 2024-09-10T10:36:28.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.120+0000 7f919fb7a740 20 client.15174 trim_cache size 0 max 16384 2024-09-10T10:36:28.141 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:28.141 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:28.141 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2024-09-10T10:36:28.141 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24445, 2024-09-10T10:36:28.141 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:28.141 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:28.142 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:28.142 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 94.351456915, 2024-09-10T10:36:28.142 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:28.142 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:28.142 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:28.142 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 130.08546149599999 2024-09-10T10:36:28.142 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 -- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91800a2c00 msgr2=0x7f91800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91800a2c00 0x7f91800a50c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f919002ae70 tx=0x7f9190005c30 comp rx=0 tx=0).stop 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 -- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9198103660 msgr2=0x7f91981989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9198103660 0x7f91981989b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f918800b3f0 tx=0x7f918800b8b0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 -- 172.21.15.92:0/3034229122 shutdown_connections 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f91800a2c00 0x7f91800a50c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f919810c170 0x7f919819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9198103660 0x7f91981989b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 --2- 172.21.15.92:0/3034229122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9198102d40 0x7f9198198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 -- 172.21.15.92:0/3034229122 >> 172.21.15.92:0/3034229122 conn(0x7f91980fc7a0 msgr2=0x7f91980fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 -- 172.21.15.92:0/3034229122 shutdown_connections 2024-09-10T10:36:28.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:28.121+0000 7f919d7a1640 1 -- 172.21.15.92:0/3034229122 wait complete. 2024-09-10T10:36:28.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T10:36:29.195 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:29.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:29 smithi121 ceph-mon[35231]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T10:36:29.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:29 smithi097 ceph-mon[35213]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T10:36:29.585 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:29 smithi092 ceph-mon[30834]: pgmap v330: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T10:36:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.664+0000 7f14cc795640 1 -- 172.21.15.92:0/1813005872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4106030 msgr2=0x7f14c410dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.664+0000 7f14cc795640 1 --2- 172.21.15.92:0/1813005872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4106030 0x7f14c410dbb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f14bc009ca0 tx=0x7f14bc02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.664+0000 7f14cc795640 1 -- 172.21.15.92:0/1813005872 shutdown_connections 2024-09-10T10:36:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.664+0000 7f14cc795640 1 --2- 172.21.15.92:0/1813005872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4106030 0x7f14c410dbb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.664+0000 7f14cc795640 1 --2- 172.21.15.92:0/1813005872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14c4101dd0 0x7f14c4105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.664+0000 7f14cc795640 1 --2- 172.21.15.92:0/1813005872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14c4101420 0x7f14c4101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.664+0000 7f14cc795640 1 -- 172.21.15.92:0/1813005872 >> 172.21.15.92:0/1813005872 conn(0x7f14c40fbee0 msgr2=0x7f14c40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:29.695 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.664+0000 7f14cc795640 1 -- 172.21.15.92:0/1813005872 shutdown_connections 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14cc795640 1 -- 172.21.15.92:0/1813005872 wait complete. 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14cc795640 1 Processor -- start 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14cc795640 1 -- start start 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14cc795640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14c4101420 0x7f14c41a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14cc795640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4101dd0 0x7f14c41a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14cc795640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14c4106030 0x7f14c419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14cc795640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f14c41121b0 con 0x7f14c4101dd0 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14cc795640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f14c4112030 con 0x7f14c4101420 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14cc795640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14c4112330 con 0x7f14c4106030 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14c9d30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4101dd0 0x7f14c41a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14c9d30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4101dd0 0x7f14c41a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45512/0 (socket says 172.21.15.92:45512) 2024-09-10T10:36:29.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.665+0000 7f14c9d30640 1 -- 172.21.15.92:0/1069433874 learned_addr learned my addr 172.21.15.92:0/1069433874 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14ca531640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14c4101420 0x7f14c41a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14cad32640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14c4106030 0x7f14c419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14c9d30640 1 -- 172.21.15.92:0/1069433874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14c4106030 msgr2=0x7f14c419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14c9d30640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14c4106030 0x7f14c419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14c9d30640 1 -- 172.21.15.92:0/1069433874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14c4101420 msgr2=0x7f14c41a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14c9d30640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14c4101420 0x7f14c41a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14c9d30640 1 -- 172.21.15.92:0/1069433874 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c419ad50 con 0x7f14c4101dd0 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14ca531640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14c4101420 0x7f14c41a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14c9d30640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4101dd0 0x7f14c41a09a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f14b400b4a0 tx=0x7f14b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14bb7fe640 1 -- 172.21.15.92:0/1069433874 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4014070 con 0x7f14c4101dd0 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14cc795640 1 -- 172.21.15.92:0/1069433874 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c419b040 con 0x7f14c4101dd0 2024-09-10T10:36:29.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14bb7fe640 1 -- 172.21.15.92:0/1069433874 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14b4010af0 con 0x7f14c4101dd0 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14bb7fe640 1 -- 172.21.15.92:0/1069433874 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4017d10 con 0x7f14c4101dd0 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.666+0000 7f14cc795640 1 -- 172.21.15.92:0/1069433874 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c41a7330 con 0x7f14c4101dd0 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.668+0000 7f14bb7fe640 1 -- 172.21.15.92:0/1069433874 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f14b4017070 con 0x7f14c4101dd0 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.668+0000 7f14ceb6e740 1 Processor -- start 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14ceb6e740 1 -- start start 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 0x55d553d72db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d732f0 0x55d553d7d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d7ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d553cd9090 con 0x55d553d7dbb0 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d553c80a70 con 0x55d553d729d0 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d553cd5050 con 0x55d553d732f0 2024-09-10T10:36:29.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14c9d30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d7ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14bb7fe640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f14b00a2b80 0x7f14b00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14c9d30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d7ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45526/0 (socket says 172.21.15.92:45526) 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14c9d30640 1 -- 172.21.15.92:0/2155210974 learned_addr learned my addr 172.21.15.92:0/2155210974 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14cad32640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f14b00a2b80 0x7f14b00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14cad32640 1 --2- 172.21.15.92:0/2155210974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 0x55d553d72db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.669+0000 7f14ca531640 1 --2- 172.21.15.92:0/2155210974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d732f0 0x55d553d7d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14bb7fe640 1 -- 172.21.15.92:0/1069433874 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f14b40ce4c0 con 0x7f14c4101dd0 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14c9d30640 1 -- 172.21.15.92:0/2155210974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d732f0 msgr2=0x55d553d7d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14c9d30640 1 --2- 172.21.15.92:0/2155210974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d732f0 0x55d553d7d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14c9d30640 1 -- 172.21.15.92:0/2155210974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 msgr2=0x55d553d72db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14c9d30640 1 --2- 172.21.15.92:0/2155210974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 0x55d553d72db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14c9d30640 1 -- 172.21.15.92:0/2155210974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d553c8d130 con 0x55d553d7dbb0 2024-09-10T10:36:29.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14c9d30640 1 --2- 172.21.15.92:0/2155210974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d7ffa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f14b40cbf00 tx=0x7f14b4095780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4d407280509ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14cad32640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f14b00a2b80 0x7f14b00a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006010 tx=0x7f14bc009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14b8ff9640 1 -- 172.21.15.92:0/2155210974 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b401e070 con 0x55d553d7dbb0 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14b8ff9640 1 -- 172.21.15.92:0/2155210974 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14b409ad20 con 0x55d553d7dbb0 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.670+0000 7f14b8ff9640 1 -- 172.21.15.92:0/2155210974 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4097390 con 0x55d553d7dbb0 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 -- 172.21.15.92:0/2155210974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 msgr2=0x55d553d7ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/2155210974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d7ffa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f14b40cbf00 tx=0x7f14b4095780 comp rx=0 tx=0).stop 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 -- 172.21.15.92:0/2155210974 shutdown_connections 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/2155210974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d7ffa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/2155210974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d732f0 0x55d553d7d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/2155210974 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 0x55d553d72db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 -- 172.21.15.92:0/2155210974 >> 172.21.15.92:0/2155210974 conn(0x55d553d6ef60 msgr2=0x55d553d6f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 -- 172.21.15.92:0/2155210974 shutdown_connections 2024-09-10T10:36:29.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 -- 172.21.15.92:0/2155210974 wait complete. 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 -- start start 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.671+0000 7f14ceb6e740 1 Processor -- start 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d729d0 0x55d553d7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 0x55d553d7a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 0x55d553d7ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d553d80780 con 0x55d553d729d0 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d553c93f20 con 0x55d553d732f0 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d553d80900 con 0x55d553d7dbb0 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 10 client.0 _ll_register_callbacks cb 0x55d553c5d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ca531640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d729d0 0x55d553d7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ca531640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d729d0 0x55d553d7d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45530/0 (socket says 172.21.15.92:45530) 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ca531640 1 -- 172.21.15.92:0/1432075045 learned_addr learned my addr 172.21.15.92:0/1432075045 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:29.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14cad32640 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 0x55d553d7ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14c9d30640 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 0x55d553d7a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ca531640 1 -- 172.21.15.92:0/1432075045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 msgr2=0x55d553d7ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ca531640 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 0x55d553d7ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ca531640 1 -- 172.21.15.92:0/1432075045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 msgr2=0x55d553d7a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ca531640 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 0x55d553d7a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ca531640 1 -- 172.21.15.92:0/1432075045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d553a4a2b0 con 0x55d553d729d0 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14c9d30640 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 0x55d553d7a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ca531640 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d729d0 0x55d553d7d3a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f14c000f790 tx=0x7f14c000fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c0716305a923c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14adffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14adffb640 1 -- 172.21.15.92:0/1432075045 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c000fea0 con 0x55d553d729d0 2024-09-10T10:36:29.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14adffb640 1 -- 172.21.15.92:0/1432075045 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f14c000dd30 con 0x55d553d729d0 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1432075045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14b409ad20 con 0x55d553d729d0 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14adffb640 1 -- 172.21.15.92:0/1432075045 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f14c001b480 con 0x55d553d729d0 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 10 client.15186 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.672+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1432075045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d553d8c080 con 0x55d553d729d0 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.673+0000 7f14adffb640 1 -- 172.21.15.92:0/1432075045 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14b409ad20 con 0x55d553d729d0 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.673+0000 7f14adffb640 1 -- 172.21.15.92:0/1432075045 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f14c0010800 con 0x55d553d729d0 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.673+0000 7f14ceb6e740 10 client.15186 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.673+0000 7f14ceb6e740 10 client.15186 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.673+0000 7f14ceb6e740 20 client.15186 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.673+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55d553d8e6d0 0x55d553d8fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.673+0000 7f14ceb6e740 4 client.15186 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.673+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1432075045 --> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d553ce6600 con 0x55d553d8e6d0 2024-09-10T10:36:29.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.673+0000 7f14c9d30640 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55d553d8e6d0 0x55d553d8fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.674+0000 7f14c9d30640 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55d553d8e6d0 0x55d553d8fb40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7913b88017216ba server_cookie=2219434cc8be3fe3 in_seq=0 out_seq=0 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.674+0000 7f14adffb640 10 client.15186 ms_handle_connect on v2:172.21.15.121:6836/332654710 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.674+0000 7f14adffb640 1 -- 172.21.15.92:0/1432075045 <== mds.1 v2:172.21.15.121:6836/332654710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d553ce6600 con 0x55d553d8e6d0 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.674+0000 7f14adffb640 10 client.15186 handle_command_reply: tid=0 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.674+0000 7f14ceb6e740 1 client.15186 shutdown 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1432075045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d729d0 msgr2=0x55d553d7d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d729d0 0x55d553d7d3a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f14c000f790 tx=0x7f14c000fc50 comp rx=0 tx=0).stop 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1432075045 shutdown_connections 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55d553d8e6d0 0x55d553d8fb40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14adffb640 0 client.15186 ms_handle_reset on v2:172.21.15.121:6836/332654710 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 0x55d553d7ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 0x55d553d7a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1432075045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d729d0 0x55d553d7d3a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1432075045 >> 172.21.15.92:0/1432075045 conn(0x55d553d6ef60 msgr2=0x55d553d74c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1432075045 shutdown_connections 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1432075045 wait complete. 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.675+0000 7f14ceb6e740 20 client.15186 trim_cache size 0 max 16384 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14ceb6e740 1 Processor -- start 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14ceb6e740 1 -- start start 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 0x55d553d8fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d732f0 0x55d553d97e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 0x55d553d98360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d553d8de80 con 0x55d553d732f0 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d553d8e550 con 0x55d553d729d0 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d553d8ec20 con 0x55d553d7dbb0 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14c9d30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d732f0 0x55d553d97e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14c9d30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d732f0 0x55d553d97e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45536/0 (socket says 172.21.15.92:45536) 2024-09-10T10:36:29.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14c9d30640 1 -- 172.21.15.92:0/3502799897 learned_addr learned my addr 172.21.15.92:0/3502799897 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.692+0000 7f14ca531640 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 0x55d553d8fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14cad32640 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 0x55d553d98360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14c9d30640 1 -- 172.21.15.92:0/3502799897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 msgr2=0x55d553d98360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14c9d30640 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 0x55d553d98360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14c9d30640 1 -- 172.21.15.92:0/3502799897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 msgr2=0x55d553d8fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14c9d30640 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 0x55d553d8fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14c9d30640 1 -- 172.21.15.92:0/3502799897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d553d6ed90 con 0x55d553d732f0 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14ca531640 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 0x55d553d8fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14c9d30640 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d732f0 0x55d553d97e20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x55d553d73890 tx=0x7f14b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b03ec64711b7891 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14affff640 1 -- 172.21.15.92:0/3502799897 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b401e040 con 0x55d553d732f0 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14affff640 1 -- 172.21.15.92:0/3502799897 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14b409f0d0 con 0x55d553d732f0 2024-09-10T10:36:29.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.693+0000 7f14affff640 1 -- 172.21.15.92:0/3502799897 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b409a170 con 0x55d553d732f0 2024-09-10T10:36:29.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.694+0000 7f14ceb6e740 1 -- 172.21.15.92:0/3502799897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d732f0 msgr2=0x55d553d97e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d732f0 0x55d553d97e20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x55d553d73890 tx=0x7f14b40046c0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 -- 172.21.15.92:0/3502799897 shutdown_connections 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d7dbb0 0x55d553d98360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d732f0 0x55d553d97e20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/3502799897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d729d0 0x55d553d8fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 -- 172.21.15.92:0/3502799897 >> 172.21.15.92:0/3502799897 conn(0x55d553d6ef60 msgr2=0x55d553d79010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 -- 172.21.15.92:0/3502799897 shutdown_connections 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 -- 172.21.15.92:0/3502799897 wait complete. 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 -- start start 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.695+0000 7f14ceb6e740 1 Processor -- start 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d729d0 0x55d553d92d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 0x55d553d932d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14ceb6e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d93810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d553d8f9c0 con 0x55d553d7dbb0 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d553d8f2f0 con 0x55d553d732f0 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14ceb6e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d553d90090 con 0x55d553d729d0 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14ceb6e740 10 client.0 _ll_register_callbacks cb 0x7f14c00093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14cad32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d93810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14cad32640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d93810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45540/0 (socket says 172.21.15.92:45540) 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14cad32640 1 -- 172.21.15.92:0/1053551703 learned_addr learned my addr 172.21.15.92:0/1053551703 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14ca531640 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d729d0 0x55d553d92d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14c9d30640 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 0x55d553d932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14cad32640 1 -- 172.21.15.92:0/1053551703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d729d0 msgr2=0x55d553d92d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14cad32640 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d729d0 0x55d553d92d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14cad32640 1 -- 172.21.15.92:0/1053551703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 msgr2=0x55d553d932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14cad32640 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 0x55d553d932d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14cad32640 1 -- 172.21.15.92:0/1053551703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d553df6ff0 con 0x55d553d7dbb0 2024-09-10T10:36:29.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14cad32640 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d93810 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0099a0 tx=0x7f14bc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7097ad962baa30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.696+0000 7f14adffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14adffb640 1 -- 172.21.15.92:0/1053551703 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc003970 con 0x55d553d7dbb0 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14adffb640 1 -- 172.21.15.92:0/1053551703 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f14bc003b10 con 0x55d553d7dbb0 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1053551703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14b409f0d0 con 0x55d553d7dbb0 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14adffb640 1 -- 172.21.15.92:0/1053551703 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f14bc003d10 con 0x55d553d7dbb0 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14ceb6e740 10 client.15192 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1053551703 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d553df82f0 con 0x55d553d7dbb0 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14adffb640 1 -- 172.21.15.92:0/1053551703 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14b409f0d0 con 0x55d553d7dbb0 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14adffb640 1 -- 172.21.15.92:0/1053551703 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f14bc05e020 con 0x55d553d7dbb0 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14ceb6e740 10 client.15192 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14ceb6e740 10 client.15192 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14ceb6e740 20 client.15192 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55d553d8e6d0 0x55d553dfbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14ceb6e740 4 client.15192 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:29.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.697+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1053551703 --> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] -- command(tid 0: {"prefix": "status"}) -- 0x55d553ce0b10 con 0x55d553d8e6d0 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14ca531640 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55d553d8e6d0 0x55d553dfbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14adffb640 10 client.15192 ms_handle_connect on v2:172.21.15.121:6836/332654710 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14ca531640 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55d553d8e6d0 0x55d553dfbc40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=96f71e75980754dc server_cookie=e6cc7f4edc45b711 in_seq=0 out_seq=0 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14adffb640 1 -- 172.21.15.92:0/1053551703 <== mds.1 v2:172.21.15.121:6836/332654710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d553ce0b10 con 0x55d553d8e6d0 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14adffb640 10 client.15192 handle_command_reply: tid=0 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14ceb6e740 1 client.15192 shutdown 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1053551703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 msgr2=0x55d553d93810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d93810 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0099a0 tx=0x7f14bc02a8c0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1053551703 shutdown_connections 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.121:6836/332654710,v1:172.21.15.121:6837/332654710] conn(0x55d553d8e6d0 0x55d553dfbc40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d553d7dbb0 0x55d553d93810 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.698+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d553d732f0 0x55d553d932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14ceb6e740 1 --2- 172.21.15.92:0/1053551703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d553d729d0 0x55d553d92d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14adffb640 0 client.15192 ms_handle_reset on v2:172.21.15.121:6836/332654710 2024-09-10T10:36:29.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1053551703 >> 172.21.15.92:0/1053551703 conn(0x55d553d6ef60 msgr2=0x55d553d79400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:29.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1053551703 shutdown_connections 2024-09-10T10:36:29.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14ceb6e740 1 -- 172.21.15.92:0/1053551703 wait complete. 2024-09-10T10:36:29.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14ceb6e740 20 client.15192 trim_cache size 0 max 16384 2024-09-10T10:36:29.714 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24451, 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 96.936395399999995, 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:29.715 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:29.716 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 128.974104267 2024-09-10T10:36:29.716 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:29.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 -- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f14b00a2b80 msgr2=0x7f14b00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:29.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f14b00a2b80 0x7f14b00a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006010 tx=0x7f14bc009360 comp rx=0 tx=0).stop 2024-09-10T10:36:29.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 -- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4101dd0 msgr2=0x7f14c41a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:29.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4101dd0 0x7f14c41a09a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f14b400b4a0 tx=0x7f14b400b960 comp rx=0 tx=0).stop 2024-09-10T10:36:29.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 -- 172.21.15.92:0/1069433874 shutdown_connections 2024-09-10T10:36:29.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f14b00a2b80 0x7f14b00a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14c4106030 0x7f14c419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14c4101dd0 0x7f14c41a09a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 --2- 172.21.15.92:0/1069433874 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f14c4101420 0x7f14c41a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:29.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.699+0000 7f14cc795640 1 -- 172.21.15.92:0/1069433874 >> 172.21.15.92:0/1069433874 conn(0x7f14c40fbee0 msgr2=0x7f14c40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:29.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.700+0000 7f14cc795640 1 -- 172.21.15.92:0/1069433874 shutdown_connections 2024-09-10T10:36:29.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:29.700+0000 7f14cc795640 1 -- 172.21.15.92:0/1069433874 wait complete. 2024-09-10T10:36:30.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T10:36:30.774 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:31.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.235+0000 7fa610394640 1 -- 172.21.15.92:0/2613411154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 msgr2=0x7fa6081067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:31.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.235+0000 7fa610394640 1 --2- 172.21.15.92:0/2613411154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 0x7fa6081067f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8009900 tx=0x7fa5f802a410 comp rx=0 tx=0).stop 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.235+0000 7fa610394640 1 -- 172.21.15.92:0/2613411154 shutdown_connections 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.235+0000 7fa610394640 1 --2- 172.21.15.92:0/2613411154 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa608106f20 0x7fa60810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.235+0000 7fa610394640 1 --2- 172.21.15.92:0/2613411154 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 0x7fa6081067f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.235+0000 7fa610394640 1 --2- 172.21.15.92:0/2613411154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa608101df0 0x7fa6081021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.235+0000 7fa610394640 1 -- 172.21.15.92:0/2613411154 >> 172.21.15.92:0/2613411154 conn(0x7fa6080fd8b0 msgr2=0x7fa6080ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.235+0000 7fa610394640 1 -- 172.21.15.92:0/2613411154 shutdown_connections 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.235+0000 7fa610394640 1 -- 172.21.15.92:0/2613411154 wait complete. 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.236+0000 7fa610394640 1 Processor -- start 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.236+0000 7fa610394640 1 -- start start 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.236+0000 7fa610394640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa608101df0 0x7fa608198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.236+0000 7fa610394640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 0x7fa608198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.236+0000 7fa610394640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa608106f20 0x7fa60819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa610394640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa608111f80 con 0x7fa6081027a0 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa610394640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa608111e00 con 0x7fa608101df0 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa610394640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa608112100 con 0x7fa608106f20 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60d92f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 0x7fa608198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60d92f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 0x7fa608198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45556/0 (socket says 172.21.15.92:45556) 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60d92f640 1 -- 172.21.15.92:0/3296501125 learned_addr learned my addr 172.21.15.92:0/3296501125 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60e130640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa608101df0 0x7fa608198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60e931640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa608106f20 0x7fa60819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60d92f640 1 -- 172.21.15.92:0/3296501125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa608106f20 msgr2=0x7fa60819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60d92f640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa608106f20 0x7fa60819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60d92f640 1 -- 172.21.15.92:0/3296501125 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa608101df0 msgr2=0x7fa608198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:31.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60d92f640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa608101df0 0x7fa608198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60d92f640 1 -- 172.21.15.92:0/3296501125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60819d3d0 con 0x7fa6081027a0 2024-09-10T10:36:31.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60e931640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa608106f20 0x7fa60819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:31.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa60d92f640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 0x7fa608198960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8006010 tx=0x7fa5f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:31.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa5ff7fe640 1 -- 172.21.15.92:0/3296501125 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f803f030 con 0x7fa6081027a0 2024-09-10T10:36:31.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa5ff7fe640 1 -- 172.21.15.92:0/3296501125 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5f8003ce0 con 0x7fa6081027a0 2024-09-10T10:36:31.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa5ff7fe640 1 -- 172.21.15.92:0/3296501125 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8035070 con 0x7fa6081027a0 2024-09-10T10:36:31.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa610394640 1 -- 172.21.15.92:0/3296501125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60819d660 con 0x7fa6081027a0 2024-09-10T10:36:31.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.237+0000 7fa610394640 1 -- 172.21.15.92:0/3296501125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6081a4fa0 con 0x7fa6081027a0 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa5ff7fe640 1 -- 172.21.15.92:0/3296501125 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa5f8042030 con 0x7fa6081027a0 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa61276d740 1 Processor -- start 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa61276d740 1 -- start start 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa61276d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa79d0 0x55fb30fa7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa61276d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa82f0 0x55fb30fb2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa61276d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa61276d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fb30f0e090 con 0x55fb30fb2bb0 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa61276d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fb30eb5a70 con 0x55fb30fa82f0 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa61276d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb30f0a050 con 0x55fb30fa79d0 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa5ff7fe640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa5f40a2b80 0x7fa5f40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa60d92f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa60e931640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa5f40a2b80 0x7fa5f40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.240+0000 7fa60d92f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45558/0 (socket says 172.21.15.92:45558) 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60d92f640 1 -- 172.21.15.92:0/3886800729 learned_addr learned my addr 172.21.15.92:0/3886800729 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60e931640 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa79d0 0x55fb30fa7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60e130640 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa82f0 0x55fb30fb2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa5ff7fe640 1 -- 172.21.15.92:0/3296501125 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fa5f80ef660 con 0x7fa6081027a0 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60d92f640 1 -- 172.21.15.92:0/3886800729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa79d0 msgr2=0x55fb30fa7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60d92f640 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa79d0 0x55fb30fa7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60d92f640 1 -- 172.21.15.92:0/3886800729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa82f0 msgr2=0x55fb30fb2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60d92f640 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa82f0 0x55fb30fb2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60d92f640 1 -- 172.21.15.92:0/3886800729 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb30ec2130 con 0x55fb30fb2bb0 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60e931640 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa79d0 0x55fb30fa7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60e931640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa5f40a2b80 0x7fa5f40a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6000129c0 tx=0x7fa60000ac00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa60d92f640 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb4fa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8005ab0 tx=0x7fa5f808f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450fb4d300138b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa5fcdea640 1 -- 172.21.15.92:0/3886800729 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8049070 con 0x55fb30fb2bb0 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa5fcdea640 1 -- 172.21.15.92:0/3886800729 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5f80bc720 con 0x55fb30fb2bb0 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.241+0000 7fa5fcdea640 1 -- 172.21.15.92:0/3886800729 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80bc020 con 0x55fb30fb2bb0 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 -- 172.21.15.92:0/3886800729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 msgr2=0x55fb30fb4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb4fa0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8005ab0 tx=0x7fa5f808f1a0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 -- 172.21.15.92:0/3886800729 shutdown_connections 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb4fa0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa82f0 0x55fb30fb2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886800729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa79d0 0x55fb30fa7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 -- 172.21.15.92:0/3886800729 >> 172.21.15.92:0/3886800729 conn(0x55fb30fa3f60 msgr2=0x55fb30fa4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 -- 172.21.15.92:0/3886800729 shutdown_connections 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 -- 172.21.15.92:0/3886800729 wait complete. 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 -- start start 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.242+0000 7fa61276d740 1 Processor -- start 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa61276d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fb2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa61276d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fa82f0 0x55fb30faf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa61276d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fb2bb0 0x55fb30fafdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa61276d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fb30fb5540 con 0x55fb30fa82f0 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa61276d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fb30ec8f20 con 0x55fb30fa79d0 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa61276d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb30fb56c0 con 0x55fb30fb2bb0 2024-09-10T10:36:31.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa61276d740 10 client.0 _ll_register_callbacks cb 0x55fb30e92030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60d92f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fa82f0 0x55fb30faf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60d92f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fa82f0 0x55fb30faf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45574/0 (socket says 172.21.15.92:45574) 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60d92f640 1 -- 172.21.15.92:0/3886634444 learned_addr learned my addr 172.21.15.92:0/3886634444 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60e130640 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fb2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60d92f640 1 -- 172.21.15.92:0/3886634444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fb2bb0 msgr2=0x55fb30fafdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60e931640 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fb2bb0 0x55fb30fafdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60d92f640 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fb2bb0 0x55fb30fafdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60d92f640 1 -- 172.21.15.92:0/3886634444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 msgr2=0x55fb30fb2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60d92f640 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fb2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60d92f640 1 -- 172.21.15.92:0/3886634444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb30c7f2b0 con 0x55fb30fa82f0 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60e130640 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fb2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa60d92f640 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fa82f0 0x55fb30faf850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80c4760 tx=0x7fa5f8003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5fcab8586fc0d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:31.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa5f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/3886634444 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8049040 con 0x55fb30fa82f0 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/3886634444 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fa5f80b8690 con 0x55fb30fa82f0 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa61276d740 1 -- 172.21.15.92:0/3886634444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f80bc720 con 0x55fb30fa82f0 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.243+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/3886634444 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa5f80bbdf0 con 0x55fb30fa82f0 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa61276d740 10 client.15204 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa61276d740 1 -- 172.21.15.92:0/3886634444 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fb30fb5540 con 0x55fb30fa82f0 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/3886634444 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5f80bc720 con 0x55fb30fa82f0 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/3886634444 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa5f80bc280 con 0x55fb30fa82f0 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa61276d740 10 client.15204 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:31.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa61276d740 10 client.15204 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa61276d740 20 client.15204 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fb30fc3200 0x55fb30fc4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa61276d740 4 client.15204 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa61276d740 1 -- 172.21.15.92:0/3886634444 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb30f1b600 con 0x55fb30fc3200 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.244+0000 7fa60e130640 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fb30fc3200 0x55fb30fc4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.245+0000 7fa60e130640 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fb30fc3200 0x55fb30fc4670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5c25de2603c808b server_cookie=88ad7b57c845c588 in_seq=0 out_seq=0 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.245+0000 7fa5f1ffb640 10 client.15204 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.245+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/3886634444 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb30f1b600 con 0x55fb30fc3200 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.245+0000 7fa5f1ffb640 10 client.15204 handle_command_reply: tid=0 2024-09-10T10:36:31.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.245+0000 7fa61276d740 1 client.15204 shutdown 2024-09-10T10:36:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 -- 172.21.15.92:0/3886634444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fa82f0 msgr2=0x55fb30faf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fa82f0 0x55fb30faf850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80c4760 tx=0x7fa5f8003f80 comp rx=0 tx=0).stop 2024-09-10T10:36:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 -- 172.21.15.92:0/3886634444 shutdown_connections 2024-09-10T10:36:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fb2bb0 0x55fb30fafdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fa82f0 0x55fb30faf850 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fb30fc3200 0x55fb30fc4670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 --2- 172.21.15.92:0/3886634444 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fb2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa5f1ffb640 0 client.15204 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:31.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 -- 172.21.15.92:0/3886634444 >> 172.21.15.92:0/3886634444 conn(0x55fb30fa3f60 msgr2=0x55fb30fa9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:31.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 -- 172.21.15.92:0/3886634444 shutdown_connections 2024-09-10T10:36:31.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 1 -- 172.21.15.92:0/3886634444 wait complete. 2024-09-10T10:36:31.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.246+0000 7fa61276d740 20 client.15204 trim_cache size 0 max 16384 2024-09-10T10:36:31.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.263+0000 7fa61276d740 1 Processor -- start 2024-09-10T10:36:31.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.263+0000 7fa61276d740 1 -- start start 2024-09-10T10:36:31.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa61276d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fc38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa61276d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 0x55fb30fa4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa61276d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa61276d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fb30fc29b0 con 0x55fb30fb2bb0 2024-09-10T10:36:31.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa61276d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fb30fc3080 con 0x55fb30fa79d0 2024-09-10T10:36:31.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa61276d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb30fc3750 con 0x55fb30fa82f0 2024-09-10T10:36:31.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e931640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e931640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45584/0 (socket says 172.21.15.92:45584) 2024-09-10T10:36:31.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e931640 1 -- 172.21.15.92:0/2820798178 learned_addr learned my addr 172.21.15.92:0/2820798178 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:31.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e130640 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fc38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60d92f640 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 0x55fb30fa4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e931640 1 -- 172.21.15.92:0/2820798178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 msgr2=0x55fb30fa4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e931640 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 0x55fb30fa4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e931640 1 -- 172.21.15.92:0/2820798178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 msgr2=0x55fb30fc38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e931640 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fc38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e931640 1 -- 172.21.15.92:0/2820798178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb30fb0120 con 0x55fb30fb2bb0 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e130640 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fc38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa60e931640 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb0fa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa60000aec0 tx=0x7fa60001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2ae226f421c315 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa5f3fff640 1 -- 172.21.15.92:0/2820798178 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600011670 con 0x55fb30fb2bb0 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa5f3fff640 1 -- 172.21.15.92:0/2820798178 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa600011cf0 con 0x55fb30fb2bb0 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.264+0000 7fa5f3fff640 1 -- 172.21.15.92:0/2820798178 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60001fca0 con 0x55fb30fb2bb0 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 -- 172.21.15.92:0/2820798178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 msgr2=0x55fb30fb0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:31.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb0fa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa60000aec0 tx=0x7fa60001c000 comp rx=0 tx=0).stop 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 -- 172.21.15.92:0/2820798178 shutdown_connections 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fb0fa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 0x55fb30fa4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 --2- 172.21.15.92:0/2820798178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fc38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 -- 172.21.15.92:0/2820798178 >> 172.21.15.92:0/2820798178 conn(0x55fb30fa3f60 msgr2=0x55fb30fae940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 -- 172.21.15.92:0/2820798178 shutdown_connections 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 -- 172.21.15.92:0/2820798178 wait complete. 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 -- start start 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.265+0000 7fa61276d740 1 Processor -- start 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa61276d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa61276d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 0x55fb30fc6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa61276d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fc65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa61276d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fb30fc44f0 con 0x55fb30fb2bb0 2024-09-10T10:36:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa61276d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fb30fc3e20 con 0x55fb30fa79d0 2024-09-10T10:36:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa61276d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb30fc4bc0 con 0x55fb30fa82f0 2024-09-10T10:36:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa61276d740 10 client.0 _ll_register_callbacks cb 0x7fa604004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e931640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fc65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e931640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fc65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45600/0 (socket says 172.21.15.92:45600) 2024-09-10T10:36:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e931640 1 -- 172.21.15.92:0/564075244 learned_addr learned my addr 172.21.15.92:0/564075244 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:31.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60d92f640 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 0x55fb30fc6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e931640 1 -- 172.21.15.92:0/564075244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 msgr2=0x55fb30fc6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e931640 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 0x55fb30fc6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e130640 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e931640 1 -- 172.21.15.92:0/564075244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 msgr2=0x55fb30fccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e931640 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e931640 1 -- 172.21.15.92:0/564075244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb30fc6af0 con 0x55fb30fb2bb0 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa60e931640 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fc65b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa60000fd30 tx=0x7fa60000aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f1c9b83e207e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa5f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.266+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/564075244 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60001fbb0 con 0x55fb30fb2bb0 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/564075244 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fa60001fd50 con 0x55fb30fb2bb0 2024-09-10T10:36:31.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa61276d740 1 -- 172.21.15.92:0/564075244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa600011cf0 con 0x55fb30fb2bb0 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/564075244 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa600011470 con 0x55fb30fb2bb0 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa61276d740 10 client.15210 fetch_fsmap learned FSMap version 27 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa61276d740 1 -- 172.21.15.92:0/564075244 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fb30fcb570 con 0x55fb30fb2bb0 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/564075244 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa600011cf0 con 0x55fb30fb2bb0 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/564075244 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa600031890 con 0x55fb30fb2bb0 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa61276d740 10 client.15210 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa61276d740 10 client.15210 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa61276d740 20 client.15210 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa61276d740 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fb31031e60 0x55fb31030b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa61276d740 4 client.15210 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T10:36:31.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa61276d740 1 -- 172.21.15.92:0/564075244 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "status"}) -- 0x55fb30f15b10 con 0x55fb31031e60 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.267+0000 7fa60e130640 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fb31031e60 0x55fb31030b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa60e130640 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fb31031e60 0x55fb31030b70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3581c21a5dd66558 server_cookie=5f41f13c4783194c in_seq=0 out_seq=0 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa5f1ffb640 10 client.15210 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa5f1ffb640 1 -- 172.21.15.92:0/564075244 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fb30f15b10 con 0x55fb31031e60 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa5f1ffb640 10 client.15210 handle_command_reply: tid=0 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 client.15210 shutdown 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 -- 172.21.15.92:0/564075244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 msgr2=0x55fb30fc65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fc65b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa60000fd30 tx=0x7fa60000aa50 comp rx=0 tx=0).stop 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 -- 172.21.15.92:0/564075244 shutdown_connections 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fb30fb2bb0 0x55fb30fc65b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb30fa82f0 0x55fb30fc6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fb31031e60 0x55fb31030b70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.280 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 --2- 172.21.15.92:0/564075244 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fb30fa79d0 0x55fb30fccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa5f1ffb640 0 client.15210 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:31.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 -- 172.21.15.92:0/564075244 >> 172.21.15.92:0/564075244 conn(0x55fb30fa3f60 msgr2=0x55fb30faf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:31.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 -- 172.21.15.92:0/564075244 shutdown_connections 2024-09-10T10:36:31.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 1 -- 172.21.15.92:0/564075244 wait complete. 2024-09-10T10:36:31.281 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.268+0000 7fa61276d740 20 client.15210 trim_cache size 0 max 16384 2024-09-10T10:36:31.281 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:36:31.281 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "0df4af84-6f5f-11ef-bcea-c7b262605968", 2024-09-10T10:36:31.281 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-09-10T10:36:31.281 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24472, 2024-09-10T10:36:31.282 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-09-10T10:36:31.282 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-09-10T10:36:31.282 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-09-10T10:36:31.282 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 105.530577736, 2024-09-10T10:36:31.282 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 27, 2024-09-10T10:36:31.282 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 83, 2024-09-10T10:36:31.282 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T10:36:31.282 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 125.21135458099999 2024-09-10T10:36:31.282 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:36:31.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 -- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa5f40a2b80 msgr2=0x7fa5f40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:31.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa5f40a2b80 0x7fa5f40a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6000129c0 tx=0x7fa60000ac00 comp rx=0 tx=0).stop 2024-09-10T10:36:31.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 -- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 msgr2=0x7fa608198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:31.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 0x7fa608198960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8006010 tx=0x7fa5f80042f0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 -- 172.21.15.92:0/3296501125 shutdown_connections 2024-09-10T10:36:31.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fa5f40a2b80 0x7fa5f40a5040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.283 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa608106f20 0x7fa60819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6081027a0 0x7fa608198960 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 --2- 172.21.15.92:0/3296501125 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa608101df0 0x7fa608198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 -- 172.21.15.92:0/3296501125 >> 172.21.15.92:0/3296501125 conn(0x7fa6080fd8b0 msgr2=0x7fa6080febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 -- 172.21.15.92:0/3296501125 shutdown_connections 2024-09-10T10:36:31.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:31.269+0000 7fa610394640 1 -- 172.21.15.92:0/3296501125 wait complete. 2024-09-10T10:36:31.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:31 smithi097 ceph-mon[35213]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T10:36:31.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:31 smithi092 ceph-mon[30834]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T10:36:31.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:31 smithi121 ceph-mon[35231]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T10:36:32.114 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T10:36:32.124 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T10:36:32.124 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T10:36:32.125 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T10:36:32.125 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-10T10:36:32.125 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T10:36:32.126 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:36:32.126 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-10T10:36:32.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.228+0000 7eff700a4640 1 -- 172.21.15.92:0/496829901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68100a50 msgr2=0x7eff68100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.228+0000 7eff700a4640 1 --2- 172.21.15.92:0/496829901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68100a50 0x7eff68100e50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7eff58009900 tx=0x7eff5802a410 comp rx=0 tx=0).stop 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.228+0000 7eff700a4640 1 -- 172.21.15.92:0/496829901 shutdown_connections 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.228+0000 7eff700a4640 1 --2- 172.21.15.92:0/496829901 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff68102600 0x7eff68108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.228+0000 7eff700a4640 1 --2- 172.21.15.92:0/496829901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff68101c40 0x7eff681020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.228+0000 7eff700a4640 1 --2- 172.21.15.92:0/496829901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68100a50 0x7eff68100e50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.228+0000 7eff700a4640 1 -- 172.21.15.92:0/496829901 >> 172.21.15.92:0/496829901 conn(0x7eff680fc1b0 msgr2=0x7eff680fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.228+0000 7eff700a4640 1 -- 172.21.15.92:0/496829901 shutdown_connections 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.228+0000 7eff700a4640 1 -- 172.21.15.92:0/496829901 wait complete. 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff700a4640 1 Processor -- start 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff700a4640 1 -- start start 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff700a4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff68100a50 0x7eff6806ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:32.233 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff700a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff68101c40 0x7eff6819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff700a4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68102600 0x7eff6819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff700a4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff6810c6d0 con 0x7eff68102600 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff700a4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7eff6810c550 con 0x7eff68100a50 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff700a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7eff6810c850 con 0x7eff68101c40 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff6e641640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68102600 0x7eff6819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff6e641640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68102600 0x7eff6819f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45622/0 (socket says 172.21.15.92:45622) 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff6e641640 1 -- 172.21.15.92:0/3528755556 learned_addr learned my addr 172.21.15.92:0/3528755556 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff6d63f640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff68101c40 0x7eff6819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.229+0000 7eff6de40640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff68100a50 0x7eff6806ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff6e641640 1 -- 172.21.15.92:0/3528755556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff68101c40 msgr2=0x7eff6819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff6e641640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff68101c40 0x7eff6819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:32.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff6e641640 1 -- 172.21.15.92:0/3528755556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff68100a50 msgr2=0x7eff6806ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff6e641640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff68100a50 0x7eff6806ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff6e641640 1 -- 172.21.15.92:0/3528755556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6819fa70 con 0x7eff68102600 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff6de40640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff68100a50 0x7eff6806ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff6e641640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68102600 0x7eff6819f160 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7eff6000eaa0 tx=0x7eff6000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff5effd640 1 -- 172.21.15.92:0/3528755556 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6000cdb0 con 0x7eff68102600 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff5effd640 1 -- 172.21.15.92:0/3528755556 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff60005020 con 0x7eff68102600 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6819fd00 con 0x7eff68102600 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff5effd640 1 -- 172.21.15.92:0/3528755556 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff600116b0 con 0x7eff68102600 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.230+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff681a01a0 con 0x7eff68102600 2024-09-10T10:36:32.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.231+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff68107df0 con 0x7eff68102600 2024-09-10T10:36:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.232+0000 7eff5effd640 1 -- 172.21.15.92:0/3528755556 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7eff60005560 con 0x7eff68102600 2024-09-10T10:36:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.233+0000 7eff5effd640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff540a2c30 0x7eff540a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.233+0000 7eff6de40640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff540a2c30 0x7eff540a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.233+0000 7eff5effd640 1 -- 172.21.15.92:0/3528755556 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7eff600cf1f0 con 0x7eff68102600 2024-09-10T10:36:32.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.233+0000 7eff6de40640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff540a2c30 0x7eff540a50f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7eff58006010 tx=0x7eff58032cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:32.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.237+0000 7eff5effd640 1 -- 172.21.15.92:0/3528755556 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff60016030 con 0x7eff68102600 2024-09-10T10:36:32.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:32.450+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7eff6802da10 con 0x7eff68102600 2024-09-10T10:36:33.295 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.293+0000 7eff5effd640 1 -- 172.21.15.92:0/3528755556 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7eff6009c1f0 con 0x7eff68102600 2024-09-10T10:36:33.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff540a2c30 msgr2=0x7eff540a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:33.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff540a2c30 0x7eff540a50f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7eff58006010 tx=0x7eff58032cf0 comp rx=0 tx=0).stop 2024-09-10T10:36:33.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68102600 msgr2=0x7eff6819f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:33.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68102600 0x7eff6819f160 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7eff6000eaa0 tx=0x7eff6000ef60 comp rx=0 tx=0).stop 2024-09-10T10:36:33.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 shutdown_connections 2024-09-10T10:36:33.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7eff540a2c30 0x7eff540a50f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:33.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff68102600 0x7eff6819f160 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:33.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff68101c40 0x7eff6819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:33.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 --2- 172.21.15.92:0/3528755556 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7eff68100a50 0x7eff6806ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:33.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 >> 172.21.15.92:0/3528755556 conn(0x7eff680fc1b0 msgr2=0x7eff68104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:33.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.296+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 shutdown_connections 2024-09-10T10:36:33.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:33.297+0000 7eff700a4640 1 -- 172.21.15.92:0/3528755556 wait complete. 2024-09-10T10:36:33.316 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T10:36:33.342 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T10:36:33.342 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T10:36:33.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:36:33.342 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-10T10:36:33.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:36:33.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-09-10T10:36:33.429 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2024-09-10T10:36:33.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:36:33.430 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-10T10:36:33.430 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T10:36:33.431 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-10T10:36:33.431 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-10T10:36:33.431 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T10:36:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-mon[35213]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T10:36:33.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3528755556' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T10:36:33.570 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: ignoring --setuser ceph since I am not root 2024-09-10T10:36:33.570 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: ignoring --setgroup ceph since I am not root 2024-09-10T10:36:33.570 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-mgr[36581]: -- 172.21.15.97:0/3529086985 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fcb3ed30e0 con 0x55fcb3eb0800 2024-09-10T10:36:33.571 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:33.449+0000 7fd3a74de040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:36:33.571 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:33.506+0000 7fd3a74de040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:36:33.593 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-mon[35231]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T10:36:33.593 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3528755556' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T10:36:33.593 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: ignoring --setuser ceph since I am not root 2024-09-10T10:36:33.593 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: ignoring --setgroup ceph since I am not root 2024-09-10T10:36:33.593 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-mgr[37033]: -- 172.21.15.121:0/453728917 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c430f1f0e0 con 0x55c430efc800 2024-09-10T10:36:33.594 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:33.447+0000 7fae54ab4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:36:33.594 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:33.503+0000 7fae54ab4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:36:33.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:33 smithi092 ceph-mon[30834]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T10:36:33.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:33 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3528755556' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T10:36:33.610 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: ignoring --setuser ceph since I am not root 2024-09-10T10:36:33.611 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: ignoring --setgroup ceph since I am not root 2024-09-10T10:36:33.611 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:33.451+0000 7fd4fefb3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T10:36:33.611 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:33.511+0000 7fd4fefb3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T10:36:33.744 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:36:33.863 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:33.650+0000 7fae54ab4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:36:33.863 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:33.716+0000 7fae54ab4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:36:34.012 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:33.655+0000 7fd3a74de040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:36:34.012 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:33.720+0000 7fd3a74de040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:36:34.012 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:33 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:33.868+0000 7fd3a74de040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:36:34.012 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:34 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:34.010+0000 7fd3a74de040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:36:34.023 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:33.667+0000 7fd4fefb3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T10:36:34.023 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:33.760+0000 7fd4fefb3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T10:36:34.023 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:33.913+0000 7fd4fefb3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:36:34.282 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.279+0000 7f66b0dc7640 1 -- 172.21.15.92:0/1680104940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ac100e20 msgr2=0x7f66ac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:34.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.279+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/1680104940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ac100e20 0x7f66ac101200 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f669c009900 tx=0x7f669c02a480 comp rx=0 tx=0).stop 2024-09-10T10:36:34.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.279+0000 7f66b0dc7640 1 -- 172.21.15.92:0/1680104940 shutdown_connections 2024-09-10T10:36:34.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.279+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/1680104940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66ac102ef0 0x7f66ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.279+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/1680104940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66ac102570 0x7f66ac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.279+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/1680104940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ac100e20 0x7f66ac101200 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.279+0000 7f66b0dc7640 1 -- 172.21.15.92:0/1680104940 >> 172.21.15.92:0/1680104940 conn(0x7f66ac0fc7d0 msgr2=0x7f66ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:34.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.279+0000 7f66b0dc7640 1 -- 172.21.15.92:0/1680104940 shutdown_connections 2024-09-10T10:36:34.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.279+0000 7f66b0dc7640 1 -- 172.21.15.92:0/1680104940 wait complete. 2024-09-10T10:36:34.335 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:34 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:34.073+0000 7fd4fefb3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:36:34.338 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:33.862+0000 7fae54ab4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:36:34.338 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:34.002+0000 7fae54ab4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T10:36:34.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66b0dc7640 1 Processor -- start 2024-09-10T10:36:34.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66b0dc7640 1 -- start start 2024-09-10T10:36:34.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66b0dc7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66ac100e20 0x7f66ac103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:34.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66b0dc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ac102570 0x7f66ac103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:34.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66b0dc7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66ac102ef0 0x7f66ac1041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66b0dc7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac110f80 con 0x7f66ac102570 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66b0dc7640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac110e00 con 0x7f66ac102ef0 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66b0dc7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac111100 con 0x7f66ac100e20 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66aa59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66ac100e20 0x7f66ac103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66aa59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66ac100e20 0x7f66ac103750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:39540/0 (socket says 172.21.15.92:39540) 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66a3fff640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ac102570 0x7f66ac103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66aa59c640 1 -- 172.21.15.92:0/522592303 learned_addr learned my addr 172.21.15.92:0/522592303 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.281+0000 7f66aad9d640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66ac102ef0 0x7f66ac1041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66a3fff640 1 -- 172.21.15.92:0/522592303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66ac100e20 msgr2=0x7f66ac103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:34.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66a3fff640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66ac100e20 0x7f66ac103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66a3fff640 1 -- 172.21.15.92:0/522592303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66ac102ef0 msgr2=0x7f66ac1041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66a3fff640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66ac102ef0 0x7f66ac1041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66a3fff640 1 -- 172.21.15.92:0/522592303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac1a69e0 con 0x7f66ac102570 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66aad9d640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66ac102ef0 0x7f66ac1041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66a3fff640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ac102570 0x7f66ac103c90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f669400e9f0 tx=0x7f669400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66a37fe640 1 -- 172.21.15.92:0/522592303 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669400ccc0 con 0x7f66ac102570 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac1a6cd0 con 0x7f66ac102570 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66a37fe640 1 -- 172.21.15.92:0/522592303 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6694005020 con 0x7f66ac102570 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66a37fe640 1 -- 172.21.15.92:0/522592303 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66940049e0 con 0x7f66ac102570 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.282+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac1a71c0 con 0x7f66ac102570 2024-09-10T10:36:34.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.283+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac101200 con 0x7f66ac102570 2024-09-10T10:36:34.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.284+0000 7f66a37fe640 1 -- 172.21.15.92:0/522592303 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f6694005560 con 0x7f66ac102570 2024-09-10T10:36:34.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.285+0000 7f66a37fe640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66980a2bd0 0x7f66980a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:34.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.285+0000 7f66aa59c640 1 -- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66980a2bd0 msgr2=0x7f66980a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2834815615 2024-09-10T10:36:34.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.285+0000 7f66a37fe640 1 -- 172.21.15.92:0/522592303 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f66940cf000 con 0x7f66ac102570 2024-09-10T10:36:34.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.285+0000 7f66aa59c640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66980a2bd0 0x7f66980a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:36:34.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.293+0000 7f66a37fe640 1 -- 172.21.15.92:0/522592303 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66940051d0 con 0x7f66ac102570 2024-09-10T10:36:34.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.486+0000 7f66aa59c640 1 -- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66980a2bd0 msgr2=0x7f66980a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2834815615 2024-09-10T10:36:34.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.486+0000 7f66aa59c640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66980a2bd0 0x7f66980a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:36:34.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.497+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f66ac104c80 con 0x7f66ac102570 2024-09-10T10:36:34.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.497+0000 7f66a37fe640 1 -- 172.21.15.92:0/522592303 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f66ac104c80 con 0x7f66ac102570 2024-09-10T10:36:34.500 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T10:36:34.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.499+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66980a2bd0 msgr2=0x7f66980a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:36:34.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.499+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66980a2bd0 0x7f66980a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.499+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ac102570 msgr2=0x7f66ac103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:34.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.499+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ac102570 0x7f66ac103c90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f669400e9f0 tx=0x7f669400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.499+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 shutdown_connections 2024-09-10T10:36:34.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.500+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f66980a2bd0 0x7f66980a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.500+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f66ac102ef0 0x7f66ac1041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.500+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66ac102570 0x7f66ac103c90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.500+0000 7f66b0dc7640 1 --2- 172.21.15.92:0/522592303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66ac100e20 0x7f66ac103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:34.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.500+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 >> 172.21.15.92:0/522592303 conn(0x7f66ac0fc7d0 msgr2=0x7f66ac06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:34.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.500+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 shutdown_connections 2024-09-10T10:36:34.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:34.500+0000 7f66b0dc7640 1 -- 172.21.15.92:0/522592303 wait complete. 2024-09-10T10:36:34.567 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:34 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3528755556' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T10:36:34.567 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:34 smithi097 ceph-mon[35213]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T10:36:34.568 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:34 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:34.323+0000 7fd3a74de040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:36:34.568 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:34 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:34.383+0000 7fd3a74de040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:36:34.568 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:34 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:34.566+0000 7fd3a74de040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:36:34.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:34 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3528755556' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T10:36:34.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:34 smithi092 ceph-mon[30834]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T10:36:34.611 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:34 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:34.405+0000 7fd4fefb3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:36:34.611 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:34 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:34.467+0000 7fd4fefb3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:36:34.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:34 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3528755556' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T10:36:34.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:34 smithi121 ceph-mon[35231]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T10:36:34.791 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:34.312+0000 7fae54ab4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T10:36:34.791 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:34.373+0000 7fae54ab4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T10:36:34.791 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:34.555+0000 7fae54ab4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:36:35.110 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:34 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:34.662+0000 7fd4fefb3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T10:36:35.318 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T10:36:35.319 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T10:36:35.319 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-09-10T10:36:35.319 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T10:36:35.319 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-10T10:36:35.319 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T10:36:35.319 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T10:36:35.319 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T10:36:35.319 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-10T10:36:35.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:36:35.319 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-09-10T10:36:35.336 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T10:36:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T10:36:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T10:36:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:36:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-09-10T10:36:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:36:35.336 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:36:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:36:35.336 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42171sec preferred_lft 42171sec 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::ec4:7aff:fe8f:cd45/64 scope link noprefixroute 2024-09-10T10:36:35.337 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-09-10T10:36:35.338 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T10:36:35.338 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:36:35.338 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-10T10:36:35.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2024-09-10T10:36:35.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2024-09-10T10:36:35.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2024-09-10T10:36:35.338 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T10:36:35.338 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-10T10:36:35.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:36:35.539 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:35 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/522592303' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:36:35.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:36:35.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:36:35.549 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T10:36:35.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:35 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/522592303' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:36:35.570 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:35 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:35.455+0000 7fd3a74de040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:36:35.570 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:35 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:35.522+0000 7fd3a74de040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:36:35.574 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-09-10T10:36:35.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:36:35.576 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-09-10T10:36:35.653 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-09-10T10:36:35.653 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T10:36:35.653 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T10:36:35.653 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T10:36:35.653 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T10:36:35.653 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:36:35.654 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-10T10:36:35.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T10:36:35.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T10:36:35.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T10:36:35.654 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-10T10:36:35.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:36:35.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:35 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/522592303' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T10:36:35.791 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:35 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:35.440+0000 7fae54ab4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:36:35.791 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:35 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:35.507+0000 7fae54ab4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:36:35.846 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:35.577+0000 7fd4fefb3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T10:36:35.846 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:35.647+0000 7fd4fefb3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T10:36:35.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:36:35.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:36:35.933 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-10T10:36:35.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:36:35.949 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-09-10T10:36:36.005 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:36:36.005 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-10T10:36:36.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-10T10:36:36.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-10T10:36:36.005 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-10T10:36:36.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:36:36.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:36:36.124 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-10T10:36:36.124 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:36:36.124 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-10T10:36:36.124 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-10T10:36:36.124 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T10:36:36.125 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-10T10:36:36.125 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-10T10:36:36.125 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-10T10:36:36.125 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-10T10:36:36.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:36:36.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:36:36.254 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T10:36:36.254 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-09-10T10:36:36.254 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-09-10T10:36:36.254 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T10:36:36.254 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-09-10T10:36:36.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:36:36.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:36:36.334 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:36:36.334 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /tmp/cephfs 2024-09-10T10:36:36.351 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-10T10:36:36.351 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T10:36:36.351 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /tmp/cephfs 2024-09-10T10:36:36.407 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T10:36:36.407 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T10:36:36.407 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/1d1ba3c6-c144-4c8e-abf8-c335e9ab9eb2 2024-09-10T10:36:36.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:36:36.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/1d1ba3c6-c144-4c8e-abf8-c335e9ab9eb2 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context=system_u:object_r:postgresql_db_t:s0 2024-09-10T10:36:36.471 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:36.212+0000 7fae54ab4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:36:36.471 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:36.327+0000 7fae54ab4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:36:36.496 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:36.235+0000 7fd3a74de040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:36:36.496 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:36.352+0000 7fd3a74de040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:36:36.514 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-10T10:36:36.514 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-10T10:36:36.514 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-10T10:36:36.646 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-10T10:36:36.646 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-10T10:36:36.646 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2024-09-10T10:36:36.646 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.97:3300,172.21.15.121:3300" 2024-09-10T10:36:36.646 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.92:3300,172.21.15.97:3300,172.21.15.121:3300:/volumes/qa/sv_1/1d1ba3c6-c144-4c8e-abf8-c335e9ab9eb2 2024-09-10T10:36:36.646 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=0df4af84-6f5f-11ef-bcea-c7b262605968" will pass to kernel 2024-09-10T10:36:36.649 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T10:36:36.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:36:36.649 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /tmp/cephfs 2024-09-10T10:36:36.671 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:36 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:36.407+0000 7fd4fefb3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T10:36:36.671 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:36 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:36.528+0000 7fd4fefb3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T10:36:36.678 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T10:36:36.752 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:36.468+0000 7fae54ab4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:36:36.752 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:36.529+0000 7fae54ab4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:36:36.752 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:36.679+0000 7fae54ab4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:36:36.752 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:36.749+0000 7fae54ab4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:36:36.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T10:36:36.773 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:36:36.780 INFO:teuthology.orchestra.run.smithi092.stdout:client15243 2024-09-10T10:36:36.780 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:36:36.780 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:36:36.781 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:36.495+0000 7fd3a74de040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:36:36.781 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:36.556+0000 7fd3a74de040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:36:36.781 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:36.705+0000 7fd3a74de040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:36:36.781 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:36.778+0000 7fd3a74de040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:36:36.798 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T10:36:36.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T10:36:36.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:36:36.895 INFO:teuthology.orchestra.run.smithi092.stdout:client15243 2024-09-10T10:36:36.895 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T10:36:36.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T10:36:36.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:36:36.952 INFO:teuthology.orchestra.run.smithi092.stdout:client15243 2024-09-10T10:36:36.952 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968.client15243/status') 2024-09-10T10:36:36.983 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:36 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:36.680+0000 7fd4fefb3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T10:36:36.983 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:36 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:36.746+0000 7fd4fefb3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T10:36:36.983 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:36 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:36.907+0000 7fd4fefb3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T10:36:36.983 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:36 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:36.981+0000 7fd4fefb3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T10:36:37.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T10:36:37.013 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.15243 (3)192.168.0.1:0/1866907125 2024-09-10T10:36:37.013 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2024-09-10T10:36:37.013 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2024-09-10T10:36:37.013 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2024-09-10T10:36:37.013 INFO:teuthology.orchestra.run.smithi092.stderr:70 bytes copied, 2.4687e-05 s, 2.8 MB/s 2024-09-10T10:36:37.015 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T10:36:37.021 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T10:36:37.030 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T10:36:37.031 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:36:37.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-10T10:36:37.040 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:36.813+0000 7fae54ab4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:36:37.040 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:36.972+0000 7fae54ab4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:36:37.040 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:37 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:37.038+0000 7fae54ab4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:36:37.066 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:36.839+0000 7fd3a74de040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:36:37.066 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:36.999+0000 7fd3a74de040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:36:37.066 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:37.065+0000 7fd3a74de040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:36:37.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.162+0000 7f351eb59640 1 -- 172.21.15.92:0/1139676110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35181025f0 msgr2=0x7f3518108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.162+0000 7f351eb59640 1 --2- 172.21.15.92:0/1139676110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35181025f0 0x7f3518108e80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3510009ca0 tx=0x7f351002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.162+0000 7f351eb59640 1 -- 172.21.15.92:0/1139676110 shutdown_connections 2024-09-10T10:36:37.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.162+0000 7f351eb59640 1 --2- 172.21.15.92:0/1139676110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35181025f0 0x7f3518108e80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.162+0000 7f351eb59640 1 --2- 172.21.15.92:0/1139676110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3518101c30 0x7f35181020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.162+0000 7f351eb59640 1 --2- 172.21.15.92:0/1139676110 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3518100a40 0x7f3518100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.162+0000 7f351eb59640 1 -- 172.21.15.92:0/1139676110 >> 172.21.15.92:0/1139676110 conn(0x7f35180fc1e0 msgr2=0x7f35180fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.162+0000 7f351eb59640 1 -- 172.21.15.92:0/1139676110 shutdown_connections 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351eb59640 1 -- 172.21.15.92:0/1139676110 wait complete. 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351eb59640 1 Processor -- start 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351eb59640 1 -- start start 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351eb59640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3518100a40 0x7f351806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351eb59640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3518101c30 0x7f351819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351eb59640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35181025f0 0x7f351819f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351eb59640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f351810c6a0 con 0x7f3518100a40 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351eb59640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f351810c520 con 0x7f3518101c30 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351eb59640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f351810c820 con 0x7f35181025f0 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351c8f5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3518100a40 0x7f351806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351c8f5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3518100a40 0x7f351806a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36412/0 (socket says 172.21.15.92:36412) 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351c8f5640 1 -- 172.21.15.92:0/1634020731 learned_addr learned my addr 172.21.15.92:0/1634020731 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f3517fff640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3518101c30 0x7f351819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.163+0000 7f351d0f6640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35181025f0 0x7f351819f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f351c8f5640 1 -- 172.21.15.92:0/1634020731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35181025f0 msgr2=0x7f351819f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f351c8f5640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35181025f0 0x7f351819f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f351c8f5640 1 -- 172.21.15.92:0/1634020731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3518101c30 msgr2=0x7f351819cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f351c8f5640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3518101c30 0x7f351819cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f351c8f5640 1 -- 172.21.15.92:0/1634020731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351819f9e0 con 0x7f3518100a40 2024-09-10T10:36:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f351c8f5640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3518100a40 0x7f351806a410 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f350c00e9c0 tx=0x7f350c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f3515ffb640 1 -- 172.21.15.92:0/1634020731 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c00cd80 con 0x7f3518100a40 2024-09-10T10:36:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f3515ffb640 1 -- 172.21.15.92:0/1634020731 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f350c0035f0 con 0x7f3518100a40 2024-09-10T10:36:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351819fc70 con 0x7f3518100a40 2024-09-10T10:36:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f3515ffb640 1 -- 172.21.15.92:0/1634020731 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c010690 con 0x7f3518100a40 2024-09-10T10:36:37.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.164+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35181a01c0 con 0x7f3518100a40 2024-09-10T10:36:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.165+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3518107de0 con 0x7f3518100a40 2024-09-10T10:36:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.167+0000 7f3515ffb640 1 -- 172.21.15.92:0/1634020731 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f350c0037a0 con 0x7f3518100a40 2024-09-10T10:36:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.168+0000 7f3515ffb640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f35080a2c80 0x7f35080a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.168+0000 7f3517fff640 1 -- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f35080a2c80 msgr2=0x7f35080a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2834815615 2024-09-10T10:36:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.168+0000 7f3515ffb640 1 -- 172.21.15.92:0/1634020731 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f350c0cf3e0 con 0x7f3518100a40 2024-09-10T10:36:37.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.169+0000 7f3517fff640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f35080a2c80 0x7f35080a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:36:37.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.173+0000 7f3515ffb640 1 -- 172.21.15.92:0/1634020731 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f350c09c3e0 con 0x7f3518100a40 2024-09-10T10:36:37.281 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:37.045+0000 7fd4fefb3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T10:36:37.281 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:37.212+0000 7fd4fefb3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T10:36:37.281 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:37.279+0000 7fd4fefb3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T10:36:37.290 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:37 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:37.104+0000 7fae54ab4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:36:37.291 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:37 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:37.186+0000 7fae54ab4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:36:37.291 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:37 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:37.245+0000 7fae54ab4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:36:37.320 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:37.131+0000 7fd3a74de040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:36:37.320 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:37.216+0000 7fd3a74de040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:36:37.320 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:37.275+0000 7fd3a74de040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:36:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.370+0000 7f3517fff640 1 -- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f35080a2c80 msgr2=0x7f35080a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2834815615 2024-09-10T10:36:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.370+0000 7f3517fff640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f35080a2c80 0x7f35080a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T10:36:37.384 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.383+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f351802d7c0 con 0x7f3518100a40 2024-09-10T10:36:37.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.435+0000 7f3515ffb640 1 -- 172.21.15.92:0/1634020731 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f350c09bce0 con 0x7f3518100a40 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f35080a2c80 msgr2=0x7f35080a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f35080a2c80 0x7f35080a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3518100a40 msgr2=0x7f351806a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3518100a40 0x7f351806a410 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f350c00e9c0 tx=0x7f350c00ee80 comp rx=0 tx=0).stop 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 shutdown_connections 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f35080a2c80 0x7f35080a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35181025f0 0x7f351819f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3518101c30 0x7f351819cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 --2- 172.21.15.92:0/1634020731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3518100a40 0x7f351806a410 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 >> 172.21.15.92:0/1634020731 conn(0x7f35180fc1e0 msgr2=0x7f3518104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 shutdown_connections 2024-09-10T10:36:37.439 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.437+0000 7f351eb59640 1 -- 172.21.15.92:0/1634020731 wait complete. 2024-09-10T10:36:37.451 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T10:36:37.464 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T10:36:37.478 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T10:36:37.478 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:36:37.478 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-10T10:36:37.561 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:37 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1634020731' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T10:36:37.562 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:37.347+0000 7fd4fefb3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T10:36:37.562 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:37.431+0000 7fd4fefb3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T10:36:37.562 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:37.496+0000 7fd4fefb3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T10:36:37.562 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:37.558+0000 7fd4fefb3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:36:37.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.580+0000 7f3d56be8640 1 -- 172.21.15.92:0/3295403669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50102060 msgr2=0x7f3d50102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.580+0000 7f3d56be8640 1 --2- 172.21.15.92:0/3295403669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50102060 0x7f3d50102460 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009900 tx=0x7f3d4402a410 comp rx=0 tx=0).stop 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.580+0000 7f3d56be8640 1 -- 172.21.15.92:0/3295403669 shutdown_connections 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.580+0000 7f3d56be8640 1 --2- 172.21.15.92:0/3295403669 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50101670 0x7f3d50108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.580+0000 7f3d56be8640 1 --2- 172.21.15.92:0/3295403669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d50100cb0 0x7f3d50101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.580+0000 7f3d56be8640 1 --2- 172.21.15.92:0/3295403669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50102060 0x7f3d50102460 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.580+0000 7f3d56be8640 1 -- 172.21.15.92:0/3295403669 >> 172.21.15.92:0/3295403669 conn(0x7f3d500fb930 msgr2=0x7f3d500fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.580+0000 7f3d56be8640 1 -- 172.21.15.92:0/3295403669 shutdown_connections 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.580+0000 7f3d56be8640 1 -- 172.21.15.92:0/3295403669 wait complete. 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d56be8640 1 Processor -- start 2024-09-10T10:36:37.584 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d56be8640 1 -- start start 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d56be8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50100cb0 0x7f3d50197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d56be8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50101670 0x7f3d50198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d56be8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d50102060 0x7f3d5019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d56be8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5010c6e0 con 0x7f3d50100cb0 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d56be8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5010c560 con 0x7f3d50101670 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d56be8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5010c860 con 0x7f3d50102060 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d54984640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50100cb0 0x7f3d50197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d54984640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50100cb0 0x7f3d50197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36430/0 (socket says 172.21.15.92:36430) 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d54984640 1 -- 172.21.15.92:0/1071519436 learned_addr learned my addr 172.21.15.92:0/1071519436 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d55185640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d50102060 0x7f3d5019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d4ffff640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50101670 0x7f3d50198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:37.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d54984640 1 -- 172.21.15.92:0/1071519436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d50102060 msgr2=0x7f3d5019f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d54984640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d50102060 0x7f3d5019f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d54984640 1 -- 172.21.15.92:0/1071519436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50101670 msgr2=0x7f3d50198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d54984640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50101670 0x7f3d50198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d54984640 1 -- 172.21.15.92:0/1071519436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5019fa50 con 0x7f3d50100cb0 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.581+0000 7f3d54984640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50100cb0 0x7f3d50197e30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d44031610 tx=0x7f3d44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.582+0000 7f3d4dffb640 1 -- 172.21.15.92:0/1071519436 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4403f030 con 0x7f3d50100cb0 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.582+0000 7f3d4dffb640 1 -- 172.21.15.92:0/1071519436 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d44003ad0 con 0x7f3d50100cb0 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.582+0000 7f3d4dffb640 1 -- 172.21.15.92:0/1071519436 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44035070 con 0x7f3d50100cb0 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.582+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5019fce0 con 0x7f3d50100cb0 2024-09-10T10:36:37.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.582+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d501a01d0 con 0x7f3d50100cb0 2024-09-10T10:36:37.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.583+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d501a03a0 con 0x7f3d50100cb0 2024-09-10T10:36:37.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.584+0000 7f3d4dffb640 1 -- 172.21.15.92:0/1071519436 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f3d44042030 con 0x7f3d50100cb0 2024-09-10T10:36:37.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.585+0000 7f3d4dffb640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3d400a2c80 0x7f3d400a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.585+0000 7f3d4ffff640 1 -- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3d400a2c80 msgr2=0x7f3d400a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2834815615 2024-09-10T10:36:37.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.585+0000 7f3d4dffb640 1 -- 172.21.15.92:0/1071519436 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f3d440ef680 con 0x7f3d50100cb0 2024-09-10T10:36:37.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.585+0000 7f3d4ffff640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3d400a2c80 0x7f3d400a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:36:37.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.589+0000 7f3d4dffb640 1 -- 172.21.15.92:0/1071519436 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d440bc030 con 0x7f3d50100cb0 2024-09-10T10:36:37.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.759+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f3d501a0570 con 0x7f3d50100cb0 2024-09-10T10:36:37.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.763+0000 7f3d4dffb640 1 -- 172.21.15.92:0/1071519436 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7f3d440c0330 con 0x7f3d50100cb0 2024-09-10T10:36:37.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3d400a2c80 msgr2=0x7f3d400a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:36:37.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3d400a2c80 0x7f3d400a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50100cb0 msgr2=0x7f3d50197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50100cb0 0x7f3d50197e30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d44031610 tx=0x7f3d44004270 comp rx=0 tx=0).stop 2024-09-10T10:36:37.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 shutdown_connections 2024-09-10T10:36:37.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f3d400a2c80 0x7f3d400a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d50102060 0x7f3d5019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f3d50101670 0x7f3d50198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 --2- 172.21.15.92:0/1071519436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d50100cb0 0x7f3d50197e30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 >> 172.21.15.92:0/1071519436 conn(0x7f3d500fb930 msgr2=0x7f3d500ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:37.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 shutdown_connections 2024-09-10T10:36:37.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.765+0000 7f3d56be8640 1 -- 172.21.15.92:0/1071519436 wait complete. 2024-09-10T10:36:37.777 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-10T10:36:37.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:37 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1634020731' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T10:36:37.791 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:37 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:37.306+0000 7fae54ab4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:36:37.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:37 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1634020731' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T10:36:37.820 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:37.335+0000 7fd3a74de040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T10:36:37.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 -- 172.21.15.92:0/3103602358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 msgr2=0x7fbab8108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/3103602358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 0x7fbab8108e80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009ca0 tx=0x7fbab002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 -- 172.21.15.92:0/3103602358 shutdown_connections 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/3103602358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 0x7fbab8108e80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/3103602358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8101c30 0x7fbab81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/3103602358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbab8100a40 0x7fbab8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 -- 172.21.15.92:0/3103602358 >> 172.21.15.92:0/3103602358 conn(0x7fbab80fc1e0 msgr2=0x7fbab80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 -- 172.21.15.92:0/3103602358 shutdown_connections 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 -- 172.21.15.92:0/3103602358 wait complete. 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.877+0000 7fbabdeaf640 1 Processor -- start 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbabdeaf640 1 -- start start 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbabdeaf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8100a40 0x7fbab8197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbabdeaf640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbab8101c30 0x7fbab81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbabdeaf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 0x7fbab819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbabdeaf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbab810c710 con 0x7fbab81025f0 2024-09-10T10:36:37.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbabdeaf640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbab810c590 con 0x7fbab8101c30 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbabdeaf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbab810c890 con 0x7fbab8100a40 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 0x7fbab819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 0x7fbab819f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36444/0 (socket says 172.21.15.92:36444) 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab7fff640 1 -- 172.21.15.92:0/318306316 learned_addr learned my addr 172.21.15.92:0/318306316 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab6ffd640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbab8101c30 0x7fbab81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab77fe640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8100a40 0x7fbab8197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab7fff640 1 -- 172.21.15.92:0/318306316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8100a40 msgr2=0x7fbab8197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab7fff640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8100a40 0x7fbab8197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab7fff640 1 -- 172.21.15.92:0/318306316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbab8101c30 msgr2=0x7fbab81982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab7fff640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbab8101c30 0x7fbab81982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.878+0000 7fbab7fff640 1 -- 172.21.15.92:0/318306316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab819f9b0 con 0x7fbab81025f0 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.879+0000 7fbab7fff640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 0x7fbab819f310 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbab00319f0 tx=0x7fbab002f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.879+0000 7fbab4ff9640 1 -- 172.21.15.92:0/318306316 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0003c70 con 0x7fbab81025f0 2024-09-10T10:36:37.882 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.879+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab819fc40 con 0x7fbab81025f0 2024-09-10T10:36:37.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.879+0000 7fbab4ff9640 1 -- 172.21.15.92:0/318306316 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab0003e10 con 0x7fbab81025f0 2024-09-10T10:36:37.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.879+0000 7fbab4ff9640 1 -- 172.21.15.92:0/318306316 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab002fd30 con 0x7fbab81025f0 2024-09-10T10:36:37.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.879+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab81a0190 con 0x7fbab81025f0 2024-09-10T10:36:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.880+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab81a0360 con 0x7fbab81025f0 2024-09-10T10:36:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.881+0000 7fbab4ff9640 1 -- 172.21.15.92:0/318306316 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7fbab0004040 con 0x7fbab81025f0 2024-09-10T10:36:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.882+0000 7fbab4ff9640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbaa00a2c80 0x7fbaa00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.882+0000 7fbab77fe640 1 -- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbaa00a2c80 msgr2=0x7fbaa00a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2834815615 2024-09-10T10:36:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.882+0000 7fbab4ff9640 1 -- 172.21.15.92:0/318306316 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7fbab00f05b0 con 0x7fbab81025f0 2024-09-10T10:36:37.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.882+0000 7fbab77fe640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbaa00a2c80 0x7fbaa00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:36:37.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:37.886+0000 7fbab4ff9640 1 -- 172.21.15.92:0/318306316 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbab00bd5b0 con 0x7fbab81025f0 2024-09-10T10:36:38.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.054+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fbab81a0530 con 0x7fbab81025f0 2024-09-10T10:36:38.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.058+0000 7fbab4ff9640 1 -- 172.21.15.92:0/318306316 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v32)=0 v32) ==== 138+0+0 (secure 0 0 0) 0x7fbab00bceb0 con 0x7fbab81025f0 2024-09-10T10:36:38.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbaa00a2c80 msgr2=0x7fbaa00a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:36:38.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbaa00a2c80 0x7fbaa00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 msgr2=0x7fbab819f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:38.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 0x7fbab819f310 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbab00319f0 tx=0x7fbab002f450 comp rx=0 tx=0).stop 2024-09-10T10:36:38.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 shutdown_connections 2024-09-10T10:36:38.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7fbaa00a2c80 0x7fbaa00a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbab81025f0 0x7fbab819f310 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbab8101c30 0x7fbab81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 --2- 172.21.15.92:0/318306316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbab8100a40 0x7fbab8197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.061+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 >> 172.21.15.92:0/318306316 conn(0x7fbab80fc1e0 msgr2=0x7fbab80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:38.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.062+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 shutdown_connections 2024-09-10T10:36:38.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.062+0000 7fbabdeaf640 1 -- 172.21.15.92:0/318306316 wait complete. 2024-09-10T10:36:38.079 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-10T10:36:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 -- 172.21.15.92:0/1864553419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 msgr2=0x7f74c0101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 --2- 172.21.15.92:0/1864553419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 0x7f74c0101f60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009900 tx=0x7f74b402a410 comp rx=0 tx=0).stop 2024-09-10T10:36:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 -- 172.21.15.92:0/1864553419 shutdown_connections 2024-09-10T10:36:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 --2- 172.21.15.92:0/1864553419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74c0103710 0x7f74c0109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 --2- 172.21.15.92:0/1864553419 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74c0102d50 0x7f74c01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 --2- 172.21.15.92:0/1864553419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 0x7f74c0101f60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 -- 172.21.15.92:0/1864553419 >> 172.21.15.92:0/1864553419 conn(0x7f74c00fd2c0 msgr2=0x7f74c00ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:38.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 -- 172.21.15.92:0/1864553419 shutdown_connections 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 -- 172.21.15.92:0/1864553419 wait complete. 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.180+0000 7f74c6e47640 1 Processor -- start 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c6e47640 1 -- start start 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c6e47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 0x7f74c0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c6e47640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74c0102d50 0x7f74c0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c6e47640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74c0103710 0x7f74c019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c6e47640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74c010d7c0 con 0x7f74c0101b60 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c6e47640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f74c010d640 con 0x7f74c0103710 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c6e47640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f74c010d940 con 0x7f74c0102d50 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c4be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 0x7f74c0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:38.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c4be3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 0x7f74c0197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36458/0 (socket says 172.21.15.92:36458) 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c4be3640 1 -- 172.21.15.92:0/2914763606 learned_addr learned my addr 172.21.15.92:0/2914763606 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c53e4640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74c0103710 0x7f74c019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74bffff640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74c0102d50 0x7f74c0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c4be3640 1 -- 172.21.15.92:0/2914763606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74c0102d50 msgr2=0x7f74c0198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c4be3640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74c0102d50 0x7f74c0198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c4be3640 1 -- 172.21.15.92:0/2914763606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74c0103710 msgr2=0x7f74c019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c4be3640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74c0103710 0x7f74c019f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c4be3640 1 -- 172.21.15.92:0/2914763606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c019fa70 con 0x7f74c0101b60 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74bffff640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74c0102d50 0x7f74c0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.181+0000 7f74c4be3640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 0x7f74c0197e50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f74b4006010 tx=0x7f74b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.182+0000 7f74bdffb640 1 -- 172.21.15.92:0/2914763606 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b403f030 con 0x7f74c0101b60 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.182+0000 7f74bdffb640 1 -- 172.21.15.92:0/2914763606 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74b4003ce0 con 0x7f74c0101b60 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.182+0000 7f74bdffb640 1 -- 172.21.15.92:0/2914763606 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4035070 con 0x7f74c0101b60 2024-09-10T10:36:38.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.182+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c019fd00 con 0x7f74c0101b60 2024-09-10T10:36:38.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.182+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c01a0190 con 0x7f74c0101b60 2024-09-10T10:36:38.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.183+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c0108f40 con 0x7f74c0101b60 2024-09-10T10:36:38.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.184+0000 7f74bdffb640 1 -- 172.21.15.92:0/2914763606 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f74b4042030 con 0x7f74c0101b60 2024-09-10T10:36:38.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.185+0000 7f74bdffb640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74b00a2d00 0x7f74b00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:38.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.185+0000 7f74bffff640 1 -- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74b00a2d00 msgr2=0x7f74b00a51c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2834815615 2024-09-10T10:36:38.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.185+0000 7f74bdffb640 1 -- 172.21.15.92:0/2914763606 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8153+0+0 (secure 0 0 0) 0x7f74b40ef460 con 0x7f74c0101b60 2024-09-10T10:36:38.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.185+0000 7f74bffff640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74b00a2d00 0x7f74b00a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T10:36:38.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.189+0000 7f74bdffb640 1 -- 172.21.15.92:0/2914763606 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74b40bc460 con 0x7f74c0101b60 2024-09-10T10:36:38.359 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.358+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f74c0062f00 con 0x7f74c0101b60 2024-09-10T10:36:38.363 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.361+0000 7f74bdffb640 1 -- 172.21.15.92:0/2914763606 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v33)=0 v33) ==== 133+0+0 (secure 0 0 0) 0x7f74b40bbd60 con 0x7f74c0101b60 2024-09-10T10:36:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74b00a2d00 msgr2=0x7f74b00a51c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:36:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74b00a2d00 0x7f74b00a51c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 msgr2=0x7f74c0197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 0x7f74c0197e50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f74b4006010 tx=0x7f74b40042f0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.365 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 shutdown_connections 2024-09-10T10:36:38.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:6800/2834815615,v1:172.21.15.92:6801/2834815615] conn(0x7f74b00a2d00 0x7f74b00a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f74c0103710 0x7f74c019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74c0102d50 0x7f74c0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 --2- 172.21.15.92:0/2914763606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c0101b60 0x7f74c0197e50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.363+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 >> 172.21.15.92:0/2914763606 conn(0x7f74c00fd2c0 msgr2=0x7f74c0106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:38.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.364+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 shutdown_connections 2024-09-10T10:36:38.366 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.364+0000 7f74c6e47640 1 -- 172.21.15.92:0/2914763606 wait complete. 2024-09-10T10:36:38.377 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-10T10:36:38.444 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y[36577]: 2024-09-10T10:36:38.131+0000 7fd3a74de040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:36:38.445 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z[37029]: 2024-09-10T10:36:38.096+0000 7fae54ab4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:36:38.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.494+0000 7f73c80d0640 1 -- 172.21.15.92:0/1727654456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 msgr2=0x7f73c0100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:38.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.494+0000 7f73c80d0640 1 --2- 172.21.15.92:0/1727654456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 0x7f73c0100230 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009900 tx=0x7f73bc02a410 comp rx=0 tx=0).stop 2024-09-10T10:36:38.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.494+0000 7f73c80d0640 1 -- 172.21.15.92:0/1727654456 shutdown_connections 2024-09-10T10:36:38.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.494+0000 7f73c80d0640 1 --2- 172.21.15.92:0/1727654456 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c0103860 0x7f73c010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.494+0000 7f73c80d0640 1 --2- 172.21.15.92:0/1727654456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0102ea0 0x7f73c0103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.494+0000 7f73c80d0640 1 --2- 172.21.15.92:0/1727654456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 0x7f73c0100230 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.494+0000 7f73c80d0640 1 -- 172.21.15.92:0/1727654456 >> 172.21.15.92:0/1727654456 conn(0x7f73c00fb930 msgr2=0x7f73c00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:38.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.496+0000 7f73c80d0640 1 -- 172.21.15.92:0/1727654456 shutdown_connections 2024-09-10T10:36:38.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.496+0000 7f73c80d0640 1 -- 172.21.15.92:0/1727654456 wait complete. 2024-09-10T10:36:38.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.497+0000 7f73c80d0640 1 Processor -- start 2024-09-10T10:36:38.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.497+0000 7f73c80d0640 1 -- start start 2024-09-10T10:36:38.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.497+0000 7f73c80d0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 0x7f73c0197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:38.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.497+0000 7f73c80d0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0102ea0 0x7f73c0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:38.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.497+0000 7f73c80d0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c0103860 0x7f73c019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:38.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.497+0000 7f73c5e6c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 0x7f73c0197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:38.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.497+0000 7f73c5e6c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 0x7f73c0197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36526/0 (socket says 172.21.15.92:36526) 2024-09-10T10:36:38.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c566b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0102ea0 0x7f73c0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:38.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c566b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0102ea0 0x7f73c0198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:39652/0 (socket says 172.21.15.92:39652) 2024-09-10T10:36:38.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c5e6c640 1 -- 172.21.15.92:0/620816795 learned_addr learned my addr 172.21.15.92:0/620816795 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f73c010d7c0 con 0x7f73c00ffe30 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f73c010d640 con 0x7f73c0103860 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f73c010d940 con 0x7f73c0102ea0 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c666d640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c0103860 0x7f73c019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c666d640 1 -- 172.21.15.92:0/620816795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0102ea0 msgr2=0x7f73c0198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c666d640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0102ea0 0x7f73c0198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c666d640 1 -- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 msgr2=0x7f73c0197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c666d640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 0x7f73c0197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c666d640 1 -- 172.21.15.92:0/620816795 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c019fa60 con 0x7f73c0103860 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.498+0000 7f73c5e6c640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 0x7f73c0197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:36:38.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.499+0000 7f73c666d640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c0103860 0x7f73c019f3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f73b800da10 tx=0x7f73b800ded0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.499+0000 7f73b6ffd640 1 -- 172.21.15.92:0/620816795 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b800bd70 con 0x7f73c0103860 2024-09-10T10:36:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.499+0000 7f73b6ffd640 1 -- 172.21.15.92:0/620816795 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b8003e50 con 0x7f73c0103860 2024-09-10T10:36:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.499+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c019fd50 con 0x7f73c0103860 2024-09-10T10:36:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.499+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c01a01e0 con 0x7f73c0103860 2024-09-10T10:36:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.501+0000 7f73b6ffd640 1 -- 172.21.15.92:0/620816795 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b80106a0 con 0x7f73c0103860 2024-09-10T10:36:38.503 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.501+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c01090c0 con 0x7f73c0103860 2024-09-10T10:36:38.504 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.503+0000 7f73b6ffd640 1 -- 172.21.15.92:0/620816795 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7f73b8003970 con 0x7f73c0103860 2024-09-10T10:36:38.505 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.504+0000 7f73b6ffd640 1 -- 172.21.15.92:0/620816795 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8411+0+0 (secure 0 0 0) 0x7f73b80cee90 con 0x7f73c0103860 2024-09-10T10:36:38.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:38.508+0000 7f73b6ffd640 1 -- 172.21.15.92:0/620816795 <== mon.2 v2:172.21.15.97:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73b809c0e0 con 0x7f73c0103860 2024-09-10T10:36:38.679 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1634020731' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1071519436' entity='client.admin' 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/318306316' entity='client.admin' 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: Standby manager daemon z restarted 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: Standby manager daemon z started 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: Standby manager daemon y restarted 2024-09-10T10:36:38.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: Standby manager daemon y started 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2914763606' entity='client.admin' 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: Active manager daemon x restarted 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: Activating manager daemon x 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: mgrmap e20: x(active, starting, since 0.011953s), standbys: y, z 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:36:38.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:36:38.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:36:38.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:36:38.684 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:36:38.684 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:36:38.684 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:36:38.684 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-mon[30834]: Manager daemon x is now available 2024-09-10T10:36:38.684 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.389+0000 7fd4fefb3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T10:36:38.684 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.676+0000 7fd467dc8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:38.717 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1634020731' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T10:36:38.717 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:36:38.717 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1071519436' entity='client.admin' 2024-09-10T10:36:38.717 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/318306316' entity='client.admin' 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: Standby manager daemon z restarted 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: Standby manager daemon z started 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: Standby manager daemon y restarted 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: Standby manager daemon y started 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:36:38.718 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2914763606' entity='client.admin' 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: Active manager daemon x restarted 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: Activating manager daemon x 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: mgrmap e20: x(active, starting, since 0.011953s), standbys: y, z 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:36:38.719 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:36:38.720 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:36:38.721 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:38 smithi121 ceph-mon[35231]: Manager daemon x is now available 2024-09-10T10:36:38.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1634020731' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T10:36:38.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:36:38.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1071519436' entity='client.admin' 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/318306316' entity='client.admin' 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: Standby manager daemon z restarted 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: Standby manager daemon z started 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.121:0/2164186455' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: Standby manager daemon y restarted 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: Standby manager daemon y started 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T10:36:38.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.? 172.21.15.97:0/2289187810' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2914763606' entity='client.admin' 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: Active manager daemon x restarted 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: Activating manager daemon x 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: mgrmap e20: x(active, starting, since 0.011953s), standbys: y, z 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:36:38.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:36:38.823 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:36:38.823 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:36:38.823 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:36:38.823 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:36:38.823 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:36:38.823 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:36:38.823 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:36:38.823 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T10:36:38.823 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T10:36:38.824 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T10:36:38.825 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T10:36:38.825 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T10:36:38.825 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T10:36:38.825 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:38 smithi097 ceph-mon[35213]: Manager daemon x is now available 2024-09-10T10:36:38.930 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.676+0000 7fd467dc8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:38.930 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.676+0000 7fd467dc8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:38.930 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.676+0000 7fd467dc8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:38.930 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.676+0000 7fd467dc8640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:38.930 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.678+0000 7fd4655c3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:38.930 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.678+0000 7fd4655c3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:38.931 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.678+0000 7fd4655c3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:38.931 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.678+0000 7fd4655c3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:38.931 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:38.678+0000 7fd4655c3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:36:39.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.409+0000 7f73b6ffd640 1 -- 172.21.15.92:0/620816795 <== mon.2 v2:172.21.15.97:3300/0 7 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f73b8097730 con 0x7f73c0103860 2024-09-10T10:36:39.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.410+0000 7f73b6ffd640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f73ac0a9860 0x7f73ac0abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:39.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.410+0000 7f73b6ffd640 1 -- 172.21.15.92:0/620816795 --> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f73b8003e50 con 0x7f73ac0a9860 2024-09-10T10:36:39.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.411+0000 7f73c5e6c640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f73ac0a9860 0x7f73ac0abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:39.414 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.413+0000 7f73c5e6c640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f73ac0a9860 0x7f73ac0abc50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f73bc000c00 tx=0x7f73bc031510 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:39.480 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.478+0000 7f73b6ffd640 1 -- 172.21.15.92:0/620816795 <== mgr.15234 v2:172.21.15.92:6800/3516468262 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f73b8003e50 con 0x7f73ac0a9860 2024-09-10T10:36:39.480 INFO:teuthology.orchestra.run.smithi092.stdout:Schedule set for path / 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f73ac0a9860 msgr2=0x7f73ac0abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f73ac0a9860 0x7f73ac0abc50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f73bc000c00 tx=0x7f73bc031510 comp rx=0 tx=0).stop 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c0103860 msgr2=0x7f73c019f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c0103860 0x7f73c019f3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f73b800da10 tx=0x7f73b800ded0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 shutdown_connections 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f73ac0a9860 0x7f73ac0abc50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f73c0103860 0x7f73c019f3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73c0102ea0 0x7f73c0198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 --2- 172.21.15.92:0/620816795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73c00ffe30 0x7f73c0197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.480+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 >> 172.21.15.92:0/620816795 conn(0x7f73c00fb930 msgr2=0x7f73c0106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:39.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.481+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 shutdown_connections 2024-09-10T10:36:39.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.481+0000 7f73c80d0640 1 -- 172.21.15.92:0/620816795 wait complete. 2024-09-10T10:36:39.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-10T10:36:39.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.597+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3113422360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4102d50 msgr2=0x7fd3d41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.597+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3113422360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4102d50 0x7fd3d41031d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009900 tx=0x7fd3c802a410 comp rx=0 tx=0).stop 2024-09-10T10:36:39.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.597+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3113422360 shutdown_connections 2024-09-10T10:36:39.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.597+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3113422360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3d4103710 0x7fd3d4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.597+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3113422360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4102d50 0x7fd3d41031d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3113422360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3d4101b60 0x7fd3d4101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3113422360 >> 172.21.15.92:0/3113422360 conn(0x7fd3d40fd2e0 msgr2=0x7fd3d40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:39.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3113422360 shutdown_connections 2024-09-10T10:36:39.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3113422360 wait complete. 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 Processor -- start 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 -- start start 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4101b60 0x7fd3d4199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3d4102d50 0x7fd3d419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3d4103710 0x7fd3d41a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d4074d00 con 0x7fd3d4101b60 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d4074b80 con 0x7fd3d4103710 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.598+0000 7fd3d9e42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d4074e80 con 0x7fd3d4102d50 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4101b60 0x7fd3d4199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4101b60 0x7fd3d4199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36598/0 (socket says 172.21.15.92:36598) 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d37fe640 1 -- 172.21.15.92:0/3228542473 learned_addr learned my addr 172.21.15.92:0/3228542473 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:39.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d3fff640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3d4103710 0x7fd3d41a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d2ffd640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3d4102d50 0x7fd3d419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d37fe640 1 -- 172.21.15.92:0/3228542473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3d4102d50 msgr2=0x7fd3d419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d37fe640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3d4102d50 0x7fd3d419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d37fe640 1 -- 172.21.15.92:0/3228542473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3d4103710 msgr2=0x7fd3d41a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d37fe640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3d4103710 0x7fd3d41a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d37fe640 1 -- 172.21.15.92:0/3228542473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d41a1bb0 con 0x7fd3d4101b60 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d37fe640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4101b60 0x7fd3d4199f90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400ccb0 tx=0x7fd3c400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d0ff9640 1 -- 172.21.15.92:0/3228542473 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4003b70 con 0x7fd3d4101b60 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d0ff9640 1 -- 172.21.15.92:0/3228542473 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c400ae50 con 0x7fd3d4101b60 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d0ff9640 1 -- 172.21.15.92:0/3228542473 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400f810 con 0x7fd3d4101b60 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d41a1ea0 con 0x7fd3d4101b60 2024-09-10T10:36:39.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.599+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d41a2310 con 0x7fd3d4101b60 2024-09-10T10:36:39.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.600+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d41a25a0 con 0x7fd3d4101b60 2024-09-10T10:36:39.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.602+0000 7fd3d0ff9640 1 -- 172.21.15.92:0/3228542473 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fd3c400f9b0 con 0x7fd3d4101b60 2024-09-10T10:36:39.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.603+0000 7fd3d0ff9640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd3bc0a2ac0 0x7fd3bc0a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:39.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.603+0000 7fd3d0ff9640 1 -- 172.21.15.92:0/3228542473 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8411+0+0 (secure 0 0 0) 0x7fd3c40cf1a0 con 0x7fd3d4101b60 2024-09-10T10:36:39.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.603+0000 7fd3d2ffd640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd3bc0a2ac0 0x7fd3bc0a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:39.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.604+0000 7fd3d2ffd640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd3bc0a2ac0 0x7fd3bc0a4f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8006010 tx=0x7fd3c8000bc0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:39.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.606+0000 7fd3d0ff9640 1 -- 172.21.15.92:0/3228542473 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3c4014070 con 0x7fd3d4101b60 2024-09-10T10:36:39.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:39 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:36:39.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:39 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:36:39.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:39 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:36:39.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:39 smithi121 ceph-mon[35231]: mgrmap e21: x(active, since 1.01745s), standbys: y, z 2024-09-10T10:36:39.763 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:39 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:36:39.764 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:39 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:36:39.764 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:39 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:36:39.764 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:39 smithi097 ceph-mon[35213]: mgrmap e21: x(active, since 1.01745s), standbys: y, z 2024-09-10T10:36:39.803 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:39 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:36:39.804 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:39 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T10:36:39.804 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:39 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T10:36:39.804 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:39 smithi092 ceph-mon[30834]: mgrmap e21: x(active, since 1.01745s), standbys: y, z 2024-09-10T10:36:39.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.809+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 --> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fd3d40fe130 con 0x7fd3bc0a2ac0 2024-09-10T10:36:39.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.863+0000 7fd3d0ff9640 1 -- 172.21.15.92:0/3228542473 <== mgr.15234 v2:172.21.15.92:6800/3516468262 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fd3d40fe130 con 0x7fd3bc0a2ac0 2024-09-10T10:36:39.865 INFO:teuthology.orchestra.run.smithi092.stdout:Retention added to path / 2024-09-10T10:36:39.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.865+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd3bc0a2ac0 msgr2=0x7fd3bc0a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd3bc0a2ac0 0x7fd3bc0a4f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8006010 tx=0x7fd3c8000bc0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4101b60 msgr2=0x7fd3d4199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4101b60 0x7fd3d4199f90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400ccb0 tx=0x7fd3c400a620 comp rx=0 tx=0).stop 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 shutdown_connections 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd3bc0a2ac0 0x7fd3bc0a4f80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd3d4103710 0x7fd3d41a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3d4102d50 0x7fd3d419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 --2- 172.21.15.92:0/3228542473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3d4101b60 0x7fd3d4199f90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 >> 172.21.15.92:0/3228542473 conn(0x7fd3d40fd2e0 msgr2=0x7fd3d40fda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 shutdown_connections 2024-09-10T10:36:39.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.866+0000 7fd3d9e42640 1 -- 172.21.15.92:0/3228542473 wait complete. 2024-09-10T10:36:39.878 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T10:36:39.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/2489530969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58101b60 msgr2=0x7f7e58101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/2489530969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58101b60 0x7f7e58101f60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009900 tx=0x7f7e4802a410 comp rx=0 tx=0).stop 2024-09-10T10:36:39.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/2489530969 shutdown_connections 2024-09-10T10:36:39.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/2489530969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e58103710 0x7f7e58109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/2489530969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e58102d50 0x7f7e581031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/2489530969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58101b60 0x7f7e58101f60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/2489530969 >> 172.21.15.92:0/2489530969 conn(0x7f7e580fd2e0 msgr2=0x7f7e580ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/2489530969 shutdown_connections 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/2489530969 wait complete. 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.978+0000 7f7e5e8d0640 1 Processor -- start 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e5e8d0640 1 -- start start 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e5e8d0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e58101b60 0x7f7e58197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e5e8d0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58102d50 0x7f7e58198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e5e8d0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e58103710 0x7f7e5819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e5e8d0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5810d7e0 con 0x7f7e58102d50 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e5e8d0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5810d660 con 0x7f7e58101b60 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e5e8d0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5810d960 con 0x7f7e58103710 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58102d50 0x7f7e58198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:39.983 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e577fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58102d50 0x7f7e58198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36616/0 (socket says 172.21.15.92:36616) 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e577fe640 1 -- 172.21.15.92:0/1409868173 learned_addr learned my addr 172.21.15.92:0/1409868173 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e5ce6d640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e58103710 0x7f7e5819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e57fff640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e58101b60 0x7f7e58197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e577fe640 1 -- 172.21.15.92:0/1409868173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e58103710 msgr2=0x7f7e5819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e577fe640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e58103710 0x7f7e5819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e577fe640 1 -- 172.21.15.92:0/1409868173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e58101b60 msgr2=0x7f7e58197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e577fe640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e58101b60 0x7f7e58197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e577fe640 1 -- 172.21.15.92:0/1409868173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5819f9f0 con 0x7f7e58102d50 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.979+0000 7f7e577fe640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58102d50 0x7f7e58198310 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00d950 tx=0x7f7e4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.980+0000 7f7e557fa640 1 -- 172.21.15.92:0/1409868173 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c017070 con 0x7f7e58102d50 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.980+0000 7f7e557fa640 1 -- 172.21.15.92:0/1409868173 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e4c009c30 con 0x7f7e58102d50 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.980+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5819fce0 con 0x7f7e58102d50 2024-09-10T10:36:39.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.980+0000 7f7e557fa640 1 -- 172.21.15.92:0/1409868173 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c00f6b0 con 0x7f7e58102d50 2024-09-10T10:36:39.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.980+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e581a0220 con 0x7f7e58102d50 2024-09-10T10:36:39.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.981+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e58108f00 con 0x7f7e58102d50 2024-09-10T10:36:39.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.982+0000 7f7e557fa640 1 -- 172.21.15.92:0/1409868173 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f7e4c0109d0 con 0x7f7e58102d50 2024-09-10T10:36:39.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.982+0000 7f7e557fa640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7e400a2ac0 0x7f7e400a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:39.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.982+0000 7f7e57fff640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7e400a2ac0 0x7f7e400a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:39.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.982+0000 7f7e557fa640 1 -- 172.21.15.92:0/1409868173 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8411+0+0 (secure 0 0 0) 0x7f7e4c0ce7d0 con 0x7f7e58102d50 2024-09-10T10:36:39.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.983+0000 7f7e57fff640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7e400a2ac0 0x7f7e400a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e48005ab0 tx=0x7f7e48000bc0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:39.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:39.987+0000 7f7e557fa640 1 -- 172.21.15.92:0/1409868173 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e4c009de0 con 0x7f7e58102d50 2024-09-10T10:36:40.111 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:40.010+0000 7fd45285e640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:10:36:40] ENGINE Error in HTTPServer.serve 2024-09-10T10:36:40.111 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: Traceback (most recent call last): 2024-09-10T10:36:40.111 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self._connections.run(self.expiration_interval) 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self._run(expiration_interval) 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: s = self.context.wrap_socket( 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: return self.sslsocket_class._create( 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:36:40.112 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self.do_handshake() 2024-09-10T10:36:40.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:36:40.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: self._sslobj.do_handshake() 2024-09-10T10:36:40.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:36:40.113 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:36:40.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.211+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 --> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f7e58062630 con 0x7f7e400a2ac0 2024-09-10T10:36:40.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.218+0000 7f7e557fa640 1 -- 172.21.15.92:0/1409868173 <== mgr.15234 v2:172.21.15.92:6800/3516468262 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f7e58062630 con 0x7f7e400a2ac0 2024-09-10T10:36:40.219 INFO:teuthology.orchestra.run.smithi092.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T10:36:39", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-10T10:36:40.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7e400a2ac0 msgr2=0x7f7e400a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:40.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7e400a2ac0 0x7f7e400a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e48005ab0 tx=0x7f7e48000bc0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58102d50 msgr2=0x7f7e58198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:40.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58102d50 0x7f7e58198310 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c00d950 tx=0x7f7e4c00de10 comp rx=0 tx=0).stop 2024-09-10T10:36:40.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 shutdown_connections 2024-09-10T10:36:40.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e58103710 0x7f7e5819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e58102d50 0x7f7e58198310 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7e400a2ac0 0x7f7e400a4f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 --2- 172.21.15.92:0/1409868173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7e58101b60 0x7f7e58197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.220+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 >> 172.21.15.92:0/1409868173 conn(0x7f7e580fd2e0 msgr2=0x7f7e581060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:40.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.221+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 shutdown_connections 2024-09-10T10:36:40.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.221+0000 7f7e5e8d0640 1 -- 172.21.15.92:0/1409868173 wait complete. 2024-09-10T10:36:40.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T10:36:40.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.343+0000 7f2033f52640 1 -- 172.21.15.92:0/2111020575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c104fa0 msgr2=0x7f202c107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:40.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.343+0000 7f2033f52640 1 --2- 172.21.15.92:0/2111020575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c104fa0 0x7f202c107390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f201c009900 tx=0x7f201c02a410 comp rx=0 tx=0).stop 2024-09-10T10:36:40.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 -- 172.21.15.92:0/2111020575 shutdown_connections 2024-09-10T10:36:40.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 --2- 172.21.15.92:0/2111020575 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c1078d0 0x7f202c109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 --2- 172.21.15.92:0/2111020575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c104fa0 0x7f202c107390 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 --2- 172.21.15.92:0/2111020575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f202c102670 0x7f202c104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 -- 172.21.15.92:0/2111020575 >> 172.21.15.92:0/2111020575 conn(0x7f202c0fc1b0 msgr2=0x7f202c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:40.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 -- 172.21.15.92:0/2111020575 shutdown_connections 2024-09-10T10:36:40.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 -- 172.21.15.92:0/2111020575 wait complete. 2024-09-10T10:36:40.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 Processor -- start 2024-09-10T10:36:40.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 -- start start 2024-09-10T10:36:40.349 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c102670 0x7f202c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:40.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f202c104fa0 0x7f202c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:40.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c1078d0 0x7f202c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:40.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f202c10d810 con 0x7f202c102670 2024-09-10T10:36:40.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f202c10d690 con 0x7f202c1078d0 2024-09-10T10:36:40.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2033f52640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f202c10d990 con 0x7f202c104fa0 2024-09-10T10:36:40.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.344+0000 7f2031cee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c102670 0x7f202c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:40.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2031cee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c102670 0x7f202c197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36634/0 (socket says 172.21.15.92:36634) 2024-09-10T10:36:40.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2031cee640 1 -- 172.21.15.92:0/476759975 learned_addr learned my addr 172.21.15.92:0/476759975 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:40.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f20314ed640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f202c104fa0 0x7f202c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:40.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f20324ef640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c1078d0 0x7f202c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:40.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2031cee640 1 -- 172.21.15.92:0/476759975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f202c104fa0 msgr2=0x7f202c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:40.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2031cee640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f202c104fa0 0x7f202c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2031cee640 1 -- 172.21.15.92:0/476759975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c1078d0 msgr2=0x7f202c19f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2031cee640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c1078d0 0x7f202c19f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2031cee640 1 -- 172.21.15.92:0/476759975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c19fa80 con 0x7f202c102670 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f20324ef640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c1078d0 0x7f202c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2031cee640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c102670 0x7f202c197e60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f202800d950 tx=0x7f202800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f20314ed640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f202c104fa0 0x7f202c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2022ffd640 1 -- 172.21.15.92:0/476759975 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028017030 con 0x7f202c102670 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.345+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202c19fd70 con 0x7f202c102670 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.346+0000 7f2022ffd640 1 -- 172.21.15.92:0/476759975 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2028004020 con 0x7f202c102670 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.346+0000 7f2022ffd640 1 -- 172.21.15.92:0/476759975 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280047a0 con 0x7f202c102670 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.346+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f202c1a01d0 con 0x7f202c102670 2024-09-10T10:36:40.352 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.347+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f202c0fdca0 con 0x7f202c102670 2024-09-10T10:36:40.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.348+0000 7f2022ffd640 1 -- 172.21.15.92:0/476759975 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f20280041d0 con 0x7f202c102670 2024-09-10T10:36:40.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.348+0000 7f2022ffd640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20180a2a40 0x7f20180a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:40.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.349+0000 7f20314ed640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20180a2a40 0x7f20180a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:40.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.349+0000 7f2022ffd640 1 -- 172.21.15.92:0/476759975 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8411+0+0 (secure 0 0 0) 0x7f20280cedb0 con 0x7f202c102670 2024-09-10T10:36:40.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.349+0000 7f20314ed640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20180a2a40 0x7f20180a4f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f201c02aa00 tx=0x7f201c000bc0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:40.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.352+0000 7f2022ffd640 1 -- 172.21.15.92:0/476759975 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2028021020 con 0x7f202c102670 2024-09-10T10:36:40.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.564+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 --> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f202c062630 con 0x7f20180a2a40 2024-09-10T10:36:40.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.571+0000 7f2022ffd640 1 -- 172.21.15.92:0/476759975 <== mgr.15234 v2:172.21.15.92:6800/3516468262 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f202c062630 con 0x7f20180a2a40 2024-09-10T10:36:40.572 INFO:teuthology.orchestra.run.smithi092.stdout:/ 1m 6m3h 2024-09-10T10:36:40.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.572+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20180a2a40 msgr2=0x7f20180a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:40.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.572+0000 7f2033f52640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20180a2a40 0x7f20180a4f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f201c02aa00 tx=0x7f201c000bc0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c102670 msgr2=0x7f202c197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:40.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c102670 0x7f202c197e60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f202800d950 tx=0x7f202800de10 comp rx=0 tx=0).stop 2024-09-10T10:36:40.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 shutdown_connections 2024-09-10T10:36:40.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20180a2a40 0x7f20180a4f00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f202c1078d0 0x7f202c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f202c104fa0 0x7f202c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 --2- 172.21.15.92:0/476759975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f202c102670 0x7f202c197e60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:40.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 >> 172.21.15.92:0/476759975 conn(0x7f202c0fc1b0 msgr2=0x7f202c103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:40.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 shutdown_connections 2024-09-10T10:36:40.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:36:40.573+0000 7f2033f52640 1 -- 172.21.15.92:0/476759975 wait complete. 2024-09-10T10:36:40.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: [10/Sep/2024:10:36:39] ENGINE Bus STARTING 2024-09-10T10:36:40.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: [10/Sep/2024:10:36:40] ENGINE Serving on https://172.21.15.92:7150 2024-09-10T10:36:40.584 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: [10/Sep/2024:10:36:40] ENGINE Error in HTTPServer.serve 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: Traceback (most recent call last): 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._run(expiration_interval) 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: s = self.context.wrap_socket( 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:36:40.585 INFO:journalctl@ceph.mon.a.smithi092.stdout: return self.sslsocket_class._create( 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout: self.do_handshake() 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout: self._sslobj.do_handshake() 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: [10/Sep/2024:10:36:40] ENGINE Serving on http://172.21.15.92:8765 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: [10/Sep/2024:10:36:40] ENGINE Bus STARTED 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:40 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.587 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-10T10:36:40.615 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-10T10:36:40.625 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-10T10:36:40.638 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:36:40.638 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-10T10:36:40.657 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T10:36:40.668 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T10:36:40.668 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:36:40.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-10T10:36:40.706 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:40.721 INFO:teuthology.orchestra.run.smithi092.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-10T10:36:40.721 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:3300,172.21.15.97:3300,172.21.15.121:3300:/volumes/qa/sv_1/1d1ba3c6-c144-4c8e-abf8-c335e9ab9eb2 340G 0 340G 0% /tmp/cephfs 2024-09-10T10:36:40.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: [10/Sep/2024:10:36:39] ENGINE Bus STARTING 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: [10/Sep/2024:10:36:40] ENGINE Serving on https://172.21.15.92:7150 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: [10/Sep/2024:10:36:40] ENGINE Error in HTTPServer.serve 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout: Traceback (most recent call last): 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout: self._run(expiration_interval) 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:36:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout: s = self.context.wrap_socket( 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout: return self.sslsocket_class._create( 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout: self.do_handshake() 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout: self._sslobj.do_handshake() 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: [10/Sep/2024:10:36:40] ENGINE Serving on http://172.21.15.92:8765 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: [10/Sep/2024:10:36:40] ENGINE Bus STARTED 2024-09-10T10:36:40.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:40.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.793 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:40 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.815 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: [10/Sep/2024:10:36:39] ENGINE Bus STARTING 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: [10/Sep/2024:10:36:40] ENGINE Serving on https://172.21.15.92:7150 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: [10/Sep/2024:10:36:40] ENGINE Error in HTTPServer.serve 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: Traceback (most recent call last): 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: self._connections.run(self.expiration_interval) 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: self._run(expiration_interval) 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T10:36:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout: s = self.context.wrap_socket( 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout: return self.sslsocket_class._create( 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout: self.do_handshake() 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout: self._sslobj.do_handshake() 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: [10/Sep/2024:10:36:40] ENGINE Serving on http://172.21.15.92:8765 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: [10/Sep/2024:10:36:40] ENGINE Bus STARTED 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.821 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:40 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:40.854 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-10T10:36:42.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:36:42.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:42.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: Unable to set osd_memory_target on smithi121 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi097 to 176.0M 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: Unable to set osd_memory_target on smithi097 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.322 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: Unable to set osd_memory_target on smithi092 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: Updating smithi097:/etc/ceph/ceph.conf 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-10T10:36:42.323 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:42 smithi097 ceph-mon[35213]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-10T10:36:42.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:36:42.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:42.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: Unable to set osd_memory_target on smithi121 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi097 to 176.0M 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: Unable to set osd_memory_target on smithi097 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.362 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-10T10:36:42.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: Unable to set osd_memory_target on smithi092 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-10T10:36:42.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:36:42.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:36:42.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-10T10:36:42.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: Updating smithi097:/etc/ceph/ceph.conf 2024-09-10T10:36:42.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-10T10:36:42.363 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:42 smithi092 ceph-mon[30834]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-10T10:36:42.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:36:42.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:36:42.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-10T10:36:42.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: Unable to set osd_memory_target on smithi121 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T10:36:42.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi097 to 176.0M 2024-09-10T10:36:42.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: Unable to set osd_memory_target on smithi097 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-10T10:36:42.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.543 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:42.544 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.544 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.544 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.544 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:36:42.544 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-10T10:36:42.544 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: Unable to set osd_memory_target on smithi092 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-10T10:36:42.544 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:36:42.544 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:36:42.544 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-10T10:36:42.545 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: Updating smithi097:/etc/ceph/ceph.conf 2024-09-10T10:36:42.545 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-10T10:36:42.545 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:42 smithi121 ceph-mon[35231]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-10T10:36:42.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-10T10:36:43.000 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-10T10:36:43.002 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-10T10:36:43.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: Updating smithi097:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:36:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:36:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:36:43.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.145 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/: 2024-09-10T10:36:43.145 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:43.146 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:36:43.146 INFO:teuthology.orchestra.run.smithi092.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 .. 2024-09-10T10:36:43.146 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 data 2024-09-10T10:36:43.146 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:43.146 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data: 2024-09-10T10:36:43.146 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:43.146 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:43.146 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 .. 2024-09-10T10:36:43.148 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-10T10:36:43.230 INFO:teuthology.orchestra.run.smithi092.stdout:[Service] 2024-09-10T10:36:43.230 INFO:teuthology.orchestra.run.smithi092.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-10T10:36:43.230 INFO:teuthology.orchestra.run.smithi092.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-10T10:36:43.233 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-10T10:36:43.354 INFO:teuthology.orchestra.run.smithi092.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-10T10:36:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:36:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:36:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:36:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:36:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:36:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: Updating smithi097:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:36:43.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:36:43.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:36:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:36:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T10:36:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:36:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:36:43.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: Updating smithi097:/etc/ceph/ceph.client.admin.keyring 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: Updating smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: Updating smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: Updating smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:36:43.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:36:43.572 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:36:44.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:44 smithi092 ceph-mon[30834]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:36:44.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:44 smithi092 ceph-mon[30834]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-09-10T10:36:44.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:44 smithi121 ceph-mon[35231]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:36:44.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:44 smithi121 ceph-mon[35231]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-09-10T10:36:44.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:44 smithi097 ceph-mon[35213]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:36:44.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:44 smithi097 ceph-mon[35213]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-09-10T10:36:46.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:46 smithi092 ceph-mon[30834]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 103 KiB/s wr, 71 op/s 2024-09-10T10:36:46.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:46 smithi121 ceph-mon[35231]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 103 KiB/s wr, 71 op/s 2024-09-10T10:36:46.573 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:46 smithi097 ceph-mon[35213]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 103 KiB/s wr, 71 op/s 2024-09-10T10:36:48.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:48 smithi092 ceph-mon[30834]: pgmap v7: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 246 KiB/s wr, 85 op/s 2024-09-10T10:36:48.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:48 smithi121 ceph-mon[35231]: pgmap v7: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 246 KiB/s wr, 85 op/s 2024-09-10T10:36:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:48 smithi097 ceph-mon[35213]: pgmap v7: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 246 KiB/s wr, 85 op/s 2024-09-10T10:36:50.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:50 smithi092 ceph-mon[30834]: pgmap v8: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 191 KiB/s wr, 66 op/s 2024-09-10T10:36:50.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:50 smithi121 ceph-mon[35231]: pgmap v8: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 191 KiB/s wr, 66 op/s 2024-09-10T10:36:50.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:50 smithi097 ceph-mon[35213]: pgmap v8: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 191 KiB/s wr, 66 op/s 2024-09-10T10:36:51.677 INFO:teuthology.orchestra.run.smithi092.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-10T10:36:51.681 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-10T10:36:51.723 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/: 2024-09-10T10:36:51.723 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.724 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:36:51.724 INFO:teuthology.orchestra.run.smithi092.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 .. 2024-09-10T10:36:51.724 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 data 2024-09-10T10:36:51.724 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.724 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data: 2024-09-10T10:36:51.724 INFO:teuthology.orchestra.run.smithi092.stdout:total 35 2024-09-10T10:36:51.724 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 . 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 .. 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 base 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 10 10:36 global 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 log 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_commit_ts 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_dynshmem 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 10 10:36 pg_hba.conf 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 10 10:36 pg_ident.conf 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 pg_logical 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 pg_multixact 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_notify 2024-09-10T10:36:51.725 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_replslot 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_serial 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_snapshots 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_stat 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_stat_tmp 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 pg_subtrans 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_tblspc 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_twophase 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 PG_VERSION 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 pg_wal 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 pg_xact 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 10 10:36 postgresql.auto.conf 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 10 10:36 postgresql.conf 2024-09-10T10:36:51.726 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base: 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 . 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 1 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 13493 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 13494 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 . 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 .. 2024-09-10T10:36:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 112 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 113 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 1247 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1247_fsm 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1247_vm 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 10:36 1249 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1249_fsm 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1249_vm 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 10:36 1255 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1255_fsm 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1255_vm 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 10:36 1259 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1259_fsm 2024-09-10T10:36:51.728 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1259_vm 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 10:36 13344 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13344_fsm 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13344_vm 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13346 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13348 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13349_fsm 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349_vm 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13351 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13353 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13354_fsm 2024-09-10T10:36:51.729 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354_vm 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13356 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13358 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13359_fsm 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359_vm 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13361 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13363 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1417 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1418 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 174 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 175 2024-09-10T10:36:51.730 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2187 2024-09-10T10:36:51.731 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2224 2024-09-10T10:36:51.731 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2328 2024-09-10T10:36:51.731 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2336 2024-09-10T10:36:51.731 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2337 2024-09-10T10:36:51.731 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2579 2024-09-10T10:36:51.731 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2600 2024-09-10T10:36:51.731 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2600_fsm 2024-09-10T10:36:51.731 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2600_vm 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2601_fsm 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601_vm 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2602 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2602_fsm 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2602_vm 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2603 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2603_fsm 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2603_vm 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2604 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2605 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2605_fsm 2024-09-10T10:36:51.732 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2605_vm 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2606_fsm 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606_vm 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2607 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2607_fsm 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2607_vm 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 10:36 2608 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2608_fsm 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2608_vm 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 10:36 2609 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2609_fsm 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2609_vm 2024-09-10T10:36:51.733 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2610 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2610_fsm 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2610_vm 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2611 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2612_fsm 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612_vm 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2613 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2615_fsm 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615_vm 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2616 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2616_fsm 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2616_vm 2024-09-10T10:36:51.734 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 10:36 2617 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2617_fsm 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2617_vm 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 10:36 2618 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2618_fsm 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2618_vm 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 10:36 2619 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2619_fsm 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2619_vm 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2620 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2650 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2651 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2652 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2653 2024-09-10T10:36:51.735 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2654 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2655 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2656 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2657 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 10:36 2658 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 2659 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2660 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2661 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2662 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2663 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2664 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2665 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2666 2024-09-10T10:36:51.736 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2667 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2668 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2669 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2670 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 10:36 2673 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 10:36 2674 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 10:36 2675 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2678 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2679 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2680 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2681 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2682 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2683 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2684 2024-09-10T10:36:51.737 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2685 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2686 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2687 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2688 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2689 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 10:36 2690 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 10:36 2691 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2692 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2693 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2696 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2699 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2701 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2702 2024-09-10T10:36:51.738 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2703 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2704 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2753 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2753_fsm 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2753_vm 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2754 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2755 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2756 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2757 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2830 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2831 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2832 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2833 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2834 2024-09-10T10:36:51.739 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2835 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2836 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2837 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 10:36 2838 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2838_fsm 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2838_vm 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2839 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840_fsm 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2840_vm 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2841 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2995 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2996 2024-09-10T10:36:51.740 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079 2024-09-10T10:36:51.741 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3079_fsm 2024-09-10T10:36:51.741 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079_vm 2024-09-10T10:36:51.741 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3080 2024-09-10T10:36:51.741 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3081 2024-09-10T10:36:51.741 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3085 2024-09-10T10:36:51.741 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3118 2024-09-10T10:36:51.741 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3119 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 10:36 3164 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3256 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3257 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3258 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3350 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3351 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3379 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3380 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3381 2024-09-10T10:36:51.742 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3394 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3394_fsm 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3394_vm 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3395 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3429 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3430 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3431 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3433 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3439 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3440 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3455 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 10:36 3456 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3456_fsm 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3456_vm 2024-09-10T10:36:51.743 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3466 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3467 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3468 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3501 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3502 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3503 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3534 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3541_fsm 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541_vm 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3542 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3574 2024-09-10T10:36:51.744 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3575 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3576 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3596 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3597 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3598 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3599 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3600_fsm 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600_vm 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3601_fsm 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601_vm 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602 2024-09-10T10:36:51.745 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3602_fsm 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602_vm 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603_fsm 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3603_vm 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3604 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3605 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3606 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3607 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3608 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 3609 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3712 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3764_fsm 2024-09-10T10:36:51.746 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764_vm 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3766 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3767 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3997 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4143 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4144 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4145 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4146 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4147 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4148 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4149 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4150 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4151 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4152 2024-09-10T10:36:51.747 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4153 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4154 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4155 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4156 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4157 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4158 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4159 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4160 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4161 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4162 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4163 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4164 2024-09-10T10:36:51.748 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4165 2024-09-10T10:36:51.751 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4166 2024-09-10T10:36:51.751 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4167 2024-09-10T10:36:51.751 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4168 2024-09-10T10:36:51.751 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4169 2024-09-10T10:36:51.751 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4170 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4171 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4172 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4173 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4174 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 5002 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 548 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 549 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6102 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6104 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6106 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6110 2024-09-10T10:36:51.752 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6111 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6112 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6113 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6117 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 826 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 827 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 828 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 10:36 pg_filenode.map 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 PG_VERSION 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 . 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 .. 2024-09-10T10:36:51.753 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 112 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 113 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 1247 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1247_fsm 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1247_vm 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 10:36 1249 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1249_fsm 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1249_vm 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 10:36 1255 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1255_fsm 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1255_vm 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 10:36 1259 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1259_fsm 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1259_vm 2024-09-10T10:36:51.754 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 10:36 13344 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13344_fsm 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13344_vm 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13346 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13348 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13349_fsm 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349_vm 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13351 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13353 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13354_fsm 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354_vm 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13356 2024-09-10T10:36:51.755 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13358 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13359_fsm 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359_vm 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13361 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13363 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1417 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1418 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 174 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 175 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2187 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2224 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2328 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2336 2024-09-10T10:36:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2337 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2579 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2600 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2600_fsm 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2600_vm 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2601_fsm 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601_vm 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2602 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2602_fsm 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2602_vm 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2603 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2603_fsm 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2603_vm 2024-09-10T10:36:51.757 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2604 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2605 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2605_fsm 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2605_vm 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2606_fsm 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606_vm 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2607 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2607_fsm 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2607_vm 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 10:36 2608 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2608_fsm 2024-09-10T10:36:51.758 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2608_vm 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 10:36 2609 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2609_fsm 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2609_vm 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2610 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2610_fsm 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2610_vm 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2611 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2612_fsm 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612_vm 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2613 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2615_fsm 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615_vm 2024-09-10T10:36:51.759 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2616 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2616_fsm 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2616_vm 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 10:36 2617 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2617_fsm 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2617_vm 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 10:36 2618 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2618_fsm 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2618_vm 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 10:36 2619 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2619_fsm 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2619_vm 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2620 2024-09-10T10:36:51.760 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2650 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2651 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2652 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2653 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2654 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2655 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2656 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2657 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 10:36 2658 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 2659 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2660 2024-09-10T10:36:51.761 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2661 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2662 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2663 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2664 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2665 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2666 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2667 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2668 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2669 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2670 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 10:36 2673 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 10:36 2674 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 10:36 2675 2024-09-10T10:36:51.762 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2678 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2679 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2680 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2681 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2682 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2683 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2684 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2685 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2686 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2687 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2688 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2689 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 10:36 2690 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 10:36 2691 2024-09-10T10:36:51.763 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2692 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2693 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2696 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2699 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2701 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2702 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2703 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2704 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2753 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2753_fsm 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2753_vm 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2754 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2755 2024-09-10T10:36:51.764 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2756 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2757 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2830 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2831 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2832 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2833 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2834 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2835 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2836 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2837 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 10:36 2838 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2838_fsm 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2838_vm 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2839 2024-09-10T10:36:51.765 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840_fsm 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2840_vm 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2841 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2995 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2996 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3079_fsm 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079_vm 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3080 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3081 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3085 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3118 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3119 2024-09-10T10:36:51.766 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 10:36 3164 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3256 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3257 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3258 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3350 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3351 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3379 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3380 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3381 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3394 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3394_fsm 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3394_vm 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3395 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3429 2024-09-10T10:36:51.767 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3430 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3431 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3433 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3439 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3440 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3455 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 10:36 3456 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3456_fsm 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3456_vm 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3466 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3467 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3468 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3501 2024-09-10T10:36:51.768 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3502 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3503 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3534 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3541_fsm 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541_vm 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3542 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3574 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3575 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3576 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3596 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3597 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3598 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3599 2024-09-10T10:36:51.769 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3600_fsm 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600_vm 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3601_fsm 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601_vm 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3602_fsm 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602_vm 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603_fsm 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3603_vm 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3604 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3605 2024-09-10T10:36:51.770 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3606 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3607 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3608 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 3609 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3712 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3764_fsm 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764_vm 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3766 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3767 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3997 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4143 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4144 2024-09-10T10:36:51.771 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4145 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4146 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4147 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4148 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4149 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4150 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4151 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4152 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4153 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4154 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4155 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4156 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4157 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4158 2024-09-10T10:36:51.772 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4159 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4160 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4161 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4162 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4163 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4164 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4165 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4166 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4167 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4168 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4169 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4170 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4171 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4172 2024-09-10T10:36:51.773 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4173 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4174 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 5002 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 548 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 549 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6102 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6104 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6106 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6110 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6111 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6112 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6113 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6117 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 826 2024-09-10T10:36:51.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 827 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 828 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 10:36 pg_filenode.map 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 PG_VERSION 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 . 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 .. 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 112 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 113 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 1247 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1247_fsm 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1247_vm 2024-09-10T10:36:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 10:36 1249 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1249_fsm 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1249_vm 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 10:36 1255 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1255_fsm 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1255_vm 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 10:36 1259 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1259_fsm 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1259_vm 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 10:36 13344 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13344_fsm 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13344_vm 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13346 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13348 2024-09-10T10:36:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13349_fsm 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349_vm 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13351 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13353 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13354_fsm 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354_vm 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13356 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13358 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13359_fsm 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359_vm 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13361 2024-09-10T10:36:51.777 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13363 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1417 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1418 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 174 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 175 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2187 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2224 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2328 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2336 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2337 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2579 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2600 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2600_fsm 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2600_vm 2024-09-10T10:36:51.778 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2601_fsm 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601_vm 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2602 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2602_fsm 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2602_vm 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2603 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2603_fsm 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2603_vm 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2604 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2605 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2605_fsm 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2605_vm 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606 2024-09-10T10:36:51.779 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2606_fsm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606_vm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2607 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2607_fsm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2607_vm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 10:36 2608 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2608_fsm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2608_vm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 10:36 2609 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2609_fsm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2609_vm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2610 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2610_fsm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2610_vm 2024-09-10T10:36:51.780 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2611 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2612_fsm 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612_vm 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2613 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2615_fsm 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615_vm 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2616 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2616_fsm 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2616_vm 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 10:36 2617 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2617_fsm 2024-09-10T10:36:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2617_vm 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 10:36 2618 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2618_fsm 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2618_vm 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 10:36 2619 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2619_fsm 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2619_vm 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2620 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2650 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2651 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2652 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2653 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2654 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2655 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2656 2024-09-10T10:36:51.782 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2657 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 10:36 2658 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 2659 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2660 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2661 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2662 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2663 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2664 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2665 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2666 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2667 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2668 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2669 2024-09-10T10:36:51.783 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2670 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 10:36 2673 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 10:36 2674 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 10:36 2675 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2678 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2679 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2680 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2681 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2682 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2683 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2684 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2685 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2686 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2687 2024-09-10T10:36:51.784 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2688 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2689 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 10:36 2690 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 10:36 2691 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2692 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2693 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2696 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2699 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2701 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2702 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2703 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2704 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2753 2024-09-10T10:36:51.785 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2753_fsm 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2753_vm 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2754 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2755 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2756 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2757 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2830 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2831 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2832 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2833 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2834 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2835 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2836 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2837 2024-09-10T10:36:51.786 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 10:36 2838 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2838_fsm 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2838_vm 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2839 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840_fsm 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2840_vm 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2841 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2995 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2996 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3079_fsm 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079_vm 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3080 2024-09-10T10:36:51.787 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3081 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3085 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3118 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3119 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 10:36 3164 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3256 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3257 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3258 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3350 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3351 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3379 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3380 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3381 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3394 2024-09-10T10:36:51.788 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3394_fsm 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3394_vm 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3395 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3429 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3430 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3431 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3433 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3439 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3440 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3455 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 10:36 3456 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3456_fsm 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3456_vm 2024-09-10T10:36:51.789 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3466 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3467 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3468 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3501 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3502 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3503 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3534 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3541_fsm 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541_vm 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3542 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3574 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3575 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3576 2024-09-10T10:36:51.790 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3596 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3597 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3598 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3599 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3600_fsm 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600_vm 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3601_fsm 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601_vm 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3602_fsm 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602_vm 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603 2024-09-10T10:36:51.791 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603_fsm 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3603_vm 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3604 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3605 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3606 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3607 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3608 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 3609 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3712 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3764_fsm 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764_vm 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3766 2024-09-10T10:36:51.792 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3767 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3997 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4143 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4144 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4145 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4146 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4147 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4148 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4149 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4150 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4151 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4152 2024-09-10T10:36:51.793 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4153 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4154 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4155 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4156 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4157 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4158 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4159 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4160 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4161 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4162 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4163 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4164 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4165 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4166 2024-09-10T10:36:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4167 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4168 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4169 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4170 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4171 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4172 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4173 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4174 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 5002 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 548 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 549 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6102 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6104 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6106 2024-09-10T10:36:51.795 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6110 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6111 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6112 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6113 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6117 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 826 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 827 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 828 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 10:36 pg_filenode.map 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 PG_VERSION 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/global: 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:total 537 2024-09-10T10:36:51.796 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 10 10:36 . 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1213 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1213_fsm 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1213_vm 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1214 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1214_fsm 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1214_vm 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 1232 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 1233 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1260 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1260_fsm 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1260_vm 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1261 2024-09-10T10:36:51.797 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1261_fsm 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1261_vm 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1262 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1262_fsm 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1262_vm 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2396 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2396_fsm 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2396_vm 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2397 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2671 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2672 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2676 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2677 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2694 2024-09-10T10:36:51.798 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2695 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2697 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2698 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2846 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2847 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2964 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2965 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2966 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2967 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3592 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3593 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4060 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4061 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4175 2024-09-10T10:36:51.799 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4176 2024-09-10T10:36:51.800 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4177 2024-09-10T10:36:51.800 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4178 2024-09-10T10:36:51.800 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4181 2024-09-10T10:36:51.800 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4182 2024-09-10T10:36:51.800 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4183 2024-09-10T10:36:51.800 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4184 2024-09-10T10:36:51.800 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4185 2024-09-10T10:36:51.800 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4186 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6000 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6001 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6002 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6100 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6114 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6115 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 pg_control 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 10:36 pg_filenode.map 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/log: 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.801 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:total 1 2024-09-10T10:36:51.802 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 . 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 mappings 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 10 10:36 replorigin_checkpoint 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 snapshots 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 .. 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.803 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 .. 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 . 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 members 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 offsets 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 .. 2024-09-10T10:36:51.804 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 0000 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 .. 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 0000 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.805 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.806 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:36:51.807 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 0000 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-10T10:36:51.808 INFO:teuthology.orchestra.run.smithi092.stdout:total 16384 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 . 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:36 000000010000000000000001 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 archive_status 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 .. 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:36:51.809 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 10 10:36 .. 2024-09-10T10:36:51.810 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 0000 2024-09-10T10:36:51.810 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-10T10:36:51.929 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-10T10:36:51.977 INFO:teuthology.orchestra.run.smithi092.stderr:dropping old tables... 2024-09-10T10:36:51.977 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-10T10:36:51.978 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-10T10:36:51.978 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-10T10:36:51.978 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-10T10:36:51.978 INFO:teuthology.orchestra.run.smithi092.stderr:creating tables... 2024-09-10T10:36:51.992 INFO:teuthology.orchestra.run.smithi092.stderr:generating data (client-side)... 2024-09-10T10:36:52.070 INFO:teuthology.orchestra.run.smithi092.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.84 s) 2024-09-10T10:36:52.225 INFO:teuthology.orchestra.run.smithi092.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.21 s, remaining 3.22 s) 2024-09-10T10:36:52.308 INFO:teuthology.orchestra.run.smithi092.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.30 s, remaining 2.86 s) 2024-09-10T10:36:52.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:52 smithi092 ceph-mon[30834]: pgmap v9: 97 pgs: 97 active+clean; 31 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 2.8 MiB/s wr, 101 op/s 2024-09-10T10:36:52.430 INFO:teuthology.orchestra.run.smithi092.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.42 s, remaining 2.94 s) 2024-09-10T10:36:52.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:52 smithi121 ceph-mon[35231]: pgmap v9: 97 pgs: 97 active+clean; 31 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 2.8 MiB/s wr, 101 op/s 2024-09-10T10:36:52.560 INFO:teuthology.orchestra.run.smithi092.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.55 s, remaining 2.97 s) 2024-09-10T10:36:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:52 smithi097 ceph-mon[35213]: pgmap v9: 97 pgs: 97 active+clean; 31 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 2.8 MiB/s wr, 101 op/s 2024-09-10T10:36:52.645 INFO:teuthology.orchestra.run.smithi092.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.63 s, remaining 2.75 s) 2024-09-10T10:36:52.778 INFO:teuthology.orchestra.run.smithi092.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.77 s, remaining 2.74 s) 2024-09-10T10:36:52.939 INFO:teuthology.orchestra.run.smithi092.stderr:800000 of 3200000 tuples (25%) done (elapsed 0.93 s, remaining 2.78 s) 2024-09-10T10:36:53.041 INFO:teuthology.orchestra.run.smithi092.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.03 s, remaining 2.63 s) 2024-09-10T10:36:53.165 INFO:teuthology.orchestra.run.smithi092.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.15 s, remaining 2.54 s) 2024-09-10T10:36:53.335 INFO:teuthology.orchestra.run.smithi092.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.32 s, remaining 2.53 s) 2024-09-10T10:36:53.437 INFO:teuthology.orchestra.run.smithi092.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.43 s, remaining 2.38 s) 2024-09-10T10:36:53.588 INFO:teuthology.orchestra.run.smithi092.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.58 s, remaining 2.31 s) 2024-09-10T10:36:53.766 INFO:teuthology.orchestra.run.smithi092.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.76 s, remaining 2.26 s) 2024-09-10T10:36:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 -- 172.21.15.92:0/318615359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c70101af0 msgr2=0x7f9c7010d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 --2- 172.21.15.92:0/318615359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c70101af0 0x7f9c7010d9a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009cd0 tx=0x7f9c6802a8e0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 -- 172.21.15.92:0/318615359 shutdown_connections 2024-09-10T10:36:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 --2- 172.21.15.92:0/318615359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c70101af0 0x7f9c7010d9a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 --2- 172.21.15.92:0/318615359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c70101130 0x7f9c701015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 --2- 172.21.15.92:0/318615359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c701028f0 0x7f9c70102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 -- 172.21.15.92:0/318615359 >> 172.21.15.92:0/318615359 conn(0x7f9c700770f0 msgr2=0x7f9c700fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 -- 172.21.15.92:0/318615359 shutdown_connections 2024-09-10T10:36:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 -- 172.21.15.92:0/318615359 wait complete. 2024-09-10T10:36:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.800+0000 7f9c76726640 1 Processor -- start 2024-09-10T10:36:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c76726640 1 -- start start 2024-09-10T10:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c76726640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c70101130 0x7f9c701983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c76726640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c70101af0 0x7f9c70198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c76726640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c701028f0 0x7f9c7019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c76726640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70110ec0 con 0x7f9c701028f0 2024-09-10T10:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c76726640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70110d40 con 0x7f9c70101af0 2024-09-10T10:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c76726640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70111040 con 0x7f9c70101130 2024-09-10T10:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c70101130 0x7f9c701983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c70101130 0x7f9c701983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:51626/0 (socket says 172.21.15.92:51626) 2024-09-10T10:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c6ffff640 1 -- 172.21.15.92:0/3319971192 learned_addr learned my addr 172.21.15.92:0/3319971192 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.801+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c701028f0 0x7f9c7019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c70101af0 0x7f9c70198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6ffff640 1 -- 172.21.15.92:0/3319971192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c70101af0 msgr2=0x7f9c70198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c70101af0 0x7f9c70198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6ffff640 1 -- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c701028f0 msgr2=0x7f9c7019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c701028f0 0x7f9c7019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6ffff640 1 -- 172.21.15.92:0/3319971192 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7019d3d0 con 0x7f9c70101130 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c70101af0 0x7f9c70198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c70101130 0x7f9c701983e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000e9f0 tx=0x7f9c6000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6d7fa640 1 -- 172.21.15.92:0/3319971192 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000cd80 con 0x7f9c70101130 2024-09-10T10:36:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6d7fa640 1 -- 172.21.15.92:0/3319971192 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c60010910 con 0x7f9c70101130 2024-09-10T10:36:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c6d7fa640 1 -- 172.21.15.92:0/3319971192 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60018990 con 0x7f9c70101130 2024-09-10T10:36:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c76726640 1 -- 172.21.15.92:0/3319971192 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7019d6c0 con 0x7f9c70101130 2024-09-10T10:36:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.802+0000 7f9c76726640 1 -- 172.21.15.92:0/3319971192 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c701a4f50 con 0x7f9c70101130 2024-09-10T10:36:53.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.805+0000 7f9c6d7fa640 1 -- 172.21.15.92:0/3319971192 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f9c60010ac0 con 0x7f9c70101130 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.805+0000 7f9c794b9740 1 Processor -- start 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.805+0000 7f9c794b9740 1 -- start start 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.805+0000 7f9c6d7fa640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9c5c0a2e40 0x7f9c5c0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.805+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d31943ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d3194e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d319510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c794b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558d318a82f0 con 0x558d3194ecb0 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c794b9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558d31850270 con 0x558d31943af0 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c794b9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558d318a42b0 con 0x558d31944410 2024-09-10T10:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d3194e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9c5c0a2e40 0x7f9c5c0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6d7fa640 1 -- 172.21.15.92:0/3319971192 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8411+0+0 (secure 0 0 0) 0x7f9c600cf8b0 con 0x7f9c70101130 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d3194e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:51638/0 (socket says 172.21.15.92:51638) 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6f7fe640 1 -- 172.21.15.92:0/3550653196 learned_addr learned my addr 172.21.15.92:0/3550653196 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/3550653196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d319510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/3550653196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d31943ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6f7fe640 1 -- 172.21.15.92:0/3550653196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 msgr2=0x558d31943ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/3550653196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d31943ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6f7fe640 1 -- 172.21.15.92:0/3550653196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 msgr2=0x558d319510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/3550653196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d319510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6f7fe640 1 -- 172.21.15.92:0/3550653196 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d3184f340 con 0x558d31944410 2024-09-10T10:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/3550653196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d3194e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009cf0 tx=0x7f9c580117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fd8ee6436b2b8df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9c5c0a2e40 0x7f9c5c0a5300 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9c68004ab0 tx=0x7f9c68009360 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c667fc640 1 -- 172.21.15.92:0/3550653196 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58012450 con 0x558d31944410 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c667fc640 1 -- 172.21.15.92:0/3550653196 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c58012ad0 con 0x558d31944410 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.806+0000 7f9c667fc640 1 -- 172.21.15.92:0/3550653196 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800fc50 con 0x558d31944410 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.807+0000 7f9c794b9740 1 -- 172.21.15.92:0/3550653196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 msgr2=0x558d3194e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.807+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3550653196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d3194e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009cf0 tx=0x7f9c580117b0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.807+0000 7f9c794b9740 1 -- 172.21.15.92:0/3550653196 shutdown_connections 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.807+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3550653196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d319510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.807+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3550653196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d3194e770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.807+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3550653196 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d31943ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.807+0000 7f9c794b9740 1 -- 172.21.15.92:0/3550653196 >> 172.21.15.92:0/3550653196 conn(0x558d31940060 msgr2=0x558d31940440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.807+0000 7f9c794b9740 1 -- 172.21.15.92:0/3550653196 shutdown_connections 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.807+0000 7f9c794b9740 1 -- 172.21.15.92:0/3550653196 wait complete. 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.808+0000 7f9c794b9740 1 -- start start 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.808+0000 7f9c794b9740 1 Processor -- start 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d3194bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31944410 0x558d3194c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d3194ecb0 0x558d3194c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c794b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558d31951880 con 0x558d31944410 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c794b9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558d31831290 con 0x558d31943af0 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c794b9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558d31951a00 con 0x558d3194ecb0 2024-09-10T10:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c794b9740 10 client.0 _ll_register_callbacks cb 0x558d31862140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31944410 0x558d3194c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31944410 0x558d3194c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48214/0 (socket says 172.21.15.92:48214) 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6f7fe640 1 -- 172.21.15.92:0/1883702237 learned_addr learned my addr 172.21.15.92:0/1883702237 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d3194bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d3194ecb0 0x558d3194c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6f7fe640 1 -- 172.21.15.92:0/1883702237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d3194ecb0 msgr2=0x558d3194c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d3194ecb0 0x558d3194c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6f7fe640 1 -- 172.21.15.92:0/1883702237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 msgr2=0x558d3194bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d3194bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6f7fe640 1 -- 172.21.15.92:0/1883702237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d315bb210 con 0x558d31944410 2024-09-10T10:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31944410 0x558d3194c040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800a010 tx=0x7f9c5800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5d979b6ba42f50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/1883702237 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58029020 con 0x558d31944410 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/1883702237 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8411+0+0 (secure 0 0 0) 0x7f9c58004040 con 0x558d31944410 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.809+0000 7f9c794b9740 1 -- 172.21.15.92:0/1883702237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c58012ad0 con 0x558d31944410 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/1883702237 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c58034050 con 0x558d31944410 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c794b9740 10 client.15342 fetch_fsmap learned FSMap version 28 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c794b9740 1 -- 172.21.15.92:0/1883702237 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d31687620 con 0x558d31944410 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/1883702237 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c58012ad0 con 0x558d31944410 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/1883702237 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9c580035f0 con 0x558d31944410 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c794b9740 10 client.15342 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T10:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c794b9740 10 client.15342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c794b9740 20 client.15342 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c794b9740 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558d3195ea60 0x558d31960e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c794b9740 4 client.15342 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c794b9740 1 -- 172.21.15.92:0/1883702237 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d318b5a20 con 0x558d3195ea60 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.810+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558d3195ea60 0x558d31960e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558d3195ea60 0x558d31960e50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cac8f5bcf3da2021 server_cookie=a17bcffd893b8a9c in_seq=0 out_seq=0 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c4f7fe640 10 client.15342 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/1883702237 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d318b5a20 con 0x558d3195ea60 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c4f7fe640 10 client.15342 handle_command_reply: tid=0 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c794b9740 1 client.15342 shutdown 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c794b9740 1 -- 172.21.15.92:0/1883702237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31944410 msgr2=0x558d3194c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c794b9740 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31944410 0x558d3194c040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800a010 tx=0x7f9c5800f670 comp rx=0 tx=0).stop 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c794b9740 1 -- 172.21.15.92:0/1883702237 shutdown_connections 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c794b9740 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d3194ecb0 0x558d3194c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c794b9740 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31944410 0x558d3194c040 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c794b9740 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558d3195ea60 0x558d31960e50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c794b9740 1 --2- 172.21.15.92:0/1883702237 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d3194bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.811+0000 7f9c4f7fe640 0 client.15342 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.812+0000 7f9c794b9740 1 -- 172.21.15.92:0/1883702237 >> 172.21.15.92:0/1883702237 conn(0x558d31940060 msgr2=0x558d31945d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.812+0000 7f9c794b9740 1 -- 172.21.15.92:0/1883702237 shutdown_connections 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.812+0000 7f9c794b9740 1 -- 172.21.15.92:0/1883702237 wait complete. 2024-09-10T10:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.812+0000 7f9c794b9740 20 client.15342 trim_cache size 0 max 16384 2024-09-10T10:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.840+0000 7f9c794b9740 1 Processor -- start 2024-09-10T10:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.840+0000 7f9c794b9740 1 -- start start 2024-09-10T10:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.840+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d31946560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.840+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d3194c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.840+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d3194da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.840+0000 7f9c794b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701ad740 con 0x558d3194ecb0 2024-09-10T10:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.840+0000 7f9c794b9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701af280 con 0x558d31943af0 2024-09-10T10:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.840+0000 7f9c794b9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701ade10 con 0x558d31944410 2024-09-10T10:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.840+0000 7f9c74cc3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d3194da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c74cc3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d3194da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48218/0 (socket says 172.21.15.92:48218) 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c74cc3640 1 -- 172.21.15.92:0/2569849015 learned_addr learned my addr 172.21.15.92:0/2569849015 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c74cc3640 1 -- 172.21.15.92:0/2569849015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 msgr2=0x558d3194c3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/2569849015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d3194c3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c74cc3640 1 -- 172.21.15.92:0/2569849015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 msgr2=0x558d31946560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/2569849015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d31946560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c74cc3640 1 -- 172.21.15.92:0/2569849015 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d3193fe90 con 0x558d3194ecb0 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/2569849015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d3194da70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009cd0 tx=0x7f9c68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781679b536c8d264 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c65ffb640 1 -- 172.21.15.92:0/2569849015 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68044040 con 0x558d3194ecb0 2024-09-10T10:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c65ffb640 1 -- 172.21.15.92:0/2569849015 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c68036070 con 0x558d3194ecb0 2024-09-10T10:36:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.841+0000 7f9c65ffb640 1 -- 172.21.15.92:0/2569849015 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68030cc0 con 0x558d3194ecb0 2024-09-10T10:36:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.842+0000 7f9c794b9740 1 -- 172.21.15.92:0/2569849015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 msgr2=0x558d3194da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.842+0000 7f9c794b9740 1 --2- 172.21.15.92:0/2569849015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d3194da70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009cd0 tx=0x7f9c68004a40 comp rx=0 tx=0).stop 2024-09-10T10:36:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.842+0000 7f9c794b9740 1 -- 172.21.15.92:0/2569849015 shutdown_connections 2024-09-10T10:36:53.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.842+0000 7f9c794b9740 1 --2- 172.21.15.92:0/2569849015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d3194ecb0 0x558d3194da70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.842+0000 7f9c794b9740 1 --2- 172.21.15.92:0/2569849015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d3194c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.842+0000 7f9c794b9740 1 --2- 172.21.15.92:0/2569849015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d31943af0 0x558d31946560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.842+0000 7f9c794b9740 1 -- 172.21.15.92:0/2569849015 >> 172.21.15.92:0/2569849015 conn(0x558d31940060 msgr2=0x558d3194d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.843+0000 7f9c794b9740 1 -- 172.21.15.92:0/2569849015 shutdown_connections 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.843+0000 7f9c794b9740 1 -- 172.21.15.92:0/2569849015 wait complete. 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.843+0000 7f9c794b9740 1 -- start start 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.843+0000 7f9c794b9740 1 Processor -- start 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31943af0 0x558d31956e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d319573c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c794b9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d3194ecb0 0x558d31948350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c794b9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701aebb0 con 0x558d31943af0 2024-09-10T10:36:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c794b9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701ae4e0 con 0x558d3194ecb0 2024-09-10T10:36:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c794b9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701ab720 con 0x558d31944410 2024-09-10T10:36:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c794b9740 10 client.0 _ll_register_callbacks cb 0x7f9c58005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:36:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31943af0 0x558d31956e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31943af0 0x558d31956e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48230/0 (socket says 172.21.15.92:48230) 2024-09-10T10:36:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c6ffff640 1 -- 172.21.15.92:0/3564834103 learned_addr learned my addr 172.21.15.92:0/3564834103 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:36:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d3194ecb0 0x558d31948350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c6ffff640 1 -- 172.21.15.92:0/3564834103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 msgr2=0x558d319573c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:36:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d319573c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c6ffff640 1 -- 172.21.15.92:0/3564834103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d3194ecb0 msgr2=0x558d31948350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:36:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d3194ecb0 0x558d31948350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c6ffff640 1 -- 172.21.15.92:0/3564834103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d3193b2d0 con 0x558d31943af0 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c74cc3640 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d3194ecb0 0x558d31948350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c6ffff640 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31943af0 0x558d31956e80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9c600cd670 tx=0x7f9c60005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53a055413824d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/3564834103 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c600b8070 con 0x558d31943af0 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/3564834103 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8411+0+0 (secure 0 0 0) 0x7f9c600bd100 con 0x558d31943af0 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c794b9740 1 -- 172.21.15.92:0/3564834103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c68036070 con 0x558d31943af0 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/3564834103 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c600a0080 con 0x558d31943af0 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.844+0000 7f9c794b9740 10 client.15348 fetch_fsmap learned FSMap version 28 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.845+0000 7f9c794b9740 1 -- 172.21.15.92:0/3564834103 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d319c8e10 con 0x558d31943af0 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.845+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/3564834103 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c68036070 con 0x558d31943af0 2024-09-10T10:36:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.845+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/3564834103 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9c600bab70 con 0x558d31943af0 2024-09-10T10:36:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.845+0000 7f9c794b9740 10 client.15348 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T10:36:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.845+0000 7f9c794b9740 10 client.15348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:36:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.845+0000 7f9c794b9740 20 client.15348 populate_metadata read hostname 'smithi092' 2024-09-10T10:36:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.845+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558d319c9580 0x558d319cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:36:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.845+0000 7f9c794b9740 4 client.15348 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:36:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.845+0000 7f9c794b9740 1 -- 172.21.15.92:0/3564834103 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d318afd70 con 0x558d319c9580 2024-09-10T10:36:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.846+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558d319c9580 0x558d319cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:36:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.847+0000 7f9c4f7fe640 10 client.15348 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:53.847+0000 7f9c6f7fe640 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558d319c9580 0x558d319cb9a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a13315abbe0d9b server_cookie=8ccb6856c932c877 in_seq=0 out_seq=0 2024-09-10T10:36:53.870 INFO:teuthology.orchestra.run.smithi092.stderr:1500000 of 3200000 tuples (46%) done (elapsed 1.86 s, remaining 2.11 s) 2024-09-10T10:36:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c4f7fe640 1 -- 172.21.15.92:0/3564834103 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d318afd70 con 0x558d319c9580 2024-09-10T10:36:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c4f7fe640 10 client.15348 handle_command_reply: tid=0 2024-09-10T10:36:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 client.15348 shutdown 2024-09-10T10:36:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 -- 172.21.15.92:0/3564834103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31943af0 msgr2=0x558d31956e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31943af0 0x558d31956e80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9c600cd670 tx=0x7f9c60005f10 comp rx=0 tx=0).stop 2024-09-10T10:36:54.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 -- 172.21.15.92:0/3564834103 shutdown_connections 2024-09-10T10:36:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558d319c9580 0x558d319cb9a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558d3194ecb0 0x558d31948350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558d31944410 0x558d319573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c4f7fe640 0 client.15348 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:36:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 --2- 172.21.15.92:0/3564834103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558d31943af0 0x558d31956e80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 -- 172.21.15.92:0/3564834103 >> 172.21.15.92:0/3564834103 conn(0x558d31940060 msgr2=0x558d3194db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 -- 172.21.15.92:0/3564834103 shutdown_connections 2024-09-10T10:36:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 1 -- 172.21.15.92:0/3564834103 wait complete. 2024-09-10T10:36:54.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.003+0000 7f9c794b9740 20 client.15348 trim_cache size 0 max 16384 2024-09-10T10:36:54.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:36:54.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:36:54.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:36:54.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:36:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 -- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9c5c0a2e40 msgr2=0x7f9c5c0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9c5c0a2e40 0x7f9c5c0a5300 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9c68004ab0 tx=0x7f9c68009360 comp rx=0 tx=0).stop 2024-09-10T10:36:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 -- 172.21.15.92:0/3319971192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c70101130 msgr2=0x7f9c701983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:36:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c70101130 0x7f9c701983e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000e9f0 tx=0x7f9c6000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:36:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 -- 172.21.15.92:0/3319971192 shutdown_connections 2024-09-10T10:36:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c701028f0 0x7f9c7019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9c5c0a2e40 0x7f9c5c0a5300 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c70101af0 0x7f9c70198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 --2- 172.21.15.92:0/3319971192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c70101130 0x7f9c701983e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:36:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 -- 172.21.15.92:0/3319971192 >> 172.21.15.92:0/3319971192 conn(0x7f9c700770f0 msgr2=0x7f9c70105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:36:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 -- 172.21.15.92:0/3319971192 shutdown_connections 2024-09-10T10:36:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:36:54.004+0000 7f9c76726640 1 -- 172.21.15.92:0/3319971192 wait complete. 2024-09-10T10:36:54.090 INFO:teuthology.orchestra.run.smithi092.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.08 s, remaining 2.08 s) 2024-09-10T10:36:54.178 INFO:teuthology.orchestra.run.smithi092.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.17 s, remaining 1.91 s) 2024-09-10T10:36:54.332 INFO:teuthology.orchestra.run.smithi092.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.32 s, remaining 1.81 s) 2024-09-10T10:36:54.498 INFO:teuthology.orchestra.run.smithi092.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.49 s, remaining 1.70 s) 2024-09-10T10:36:54.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:54 smithi121 ceph-mon[35231]: pgmap v10: 97 pgs: 97 active+clean; 31 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 2.6 MiB/s wr, 93 op/s 2024-09-10T10:36:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:54 smithi097 ceph-mon[35213]: pgmap v10: 97 pgs: 97 active+clean; 31 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 2.6 MiB/s wr, 93 op/s 2024-09-10T10:36:54.570 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:36:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h[65169]: ignoring --setuser ceph since I am not root 2024-09-10T10:36:54.570 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:36:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h[65169]: ignoring --setgroup ceph since I am not root 2024-09-10T10:36:54.570 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:36:54 smithi097 ceph-mds[65173]: -- 172.21.15.97:0/510573963 <== mon.2 v2:172.21.15.97:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56125bd01860 con 0x56125bcdf000 2024-09-10T10:36:54.570 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:36:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h[65169]: starting mds.h at 2024-09-10T10:36:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:54 smithi092 ceph-mon[30834]: pgmap v10: 97 pgs: 97 active+clean; 31 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 2.6 MiB/s wr, 93 op/s 2024-09-10T10:36:54.660 INFO:teuthology.orchestra.run.smithi092.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.65 s, remaining 1.59 s) 2024-09-10T10:36:54.751 INFO:teuthology.orchestra.run.smithi092.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.74 s, remaining 1.44 s) 2024-09-10T10:36:54.898 INFO:teuthology.orchestra.run.smithi092.stderr:2200000 of 3200000 tuples (68%) done (elapsed 2.89 s, remaining 1.31 s) 2024-09-10T10:36:54.980 INFO:teuthology.orchestra.run.smithi092.stderr:2300000 of 3200000 tuples (71%) done (elapsed 2.97 s, remaining 1.16 s) 2024-09-10T10:36:55.147 INFO:teuthology.orchestra.run.smithi092.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.14 s, remaining 1.05 s) 2024-09-10T10:36:55.290 INFO:teuthology.orchestra.run.smithi092.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.28 s, remaining 0.92 s) 2024-09-10T10:36:55.388 INFO:teuthology.orchestra.run.smithi092.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.38 s, remaining 0.78 s) 2024-09-10T10:36:55.523 INFO:teuthology.orchestra.run.smithi092.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.51 s, remaining 0.65 s) 2024-09-10T10:36:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:55 smithi121 ceph-mon[35231]: daemon mds.h restarted 2024-09-10T10:36:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:55 smithi121 ceph-mon[35231]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T10:36:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:55 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6836/1495848279,v1:172.21.15.97:6837/1495848279] up:boot 2024-09-10T10:36:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:55 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:36:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:36:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:55 smithi097 ceph-mon[35213]: daemon mds.h restarted 2024-09-10T10:36:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:55 smithi097 ceph-mon[35213]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T10:36:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:55 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6836/1495848279,v1:172.21.15.97:6837/1495848279] up:boot 2024-09-10T10:36:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:55 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:36:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:36:55.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:55 smithi092 ceph-mon[30834]: daemon mds.h restarted 2024-09-10T10:36:55.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:55 smithi092 ceph-mon[30834]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T10:36:55.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:55 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6836/1495848279,v1:172.21.15.97:6837/1495848279] up:boot 2024-09-10T10:36:55.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:55 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:36:55.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:36:55.619 INFO:teuthology.orchestra.run.smithi092.stderr:2800000 of 3200000 tuples (87%) done (elapsed 3.61 s, remaining 0.52 s) 2024-09-10T10:36:55.763 INFO:teuthology.orchestra.run.smithi092.stderr:2900000 of 3200000 tuples (90%) done (elapsed 3.75 s, remaining 0.39 s) 2024-09-10T10:36:55.907 INFO:teuthology.orchestra.run.smithi092.stderr:3000000 of 3200000 tuples (93%) done (elapsed 3.90 s, remaining 0.26 s) 2024-09-10T10:36:56.023 INFO:teuthology.orchestra.run.smithi092.stderr:3100000 of 3200000 tuples (96%) done (elapsed 4.01 s, remaining 0.13 s) 2024-09-10T10:36:56.131 INFO:teuthology.orchestra.run.smithi092.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.12 s, remaining 0.00 s) 2024-09-10T10:36:56.177 INFO:teuthology.orchestra.run.smithi092.stderr:vacuuming... 2024-09-10T10:36:56.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:56 smithi121 ceph-mon[35231]: pgmap v12: 97 pgs: 97 active+clean; 122 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 21 MiB/s wr, 201 op/s 2024-09-10T10:36:56.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:56 smithi097 ceph-mon[35213]: pgmap v12: 97 pgs: 97 active+clean; 122 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 21 MiB/s wr, 201 op/s 2024-09-10T10:36:56.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:56 smithi092 ceph-mon[30834]: pgmap v12: 97 pgs: 97 active+clean; 122 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 21 MiB/s wr, 201 op/s 2024-09-10T10:36:56.754 INFO:teuthology.orchestra.run.smithi092.stderr:creating primary keys... 2024-09-10T10:36:57.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:57 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:36:57.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:57 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:36:57.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:57 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:36:58.093 INFO:teuthology.orchestra.run.smithi092.stderr:done in 6.12 s (drop tables 0.00 s, create tables 0.01 s, client-side generate 4.18 s, vacuum 0.58 s, primary keys 1.34 s). 2024-09-10T10:36:58.096 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-10T10:36:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:starting vacuum...end. 2024-09-10T10:36:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:36:58 smithi092 ceph-mon[30834]: pgmap v13: 97 pgs: 97 active+clean; 225 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 41 MiB/s wr, 374 op/s 2024-09-10T10:36:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:36:58 smithi097 ceph-mon[35213]: pgmap v13: 97 pgs: 97 active+clean; 225 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 41 MiB/s wr, 374 op/s 2024-09-10T10:36:58.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:36:58 smithi121 ceph-mon[35231]: pgmap v13: 97 pgs: 97 active+clean; 225 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 41 MiB/s wr, 374 op/s 2024-09-10T10:37:00.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:00 smithi097 ceph-mon[35213]: pgmap v14: 97 pgs: 97 active+clean; 225 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 41 MiB/s wr, 374 op/s 2024-09-10T10:37:00.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:00 smithi092 ceph-mon[30834]: pgmap v14: 97 pgs: 97 active+clean; 225 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 41 MiB/s wr, 374 op/s 2024-09-10T10:37:00.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:00 smithi121 ceph-mon[35231]: pgmap v14: 97 pgs: 97 active+clean; 225 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 41 MiB/s wr, 374 op/s 2024-09-10T10:37:01.318 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:37:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:37:00.874+0000 7fd45201d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:37:01.318 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:37:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:37:00.874+0000 7fd45201d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:37:01.319 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:37:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:37:00.874+0000 7fd45201d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:37:01.319 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:37:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:37:00.874+0000 7fd45201d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:37:01.319 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:37:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x[31061]: 2024-09-10T10:37:00.874+0000 7fd45201d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T10:37:02.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:02 smithi097 ceph-mon[35213]: pgmap v15: 97 pgs: 97 active+clean; 510 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 88 MiB/s wr, 392 op/s 2024-09-10T10:37:02.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:02 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:02.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:02 smithi092 ceph-mon[30834]: pgmap v15: 97 pgs: 97 active+clean; 510 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 88 MiB/s wr, 392 op/s 2024-09-10T10:37:02.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:02 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:02.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:02 smithi121 ceph-mon[35231]: pgmap v15: 97 pgs: 97 active+clean; 510 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 88 MiB/s wr, 392 op/s 2024-09-10T10:37:02.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:02 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 5.0 s, 2231.4 tps, lat 43.916 ms stddev 83.111 2024-09-10T10:37:04.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:04 smithi097 ceph-mon[35213]: pgmap v16: 97 pgs: 97 active+clean; 510 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 88 MiB/s wr, 392 op/s 2024-09-10T10:37:04.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:04 smithi097 ceph-mon[35213]: mgrmap e24: x(active, since 24s), standbys: y, z 2024-09-10T10:37:04.593 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:04 smithi121 ceph-mon[35231]: pgmap v16: 97 pgs: 97 active+clean; 510 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 88 MiB/s wr, 392 op/s 2024-09-10T10:37:04.593 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:04 smithi121 ceph-mon[35231]: mgrmap e24: x(active, since 24s), standbys: y, z 2024-09-10T10:37:04.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:04 smithi092 ceph-mon[30834]: pgmap v16: 97 pgs: 97 active+clean; 510 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 88 MiB/s wr, 392 op/s 2024-09-10T10:37:04.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:04 smithi092 ceph-mon[30834]: mgrmap e24: x(active, since 24s), standbys: y, z 2024-09-10T10:37:06.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:06 smithi097 ceph-mon[35213]: pgmap v17: 97 pgs: 97 active+clean; 816 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 118 MiB/s wr, 638 op/s 2024-09-10T10:37:06.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:06 smithi092 ceph-mon[30834]: pgmap v17: 97 pgs: 97 active+clean; 816 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 118 MiB/s wr, 638 op/s 2024-09-10T10:37:06.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:06 smithi121 ceph-mon[35231]: pgmap v17: 97 pgs: 97 active+clean; 816 MiB data, 838 MiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 118 MiB/s wr, 638 op/s 2024-09-10T10:37:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.122+0000 7f8cbd331640 1 -- 172.21.15.92:0/2312871294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb810c100 msgr2=0x7f8cb810e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.122+0000 7f8cbd331640 1 --2- 172.21.15.92:0/2312871294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb810c100 0x7f8cb810e590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0009ca0 tx=0x7f8cb002a960 comp rx=0 tx=0).stop 2024-09-10T10:37:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.122+0000 7f8cbd331640 1 -- 172.21.15.92:0/2312871294 shutdown_connections 2024-09-10T10:37:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.122+0000 7f8cbd331640 1 --2- 172.21.15.92:0/2312871294 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb810c100 0x7f8cb810e590 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.122+0000 7f8cbd331640 1 --2- 172.21.15.92:0/2312871294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb8103690 0x7f8cb810bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.122+0000 7f8cbd331640 1 --2- 172.21.15.92:0/2312871294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8102d70 0x7f8cb8103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.122+0000 7f8cbd331640 1 -- 172.21.15.92:0/2312871294 >> 172.21.15.92:0/2312871294 conn(0x7f8cb80fc6c0 msgr2=0x7f8cb80feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.122+0000 7f8cbd331640 1 -- 172.21.15.92:0/2312871294 shutdown_connections 2024-09-10T10:37:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.122+0000 7f8cbd331640 1 -- 172.21.15.92:0/2312871294 wait complete. 2024-09-10T10:37:07.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.123+0000 7f8cbd331640 1 Processor -- start 2024-09-10T10:37:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.123+0000 7f8cbd331640 1 -- start start 2024-09-10T10:37:07.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.123+0000 7f8cbd331640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb8102d70 0x7f8cb8197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.123+0000 7f8cbd331640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb8103690 0x7f8cb8198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.123+0000 7f8cbd331640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb810c100 0x7f8cb819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8caffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb8103690 0x7f8cb8198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8caffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb8103690 0x7f8cb8198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:46090/0 (socket says 172.21.15.92:46090) 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb810c100 0x7f8cb819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8cbd331640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8111fa0 con 0x7f8cb810c100 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8cbd331640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8111e20 con 0x7f8cb8103690 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8cbd331640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8112120 con 0x7f8cb8102d70 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8caffff640 1 -- 172.21.15.92:0/19920415 learned_addr learned my addr 172.21.15.92:0/19920415 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb8102d70 0x7f8cb8197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8caffff640 1 -- 172.21.15.92:0/19920415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb8102d70 msgr2=0x7f8cb8197c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8caffff640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb8102d70 0x7f8cb8197c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8caffff640 1 -- 172.21.15.92:0/19920415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb810c100 msgr2=0x7f8cb819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8caffff640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb810c100 0x7f8cb819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8caffff640 1 -- 172.21.15.92:0/19920415 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb819b0d0 con 0x7f8cb8103690 2024-09-10T10:37:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.124+0000 7f8caffff640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb8103690 0x7f8cb8198160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000b450 tx=0x7f8ca000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.126+0000 7f8cb4ff9640 1 -- 172.21.15.92:0/19920415 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0015020 con 0x7f8cb8103690 2024-09-10T10:37:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.126+0000 7f8cb4ff9640 1 -- 172.21.15.92:0/19920415 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca0011d70 con 0x7f8cb8103690 2024-09-10T10:37:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.126+0000 7f8cb4ff9640 1 -- 172.21.15.92:0/19920415 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000f340 con 0x7f8cb8103690 2024-09-10T10:37:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.126+0000 7f8cbd331640 1 -- 172.21.15.92:0/19920415 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb819b3c0 con 0x7f8cb8103690 2024-09-10T10:37:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.126+0000 7f8cbd331640 1 -- 172.21.15.92:0/19920415 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb810ab70 con 0x7f8cb8103690 2024-09-10T10:37:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.128+0000 7f8cb4ff9640 1 -- 172.21.15.92:0/19920415 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f8ca0018020 con 0x7f8cb8103690 2024-09-10T10:37:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.130+0000 7f8cb4ff9640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f8ca40a3020 0x7f8ca40a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.130+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f8ca40a3020 0x7f8ca40a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.130+0000 7f8cb4ff9640 1 -- 172.21.15.92:0/19920415 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f8ca00ceea0 con 0x7f8cb8103690 2024-09-10T10:37:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.130+0000 7f8cc00ce740 1 Processor -- start 2024-09-10T10:37:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.130+0000 7f8cc00ce740 1 -- start start 2024-09-10T10:37:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.130+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f8ca40a3020 0x7f8ca40a54e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8005e10 tx=0x7f8ca8005da0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.130+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.130+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 0x55cdb4acb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.130+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ace0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cdb4a252f0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55cdb49cd270 con 0x55cdb4acbcb0 2024-09-10T10:37:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cdb4a212b0 con 0x55cdb4ac1410 2024-09-10T10:37:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53216/0 (socket says 172.21.15.92:53216) 2024-09-10T10:37:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cb6ffd640 1 -- 172.21.15.92:0/2684954320 learned_addr learned my addr 172.21.15.92:0/2684954320 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8caffff640 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 0x55cdb4acb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cb77fe640 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ace0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8caffff640 1 -- 172.21.15.92:0/2684954320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 msgr2=0x55cdb4ace0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:07.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8caffff640 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ace0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8caffff640 1 -- 172.21.15.92:0/2684954320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 msgr2=0x55cdb4ac0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8caffff640 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8caffff640 1 -- 172.21.15.92:0/2684954320 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb49cc340 con 0x55cdb4ac1410 2024-09-10T10:37:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8caffff640 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 0x55cdb4acb770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00cc5f0 tx=0x7f8ca009bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac3f1e3016b407bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:07.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cad7fa640 1 -- 172.21.15.92:0/2684954320 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00a3f60 con 0x55cdb4ac1410 2024-09-10T10:37:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cad7fa640 1 -- 172.21.15.92:0/2684954320 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca00995f0 con 0x55cdb4ac1410 2024-09-10T10:37:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.131+0000 7f8cad7fa640 1 -- 172.21.15.92:0/2684954320 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00cca20 con 0x55cdb4ac1410 2024-09-10T10:37:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.132+0000 7f8cc00ce740 1 -- 172.21.15.92:0/2684954320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 msgr2=0x55cdb4acb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.132+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 0x55cdb4acb770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00cc5f0 tx=0x7f8ca009bab0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.132+0000 7f8cc00ce740 1 -- 172.21.15.92:0/2684954320 shutdown_connections 2024-09-10T10:37:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.132+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ace0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.132+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 0x55cdb4acb770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.132+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/2684954320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.132+0000 7f8cc00ce740 1 -- 172.21.15.92:0/2684954320 >> 172.21.15.92:0/2684954320 conn(0x55cdb4abd060 msgr2=0x55cdb4abd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.132+0000 7f8cc00ce740 1 -- 172.21.15.92:0/2684954320 shutdown_connections 2024-09-10T10:37:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.132+0000 7f8cc00ce740 1 -- 172.21.15.92:0/2684954320 wait complete. 2024-09-10T10:37:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.133+0000 7f8cc00ce740 1 -- start start 2024-09-10T10:37:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.133+0000 7f8cc00ce740 1 Processor -- start 2024-09-10T10:37:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.133+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.133+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.133+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cdb4ace880 con 0x55cdb4ac0af0 2024-09-10T10:37:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55cdb49ae290 con 0x55cdb4acbcb0 2024-09-10T10:37:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cdb4acea00 con 0x55cdb4ac1410 2024-09-10T10:37:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:46108/0 (socket says 172.21.15.92:46108) 2024-09-10T10:37:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cb77fe640 1 -- 172.21.15.92:0/1569569604 learned_addr learned my addr 172.21.15.92:0/1569569604 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cc00ce740 10 client.0 _ll_register_callbacks cb 0x55cdb49df140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8caffff640 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cb6ffd640 1 -- 172.21.15.92:0/1569569604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 msgr2=0x55cdb4ac9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cb6ffd640 1 -- 172.21.15.92:0/1569569604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 msgr2=0x55cdb4ac95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.134+0000 7f8cb6ffd640 1 -- 172.21.15.92:0/1569569604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdb4738210 con 0x55cdb4ac0af0 2024-09-10T10:37:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.135+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac8b20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800a320 tx=0x7f8ca80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1550d0aa844d736 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.135+0000 7f8c9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:37:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.135+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/1569569604 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca801dd50 con 0x55cdb4ac0af0 2024-09-10T10:37:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.135+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/1569569604 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f8ca801e430 con 0x55cdb4ac0af0 2024-09-10T10:37:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.135+0000 7f8cc00ce740 1 -- 172.21.15.92:0/1569569604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca00995f0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.135+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/1569569604 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8ca801e670 con 0x55cdb4ac0af0 2024-09-10T10:37:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.135+0000 7f8cc00ce740 10 client.15369 fetch_fsmap learned FSMap version 32 2024-09-10T10:37:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.135+0000 7f8cc00ce740 1 -- 172.21.15.92:0/1569569604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cdb4804620 con 0x55cdb4ac0af0 2024-09-10T10:37:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.135+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/1569569604 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca00995f0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/1569569604 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f8ca802e030 con 0x55cdb4ac0af0 2024-09-10T10:37:07.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8cc00ce740 10 client.15369 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T10:37:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8cc00ce740 10 client.15369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8cc00ce740 20 client.15369 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cdb4adbca0 0x55cdb4ade0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8cc00ce740 4 client.15369 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:37:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8cc00ce740 1 -- 172.21.15.92:0/1569569604 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdb4a32a20 con 0x55cdb4adbca0 2024-09-10T10:37:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8caffff640 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cdb4adbca0 0x55cdb4ade0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8caffff640 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cdb4adbca0 0x55cdb4ade0d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bf6e898ee65e590 server_cookie=b530cb045800c3d9 in_seq=0 out_seq=0 2024-09-10T10:37:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.136+0000 7f8c9e7fc640 10 client.15369 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/1569569604 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cdb4a32a20 con 0x55cdb4adbca0 2024-09-10T10:37:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8c9e7fc640 10 client.15369 handle_command_reply: tid=0 2024-09-10T10:37:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 client.15369 shutdown 2024-09-10T10:37:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 -- 172.21.15.92:0/1569569604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 msgr2=0x55cdb4ac8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac8b20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800a320 tx=0x7f8ca80046c0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 -- 172.21.15.92:0/1569569604 shutdown_connections 2024-09-10T10:37:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cdb4adbca0 0x55cdb4ade0d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8c9e7fc640 0 client.15369 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/1569569604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac8b20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 -- 172.21.15.92:0/1569569604 >> 172.21.15.92:0/1569569604 conn(0x55cdb4abd060 msgr2=0x55cdb4ac2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 -- 172.21.15.92:0/1569569604 shutdown_connections 2024-09-10T10:37:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 1 -- 172.21.15.92:0/1569569604 wait complete. 2024-09-10T10:37:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.137+0000 7f8cc00ce740 20 client.15369 trim_cache size 0 max 16384 2024-09-10T10:37:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cc00ce740 1 Processor -- start 2024-09-10T10:37:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cc00ce740 1 -- start start 2024-09-10T10:37:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ae39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9800e5d0 con 0x55cdb4ac1410 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8c980101a0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9800eca0 con 0x55cdb4acbcb0 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8caffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8caffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53224/0 (socket says 172.21.15.92:53224) 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8caffff640 1 -- 172.21.15.92:0/3324334192 learned_addr learned my addr 172.21.15.92:0/3324334192 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8cb77fe640 1 --2- 172.21.15.92:0/3324334192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ae39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8caffff640 1 -- 172.21.15.92:0/3324334192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4acbcb0 msgr2=0x55cdb4ae39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8caffff640 1 --2- 172.21.15.92:0/3324334192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ae39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8caffff640 1 -- 172.21.15.92:0/3324334192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac0af0 msgr2=0x55cdb4ac9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8caffff640 1 --2- 172.21.15.92:0/3324334192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.164 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.155+0000 7f8caffff640 1 -- 172.21.15.92:0/3324334192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdb4abce90 con 0x55cdb4ac1410 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.156+0000 7f8caffff640 1 --2- 172.21.15.92:0/3324334192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac95b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00a3ed0 tx=0x7f8ca009f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb0f129ea8f9bde server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.156+0000 7f8cacff9640 1 -- 172.21.15.92:0/3324334192 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00995f0 con 0x55cdb4ac1410 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.156+0000 7f8cacff9640 1 -- 172.21.15.92:0/3324334192 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca00a3ad0 con 0x55cdb4ac1410 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.156+0000 7f8cacff9640 1 -- 172.21.15.92:0/3324334192 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca009f3d0 con 0x55cdb4ac1410 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.157+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3324334192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac1410 msgr2=0x55cdb4ac95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.157+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3324334192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac95b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00a3ed0 tx=0x7f8ca009f820 comp rx=0 tx=0).stop 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.157+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3324334192 shutdown_connections 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.157+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3324334192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ae39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.157+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3324334192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac95b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.157+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3324334192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.157+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3324334192 >> 172.21.15.92:0/3324334192 conn(0x55cdb4abd060 msgr2=0x55cdb4acaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:07.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.157+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3324334192 shutdown_connections 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.157+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3324334192 wait complete. 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cc00ce740 1 -- start start 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cc00ce740 1 Processor -- start 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cc00ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9800fad0 con 0x55cdb4acbcb0 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9800f370 con 0x55cdb4ac1410 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cc00ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9800c5b0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cc00ce740 10 client.0 _ll_register_callbacks cb 0x7f8ca8010680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cb6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:46574/0 (socket says 172.21.15.92:46574) 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cb6ffd640 1 -- 172.21.15.92:0/3595042736 learned_addr learned my addr 172.21.15.92:0/3595042736 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8cb77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53232/0 (socket says 172.21.15.92:53232) 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.158+0000 7f8caffff640 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8cb6ffd640 1 -- 172.21.15.92:0/3595042736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac1410 msgr2=0x55cdb4ac61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8cb6ffd640 1 -- 172.21.15.92:0/3595042736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4acbcb0 msgr2=0x55cdb4ac66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8cb6ffd640 1 -- 172.21.15.92:0/3595042736 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdb4ab82d0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8cb6ffd640 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac5c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8026a70 tx=0x7f8ca800a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8033c19f8b0f763 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8c9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/3595042736 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca801db50 con 0x55cdb4ac0af0 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/3595042736 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f8ca801dcf0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3595042736 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca00a3ad0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/3595042736 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8ca8026aa0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8cc00ce740 10 client.24934 fetch_fsmap learned FSMap version 32 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3595042736 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cdb4b46c00 con 0x55cdb4ac0af0 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.159+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/3595042736 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca00a3ad0 con 0x55cdb4ac0af0 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/3595042736 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f8ca802e040 con 0x55cdb4ac0af0 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8cc00ce740 10 client.24934 fetch_fsmap finished waiting for FSMap version 32 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8cc00ce740 10 client.24934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8cc00ce740 20 client.24934 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cdb4adbca0 0x55cdb4b49480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8cc00ce740 4 client.24934 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3595042736 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cdb4a2cd70 con 0x55cdb4adbca0 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8caffff640 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cdb4adbca0 0x55cdb4b49480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8caffff640 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cdb4adbca0 0x55cdb4b49480 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b35fa940cd45f4f9 server_cookie=6312fa1cd97a8f9b in_seq=0 out_seq=0 2024-09-10T10:37:07.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.160+0000 7f8c9e7fc640 10 client.24934 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8c9e7fc640 1 -- 172.21.15.92:0/3595042736 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cdb4a2cd70 con 0x55cdb4adbca0 2024-09-10T10:37:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8c9e7fc640 10 client.24934 handle_command_reply: tid=0 2024-09-10T10:37:07.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 client.24934 shutdown 2024-09-10T10:37:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3595042736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac0af0 msgr2=0x55cdb4ac5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac5c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8026a70 tx=0x7f8ca800a440 comp rx=0 tx=0).stop 2024-09-10T10:37:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3595042736 shutdown_connections 2024-09-10T10:37:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cdb4acbcb0 0x55cdb4ac66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cdb4adbca0 0x55cdb4b49480 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cdb4ac1410 0x55cdb4ac61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8c9e7fc640 0 client.24934 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 --2- 172.21.15.92:0/3595042736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cdb4ac0af0 0x55cdb4ac5c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3595042736 >> 172.21.15.92:0/3595042736 conn(0x55cdb4abd060 msgr2=0x55cdb4abb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3595042736 shutdown_connections 2024-09-10T10:37:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 1 -- 172.21.15.92:0/3595042736 wait complete. 2024-09-10T10:37:07.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.179+0000 7f8cc00ce740 20 client.24934 trim_cache size 0 max 16384 2024-09-10T10:37:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:37:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:37:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:37:07.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 -- 172.21.15.92:0/19920415 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f8ca40a3020 msgr2=0x7f8ca40a54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f8ca40a3020 0x7f8ca40a54e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8005e10 tx=0x7f8ca8005da0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 -- 172.21.15.92:0/19920415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb8103690 msgr2=0x7f8cb8198160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb8103690 0x7f8cb8198160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000b450 tx=0x7f8ca000b910 comp rx=0 tx=0).stop 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 -- 172.21.15.92:0/19920415 shutdown_connections 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb810c100 0x7f8cb819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f8ca40a3020 0x7f8ca40a54e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8cb8103690 0x7f8cb8198160 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 --2- 172.21.15.92:0/19920415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cb8102d70 0x7f8cb8197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:07.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 -- 172.21.15.92:0/19920415 >> 172.21.15.92:0/19920415 conn(0x7f8cb80fc6c0 msgr2=0x7f8cb810e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 -- 172.21.15.92:0/19920415 shutdown_connections 2024-09-10T10:37:07.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:07.180+0000 7f8cbd331640 1 -- 172.21.15.92:0/19920415 wait complete. 2024-09-10T10:37:07.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:07 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:07.731 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:07 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:07.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:07 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 10.0 s, 3569.4 tps, lat 28.107 ms stddev 29.227 2024-09-10T10:37:08.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:08 smithi092 ceph-mon[30834]: pgmap v18: 97 pgs: 97 active+clean; 929 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 94 MiB/s wr, 523 op/s 2024-09-10T10:37:08.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:08 smithi121 ceph-mon[35231]: pgmap v18: 97 pgs: 97 active+clean; 929 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 94 MiB/s wr, 523 op/s 2024-09-10T10:37:08.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:08 smithi097 ceph-mon[35213]: pgmap v18: 97 pgs: 97 active+clean; 929 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 94 MiB/s wr, 523 op/s 2024-09-10T10:37:10.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:10 smithi092 ceph-mon[30834]: pgmap v19: 97 pgs: 97 active+clean; 929 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 MiB/s wr, 359 op/s 2024-09-10T10:37:10.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:10 smithi121 ceph-mon[35231]: pgmap v19: 97 pgs: 97 active+clean; 929 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 MiB/s wr, 359 op/s 2024-09-10T10:37:10.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:10 smithi097 ceph-mon[35213]: pgmap v19: 97 pgs: 97 active+clean; 929 MiB data, 935 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 MiB/s wr, 359 op/s 2024-09-10T10:37:12.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:12 smithi092 ceph-mon[30834]: pgmap v20: 97 pgs: 97 active+clean; 975 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 82 MiB/s wr, 698 op/s 2024-09-10T10:37:12.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:12 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:12.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:12 smithi121 ceph-mon[35231]: pgmap v20: 97 pgs: 97 active+clean; 975 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 82 MiB/s wr, 698 op/s 2024-09-10T10:37:12.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:12 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:12.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:12 smithi097 ceph-mon[35213]: pgmap v20: 97 pgs: 97 active+clean; 975 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 82 MiB/s wr, 698 op/s 2024-09-10T10:37:12.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:12 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 15.0 s, 3647.2 tps, lat 27.390 ms stddev 28.134 2024-09-10T10:37:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:14 smithi092 ceph-mon[30834]: pgmap v21: 97 pgs: 97 active+clean; 975 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 41 MiB/s wr, 639 op/s 2024-09-10T10:37:14.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:14 smithi121 ceph-mon[35231]: pgmap v21: 97 pgs: 97 active+clean; 975 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 41 MiB/s wr, 639 op/s 2024-09-10T10:37:14.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:14 smithi097 ceph-mon[35213]: pgmap v21: 97 pgs: 97 active+clean; 975 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 41 MiB/s wr, 639 op/s 2024-09-10T10:37:16.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:16 smithi092 ceph-mon[30834]: pgmap v22: 97 pgs: 97 active+clean; 992 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 44 MiB/s wr, 935 op/s 2024-09-10T10:37:16.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:16 smithi121 ceph-mon[35231]: pgmap v22: 97 pgs: 97 active+clean; 992 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 44 MiB/s wr, 935 op/s 2024-09-10T10:37:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:16 smithi097 ceph-mon[35213]: pgmap v22: 97 pgs: 97 active+clean; 992 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 44 MiB/s wr, 935 op/s 2024-09-10T10:37:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 20.0 s, 3477.2 tps, lat 28.718 ms stddev 31.831 2024-09-10T10:37:18.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:18 smithi092 ceph-mon[30834]: pgmap v23: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 18 MiB/s wr, 745 op/s 2024-09-10T10:37:18.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:18 smithi121 ceph-mon[35231]: pgmap v23: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 18 MiB/s wr, 745 op/s 2024-09-10T10:37:18.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:18 smithi097 ceph-mon[35213]: pgmap v23: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 18 MiB/s wr, 745 op/s 2024-09-10T10:37:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.308+0000 7f377215f640 1 -- 172.21.15.92:0/2072182041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c1069e0 msgr2=0x7f376c106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.308+0000 7f377215f640 1 --2- 172.21.15.92:0/2072182041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c1069e0 0x7f376c106dc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f375c009890 tx=0x7f375c02a380 comp rx=0 tx=0).stop 2024-09-10T10:37:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.308+0000 7f377215f640 1 -- 172.21.15.92:0/2072182041 shutdown_connections 2024-09-10T10:37:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.308+0000 7f377215f640 1 --2- 172.21.15.92:0/2072182041 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f376c101370 0x7f376c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.308+0000 7f377215f640 1 --2- 172.21.15.92:0/2072182041 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f376c1009d0 0x7f376c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.308+0000 7f377215f640 1 --2- 172.21.15.92:0/2072182041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c1069e0 0x7f376c106dc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.308+0000 7f377215f640 1 -- 172.21.15.92:0/2072182041 >> 172.21.15.92:0/2072182041 conn(0x7f376c0fc6b0 msgr2=0x7f376c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.308+0000 7f377215f640 1 -- 172.21.15.92:0/2072182041 shutdown_connections 2024-09-10T10:37:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.309+0000 7f377215f640 1 -- 172.21.15.92:0/2072182041 wait complete. 2024-09-10T10:37:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.309+0000 7f377215f640 1 Processor -- start 2024-09-10T10:37:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f377215f640 1 -- start start 2024-09-10T10:37:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f377215f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f376c1009d0 0x7f376c109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f377215f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c101370 0x7f376c109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f377215f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f376c1069e0 0x7f376c1aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f377215f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f376c10fcf0 con 0x7f376c101370 2024-09-10T10:37:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f377215f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f376c10fb70 con 0x7f376c1009d0 2024-09-10T10:37:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f377215f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f376c10fe70 con 0x7f376c1069e0 2024-09-10T10:37:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f3762ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c101370 0x7f376c109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f376bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f376c1069e0 0x7f376c1aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f3762ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c101370 0x7f376c109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59404/0 (socket says 172.21.15.92:59404) 2024-09-10T10:37:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f3762ffd640 1 -- 172.21.15.92:0/2535133075 learned_addr learned my addr 172.21.15.92:0/2535133075 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.310+0000 7f376b7fe640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f376c1009d0 0x7f376c109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.311+0000 7f3762ffd640 1 -- 172.21.15.92:0/2535133075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f376c1069e0 msgr2=0x7f376c1aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.311+0000 7f3762ffd640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f376c1069e0 0x7f376c1aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.311+0000 7f3762ffd640 1 -- 172.21.15.92:0/2535133075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f376c1009d0 msgr2=0x7f376c109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.311+0000 7f3762ffd640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f376c1009d0 0x7f376c109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.311+0000 7f3762ffd640 1 -- 172.21.15.92:0/2535133075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376c1aac10 con 0x7f376c101370 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.311+0000 7f376bfff640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f376c1069e0 0x7f376c1aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.312+0000 7f3762ffd640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c101370 0x7f376c109640 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f375400e9c0 tx=0x7f375400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.312+0000 7f37697fa640 1 -- 172.21.15.92:0/2535133075 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375400cd80 con 0x7f376c101370 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.312+0000 7f377215f640 1 -- 172.21.15.92:0/2535133075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376c1aaea0 con 0x7f376c101370 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.312+0000 7f37697fa640 1 -- 172.21.15.92:0/2535133075 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37540035f0 con 0x7f376c101370 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.312+0000 7f37697fa640 1 -- 172.21.15.92:0/2535133075 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754010670 con 0x7f376c101370 2024-09-10T10:37:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.312+0000 7f377215f640 1 -- 172.21.15.92:0/2535133075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376c1ab410 con 0x7f376c101370 2024-09-10T10:37:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.316+0000 7f3774fd6740 1 Processor -- start 2024-09-10T10:37:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.316+0000 7f3774fd6740 1 -- start start 2024-09-10T10:37:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.316+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef0af0 0x55caadef0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 0x55caadefb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadefe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f3774fd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55caade552f0 con 0x55caadefbcb0 2024-09-10T10:37:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f3774fd6740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55caaddfd270 con 0x55caadef0af0 2024-09-10T10:37:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f3774fd6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55caade512b0 con 0x55caadef1410 2024-09-10T10:37:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef0af0 0x55caadef0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 0x55caadefb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f37697fa640 1 -- 172.21.15.92:0/2535133075 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f37540037a0 con 0x7f376c101370 2024-09-10T10:37:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef0af0 0x55caadef0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:46888/0 (socket says 172.21.15.92:46888) 2024-09-10T10:37:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376bfff640 1 -- 172.21.15.92:0/1408102911 learned_addr learned my addr 172.21.15.92:0/1408102911 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f3762ffd640 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadefe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376bfff640 1 -- 172.21.15.92:0/1408102911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 msgr2=0x55caadefb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376bfff640 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 0x55caadefb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376bfff640 1 -- 172.21.15.92:0/1408102911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 msgr2=0x55caadefe0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376bfff640 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadefe0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376b7fe640 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 0x55caadefb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:37:20.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f376bfff640 1 -- 172.21.15.92:0/1408102911 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caaddfc340 con 0x55caadef0af0 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.317+0000 7f3762ffd640 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadefe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.318+0000 7f376bfff640 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef0af0 0x55caadef0ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3764011760 tx=0x7f3764011c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c97cf5dd30ba8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.318+0000 7f3761ffb640 1 -- 172.21.15.92:0/1408102911 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764004d20 con 0x55caadef0af0 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.318+0000 7f3761ffb640 1 -- 172.21.15.92:0/1408102911 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f376400f9a0 con 0x55caadef0af0 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.318+0000 7f3761ffb640 1 -- 172.21.15.92:0/1408102911 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764004590 con 0x55caadef0af0 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.318+0000 7f37697fa640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f37580a2f40 0x7f37580a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f376b7fe640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f37580a2f40 0x7f37580a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f37697fa640 1 -- 172.21.15.92:0/2535133075 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f37540cf950 con 0x7f376c101370 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f3774fd6740 1 -- 172.21.15.92:0/1408102911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef0af0 msgr2=0x55caadef0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f3774fd6740 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef0af0 0x55caadef0ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3764011760 tx=0x7f3764011c20 comp rx=0 tx=0).stop 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f376b7fe640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f37580a2f40 0x7f37580a5400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x55caadeedec0 tx=0x7f375c005850 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f3774fd6740 1 -- 172.21.15.92:0/1408102911 shutdown_connections 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f3774fd6740 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadefe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f3774fd6740 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 0x55caadefb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f3774fd6740 1 --2- 172.21.15.92:0/1408102911 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef0af0 0x55caadef0ed0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f3774fd6740 1 -- 172.21.15.92:0/1408102911 >> 172.21.15.92:0/1408102911 conn(0x55caadeed060 msgr2=0x55caadeed440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f3774fd6740 1 -- 172.21.15.92:0/1408102911 shutdown_connections 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.319+0000 7f3774fd6740 1 -- 172.21.15.92:0/1408102911 wait complete. 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.320+0000 7f3774fd6740 1 -- start start 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.320+0000 7f3774fd6740 1 Processor -- start 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadef8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef1410 0x55caadef90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadef95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f3774fd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55caadefe8d0 con 0x55caadefbcb0 2024-09-10T10:37:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f3774fd6740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55caaddde290 con 0x55caadef1410 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f3774fd6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55caadefea50 con 0x55caadef0af0 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f3774fd6740 10 client.0 _ll_register_callbacks cb 0x55caade0f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadef95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadef8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadef8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:51978/0 (socket says 172.21.15.92:51978) 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f3762ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef1410 0x55caadef90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376b7fe640 1 -- 172.21.15.92:0/3626885482 learned_addr learned my addr 172.21.15.92:0/3626885482 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadef95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59422/0 (socket says 172.21.15.92:59422) 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376b7fe640 1 -- 172.21.15.92:0/3626885482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef1410 msgr2=0x55caadef90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376b7fe640 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef1410 0x55caadef90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376b7fe640 1 -- 172.21.15.92:0/3626885482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 msgr2=0x55caadef95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376b7fe640 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadef95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376b7fe640 1 -- 172.21.15.92:0/3626885482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caadb68210 con 0x55caadef0af0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376bfff640 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadef95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f3762ffd640 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef1410 0x55caadef90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f376b7fe640 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadef8b60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f375c0095f0 tx=0x7f375c02a380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=118dbef21baf5b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.321+0000 7f374affd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f374affd640 1 -- 172.21.15.92:0/3626885482 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c04d020 con 0x55caadef0af0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f374affd640 1 -- 172.21.15.92:0/3626885482 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f375c02ac80 con 0x55caadef0af0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f3774fd6740 1 -- 172.21.15.92:0/3626885482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f376400f9a0 con 0x55caadef0af0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f374affd640 1 -- 172.21.15.92:0/3626885482 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f375c058050 con 0x55caadef0af0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f3774fd6740 10 client.24946 fetch_fsmap learned FSMap version 33 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f3774fd6740 1 -- 172.21.15.92:0/3626885482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55caadc34620 con 0x55caadef0af0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f374affd640 1 -- 172.21.15.92:0/3626885482 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f376400f9a0 con 0x55caadef0af0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f374affd640 1 -- 172.21.15.92:0/3626885482 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f375c0035f0 con 0x55caadef0af0 2024-09-10T10:37:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f3774fd6740 10 client.24946 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f3774fd6740 10 client.24946 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f3774fd6740 20 client.24946 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55caadf0bc40 0x55caadf0e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f3774fd6740 4 client.24946 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.322+0000 7f3774fd6740 1 -- 172.21.15.92:0/3626885482 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55caade62a20 con 0x55caadf0bc40 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.323+0000 7f3762ffd640 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55caadf0bc40 0x55caadf0e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.323+0000 7f3762ffd640 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55caadf0bc40 0x55caadf0e070 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80dec3c13e92a885 server_cookie=b2283ec497c3763c in_seq=0 out_seq=0 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.323+0000 7f374affd640 10 client.24946 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f374affd640 1 -- 172.21.15.92:0/3626885482 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55caade62a20 con 0x55caadf0bc40 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f374affd640 10 client.24946 handle_command_reply: tid=0 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 client.24946 shutdown 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 -- 172.21.15.92:0/3626885482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 msgr2=0x55caadef8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadef8b60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f375c0095f0 tx=0x7f375c02a380 comp rx=0 tx=0).stop 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 -- 172.21.15.92:0/3626885482 shutdown_connections 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadefbcb0 0x55caadef95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55caadf0bc40 0x55caadf0e070 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadef1410 0x55caadef90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3626885482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadef8b60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 -- 172.21.15.92:0/3626885482 >> 172.21.15.92:0/3626885482 conn(0x55caadeed060 msgr2=0x55caadeec1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f374affd640 0 client.24946 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 -- 172.21.15.92:0/3626885482 shutdown_connections 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 1 -- 172.21.15.92:0/3626885482 wait complete. 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.325+0000 7f3774fd6740 20 client.24946 trim_cache size 0 max 16384 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3774fd6740 1 Processor -- start 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3774fd6740 1 -- start start 2024-09-10T10:37:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadefaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef1410 0x55caadf13980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 0x55caadf13ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3774fd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1b3c60 con 0x55caadef1410 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3774fd6740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1b5860 con 0x55caadefbcb0 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3774fd6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1b4330 con 0x55caadef0af0 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f376b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadefaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3762ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef1410 0x55caadf13980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f376b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadefaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:51984/0 (socket says 172.21.15.92:51984) 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f376b7fe640 1 -- 172.21.15.92:0/122711705 learned_addr learned my addr 172.21.15.92:0/122711705 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f376bfff640 1 --2- 172.21.15.92:0/122711705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 0x55caadf13ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f376b7fe640 1 -- 172.21.15.92:0/122711705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 msgr2=0x55caadf13ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f376b7fe640 1 --2- 172.21.15.92:0/122711705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 0x55caadf13ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f376b7fe640 1 -- 172.21.15.92:0/122711705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef1410 msgr2=0x55caadf13980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f376b7fe640 1 --2- 172.21.15.92:0/122711705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef1410 0x55caadf13980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f376b7fe640 1 -- 172.21.15.92:0/122711705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caadef7090 con 0x55caadef0af0 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.345+0000 7f3762ffd640 1 --2- 172.21.15.92:0/122711705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef1410 0x55caadf13980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.346+0000 7f376b7fe640 1 --2- 172.21.15.92:0/122711705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadefaad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f375c000c00 tx=0x7f375c02a9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8312056e1c2a846 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.346+0000 7f37617fa640 1 -- 172.21.15.92:0/122711705 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c061070 con 0x55caadef0af0 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.346+0000 7f37617fa640 1 -- 172.21.15.92:0/122711705 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f375c02ac80 con 0x55caadef0af0 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.346+0000 7f37617fa640 1 -- 172.21.15.92:0/122711705 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c04d070 con 0x55caadef0af0 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 -- 172.21.15.92:0/122711705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 msgr2=0x55caadefaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 --2- 172.21.15.92:0/122711705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadefaad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f375c000c00 tx=0x7f375c02a9c0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 -- 172.21.15.92:0/122711705 shutdown_connections 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 --2- 172.21.15.92:0/122711705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 0x55caadf13ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 --2- 172.21.15.92:0/122711705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef1410 0x55caadf13980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 --2- 172.21.15.92:0/122711705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef0af0 0x55caadefaad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 -- 172.21.15.92:0/122711705 >> 172.21.15.92:0/122711705 conn(0x55caadeed060 msgr2=0x55caadefa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 -- 172.21.15.92:0/122711705 shutdown_connections 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 -- 172.21.15.92:0/122711705 wait complete. 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 -- start start 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.347+0000 7f3774fd6740 1 Processor -- start 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef0af0 0x55caadeff450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 0x55caadeff990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef0af0 0x55caadeff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f3774fd6740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 0x55caadf6e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef0af0 0x55caadeff450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59442/0 (socket says 172.21.15.92:59442) 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376b7fe640 1 -- 172.21.15.92:0/3898010011 learned_addr learned my addr 172.21.15.92:0/3898010011 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1b5190 con 0x55caadef0af0 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1b4a00 con 0x55caadefbcb0 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f376c1b1c40 con 0x55caadef1410 2024-09-10T10:37:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f3774fd6740 10 client.0 _ll_register_callbacks cb 0x7f375c041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f3762ffd640 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 0x55caadeff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376bfff640 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 0x55caadf6e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376b7fe640 1 -- 172.21.15.92:0/3898010011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 msgr2=0x55caadeff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376b7fe640 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 0x55caadeff990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376b7fe640 1 -- 172.21.15.92:0/3898010011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 msgr2=0x55caadf6e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376b7fe640 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 0x55caadf6e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376b7fe640 1 -- 172.21.15.92:0/3898010011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caadf6ef50 con 0x55caadef0af0 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376bfff640 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 0x55caadf6e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f376b7fe640 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef0af0 0x55caadeff450 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f375c02a970 tx=0x7f375c02ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6561468218a263 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.348+0000 7f374affd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.352+0000 7f374affd640 1 -- 172.21.15.92:0/3898010011 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c061070 con 0x55caadef0af0 2024-09-10T10:37:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f374affd640 1 -- 172.21.15.92:0/3898010011 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f375c030c40 con 0x55caadef0af0 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f375c02ac80 con 0x55caadef0af0 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f374affd640 1 -- 172.21.15.92:0/3898010011 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f375c06f050 con 0x55caadef0af0 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f3774fd6740 10 client.15390 fetch_fsmap learned FSMap version 33 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55caadf762f0 con 0x55caadef0af0 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f374affd640 1 -- 172.21.15.92:0/3898010011 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f375c02ac80 con 0x55caadef0af0 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f374affd640 1 -- 172.21.15.92:0/3898010011 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f375c0496b0 con 0x55caadef0af0 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f3774fd6740 10 client.15390 fetch_fsmap finished waiting for FSMap version 33 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f3774fd6740 10 client.15390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f3774fd6740 20 client.15390 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55caadf769d0 0x55caadf78df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f3774fd6740 4 client.15390 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.353+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55caade5cd70 con 0x55caadf769d0 2024-09-10T10:37:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.354+0000 7f3762ffd640 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55caadf769d0 0x55caadf78df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.354+0000 7f374affd640 10 client.15390 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.354+0000 7f3762ffd640 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55caadf769d0 0x55caadf78df0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce4e51ecb69317f8 server_cookie=e63d43226713cdc7 in_seq=0 out_seq=0 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.368+0000 7f374affd640 1 -- 172.21.15.92:0/3898010011 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55caade5cd70 con 0x55caadf769d0 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.368+0000 7f374affd640 10 client.15390 handle_command_reply: tid=0 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.368+0000 7f3774fd6740 1 client.15390 shutdown 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef0af0 msgr2=0x55caadeff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef0af0 0x55caadeff450 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f375c02a970 tx=0x7f375c02ae30 comp rx=0 tx=0).stop 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 shutdown_connections 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55caadf769d0 0x55caadf78df0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55caadefbcb0 0x55caadf6e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f374affd640 0 client.15390 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55caadef1410 0x55caadeff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 --2- 172.21.15.92:0/3898010011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55caadef0af0 0x55caadeff450 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 >> 172.21.15.92:0/3898010011 conn(0x55caadeed060 msgr2=0x55caadeeb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 shutdown_connections 2024-09-10T10:37:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 1 -- 172.21.15.92:0/3898010011 wait complete. 2024-09-10T10:37:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f3774fd6740 20 client.15390 trim_cache size 0 max 16384 2024-09-10T10:37:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:37:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:37:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:37:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:37:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f377215f640 1 -- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f37580a2f40 msgr2=0x7f37580a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f377215f640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f37580a2f40 0x7f37580a5400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x55caadeedec0 tx=0x7f375c005850 comp rx=0 tx=0).stop 2024-09-10T10:37:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f377215f640 1 -- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c101370 msgr2=0x7f376c109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.369+0000 7f377215f640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c101370 0x7f376c109640 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f375400e9c0 tx=0x7f375400ee80 comp rx=0 tx=0).stop 2024-09-10T10:37:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.370+0000 7f377215f640 1 -- 172.21.15.92:0/2535133075 shutdown_connections 2024-09-10T10:37:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.370+0000 7f377215f640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f376c1069e0 0x7f376c1aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.370+0000 7f377215f640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f376c101370 0x7f376c109640 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.370+0000 7f377215f640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f37580a2f40 0x7f37580a5400 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.370+0000 7f377215f640 1 --2- 172.21.15.92:0/2535133075 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f376c1009d0 0x7f376c109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.370+0000 7f377215f640 1 -- 172.21.15.92:0/2535133075 >> 172.21.15.92:0/2535133075 conn(0x7f376c0fc6b0 msgr2=0x7f376c0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.370+0000 7f377215f640 1 -- 172.21.15.92:0/2535133075 shutdown_connections 2024-09-10T10:37:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:20.370+0000 7f377215f640 1 -- 172.21.15.92:0/2535133075 wait complete. 2024-09-10T10:37:20.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:20 smithi092 ceph-mon[30834]: pgmap v24: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.2 MiB/s wr, 657 op/s 2024-09-10T10:37:20.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:20 smithi121 ceph-mon[35231]: pgmap v24: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.2 MiB/s wr, 657 op/s 2024-09-10T10:37:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:20 smithi097 ceph-mon[35213]: pgmap v24: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.2 MiB/s wr, 657 op/s 2024-09-10T10:37:22.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:22 smithi092 ceph-mon[30834]: pgmap v25: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 976 op/s 2024-09-10T10:37:22.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:22 smithi121 ceph-mon[35231]: pgmap v25: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 976 op/s 2024-09-10T10:37:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:22 smithi097 ceph-mon[35213]: pgmap v25: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 976 op/s 2024-09-10T10:37:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 25.0 s, 3744.4 tps, lat 26.688 ms stddev 26.588 2024-09-10T10:37:24.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:24 smithi092 ceph-mon[30834]: pgmap v26: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.7 MiB/s wr, 637 op/s 2024-09-10T10:37:24.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:24 smithi121 ceph-mon[35231]: pgmap v26: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.7 MiB/s wr, 637 op/s 2024-09-10T10:37:24.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:24 smithi097 ceph-mon[35213]: pgmap v26: 97 pgs: 97 active+clean; 1.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.7 MiB/s wr, 637 op/s 2024-09-10T10:37:26.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:26 smithi121 ceph-mon[35231]: pgmap v27: 97 pgs: 97 active+clean; 1.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 12 MiB/s wr, 1k op/s 2024-09-10T10:37:26.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:26 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:26.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:26 smithi097 ceph-mon[35213]: pgmap v27: 97 pgs: 97 active+clean; 1.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 12 MiB/s wr, 1k op/s 2024-09-10T10:37:26.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:26 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:26.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:26 smithi092 ceph-mon[30834]: pgmap v27: 97 pgs: 97 active+clean; 1.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 12 MiB/s wr, 1k op/s 2024-09-10T10:37:26.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:26 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:37:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 30.0 s, 3514.0 tps, lat 28.472 ms stddev 29.308 2024-09-10T10:37:28.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:28 smithi121 ceph-mon[35231]: pgmap v28: 97 pgs: 97 active+clean; 1.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.7 MiB/s wr, 704 op/s 2024-09-10T10:37:28.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:28 smithi097 ceph-mon[35213]: pgmap v28: 97 pgs: 97 active+clean; 1.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.7 MiB/s wr, 704 op/s 2024-09-10T10:37:28.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:28 smithi092 ceph-mon[30834]: pgmap v28: 97 pgs: 97 active+clean; 1.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.7 MiB/s wr, 704 op/s 2024-09-10T10:37:30.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:30 smithi121 ceph-mon[35231]: pgmap v29: 97 pgs: 97 active+clean; 1.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.5 MiB/s wr, 683 op/s 2024-09-10T10:37:30.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:30 smithi097 ceph-mon[35213]: pgmap v29: 97 pgs: 97 active+clean; 1.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.5 MiB/s wr, 683 op/s 2024-09-10T10:37:30.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:30 smithi092 ceph-mon[30834]: pgmap v29: 97 pgs: 97 active+clean; 1.0 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 8.5 MiB/s wr, 683 op/s 2024-09-10T10:37:31.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:31 smithi121 ceph-mon[35231]: pgmap v30: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 1.02k op/s 2024-09-10T10:37:31.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:31 smithi097 ceph-mon[35213]: pgmap v30: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 1.02k op/s 2024-09-10T10:37:31.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:31 smithi092 ceph-mon[30834]: pgmap v30: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 1.02k op/s 2024-09-10T10:37:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 35.0 s, 3405.2 tps, lat 29.363 ms stddev 29.198 2024-09-10T10:37:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.494+0000 7fa24eea5640 1 -- 172.21.15.92:0/1255804828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa248101d70 msgr2=0x7fa248102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.494+0000 7fa24eea5640 1 --2- 172.21.15.92:0/1255804828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa248101d70 0x7fa248102220 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa240009c10 tx=0x7fa24002a6e0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 -- 172.21.15.92:0/1255804828 shutdown_connections 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 --2- 172.21.15.92:0/1255804828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa248101d70 0x7fa248102220 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 --2- 172.21.15.92:0/1255804828 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa248069480 0x7fa2481009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 --2- 172.21.15.92:0/1255804828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa248069010 0x7fa248100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 -- 172.21.15.92:0/1255804828 >> 172.21.15.92:0/1255804828 conn(0x7fa2480770f0 msgr2=0x7fa2480fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 -- 172.21.15.92:0/1255804828 shutdown_connections 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 -- 172.21.15.92:0/1255804828 wait complete. 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 Processor -- start 2024-09-10T10:37:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 -- start start 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa248069010 0x7fa248196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa248069480 0x7fa2481965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa248101d70 0x7fa24819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa24810fce0 con 0x7fa248069010 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa24810fb60 con 0x7fa248101d70 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24eea5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa24810fe60 con 0x7fa248069480 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24cc41640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa248069010 0x7fa248196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.495+0000 7fa24cc41640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa248069010 0x7fa248196070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60222/0 (socket says 172.21.15.92:60222) 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.496+0000 7fa24cc41640 1 -- 172.21.15.92:0/255475532 learned_addr learned my addr 172.21.15.92:0/255475532 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.496+0000 7fa247fff640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa248069480 0x7fa2481965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.496+0000 7fa24d442640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa248101d70 0x7fa24819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.496+0000 7fa24cc41640 1 -- 172.21.15.92:0/255475532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa248069480 msgr2=0x7fa2481965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.496+0000 7fa24cc41640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa248069480 0x7fa2481965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.496+0000 7fa24cc41640 1 -- 172.21.15.92:0/255475532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa248101d70 msgr2=0x7fa24819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.496+0000 7fa24cc41640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa248101d70 0x7fa24819a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.496+0000 7fa24cc41640 1 -- 172.21.15.92:0/255475532 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24819b060 con 0x7fa248069010 2024-09-10T10:37:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.497+0000 7fa24cc41640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa248069010 0x7fa248196070 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009a80 tx=0x7fa23c009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.498+0000 7fa245ffb640 1 -- 172.21.15.92:0/255475532 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c007c70 con 0x7fa248069010 2024-09-10T10:37:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.498+0000 7fa245ffb640 1 -- 172.21.15.92:0/255475532 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa23c01c070 con 0x7fa248069010 2024-09-10T10:37:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.498+0000 7fa245ffb640 1 -- 172.21.15.92:0/255475532 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c016680 con 0x7fa248069010 2024-09-10T10:37:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.498+0000 7fa24eea5640 1 -- 172.21.15.92:0/255475532 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24819b350 con 0x7fa248069010 2024-09-10T10:37:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.498+0000 7fa24eea5640 1 -- 172.21.15.92:0/255475532 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2481a2be0 con 0x7fa248069010 2024-09-10T10:37:33.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.501+0000 7fa251c46740 1 Processor -- start 2024-09-10T10:37:33.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.501+0000 7fa245ffb640 1 -- 172.21.15.92:0/255475532 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7fa23c0173f0 con 0x7fa248069010 2024-09-10T10:37:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.502+0000 7fa251c46740 1 -- start start 2024-09-10T10:37:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.502+0000 7fa251c46740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b0f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.502+0000 7fa251c46740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b10310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.502+0000 7fa251c46740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 0x555ab1b25740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.502+0000 7fa251c46740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555ab1a742f0 con 0x555ab1b23350 2024-09-10T10:37:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.502+0000 7fa251c46740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x555ab1a1c270 con 0x555ab1b0fed0 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.502+0000 7fa251c46740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555ab1a702b0 con 0x555ab1b11080 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.502+0000 7fa24d442640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b0f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24d442640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b0f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:49556/0 (socket says 172.21.15.92:49556) 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24d442640 1 -- 172.21.15.92:0/116677117 learned_addr learned my addr 172.21.15.92:0/116677117 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa247fff640 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 0x555ab1b25740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24d442640 1 -- 172.21.15.92:0/116677117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 msgr2=0x555ab1b10310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24cc41640 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b10310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24d442640 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b10310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24d442640 1 -- 172.21.15.92:0/116677117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 msgr2=0x555ab1b25740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24d442640 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 0x555ab1b25740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24d442640 1 -- 172.21.15.92:0/116677117 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab1a1b340 con 0x555ab1b11080 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa247fff640 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 0x555ab1b25740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:37:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24cc41640 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b10310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:37:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa245ffb640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa2380a2f40 0x7fa2380a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24d442640 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b0f990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa240009be0 tx=0x7fa240030a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bb54445c455ec4f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.503+0000 7fa24cc41640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa2380a2f40 0x7fa2380a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.504+0000 7fa245ffb640 1 -- 172.21.15.92:0/255475532 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fa23c0cf1c0 con 0x7fa248069010 2024-09-10T10:37:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.504+0000 7fa232ffd640 1 -- 172.21.15.92:0/116677117 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240041030 con 0x555ab1b11080 2024-09-10T10:37:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.504+0000 7fa232ffd640 1 -- 172.21.15.92:0/116677117 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa240030c60 con 0x555ab1b11080 2024-09-10T10:37:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.504+0000 7fa232ffd640 1 -- 172.21.15.92:0/116677117 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240036040 con 0x555ab1b11080 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.505+0000 7fa251c46740 1 -- 172.21.15.92:0/116677117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 msgr2=0x555ab1b0f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.505+0000 7fa251c46740 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b0f990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa240009be0 tx=0x7fa240030a30 comp rx=0 tx=0).stop 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.505+0000 7fa251c46740 1 -- 172.21.15.92:0/116677117 shutdown_connections 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.505+0000 7fa251c46740 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 0x555ab1b25740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.505+0000 7fa251c46740 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b10310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.505+0000 7fa251c46740 1 --2- 172.21.15.92:0/116677117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b0f990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.505+0000 7fa251c46740 1 -- 172.21.15.92:0/116677117 >> 172.21.15.92:0/116677117 conn(0x555ab1b0c060 msgr2=0x555ab1b0c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.506+0000 7fa24cc41640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa2380a2f40 0x7fa2380a5400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0ce9f0 tx=0x7fa23c000bc0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.506+0000 7fa251c46740 1 -- 172.21.15.92:0/116677117 shutdown_connections 2024-09-10T10:37:33.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.506+0000 7fa251c46740 1 -- 172.21.15.92:0/116677117 wait complete. 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.506+0000 7fa251c46740 1 -- start start 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.506+0000 7fa251c46740 1 Processor -- start 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa251c46740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b1cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa251c46740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b22c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa251c46740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 0x555ab1b1d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa251c46740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555ab1b16f20 con 0x555ab1b23350 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa251c46740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x555ab19fd290 con 0x555ab1b0fed0 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa251c46740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555ab1b170a0 con 0x555ab1b11080 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa251c46740 10 client.0 _ll_register_callbacks cb 0x555ab1a2e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa24d442640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b1cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa247fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b22c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa24d442640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b1cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:47272/0 (socket says 172.21.15.92:47272) 2024-09-10T10:37:33.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa24d442640 1 -- 172.21.15.92:0/107246747 learned_addr learned my addr 172.21.15.92:0/107246747 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:33.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.507+0000 7fa24d442640 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 0x555ab1b1d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.508+0000 7fa24d442640 1 -- 172.21.15.92:0/107246747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 msgr2=0x555ab1b22c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.508+0000 7fa24d442640 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b22c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.508+0000 7fa24d442640 1 -- 172.21.15.92:0/107246747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 msgr2=0x555ab1b1d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.508+0000 7fa24d442640 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 0x555ab1b1d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.508+0000 7fa24d442640 1 -- 172.21.15.92:0/107246747 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab1787210 con 0x555ab1b0fed0 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.508+0000 7fa24d442640 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b1cf20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2400099a0 tx=0x7fa240003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8b7be26ab6e5b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.508+0000 7fa227fff640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.508+0000 7fa227fff640 1 -- 172.21.15.92:0/107246747 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240041070 con 0x555ab1b0fed0 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.508+0000 7fa227fff640 1 -- 172.21.15.92:0/107246747 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fa2400303a0 con 0x555ab1b0fed0 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.509+0000 7fa251c46740 1 -- 172.21.15.92:0/107246747 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa240030c60 con 0x555ab1b0fed0 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.509+0000 7fa227fff640 1 -- 172.21.15.92:0/107246747 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa240036040 con 0x555ab1b0fed0 2024-09-10T10:37:33.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.509+0000 7fa251c46740 10 client.24929 fetch_fsmap learned FSMap version 34 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.509+0000 7fa251c46740 1 -- 172.21.15.92:0/107246747 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555ab1853620 con 0x555ab1b0fed0 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.509+0000 7fa227fff640 1 -- 172.21.15.92:0/107246747 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa240030c60 con 0x555ab1b0fed0 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.509+0000 7fa227fff640 1 -- 172.21.15.92:0/107246747 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fa24003d580 con 0x555ab1b0fed0 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.510+0000 7fa251c46740 10 client.24929 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.510+0000 7fa251c46740 10 client.24929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.510+0000 7fa251c46740 20 client.24929 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.510+0000 7fa251c46740 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x555ab1b3ba60 0x555ab1b3de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.510+0000 7fa251c46740 4 client.24929 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.510+0000 7fa251c46740 1 -- 172.21.15.92:0/107246747 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ab1a81a20 con 0x555ab1b3ba60 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.510+0000 7fa247fff640 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x555ab1b3ba60 0x555ab1b3de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.510+0000 7fa247fff640 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x555ab1b3ba60 0x555ab1b3de50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4348a8cc21627a95 server_cookie=829d21c1a9b417f4 in_seq=0 out_seq=0 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.510+0000 7fa227fff640 10 client.24929 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.511+0000 7fa227fff640 1 -- 172.21.15.92:0/107246747 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ab1a81a20 con 0x555ab1b3ba60 2024-09-10T10:37:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.511+0000 7fa227fff640 10 client.24929 handle_command_reply: tid=0 2024-09-10T10:37:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.511+0000 7fa251c46740 1 client.24929 shutdown 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.512+0000 7fa251c46740 1 -- 172.21.15.92:0/107246747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 msgr2=0x555ab1b1cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.512+0000 7fa251c46740 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b1cf20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2400099a0 tx=0x7fa240003cd0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.512+0000 7fa251c46740 1 -- 172.21.15.92:0/107246747 shutdown_connections 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.512+0000 7fa251c46740 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b23350 0x555ab1b1d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.512+0000 7fa251c46740 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b11080 0x555ab1b22c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.512+0000 7fa251c46740 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x555ab1b3ba60 0x555ab1b3de50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.512+0000 7fa227fff640 0 client.24929 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.512+0000 7fa251c46740 1 --2- 172.21.15.92:0/107246747 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b0fed0 0x555ab1b1cf20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.512+0000 7fa251c46740 1 -- 172.21.15.92:0/107246747 >> 172.21.15.92:0/107246747 conn(0x555ab1b0c060 msgr2=0x555ab1b11dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.513+0000 7fa251c46740 1 -- 172.21.15.92:0/107246747 shutdown_connections 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.513+0000 7fa251c46740 1 -- 172.21.15.92:0/107246747 wait complete. 2024-09-10T10:37:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.513+0000 7fa251c46740 20 client.24929 trim_cache size 0 max 16384 2024-09-10T10:37:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.533+0000 7fa251c46740 1 Processor -- start 2024-09-10T10:37:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.533+0000 7fa251c46740 1 -- start start 2024-09-10T10:37:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.533+0000 7fa251c46740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b0fed0 0x555ab1b22c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.534+0000 7fa251c46740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b11080 0x555ab1b1cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.534+0000 7fa251c46740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b23350 0x555ab1b12a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.534+0000 7fa251c46740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481ab350 con 0x555ab1b11080 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.534+0000 7fa251c46740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481acf80 con 0x555ab1b23350 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.534+0000 7fa251c46740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481aba50 con 0x555ab1b0fed0 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.534+0000 7fa247fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b11080 0x555ab1b1cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.534+0000 7fa247fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b11080 0x555ab1b1cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60236/0 (socket says 172.21.15.92:60236) 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.534+0000 7fa247fff640 1 -- 172.21.15.92:0/617771523 learned_addr learned my addr 172.21.15.92:0/617771523 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.534+0000 7fa24d442640 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b0fed0 0x555ab1b22c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa24d442640 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b23350 0x555ab1b12a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa24d442640 1 -- 172.21.15.92:0/617771523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b23350 msgr2=0x555ab1b12a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:33.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa24d442640 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b23350 0x555ab1b12a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa24d442640 1 -- 172.21.15.92:0/617771523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b11080 msgr2=0x555ab1b1cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa24d442640 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b11080 0x555ab1b1cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa24d442640 1 -- 172.21.15.92:0/617771523 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab1b38cd0 con 0x555ab1b0fed0 2024-09-10T10:37:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa247fff640 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b11080 0x555ab1b1cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa24d442640 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b0fed0 0x555ab1b22c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa24003da20 tx=0x7fa24002a6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3f39413a9329481 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa2327fc640 1 -- 172.21.15.92:0/617771523 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240041070 con 0x555ab1b0fed0 2024-09-10T10:37:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa2327fc640 1 -- 172.21.15.92:0/617771523 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa240030c60 con 0x555ab1b0fed0 2024-09-10T10:37:33.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.535+0000 7fa2327fc640 1 -- 172.21.15.92:0/617771523 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2400303a0 con 0x555ab1b0fed0 2024-09-10T10:37:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.536+0000 7fa251c46740 1 -- 172.21.15.92:0/617771523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b0fed0 msgr2=0x555ab1b22c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.536+0000 7fa251c46740 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b0fed0 0x555ab1b22c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa24003da20 tx=0x7fa24002a6e0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.536+0000 7fa251c46740 1 -- 172.21.15.92:0/617771523 shutdown_connections 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.536+0000 7fa251c46740 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b23350 0x555ab1b12a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.536+0000 7fa251c46740 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b11080 0x555ab1b1cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.536+0000 7fa251c46740 1 --2- 172.21.15.92:0/617771523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b0fed0 0x555ab1b22c70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.536+0000 7fa251c46740 1 -- 172.21.15.92:0/617771523 >> 172.21.15.92:0/617771523 conn(0x555ab1b0c060 msgr2=0x555ab1b15e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.536+0000 7fa251c46740 1 -- 172.21.15.92:0/617771523 shutdown_connections 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.537+0000 7fa251c46740 1 -- 172.21.15.92:0/617771523 wait complete. 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.537+0000 7fa251c46740 1 -- start start 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.537+0000 7fa251c46740 1 Processor -- start 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa251c46740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b0fed0 0x555ab1b4f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa251c46740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b11080 0x555ab1b42ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa251c46740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b23350 0x555ab1b43220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa251c46740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481ac8b0 con 0x555ab1b0fed0 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa251c46740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481ac120 con 0x555ab1b11080 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa251c46740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2481a9330 con 0x555ab1b23350 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa251c46740 10 client.0 _ll_register_callbacks cb 0x7fa234005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa24d442640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b0fed0 0x555ab1b4f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa24d442640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b0fed0 0x555ab1b4f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60240/0 (socket says 172.21.15.92:60240) 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa24d442640 1 -- 172.21.15.92:0/312887188 learned_addr learned my addr 172.21.15.92:0/312887188 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa247fff640 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b11080 0x555ab1b42ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa24d442640 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b23350 0x555ab1b43220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa24d442640 1 -- 172.21.15.92:0/312887188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b23350 msgr2=0x555ab1b43220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa24d442640 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b23350 0x555ab1b43220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa24d442640 1 -- 172.21.15.92:0/312887188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b11080 msgr2=0x555ab1b42ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa24d442640 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b11080 0x555ab1b42ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa24d442640 1 -- 172.21.15.92:0/312887188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab1b43910 con 0x555ab1b0fed0 2024-09-10T10:37:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.538+0000 7fa247fff640 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b11080 0x555ab1b42ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.539+0000 7fa24d442640 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b0fed0 0x555ab1b4f800 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa240005f00 tx=0x7fa240000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6ad8a359bf0a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.539+0000 7fa227fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:37:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.539+0000 7fa227fff640 1 -- 172.21.15.92:0/312887188 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240041030 con 0x555ab1b0fed0 2024-09-10T10:37:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.539+0000 7fa227fff640 1 -- 172.21.15.92:0/312887188 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fa2400303a0 con 0x555ab1b0fed0 2024-09-10T10:37:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.539+0000 7fa251c46740 1 -- 172.21.15.92:0/312887188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa240030c60 con 0x555ab1b0fed0 2024-09-10T10:37:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.540+0000 7fa227fff640 1 -- 172.21.15.92:0/312887188 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa240003c30 con 0x555ab1b0fed0 2024-09-10T10:37:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.540+0000 7fa251c46740 10 client.15405 fetch_fsmap learned FSMap version 34 2024-09-10T10:37:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.540+0000 7fa251c46740 1 -- 172.21.15.92:0/312887188 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555ab1ba6330 con 0x555ab1b0fed0 2024-09-10T10:37:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.540+0000 7fa227fff640 1 -- 172.21.15.92:0/312887188 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa240030c60 con 0x555ab1b0fed0 2024-09-10T10:37:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.540+0000 7fa227fff640 1 -- 172.21.15.92:0/312887188 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7fa240061450 con 0x555ab1b0fed0 2024-09-10T10:37:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.540+0000 7fa251c46740 10 client.15405 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T10:37:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.541+0000 7fa251c46740 10 client.15405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.541+0000 7fa251c46740 20 client.15405 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.541+0000 7fa251c46740 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x555ab1b3ba60 0x555ab1ba89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.541+0000 7fa251c46740 4 client.15405 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:37:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.541+0000 7fa251c46740 1 -- 172.21.15.92:0/312887188 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555ab1a7bd70 con 0x555ab1b3ba60 2024-09-10T10:37:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.541+0000 7fa247fff640 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x555ab1b3ba60 0x555ab1ba89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.542+0000 7fa247fff640 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x555ab1b3ba60 0x555ab1ba89b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d040a61647b0ec1c server_cookie=f0664250d1826724 in_seq=0 out_seq=0 2024-09-10T10:37:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.542+0000 7fa227fff640 10 client.15405 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.555+0000 7fa227fff640 1 -- 172.21.15.92:0/312887188 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555ab1a7bd70 con 0x555ab1b3ba60 2024-09-10T10:37:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.555+0000 7fa227fff640 10 client.15405 handle_command_reply: tid=0 2024-09-10T10:37:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 client.15405 shutdown 2024-09-10T10:37:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 -- 172.21.15.92:0/312887188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b0fed0 msgr2=0x555ab1b4f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b0fed0 0x555ab1b4f800 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa240005f00 tx=0x7fa240000f40 comp rx=0 tx=0).stop 2024-09-10T10:37:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 -- 172.21.15.92:0/312887188 shutdown_connections 2024-09-10T10:37:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555ab1b23350 0x555ab1b43220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x555ab1b3ba60 0x555ab1ba89b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x555ab1b11080 0x555ab1b42ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 --2- 172.21.15.92:0/312887188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555ab1b0fed0 0x555ab1b4f800 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 -- 172.21.15.92:0/312887188 >> 172.21.15.92:0/312887188 conn(0x555ab1b0c060 msgr2=0x555ab1b0c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa227fff640 0 client.15405 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.556+0000 7fa251c46740 1 -- 172.21.15.92:0/312887188 shutdown_connections 2024-09-10T10:37:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa251c46740 1 -- 172.21.15.92:0/312887188 wait complete. 2024-09-10T10:37:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa251c46740 20 client.15405 trim_cache size 0 max 16384 2024-09-10T10:37:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:37:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:37:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:37:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:37:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 -- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa2380a2f40 msgr2=0x7fa2380a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa2380a2f40 0x7fa2380a5400 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0ce9f0 tx=0x7fa23c000bc0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 -- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa248069010 msgr2=0x7fa248196070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa248069010 0x7fa248196070 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009a80 tx=0x7fa23c009f40 comp rx=0 tx=0).stop 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 -- 172.21.15.92:0/255475532 shutdown_connections 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa2380a2f40 0x7fa2380a5400 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa248101d70 0x7fa24819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa248069480 0x7fa2481965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 --2- 172.21.15.92:0/255475532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa248069010 0x7fa248196070 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 -- 172.21.15.92:0/255475532 >> 172.21.15.92:0/255475532 conn(0x7fa2480770f0 msgr2=0x7fa248103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 -- 172.21.15.92:0/255475532 shutdown_connections 2024-09-10T10:37:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:33.557+0000 7fa24eea5640 1 -- 172.21.15.92:0/255475532 wait complete. 2024-09-10T10:37:33.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:33 smithi121 ceph-mon[35231]: pgmap v31: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 14 MiB/s wr, 703 op/s 2024-09-10T10:37:33.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:33 smithi097 ceph-mon[35213]: pgmap v31: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 14 MiB/s wr, 703 op/s 2024-09-10T10:37:33.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:33 smithi092 ceph-mon[30834]: pgmap v31: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 14 MiB/s wr, 703 op/s 2024-09-10T10:37:35.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:35 smithi121 ceph-mon[35231]: pgmap v32: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-09-10T10:37:35.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:35 smithi097 ceph-mon[35213]: pgmap v32: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-09-10T10:37:35.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:35 smithi092 ceph-mon[30834]: pgmap v32: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 18 MiB/s wr, 1.01k op/s 2024-09-10T10:37:37.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:37 smithi121 ceph-mon[35231]: pgmap v33: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-09-10T10:37:37.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:37 smithi097 ceph-mon[35213]: pgmap v33: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-09-10T10:37:37.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:37 smithi092 ceph-mon[30834]: pgmap v33: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-09-10T10:37:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 40.0 s, 3497.4 tps, lat 28.633 ms stddev 28.026 2024-09-10T10:37:39.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:39 smithi121 ceph-mon[35231]: pgmap v34: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-09-10T10:37:39.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:39 smithi097 ceph-mon[35213]: pgmap v34: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-09-10T10:37:39.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:39 smithi092 ceph-mon[30834]: pgmap v34: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-09-10T10:37:41.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:41 smithi121 ceph-mon[35231]: pgmap v35: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 974 op/s 2024-09-10T10:37:41.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:41 smithi097 ceph-mon[35213]: pgmap v35: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 974 op/s 2024-09-10T10:37:41.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:41 smithi092 ceph-mon[30834]: pgmap v35: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 974 op/s 2024-09-10T10:37:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 45.0 s, 3394.0 tps, lat 29.335 ms stddev 31.921 2024-09-10T10:37:43.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:43 smithi121 ceph-mon[35231]: pgmap v36: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.0 MiB/s wr, 633 op/s 2024-09-10T10:37:43.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:37:43.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:37:43.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:37:43.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:37:43.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:43 smithi097 ceph-mon[35213]: pgmap v36: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.0 MiB/s wr, 633 op/s 2024-09-10T10:37:43.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:37:43.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:37:43.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:37:43.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:37:43.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:43 smithi092 ceph-mon[30834]: pgmap v36: 97 pgs: 97 active+clean; 1.1 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.0 MiB/s wr, 633 op/s 2024-09-10T10:37:43.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:37:43.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:37:43.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:37:43.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:37:45.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:45 smithi121 ceph-mon[35231]: pgmap v37: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2024-09-10T10:37:45.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:45 smithi097 ceph-mon[35213]: pgmap v37: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2024-09-10T10:37:45.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:45 smithi092 ceph-mon[30834]: pgmap v37: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 16 MiB/s wr, 1.05k op/s 2024-09-10T10:37:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/3036362471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe01009d0 msgr2=0x7f9fe0100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/3036362471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe01009d0 0x7f9fe0100e30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009930 tx=0x7f9fc802a420 comp rx=0 tx=0).stop 2024-09-10T10:37:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/3036362471 shutdown_connections 2024-09-10T10:37:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/3036362471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe0101370 0x7f9fe010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/3036362471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe01009d0 0x7f9fe0100e30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/3036362471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe01069e0 0x7f9fe0106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/3036362471 >> 172.21.15.92:0/3036362471 conn(0x7f9fe00fc6f0 msgr2=0x7f9fe00feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/3036362471 shutdown_connections 2024-09-10T10:37:46.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/3036362471 wait complete. 2024-09-10T10:37:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.675+0000 7f9fe5f4b640 1 Processor -- start 2024-09-10T10:37:46.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fe5f4b640 1 -- start start 2024-09-10T10:37:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fe5f4b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe01009d0 0x7f9fe0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fe5f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe0101370 0x7f9fe01988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fe5f4b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe01069e0 0x7f9fe019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fe5f4b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0110e20 con 0x7f9fe0101370 2024-09-10T10:37:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fe5f4b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0110ca0 con 0x7f9fe01069e0 2024-09-10T10:37:46.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fe5f4b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0110fa0 con 0x7f9fe01009d0 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fdeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe0101370 0x7f9fe01988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fdeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe0101370 0x7f9fe01988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43984/0 (socket says 172.21.15.92:43984) 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe01069e0 0x7f9fe019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fdeffd640 1 -- 172.21.15.92:0/1432866165 learned_addr learned my addr 172.21.15.92:0/1432866165 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe01009d0 0x7f9fe0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fdf7fe640 1 -- 172.21.15.92:0/1432866165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe01069e0 msgr2=0x7f9fe019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.676+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe01069e0 0x7f9fe019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fdf7fe640 1 -- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe0101370 msgr2=0x7f9fe01988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe0101370 0x7f9fe01988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fdf7fe640 1 -- 172.21.15.92:0/1432866165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe019d350 con 0x7f9fe01009d0 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe0101370 0x7f9fe01988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:46.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fdffff640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe01069e0 0x7f9fe019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe01009d0 0x7f9fe0198360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800ec80 tx=0x7f9fd800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fdcff9640 1 -- 172.21.15.92:0/1432866165 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8003b70 con 0x7f9fe01009d0 2024-09-10T10:37:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fdcff9640 1 -- 172.21.15.92:0/1432866165 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd8003d10 con 0x7f9fe01009d0 2024-09-10T10:37:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fdcff9640 1 -- 172.21.15.92:0/1432866165 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8010a30 con 0x7f9fe01009d0 2024-09-10T10:37:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.677+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/1432866165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe019d640 con 0x7f9fe01009d0 2024-09-10T10:37:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.678+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/1432866165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe01a4ed0 con 0x7f9fe01009d0 2024-09-10T10:37:46.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.680+0000 7f9fdcff9640 1 -- 172.21.15.92:0/1432866165 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f9fd8003ec0 con 0x7f9fe01009d0 2024-09-10T10:37:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fe8dc1740 1 Processor -- start 2024-09-10T10:37:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdcff9640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a3020 0x7f9fcc0a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fe8dc1740 1 -- start start 2024-09-10T10:37:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfb8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdcff9640 1 -- 172.21.15.92:0/1432866165 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f9fd80cfc60 con 0x7f9fe01009d0 2024-09-10T10:37:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fe8dc1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55901cf1d2f0 con 0x55901cfc3cb0 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fe8dc1740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55901cec5270 con 0x55901cfb9410 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fe8dc1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55901cf192b0 con 0x55901cfb8af0 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdffff640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a3020 0x7f9fcc0a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdeffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdf7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfb8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdf7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfb8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:57406/0 (socket says 172.21.15.92:57406) 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdeffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:41100/0 (socket says 172.21.15.92:41100) 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdf7fe640 1 -- 172.21.15.92:0/4271017695 learned_addr learned my addr 172.21.15.92:0/4271017695 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdffff640 1 --2- 172.21.15.92:0/4271017695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdf7fe640 1 -- 172.21.15.92:0/4271017695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 msgr2=0x55901cfc3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/4271017695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdf7fe640 1 -- 172.21.15.92:0/4271017695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 msgr2=0x55901cfc60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:46.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/4271017695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.681+0000 7f9fdf7fe640 1 -- 172.21.15.92:0/4271017695 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901cec4340 con 0x55901cfb8af0 2024-09-10T10:37:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.682+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/4271017695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfb8ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80a4680 tx=0x7f9fd809bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c57722c10b3c29d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:46.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.682+0000 7f9fd5ffb640 1 -- 172.21.15.92:0/4271017695 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd809bf40 con 0x55901cfb8af0 2024-09-10T10:37:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.682+0000 7f9fd5ffb640 1 -- 172.21.15.92:0/4271017695 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd80a02f0 con 0x55901cfb8af0 2024-09-10T10:37:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.682+0000 7f9fdffff640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a3020 0x7f9fcc0a54e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009710 tx=0x7f9fd0009f50 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.682+0000 7f9fd5ffb640 1 -- 172.21.15.92:0/4271017695 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd809c1a0 con 0x55901cfb8af0 2024-09-10T10:37:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.683+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/4271017695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 msgr2=0x55901cfb8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.683+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/4271017695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfb8ed0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80a4680 tx=0x7f9fd809bdd0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.683+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/4271017695 shutdown_connections 2024-09-10T10:37:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.683+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/4271017695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.683+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/4271017695 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.683+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/4271017695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfb8ed0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.683+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/4271017695 >> 172.21.15.92:0/4271017695 conn(0x55901cfb5060 msgr2=0x55901cfb5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.683+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/4271017695 shutdown_connections 2024-09-10T10:37:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.683+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/4271017695 wait complete. 2024-09-10T10:37:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.684+0000 7f9fe8dc1740 1 -- start start 2024-09-10T10:37:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.684+0000 7f9fe8dc1740 1 Processor -- start 2024-09-10T10:37:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.685+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfc0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.685+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.685+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.685+0000 7f9fdf7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfc0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.685+0000 7f9fdf7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfc0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:57422/0 (socket says 172.21.15.92:57422) 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43994/0 (socket says 172.21.15.92:43994) 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdf7fe640 1 -- 172.21.15.92:0/3239998491 learned_addr learned my addr 172.21.15.92:0/3239998491 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55901cfc6880 con 0x55901cfc3cb0 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55901cea6290 con 0x55901cfb9410 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55901cfc6a00 con 0x55901cfb8af0 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fe8dc1740 10 client.0 _ll_register_callbacks cb 0x55901ced7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdeffd640 1 -- 172.21.15.92:0/3239998491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 msgr2=0x55901cfc0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfc0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdeffd640 1 -- 172.21.15.92:0/3239998491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 msgr2=0x55901cfc1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdeffd640 1 -- 172.21.15.92:0/3239998491 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55901cc30210 con 0x55901cfb9410 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdffff640 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc1140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8004770 tx=0x7f9fc8031900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2513b24fcbf0e2cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fbeffd640 1 -- 172.21.15.92:0/3239998491 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8035040 con 0x55901cfb9410 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fbeffd640 1 -- 172.21.15.92:0/3239998491 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f9fc8004250 con 0x55901cfb9410 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.686+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fd80a02f0 con 0x55901cfb9410 2024-09-10T10:37:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fbeffd640 1 -- 172.21.15.92:0/3239998491 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9fc80319f0 con 0x55901cfb9410 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fe8dc1740 10 client.24947 fetch_fsmap learned FSMap version 34 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55901ccfc620 con 0x55901cfb9410 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fbeffd640 1 -- 172.21.15.92:0/3239998491 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd80a02f0 con 0x55901cfb9410 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fbeffd640 1 -- 172.21.15.92:0/3239998491 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f9fc804e020 con 0x55901cfb9410 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fe8dc1740 10 client.24947 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fe8dc1740 10 client.24947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fe8dc1740 20 client.24947 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55901cfd3ce0 0x55901cfd6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fe8dc1740 4 client.24947 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55901cf2aa20 con 0x55901cfd3ce0 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.687+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55901cfd3ce0 0x55901cfd6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.688+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55901cfd3ce0 0x55901cfd6100 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c906961a7ad01e0 server_cookie=d9fbb870d22893c0 in_seq=0 out_seq=0 2024-09-10T10:37:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.688+0000 7f9fbeffd640 10 client.24947 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.688+0000 7f9fbeffd640 1 -- 172.21.15.92:0/3239998491 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55901cf2aa20 con 0x55901cfd3ce0 2024-09-10T10:37:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.688+0000 7f9fbeffd640 10 client.24947 handle_command_reply: tid=0 2024-09-10T10:37:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.688+0000 7f9fe8dc1740 1 client.24947 shutdown 2024-09-10T10:37:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 msgr2=0x55901cfc1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc1140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8004770 tx=0x7f9fc8031900 comp rx=0 tx=0).stop 2024-09-10T10:37:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 shutdown_connections 2024-09-10T10:37:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfc3cb0 0x55901cfc1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55901cfd3ce0 0x55901cfd6100 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc1140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3239998491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb8af0 0x55901cfc0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 >> 172.21.15.92:0/3239998491 conn(0x55901cfb5060 msgr2=0x55901cfbad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fbeffd640 0 client.24947 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 shutdown_connections 2024-09-10T10:37:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.689+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3239998491 wait complete. 2024-09-10T10:37:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.690+0000 7f9fe8dc1740 20 client.24947 trim_cache size 0 max 16384 2024-09-10T10:37:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fe8dc1740 1 Processor -- start 2024-09-10T10:37:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fe8dc1740 1 -- start start 2024-09-10T10:37:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb9410 0x55901cfdb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfc3cb0 0x55901cfdbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fe8dc1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01af790 con 0x55901cfb8af0 2024-09-10T10:37:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fe8dc1740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01b13c0 con 0x55901cfc3cb0 2024-09-10T10:37:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fe8dc1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01afe90 con 0x55901cfb9410 2024-09-10T10:37:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fdf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fdf7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44010/0 (socket says 172.21.15.92:44010) 2024-09-10T10:37:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fdf7fe640 1 -- 172.21.15.92:0/3037055581 learned_addr learned my addr 172.21.15.92:0/3037055581 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.729+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb9410 0x55901cfdb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fdffff640 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfc3cb0 0x55901cfdbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fdeffd640 1 -- 172.21.15.92:0/3037055581 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfc3cb0 msgr2=0x55901cfdbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfc3cb0 0x55901cfdbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fdeffd640 1 -- 172.21.15.92:0/3037055581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 msgr2=0x55901cfc14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fdeffd640 1 -- 172.21.15.92:0/3037055581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55901cfbf130 con 0x55901cfb9410 2024-09-10T10:37:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb9410 0x55901cfdb9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8046800 tx=0x7f9fc802a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60fdd44c6d03edb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fd57fa640 1 -- 172.21.15.92:0/3037055581 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8035070 con 0x55901cfb9410 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.730+0000 7f9fd57fa640 1 -- 172.21.15.92:0/3037055581 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc8055020 con 0x55901cfb9410 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fd57fa640 1 -- 172.21.15.92:0/3037055581 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8005260 con 0x55901cfb9410 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3037055581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb9410 msgr2=0x55901cfdb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb9410 0x55901cfdb9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8046800 tx=0x7f9fc802a420 comp rx=0 tx=0).stop 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3037055581 shutdown_connections 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfc3cb0 0x55901cfdbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfb9410 0x55901cfdb9d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/3037055581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3037055581 >> 172.21.15.92:0/3037055581 conn(0x55901cfb5060 msgr2=0x55901cfbfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3037055581 shutdown_connections 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.731+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/3037055581 wait complete. 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.732+0000 7f9fe8dc1740 1 -- start start 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.732+0000 7f9fe8dc1740 1 Processor -- start 2024-09-10T10:37:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.732+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.732+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fe8dc1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfc3cb0 0x55901d03c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fe8dc1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01b0cf0 con 0x55901cfb8af0 2024-09-10T10:37:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fe8dc1740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01b0560 con 0x55901cfb9410 2024-09-10T10:37:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fe8dc1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01ad790 con 0x55901cfc3cb0 2024-09-10T10:37:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fe8dc1740 10 client.0 _ll_register_callbacks cb 0x7f9fc8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfc3cb0 0x55901d03c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfc3cb0 0x55901d03c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:57434/0 (socket says 172.21.15.92:57434) 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fdffff640 1 -- 172.21.15.92:0/1633990797 learned_addr learned my addr 172.21.15.92:0/1633990797 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fdeffd640 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.733+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fdffff640 1 -- 172.21.15.92:0/1633990797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 msgr2=0x55901cfc7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fdffff640 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fdffff640 1 -- 172.21.15.92:0/1633990797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 msgr2=0x55901cfc7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fdffff640 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fdffff640 1 -- 172.21.15.92:0/1633990797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55901d03cfa0 con 0x55901cfc3cb0 2024-09-10T10:37:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fdffff640 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfc3cb0 0x55901d03c990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00041d0 tx=0x7f9fd0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59083e62744fd1e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fbeffd640 1 -- 172.21.15.92:0/1633990797 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd002a480 con 0x55901cfc3cb0 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fbeffd640 1 -- 172.21.15.92:0/1633990797 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f9fd001a070 con 0x55901cfc3cb0 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/1633990797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc8055020 con 0x55901cfc3cb0 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fbeffd640 1 -- 172.21.15.92:0/1633990797 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9fd0038050 con 0x55901cfc3cb0 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fe8dc1740 10 client.24988 fetch_fsmap learned FSMap version 34 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.734+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/1633990797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55901d03e290 con 0x55901cfc3cb0 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fbeffd640 1 -- 172.21.15.92:0/1633990797 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fc8055020 con 0x55901cfc3cb0 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fbeffd640 1 -- 172.21.15.92:0/1633990797 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f9fd001f600 con 0x55901cfc3cb0 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fe8dc1740 10 client.24988 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fe8dc1740 10 client.24988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fe8dc1740 20 client.24988 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55901d03eb20 0x55901d040f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fe8dc1740 4 client.24988 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:37:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/1633990797 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55901cf24d70 con 0x55901d03eb20 2024-09-10T10:37:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55901d03eb20 0x55901d040f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fbeffd640 10 client.24988 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.735+0000 7f9fdf7fe640 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55901d03eb20 0x55901d040f60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c72e0a23228233ea server_cookie=e75e3a96193b70d2 in_seq=0 out_seq=0 2024-09-10T10:37:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.748+0000 7f9fbeffd640 1 -- 172.21.15.92:0/1633990797 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55901cf24d70 con 0x55901d03eb20 2024-09-10T10:37:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fbeffd640 10 client.24988 handle_command_reply: tid=0 2024-09-10T10:37:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 client.24988 shutdown 2024-09-10T10:37:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/1633990797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfc3cb0 msgr2=0x55901d03c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfc3cb0 0x55901d03c990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00041d0 tx=0x7f9fd0005f90 comp rx=0 tx=0).stop 2024-09-10T10:37:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/1633990797 shutdown_connections 2024-09-10T10:37:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55901cfc3cb0 0x55901d03c990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55901d03eb20 0x55901d040f60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55901cfb9410 0x55901cfc7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 --2- 172.21.15.92:0/1633990797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55901cfb8af0 0x55901cfc7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/1633990797 >> 172.21.15.92:0/1633990797 conn(0x55901cfb5060 msgr2=0x55901cfba550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fbeffd640 0 client.24988 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/1633990797 shutdown_connections 2024-09-10T10:37:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.749+0000 7f9fe8dc1740 1 -- 172.21.15.92:0/1633990797 wait complete. 2024-09-10T10:37:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe8dc1740 20 client.24988 trim_cache size 0 max 16384 2024-09-10T10:37:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:37:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:37:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:37:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:37:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a3020 msgr2=0x7f9fcc0a54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a3020 0x7f9fcc0a54e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009710 tx=0x7f9fd0009f50 comp rx=0 tx=0).stop 2024-09-10T10:37:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/1432866165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe01009d0 msgr2=0x7f9fe0198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe01009d0 0x7f9fe0198360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800ec80 tx=0x7f9fd800c6a0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/1432866165 shutdown_connections 2024-09-10T10:37:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a3020 0x7f9fcc0a54e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe01069e0 0x7f9fe019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe0101370 0x7f9fe01988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 --2- 172.21.15.92:0/1432866165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe01009d0 0x7f9fe0198360 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.750+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/1432866165 >> 172.21.15.92:0/1432866165 conn(0x7f9fe00fc6f0 msgr2=0x7f9fe006a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.751+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/1432866165 shutdown_connections 2024-09-10T10:37:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:46.751+0000 7f9fe5f4b640 1 -- 172.21.15.92:0/1432866165 wait complete. 2024-09-10T10:37:47.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:47 smithi121 ceph-mon[35231]: pgmap v38: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-09-10T10:37:47.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:47 smithi097 ceph-mon[35213]: pgmap v38: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-09-10T10:37:47.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:47 smithi092 ceph-mon[30834]: pgmap v38: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-09-10T10:37:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 50.0 s, 3528.6 tps, lat 28.503 ms stddev 30.841 2024-09-10T10:37:49.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:49 smithi121 ceph-mon[35231]: pgmap v39: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-09-10T10:37:49.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:49 smithi097 ceph-mon[35213]: pgmap v39: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-09-10T10:37:49.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:49 smithi092 ceph-mon[30834]: pgmap v39: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-09-10T10:37:51.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:51 smithi092 ceph-mon[30834]: pgmap v40: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 17 MiB/s wr, 1.06k op/s 2024-09-10T10:37:51.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:51 smithi121 ceph-mon[35231]: pgmap v40: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 17 MiB/s wr, 1.06k op/s 2024-09-10T10:37:51.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:51 smithi097 ceph-mon[35213]: pgmap v40: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 17 MiB/s wr, 1.06k op/s 2024-09-10T10:37:53.153 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 55.0 s, 3695.8 tps, lat 26.969 ms stddev 28.685 2024-09-10T10:37:53.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:53 smithi121 ceph-mon[35231]: pgmap v41: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 737 op/s 2024-09-10T10:37:53.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:53 smithi097 ceph-mon[35213]: pgmap v41: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 737 op/s 2024-09-10T10:37:53.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:53 smithi092 ceph-mon[30834]: pgmap v41: 97 pgs: 97 active+clean; 1.2 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 737 op/s 2024-09-10T10:37:55.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:55 smithi121 ceph-mon[35231]: pgmap v42: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 16 MiB/s wr, 1.08k op/s 2024-09-10T10:37:55.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:55 smithi097 ceph-mon[35213]: pgmap v42: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 16 MiB/s wr, 1.08k op/s 2024-09-10T10:37:55.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:55 smithi092 ceph-mon[30834]: pgmap v42: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 16 MiB/s wr, 1.08k op/s 2024-09-10T10:37:57.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:57 smithi121 ceph-mon[35231]: pgmap v43: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 8.6 MiB/s wr, 665 op/s 2024-09-10T10:37:57.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:57 smithi097 ceph-mon[35213]: pgmap v43: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 8.6 MiB/s wr, 665 op/s 2024-09-10T10:37:57.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:57 smithi092 ceph-mon[30834]: pgmap v43: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 8.6 MiB/s wr, 665 op/s 2024-09-10T10:37:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 60.0 s, 3184.0 tps, lat 30.867 ms stddev 32.812 2024-09-10T10:37:59.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:37:59 smithi121 ceph-mon[35231]: pgmap v44: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 8.6 MiB/s wr, 665 op/s 2024-09-10T10:37:59.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:37:59 smithi097 ceph-mon[35213]: pgmap v44: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 8.6 MiB/s wr, 665 op/s 2024-09-10T10:37:59.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:37:59 smithi092 ceph-mon[30834]: pgmap v44: 97 pgs: 97 active+clean; 1.2 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 8.6 MiB/s wr, 665 op/s 2024-09-10T10:37:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.878+0000 7f623461e640 1 -- 172.21.15.92:0/2230984567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c1009d0 msgr2=0x7f622c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.878+0000 7f623461e640 1 --2- 172.21.15.92:0/2230984567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c1009d0 0x7f622c100e30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f621c009930 tx=0x7f621c02a420 comp rx=0 tx=0).stop 2024-09-10T10:37:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.879+0000 7f623461e640 1 -- 172.21.15.92:0/2230984567 shutdown_connections 2024-09-10T10:37:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.879+0000 7f623461e640 1 --2- 172.21.15.92:0/2230984567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f622c101370 0x7f622c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.879+0000 7f623461e640 1 --2- 172.21.15.92:0/2230984567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c1009d0 0x7f622c100e30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.879+0000 7f623461e640 1 --2- 172.21.15.92:0/2230984567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f622c1069e0 0x7f622c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.879+0000 7f623461e640 1 -- 172.21.15.92:0/2230984567 >> 172.21.15.92:0/2230984567 conn(0x7f622c0fc6b0 msgr2=0x7f622c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.879+0000 7f623461e640 1 -- 172.21.15.92:0/2230984567 shutdown_connections 2024-09-10T10:37:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.879+0000 7f623461e640 1 -- 172.21.15.92:0/2230984567 wait complete. 2024-09-10T10:37:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f623461e640 1 Processor -- start 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f623461e640 1 -- start start 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f623461e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f622c1009d0 0x7f622c198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f623461e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c101370 0x7f622c1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f623461e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f622c1069e0 0x7f622c19ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f623461e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f622c110e20 con 0x7f622c101370 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f623461e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f622c110ca0 con 0x7f622c1009d0 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f623461e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f622c110fa0 con 0x7f622c1069e0 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f62323ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f622c1009d0 0x7f622c198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f6231bb9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c101370 0x7f622c1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f6231bb9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c101370 0x7f622c1986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52232/0 (socket says 172.21.15.92:52232) 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f6231bb9640 1 -- 172.21.15.92:0/1027068399 learned_addr learned my addr 172.21.15.92:0/1027068399 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.880+0000 7f6232bbb640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f622c1069e0 0x7f622c19ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f6231bb9640 1 -- 172.21.15.92:0/1027068399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f622c1069e0 msgr2=0x7f622c19ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f6231bb9640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f622c1069e0 0x7f622c19ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f6231bb9640 1 -- 172.21.15.92:0/1027068399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f622c1009d0 msgr2=0x7f622c198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f6231bb9640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f622c1009d0 0x7f622c198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f6231bb9640 1 -- 172.21.15.92:0/1027068399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622c19d170 con 0x7f622c101370 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f6232bbb640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f622c1069e0 0x7f622c19ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f6231bb9640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c101370 0x7f622c1986c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f621c009900 tx=0x7f621c030710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f62237fe640 1 -- 172.21.15.92:0/1027068399 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c03f070 con 0x7f622c101370 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f623461e640 1 -- 172.21.15.92:0/1027068399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622c19d400 con 0x7f622c101370 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f62237fe640 1 -- 172.21.15.92:0/1027068399 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f621c004460 con 0x7f622c101370 2024-09-10T10:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f62237fe640 1 -- 172.21.15.92:0/1027068399 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c035030 con 0x7f622c101370 2024-09-10T10:37:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.881+0000 7f623461e640 1 -- 172.21.15.92:0/1027068399 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622c107870 con 0x7f622c101370 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.884+0000 7f6236ffd740 1 Processor -- start 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6236ffd740 1 -- start start 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f62237fe640 1 -- 172.21.15.92:0/1027068399 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f621c042070 con 0x7f622c101370 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce3fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce4a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce4d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6236ffd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55edbcda42f0 con 0x55edbce3faf0 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6236ffd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55edbcd4c270 con 0x55edbce40410 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6236ffd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edbcda02b0 con 0x55edbce4acb0 2024-09-10T10:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6232bbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce3fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f62323ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce4a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6232bbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce3fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52244/0 (socket says 172.21.15.92:52244) 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6232bbb640 1 -- 172.21.15.92:0/1703934883 learned_addr learned my addr 172.21.15.92:0/1703934883 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f6231bb9640 1 --2- 172.21.15.92:0/1703934883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce4d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f62323ba640 1 -- 172.21.15.92:0/1703934883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 msgr2=0x55edbce4d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f62323ba640 1 --2- 172.21.15.92:0/1703934883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce4d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f62323ba640 1 -- 172.21.15.92:0/1703934883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 msgr2=0x55edbce3fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f62323ba640 1 --2- 172.21.15.92:0/1703934883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce3fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f62323ba640 1 -- 172.21.15.92:0/1703934883 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbcd4b340 con 0x55edbce40410 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.885+0000 7f62323ba640 1 --2- 172.21.15.92:0/1703934883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce4a770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6228009c00 tx=0x7f6228011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18b8492ef2b88f98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.886+0000 7f6220bfe640 1 -- 172.21.15.92:0/1703934883 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228004050 con 0x55edbce40410 2024-09-10T10:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.886+0000 7f62237fe640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62180a2ec0 0x7f62180a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.886+0000 7f6220bfe640 1 -- 172.21.15.92:0/1703934883 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6228005500 con 0x55edbce40410 2024-09-10T10:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.886+0000 7f6220bfe640 1 -- 172.21.15.92:0/1703934883 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228004da0 con 0x55edbce40410 2024-09-10T10:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.886+0000 7f6232bbb640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62180a2ec0 0x7f62180a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.886+0000 7f62237fe640 1 -- 172.21.15.92:0/1027068399 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f621c0efcf0 con 0x7f622c101370 2024-09-10T10:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.887+0000 7f6236ffd740 1 -- 172.21.15.92:0/1703934883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 msgr2=0x55edbce4a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.887+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1703934883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce4a770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6228009c00 tx=0x7f6228011810 comp rx=0 tx=0).stop 2024-09-10T10:37:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.887+0000 7f6236ffd740 1 -- 172.21.15.92:0/1703934883 shutdown_connections 2024-09-10T10:37:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.887+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1703934883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce4d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.887+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1703934883 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce4a770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.887+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1703934883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce3fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.887+0000 7f6236ffd740 1 -- 172.21.15.92:0/1703934883 >> 172.21.15.92:0/1703934883 conn(0x55edbce3c060 msgr2=0x55edbce3c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.887+0000 7f6232bbb640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62180a2ec0 0x7f62180a5380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62240098b0 tx=0x7f6224009600 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.888+0000 7f6236ffd740 1 -- 172.21.15.92:0/1703934883 shutdown_connections 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.888+0000 7f6236ffd740 1 -- 172.21.15.92:0/1703934883 wait complete. 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.888+0000 7f6236ffd740 1 -- start start 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.888+0000 7f6236ffd740 1 Processor -- start 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce47b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce48060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce485a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6236ffd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55edbce4d880 con 0x55edbce3faf0 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6236ffd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55edbcd2d290 con 0x55edbce40410 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6236ffd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edbce4da00 con 0x55edbce4acb0 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6236ffd740 10 client.0 _ll_register_callbacks cb 0x55edbcd5e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:59.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f62323ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce47b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f62323ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce47b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52254/0 (socket says 172.21.15.92:52254) 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f62323ba640 1 -- 172.21.15.92:0/2151253082 learned_addr learned my addr 172.21.15.92:0/2151253082 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6231bb9640 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce48060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6232bbb640 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f62323ba640 1 -- 172.21.15.92:0/2151253082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 msgr2=0x55edbce485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f62323ba640 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f62323ba640 1 -- 172.21.15.92:0/2151253082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 msgr2=0x55edbce48060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f62323ba640 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce48060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f62323ba640 1 -- 172.21.15.92:0/2151253082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edbcab7210 con 0x55edbce3faf0 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.889+0000 7f6231bb9640 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce48060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f62323ba640 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce47b20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6228009bd0 tx=0x7f6228004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb0d5681c54fa80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f6215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f6215ffb640 1 -- 172.21.15.92:0/2151253082 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228029070 con 0x55edbce3faf0 2024-09-10T10:37:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f6215ffb640 1 -- 172.21.15.92:0/2151253082 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f6228004f50 con 0x55edbce3faf0 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f6236ffd740 1 -- 172.21.15.92:0/2151253082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6228005500 con 0x55edbce3faf0 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f6215ffb640 1 -- 172.21.15.92:0/2151253082 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6228035050 con 0x55edbce3faf0 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f6236ffd740 10 client.15435 fetch_fsmap learned FSMap version 34 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f6236ffd740 1 -- 172.21.15.92:0/2151253082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55edbcb83620 con 0x55edbce3faf0 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f6215ffb640 1 -- 172.21.15.92:0/2151253082 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6228005500 con 0x55edbce3faf0 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.890+0000 7f6215ffb640 1 -- 172.21.15.92:0/2151253082 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f6228023430 con 0x55edbce3faf0 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.891+0000 7f6236ffd740 10 client.15435 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.891+0000 7f6236ffd740 10 client.15435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.891+0000 7f6236ffd740 20 client.15435 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.891+0000 7f6236ffd740 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edbce63280 0x55edbce65670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.891+0000 7f6236ffd740 4 client.15435 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.891+0000 7f6236ffd740 1 -- 172.21.15.92:0/2151253082 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edbcdb1a20 con 0x55edbce63280 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.891+0000 7f6231bb9640 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edbce63280 0x55edbce65670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.892+0000 7f6231bb9640 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edbce63280 0x55edbce65670 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa775cfe5b1db1e server_cookie=50efaad209b23052 in_seq=0 out_seq=0 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.892+0000 7f6215ffb640 10 client.15435 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.892+0000 7f6215ffb640 1 -- 172.21.15.92:0/2151253082 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55edbcdb1a20 con 0x55edbce63280 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.892+0000 7f6215ffb640 10 client.15435 handle_command_reply: tid=0 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.892+0000 7f6236ffd740 1 client.15435 shutdown 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.892+0000 7f6236ffd740 1 -- 172.21.15.92:0/2151253082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 msgr2=0x55edbce47b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.892+0000 7f6236ffd740 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce47b20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6228009bd0 tx=0x7f6228004530 comp rx=0 tx=0).stop 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6236ffd740 1 -- 172.21.15.92:0/2151253082 shutdown_connections 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6236ffd740 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6236ffd740 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edbce63280 0x55edbce65670 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6236ffd740 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce48060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6236ffd740 1 --2- 172.21.15.92:0/2151253082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce47b20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6215ffb640 0 client.15435 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6236ffd740 1 -- 172.21.15.92:0/2151253082 >> 172.21.15.92:0/2151253082 conn(0x55edbce3c060 msgr2=0x55edbce41dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6236ffd740 1 -- 172.21.15.92:0/2151253082 shutdown_connections 2024-09-10T10:37:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6236ffd740 1 -- 172.21.15.92:0/2151253082 wait complete. 2024-09-10T10:37:59.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.893+0000 7f6236ffd740 20 client.15435 trim_cache size 0 max 16384 2024-09-10T10:37:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6236ffd740 1 Processor -- start 2024-09-10T10:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6236ffd740 1 -- start start 2024-09-10T10:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce49a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce40410 0x55edbce6aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce4acb0 0x55edbce6b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6236ffd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1ab460 con 0x55edbce3faf0 2024-09-10T10:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6236ffd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1ad090 con 0x55edbce4acb0 2024-09-10T10:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6236ffd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1abb60 con 0x55edbce40410 2024-09-10T10:37:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f62323ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce49a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6232bbb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce4acb0 0x55edbce6b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6232bbb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce4acb0 0x55edbce6b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:41284/0 (socket says 172.21.15.92:41284) 2024-09-10T10:37:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f62323ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce49a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52268/0 (socket says 172.21.15.92:52268) 2024-09-10T10:37:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.916+0000 7f6232bbb640 1 -- 172.21.15.92:0/4039099493 learned_addr learned my addr 172.21.15.92:0/4039099493 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.917+0000 7f6232bbb640 1 -- 172.21.15.92:0/4039099493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce40410 msgr2=0x55edbce6aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.917+0000 7f6232bbb640 1 --2- 172.21.15.92:0/4039099493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce40410 0x55edbce6aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.917+0000 7f6232bbb640 1 -- 172.21.15.92:0/4039099493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 msgr2=0x55edbce49a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.917+0000 7f6232bbb640 1 --2- 172.21.15.92:0/4039099493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce49a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.917+0000 7f6232bbb640 1 -- 172.21.15.92:0/4039099493 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edbce40240 con 0x55edbce4acb0 2024-09-10T10:37:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.917+0000 7f6232bbb640 1 --2- 172.21.15.92:0/4039099493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce4acb0 0x55edbce6b430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6224013e40 tx=0x7f622400b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ae9c08da51c195f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.917+0000 7f6217fff640 1 -- 172.21.15.92:0/4039099493 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224004b20 con 0x55edbce4acb0 2024-09-10T10:37:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.917+0000 7f6217fff640 1 -- 172.21.15.92:0/4039099493 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6224004cc0 con 0x55edbce4acb0 2024-09-10T10:37:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.917+0000 7f6217fff640 1 -- 172.21.15.92:0/4039099493 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622401c7e0 con 0x55edbce4acb0 2024-09-10T10:37:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.918+0000 7f6236ffd740 1 -- 172.21.15.92:0/4039099493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce4acb0 msgr2=0x55edbce6b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.918+0000 7f6236ffd740 1 --2- 172.21.15.92:0/4039099493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce4acb0 0x55edbce6b430 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6224013e40 tx=0x7f622400b000 comp rx=0 tx=0).stop 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.918+0000 7f6236ffd740 1 -- 172.21.15.92:0/4039099493 shutdown_connections 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.918+0000 7f6236ffd740 1 --2- 172.21.15.92:0/4039099493 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce4acb0 0x55edbce6b430 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.918+0000 7f6236ffd740 1 --2- 172.21.15.92:0/4039099493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce40410 0x55edbce6aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.918+0000 7f6236ffd740 1 --2- 172.21.15.92:0/4039099493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce49a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.918+0000 7f6236ffd740 1 -- 172.21.15.92:0/4039099493 >> 172.21.15.92:0/4039099493 conn(0x55edbce3c060 msgr2=0x55edbce49380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.918+0000 7f6236ffd740 1 -- 172.21.15.92:0/4039099493 shutdown_connections 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.918+0000 7f6236ffd740 1 -- 172.21.15.92:0/4039099493 wait complete. 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.919+0000 7f6236ffd740 1 -- start start 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.919+0000 7f6236ffd740 1 Processor -- start 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce5b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce56cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f6236ffd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce57210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f6236ffd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1ac9c0 con 0x55edbce3faf0 2024-09-10T10:37:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f6236ffd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1ac230 con 0x55edbce40410 2024-09-10T10:37:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f6236ffd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f622c1a9480 con 0x55edbce4acb0 2024-09-10T10:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f62323ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce5b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f6236ffd740 10 client.0 _ll_register_callbacks cb 0x7f6224009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f62323ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce5b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52274/0 (socket says 172.21.15.92:52274) 2024-09-10T10:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.920+0000 7f62323ba640 1 -- 172.21.15.92:0/1639902410 learned_addr learned my addr 172.21.15.92:0/1639902410 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f6232bbb640 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce57210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f62323ba640 1 -- 172.21.15.92:0/1639902410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 msgr2=0x55edbce57210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f62323ba640 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce57210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f62323ba640 1 -- 172.21.15.92:0/1639902410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 msgr2=0x55edbce56cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f62323ba640 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce56cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f62323ba640 1 -- 172.21.15.92:0/1639902410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edbce57750 con 0x55edbce3faf0 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f62323ba640 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce5b9b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6228011d10 tx=0x7f6228005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fd60684b93c46e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f6215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f6215ffb640 1 -- 172.21.15.92:0/1639902410 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622803e060 con 0x55edbce3faf0 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f6215ffb640 1 -- 172.21.15.92:0/1639902410 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f6228023a70 con 0x55edbce3faf0 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.921+0000 7f6236ffd740 1 -- 172.21.15.92:0/1639902410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6224004cc0 con 0x55edbce3faf0 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6215ffb640 1 -- 172.21.15.92:0/1639902410 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6228029040 con 0x55edbce3faf0 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6236ffd740 10 client.15441 fetch_fsmap learned FSMap version 34 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6236ffd740 1 -- 172.21.15.92:0/1639902410 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55edbcecdc20 con 0x55edbce3faf0 2024-09-10T10:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6215ffb640 1 -- 172.21.15.92:0/1639902410 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6224004cc0 con 0x55edbce3faf0 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6215ffb640 1 -- 172.21.15.92:0/1639902410 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f6228041020 con 0x55edbce3faf0 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6236ffd740 10 client.15441 fetch_fsmap finished waiting for FSMap version 34 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6236ffd740 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6236ffd740 20 client.15441 populate_metadata read hostname 'smithi092' 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edbcece3f0 0x55edbced0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6236ffd740 4 client.15441 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6236ffd740 1 -- 172.21.15.92:0/1639902410 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55edbcdabd70 con 0x55edbcece3f0 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6231bb9640 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edbcece3f0 0x55edbced0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.922+0000 7f6215ffb640 10 client.15441 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.923+0000 7f6231bb9640 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edbcece3f0 0x55edbced0810 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=574a4b7ec01d2fd9 server_cookie=7ca221c17e258e85 in_seq=0 out_seq=0 2024-09-10T10:37:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6215ffb640 1 -- 172.21.15.92:0/1639902410 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55edbcdabd70 con 0x55edbcece3f0 2024-09-10T10:37:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6215ffb640 10 client.15441 handle_command_reply: tid=0 2024-09-10T10:37:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 client.15441 shutdown 2024-09-10T10:37:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 -- 172.21.15.92:0/1639902410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 msgr2=0x55edbce5b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce5b9b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6228011d10 tx=0x7f6228005da0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 -- 172.21.15.92:0/1639902410 shutdown_connections 2024-09-10T10:37:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edbce4acb0 0x55edbce57210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edbcece3f0 0x55edbced0810 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edbce40410 0x55edbce56cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 --2- 172.21.15.92:0/1639902410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edbce3faf0 0x55edbce5b9b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6215ffb640 0 client.15441 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:37:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 -- 172.21.15.92:0/1639902410 >> 172.21.15.92:0/1639902410 conn(0x55edbce3c060 msgr2=0x55edbce49ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 -- 172.21.15.92:0/1639902410 shutdown_connections 2024-09-10T10:37:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.935+0000 7f6236ffd740 1 -- 172.21.15.92:0/1639902410 wait complete. 2024-09-10T10:37:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f6236ffd740 20 client.15441 trim_cache size 0 max 16384 2024-09-10T10:37:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:37:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:37:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:37:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 -- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62180a2ec0 msgr2=0x7f62180a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62180a2ec0 0x7f62180a5380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62240098b0 tx=0x7f6224009600 comp rx=0 tx=0).stop 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 -- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c101370 msgr2=0x7f622c1986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c101370 0x7f622c1986c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f621c009900 tx=0x7f621c030710 comp rx=0 tx=0).stop 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 -- 172.21.15.92:0/1027068399 shutdown_connections 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f622c1069e0 0x7f622c19ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f622c101370 0x7f622c1986c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62180a2ec0 0x7f62180a5380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 --2- 172.21.15.92:0/1027068399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f622c1009d0 0x7f622c198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:37:59.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 -- 172.21.15.92:0/1027068399 >> 172.21.15.92:0/1027068399 conn(0x7f622c0fc6b0 msgr2=0x7f622c1044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:37:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 -- 172.21.15.92:0/1027068399 shutdown_connections 2024-09-10T10:37:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:37:59.936+0000 7f623461e640 1 -- 172.21.15.92:0/1027068399 wait complete. 2024-09-10T10:38:01.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:01 smithi121 ceph-mon[35231]: pgmap v45: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-09-10T10:38:01.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:01 smithi097 ceph-mon[35213]: pgmap v45: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-09-10T10:38:01.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:01 smithi092 ceph-mon[30834]: pgmap v45: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2024-09-10T10:38:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 65.0 s, 2374.8 tps, lat 42.610 ms stddev 77.619 2024-09-10T10:38:03.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:03 smithi121 ceph-mon[35231]: pgmap v46: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 9.1 MiB/s wr, 704 op/s 2024-09-10T10:38:03.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:03 smithi097 ceph-mon[35213]: pgmap v46: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 9.1 MiB/s wr, 704 op/s 2024-09-10T10:38:03.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:03 smithi092 ceph-mon[30834]: pgmap v46: 97 pgs: 97 active+clean; 1.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 9.1 MiB/s wr, 704 op/s 2024-09-10T10:38:05.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:05 smithi121 ceph-mon[35231]: pgmap v47: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 43 MiB/s wr, 1.80k op/s 2024-09-10T10:38:05.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:05 smithi097 ceph-mon[35213]: pgmap v47: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 43 MiB/s wr, 1.80k op/s 2024-09-10T10:38:05.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:05 smithi092 ceph-mon[30834]: pgmap v47: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 43 MiB/s wr, 1.80k op/s 2024-09-10T10:38:07.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:07 smithi121 ceph-mon[35231]: pgmap v48: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 38 MiB/s wr, 1.46k op/s 2024-09-10T10:38:07.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:07 smithi097 ceph-mon[35213]: pgmap v48: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 38 MiB/s wr, 1.46k op/s 2024-09-10T10:38:07.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:07 smithi092 ceph-mon[30834]: pgmap v48: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 38 MiB/s wr, 1.46k op/s 2024-09-10T10:38:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 70.0 s, 3244.8 tps, lat 30.931 ms stddev 35.416 2024-09-10T10:38:09.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:09 smithi121 ceph-mon[35231]: pgmap v49: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 38 MiB/s wr, 1.46k op/s 2024-09-10T10:38:09.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:09 smithi097 ceph-mon[35213]: pgmap v49: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 38 MiB/s wr, 1.46k op/s 2024-09-10T10:38:09.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:09 smithi092 ceph-mon[30834]: pgmap v49: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 38 MiB/s wr, 1.46k op/s 2024-09-10T10:38:11.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:11 smithi097 ceph-mon[35213]: pgmap v50: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 43 MiB/s wr, 1.77k op/s 2024-09-10T10:38:11.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:11 smithi097 ceph-mon[35213]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-10T10:38:11.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:11 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:38:11.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:11 smithi092 ceph-mon[30834]: pgmap v50: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 43 MiB/s wr, 1.77k op/s 2024-09-10T10:38:11.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:11 smithi092 ceph-mon[30834]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-10T10:38:11.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:11 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:38:12.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:11 smithi121 ceph-mon[35231]: pgmap v50: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 43 MiB/s wr, 1.77k op/s 2024-09-10T10:38:12.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:11 smithi121 ceph-mon[35231]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-10T10:38:12.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:11 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:38:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.062+0000 7f425b778640 1 -- 172.21.15.92:0/2303823569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 msgr2=0x7f4254107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.062+0000 7f425b778640 1 --2- 172.21.15.92:0/2303823569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 0x7f4254107eb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4250009930 tx=0x7f425002a420 comp rx=0 tx=0).stop 2024-09-10T10:38:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.062+0000 7f425b778640 1 -- 172.21.15.92:0/2303823569 shutdown_connections 2024-09-10T10:38:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.062+0000 7f425b778640 1 --2- 172.21.15.92:0/2303823569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4254102460 0x7f425410e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.062+0000 7f425b778640 1 --2- 172.21.15.92:0/2303823569 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4254101ac0 0x7f4254101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.062+0000 7f425b778640 1 --2- 172.21.15.92:0/2303823569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 0x7f4254107eb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.062+0000 7f425b778640 1 -- 172.21.15.92:0/2303823569 >> 172.21.15.92:0/2303823569 conn(0x7f42540fd820 msgr2=0x7f42540ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.062+0000 7f425b778640 1 -- 172.21.15.92:0/2303823569 shutdown_connections 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.062+0000 7f425b778640 1 -- 172.21.15.92:0/2303823569 wait complete. 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f425b778640 1 Processor -- start 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f425b778640 1 -- start start 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f425b778640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4254101ac0 0x7f4254198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f425b778640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4254102460 0x7f4254198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f425b778640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 0x7f425419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f425b778640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4254111f10 con 0x7f4254107ad0 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f425b778640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4254111d90 con 0x7f4254101ac0 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f425b778640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4254112090 con 0x7f4254102460 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f4259d15640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 0x7f425419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f4259d15640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 0x7f425419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50626/0 (socket says 172.21.15.92:50626) 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f4259d15640 1 -- 172.21.15.92:0/3390239191 learned_addr learned my addr 172.21.15.92:0/3390239191 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f4258d13640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4254102460 0x7f4254198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.063+0000 7f4259514640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4254101ac0 0x7f4254198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f4259d15640 1 -- 172.21.15.92:0/3390239191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4254102460 msgr2=0x7f4254198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f4259d15640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4254102460 0x7f4254198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f4259d15640 1 -- 172.21.15.92:0/3390239191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4254101ac0 msgr2=0x7f4254198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f4259d15640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4254101ac0 0x7f4254198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f4259d15640 1 -- 172.21.15.92:0/3390239191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425419d430 con 0x7f4254107ad0 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f4259d15640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 0x7f425419cd00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f424c00cad0 tx=0x7f424c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f424a7fc640 1 -- 172.21.15.92:0/3390239191 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c00ae20 con 0x7f4254107ad0 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f424a7fc640 1 -- 172.21.15.92:0/3390239191 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f424c005020 con 0x7f4254107ad0 2024-09-10T10:38:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f425b778640 1 -- 172.21.15.92:0/3390239191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425419d720 con 0x7f4254107ad0 2024-09-10T10:38:13.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f424a7fc640 1 -- 172.21.15.92:0/3390239191 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c00f6f0 con 0x7f4254107ad0 2024-09-10T10:38:13.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.064+0000 7f425b778640 1 -- 172.21.15.92:0/3390239191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42541a4fb0 con 0x7f4254107ad0 2024-09-10T10:38:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.068+0000 7f425e5f2740 1 Processor -- start 2024-09-10T10:38:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.069+0000 7f424a7fc640 1 -- 172.21.15.92:0/3390239191 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f424c0051d0 con 0x7f4254107ad0 2024-09-10T10:38:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.069+0000 7f425e5f2740 1 -- start start 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.069+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bbdcc0 0x55f210bbe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.069+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bb9660 0x55f210bb9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.069+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bba000 0x55f210bc59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.069+0000 7f425e5f2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f210b142f0 con 0x55f210bba000 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.069+0000 7f425e5f2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f210abc270 con 0x55f210bb9660 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.069+0000 7f425e5f2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f210b102b0 con 0x55f210bbdcc0 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bbdcc0 0x55f210bbe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bbdcc0 0x55f210bbe0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:59678/0 (socket says 172.21.15.92:59678) 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 -- 172.21.15.92:0/3238898071 learned_addr learned my addr 172.21.15.92:0/3238898071 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4259514640 1 --2- 172.21.15.92:0/3238898071 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bb9660 0x55f210bb9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 --2- 172.21.15.92:0/3238898071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bba000 0x55f210bc59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 -- 172.21.15.92:0/3238898071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bbdcc0 msgr2=0x55f210bbe0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 --2- 172.21.15.92:0/3238898071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bbdcc0 0x55f210bbe0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f424a7fc640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f42400a2e20 0x7f42400a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 -- 172.21.15.92:0/3238898071 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bb9660 msgr2=0x55f210bb9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 --2- 172.21.15.92:0/3238898071 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bb9660 0x55f210bb9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 -- 172.21.15.92:0/3238898071 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f210abb340 con 0x55f210bba000 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4259d15640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f42400a2e20 0x7f42400a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f4258d13640 1 --2- 172.21.15.92:0/3238898071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bba000 0x55f210bc59c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4244012780 tx=0x7f4244005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348cfb455555ebcb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f424a7fc640 1 -- 172.21.15.92:0/3390239191 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f424c0cf4e0 con 0x7f4254107ad0 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.070+0000 7f423f7fe640 1 -- 172.21.15.92:0/3238898071 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244012050 con 0x55f210bba000 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f423f7fe640 1 -- 172.21.15.92:0/3238898071 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42440121f0 con 0x55f210bba000 2024-09-10T10:38:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f423f7fe640 1 -- 172.21.15.92:0/3238898071 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42440035f0 con 0x55f210bba000 2024-09-10T10:38:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f425e5f2740 1 -- 172.21.15.92:0/3238898071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bba000 msgr2=0x55f210bc59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f4259d15640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f42400a2e20 0x7f42400a52e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f424c00caa0 tx=0x7f424c01cf90 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f425e5f2740 1 --2- 172.21.15.92:0/3238898071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bba000 0x55f210bc59c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4244012780 tx=0x7f4244005f90 comp rx=0 tx=0).stop 2024-09-10T10:38:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f425e5f2740 1 -- 172.21.15.92:0/3238898071 shutdown_connections 2024-09-10T10:38:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f425e5f2740 1 --2- 172.21.15.92:0/3238898071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bba000 0x55f210bc59c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f425e5f2740 1 --2- 172.21.15.92:0/3238898071 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bb9660 0x55f210bb9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f425e5f2740 1 --2- 172.21.15.92:0/3238898071 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bbdcc0 0x55f210bbe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f425e5f2740 1 -- 172.21.15.92:0/3238898071 >> 172.21.15.92:0/3238898071 conn(0x55f210babb10 msgr2=0x55f210babef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f425e5f2740 1 -- 172.21.15.92:0/3238898071 shutdown_connections 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.071+0000 7f425e5f2740 1 -- 172.21.15.92:0/3238898071 wait complete. 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.072+0000 7f425e5f2740 1 -- start start 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.072+0000 7f425e5f2740 1 Processor -- start 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.072+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.072+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bc3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.072+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bc3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f4258d13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f4258d13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:59680/0 (socket says 172.21.15.92:59680) 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f4258d13640 1 -- 172.21.15.92:0/441499781 learned_addr learned my addr 172.21.15.92:0/441499781 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f210bc6050 con 0x55f210bbdcc0 2024-09-10T10:38:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f210a9d290 con 0x55f210bba000 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f210bc61d0 con 0x55f210bb9660 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f4258d13640 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bc3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f425e5f2740 10 client.0 _ll_register_callbacks cb 0x55f210ace140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f4258d13640 1 -- 172.21.15.92:0/441499781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 msgr2=0x55f210bc3420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f4258d13640 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bc3420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f4258d13640 1 -- 172.21.15.92:0/441499781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 msgr2=0x55f210bc3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f4258d13640 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bc3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.073+0000 7f4258d13640 1 -- 172.21.15.92:0/441499781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f210827210 con 0x55f210bb9660 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.074+0000 7f4258d13640 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc2ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4244001eb0 tx=0x7f424400da10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a5c4cbfda3192e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.074+0000 7f423cff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:38:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.074+0000 7f423cff9640 1 -- 172.21.15.92:0/441499781 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244004260 con 0x55f210bb9660 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.074+0000 7f423cff9640 1 -- 172.21.15.92:0/441499781 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f4244004400 con 0x55f210bb9660 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.074+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42440121f0 con 0x55f210bb9660 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.074+0000 7f423cff9640 1 -- 172.21.15.92:0/441499781 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4244036050 con 0x55f210bb9660 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.074+0000 7f425e5f2740 10 client.25012 fetch_fsmap learned FSMap version 35 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.074+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f2108f3620 con 0x55f210bb9660 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.074+0000 7f423cff9640 1 -- 172.21.15.92:0/441499781 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42440121f0 con 0x55f210bb9660 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f423cff9640 1 -- 172.21.15.92:0/441499781 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7f4244003790 con 0x55f210bb9660 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f425e5f2740 10 client.25012 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f425e5f2740 10 client.25012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f425e5f2740 20 client.25012 populate_metadata read hostname 'smithi092' 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f425e5f2740 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f210bd3330 0x55f210bd5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f425e5f2740 4 client.25012 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f210b21a20 con 0x55f210bd3330 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f4259514640 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f210bd3330 0x55f210bd5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f423cff9640 10 client.25012 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.075+0000 7f4259514640 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f210bd3330 0x55f210bd5720 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8297b8246317f7e7 server_cookie=5eb633501cee6e85 in_seq=0 out_seq=0 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.076+0000 7f423cff9640 1 -- 172.21.15.92:0/441499781 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f210b21a20 con 0x55f210bd3330 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.076+0000 7f423cff9640 10 client.25012 handle_command_reply: tid=0 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.076+0000 7f425e5f2740 1 client.25012 shutdown 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.076+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 msgr2=0x55f210bc2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.076+0000 7f425e5f2740 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc2ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4244001eb0 tx=0x7f424400da10 comp rx=0 tx=0).stop 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.076+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 shutdown_connections 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.077+0000 7f425e5f2740 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bc3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.077+0000 7f425e5f2740 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f210bd3330 0x55f210bd5720 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.077+0000 7f425e5f2740 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bc3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.077+0000 7f425e5f2740 1 --2- 172.21.15.92:0/441499781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc2ee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.077+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 >> 172.21.15.92:0/441499781 conn(0x55f210babb10 msgr2=0x55f210bb8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.077+0000 7f423cff9640 0 client.25012 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.078+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 shutdown_connections 2024-09-10T10:38:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.078+0000 7f425e5f2740 1 -- 172.21.15.92:0/441499781 wait complete. 2024-09-10T10:38:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.078+0000 7f425e5f2740 20 client.25012 trim_cache size 0 max 16384 2024-09-10T10:38:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.097+0000 7f425e5f2740 1 Processor -- start 2024-09-10T10:38:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.097+0000 7f425e5f2740 1 -- start start 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bdaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bdb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f425e5f2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42541ab4c0 con 0x55f210bbdcc0 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f425e5f2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f42541ad120 con 0x55f210bba000 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f425e5f2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42541abbf0 con 0x55f210bb9660 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4259514640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bdaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4258d13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bdb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4259514640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bdaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:40322/0 (socket says 172.21.15.92:40322) 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4259514640 1 -- 172.21.15.92:0/2539842655 learned_addr learned my addr 172.21.15.92:0/2539842655 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4258d13640 1 --2- 172.21.15.92:0/2539842655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4259514640 1 -- 172.21.15.92:0/2539842655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 msgr2=0x55f210bc35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4259514640 1 --2- 172.21.15.92:0/2539842655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4259514640 1 -- 172.21.15.92:0/2539842655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 msgr2=0x55f210bdb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4259514640 1 --2- 172.21.15.92:0/2539842655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bdb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4259514640 1 -- 172.21.15.92:0/2539842655 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f210bc1410 con 0x55f210bba000 2024-09-10T10:38:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4258d13640 1 --2- 172.21.15.92:0/2539842655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f4259514640 1 --2- 172.21.15.92:0/2539842655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bdaf20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f425002a940 tx=0x7f42500314f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38deb07664ac6363 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.098+0000 7f423effd640 1 -- 172.21.15.92:0/2539842655 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425004a020 con 0x55f210bba000 2024-09-10T10:38:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.099+0000 7f423effd640 1 -- 172.21.15.92:0/2539842655 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4250005640 con 0x55f210bba000 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.099+0000 7f423effd640 1 -- 172.21.15.92:0/2539842655 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4250035020 con 0x55f210bba000 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.100+0000 7f425e5f2740 1 -- 172.21.15.92:0/2539842655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 msgr2=0x55f210bdaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.100+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2539842655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bdaf20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f425002a940 tx=0x7f42500314f0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.100+0000 7f425e5f2740 1 -- 172.21.15.92:0/2539842655 shutdown_connections 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.100+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2539842655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bdb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.100+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2539842655 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bdaf20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.100+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2539842655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bc35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.100+0000 7f425e5f2740 1 -- 172.21.15.92:0/2539842655 >> 172.21.15.92:0/2539842655 conn(0x55f210babb10 msgr2=0x55f210bc2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.100+0000 7f425e5f2740 1 -- 172.21.15.92:0/2539842655 shutdown_connections 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.100+0000 7f425e5f2740 1 -- 172.21.15.92:0/2539842655 wait complete. 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f425e5f2740 1 -- start start 2024-09-10T10:38:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f425e5f2740 1 Processor -- start 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bcb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bcbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f425e5f2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bc6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f425e5f2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42541aca50 con 0x55f210bbdcc0 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f425e5f2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f42541ac2c0 con 0x55f210bba000 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f425e5f2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42541a94c0 con 0x55f210bb9660 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f425e5f2740 10 client.0 _ll_register_callbacks cb 0x7f4244005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f4258d13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bc6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f4258d13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bcb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f4259514640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bcbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f4258d13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bcb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:59690/0 (socket says 172.21.15.92:59690) 2024-09-10T10:38:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.101+0000 7f4258d13640 1 -- 172.21.15.92:0/2671442275 learned_addr learned my addr 172.21.15.92:0/2671442275 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f4258d13640 1 -- 172.21.15.92:0/2671442275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 msgr2=0x55f210bcbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f4258d13640 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bcbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f4258d13640 1 -- 172.21.15.92:0/2671442275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 msgr2=0x55f210bc6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f4258d13640 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bc6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f4258d13640 1 -- 172.21.15.92:0/2671442275 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f210bc75b0 con 0x55f210bb9660 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f4258d13640 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bcb830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4244009760 tx=0x7f4244005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=183154fdbcc0e5e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f423cff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f423cff9640 1 -- 172.21.15.92:0/2671442275 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244012030 con 0x55f210bb9660 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f423cff9640 1 -- 172.21.15.92:0/2671442275 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f42440121d0 con 0x55f210bb9660 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f425e5f2740 1 -- 172.21.15.92:0/2671442275 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4250005640 con 0x55f210bb9660 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f423cff9640 1 -- 172.21.15.92:0/2671442275 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4244030020 con 0x55f210bb9660 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f425e5f2740 10 client.25018 fetch_fsmap learned FSMap version 35 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f425e5f2740 1 -- 172.21.15.92:0/2671442275 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f210c3db90 con 0x55f210bb9660 2024-09-10T10:38:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f423cff9640 1 -- 172.21.15.92:0/2671442275 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4250005640 con 0x55f210bb9660 2024-09-10T10:38:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f423cff9640 1 -- 172.21.15.92:0/2671442275 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7f4244021960 con 0x55f210bb9660 2024-09-10T10:38:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f425e5f2740 10 client.25018 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:38:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f425e5f2740 10 client.25018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:38:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f425e5f2740 20 client.25018 populate_metadata read hostname 'smithi092' 2024-09-10T10:38:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.102+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f210c3e340 0x55f210c40760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.103+0000 7f425e5f2740 4 client.25018 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:38:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.103+0000 7f425e5f2740 1 -- 172.21.15.92:0/2671442275 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f210b1bd70 con 0x55f210c3e340 2024-09-10T10:38:13.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.103+0000 7f4259514640 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f210c3e340 0x55f210c40760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.104+0000 7f4259514640 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f210c3e340 0x55f210c40760 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a82b7884dbe64f server_cookie=1a76fdcf0a46a7a2 in_seq=0 out_seq=0 2024-09-10T10:38:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.104+0000 7f423cff9640 10 client.25018 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.116+0000 7f423cff9640 1 -- 172.21.15.92:0/2671442275 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f210b1bd70 con 0x55f210c3e340 2024-09-10T10:38:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.116+0000 7f423cff9640 10 client.25018 handle_command_reply: tid=0 2024-09-10T10:38:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 client.25018 shutdown 2024-09-10T10:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 -- 172.21.15.92:0/2671442275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 msgr2=0x55f210bcb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bcb830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4244009760 tx=0x7f4244005f90 comp rx=0 tx=0).stop 2024-09-10T10:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 -- 172.21.15.92:0/2671442275 shutdown_connections 2024-09-10T10:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f210bbdcc0 0x55f210bc6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f210c3e340 0x55f210c40760 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f210bba000 0x55f210bcbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 --2- 172.21.15.92:0/2671442275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f210bb9660 0x55f210bcb830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 -- 172.21.15.92:0/2671442275 >> 172.21.15.92:0/2671442275 conn(0x55f210babb10 msgr2=0x55f210bb8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f423cff9640 0 client.25018 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 -- 172.21.15.92:0/2671442275 shutdown_connections 2024-09-10T10:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 1 -- 172.21.15.92:0/2671442275 wait complete. 2024-09-10T10:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.117+0000 7f425e5f2740 20 client.25018 trim_cache size 0 max 16384 2024-09-10T10:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 -- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f42400a2e20 msgr2=0x7f42400a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f42400a2e20 0x7f42400a52e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f424c00caa0 tx=0x7f424c01cf90 comp rx=0 tx=0).stop 2024-09-10T10:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 -- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 msgr2=0x7f425419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 0x7f425419cd00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f424c00cad0 tx=0x7f424c00cf90 comp rx=0 tx=0).stop 2024-09-10T10:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 -- 172.21.15.92:0/3390239191 shutdown_connections 2024-09-10T10:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4254107ad0 0x7f425419cd00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4254102460 0x7f4254198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f42400a2e20 0x7f42400a52e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 --2- 172.21.15.92:0/3390239191 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4254101ac0 0x7f4254198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 -- 172.21.15.92:0/3390239191 >> 172.21.15.92:0/3390239191 conn(0x7f42540fd820 msgr2=0x7f42540feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 -- 172.21.15.92:0/3390239191 shutdown_connections 2024-09-10T10:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:13.118+0000 7f425b778640 1 -- 172.21.15.92:0/3390239191 wait complete. 2024-09-10T10:38:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 75.0 s, 3413.2 tps, lat 29.350 ms stddev 30.720 2024-09-10T10:38:13.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:13 smithi097 ceph-mon[35213]: pgmap v51: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 MiB/s wr, 1.41k op/s 2024-09-10T10:38:13.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:13 smithi092 ceph-mon[30834]: pgmap v51: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 MiB/s wr, 1.41k op/s 2024-09-10T10:38:14.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:13 smithi121 ceph-mon[35231]: pgmap v51: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 MiB/s wr, 1.41k op/s 2024-09-10T10:38:15.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:15 smithi097 ceph-mon[35213]: pgmap v52: 97 pgs: 97 active+clean; 1.6 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 41 MiB/s wr, 1.72k op/s 2024-09-10T10:38:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:15 smithi092 ceph-mon[30834]: pgmap v52: 97 pgs: 97 active+clean; 1.6 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 41 MiB/s wr, 1.72k op/s 2024-09-10T10:38:16.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:15 smithi121 ceph-mon[35231]: pgmap v52: 97 pgs: 97 active+clean; 1.6 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 41 MiB/s wr, 1.72k op/s 2024-09-10T10:38:17.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:17 smithi097 ceph-mon[35213]: pgmap v53: 97 pgs: 97 active+clean; 1.6 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.6 MiB/s wr, 625 op/s 2024-09-10T10:38:17.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:17 smithi092 ceph-mon[30834]: pgmap v53: 97 pgs: 97 active+clean; 1.6 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.6 MiB/s wr, 625 op/s 2024-09-10T10:38:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:17 smithi121 ceph-mon[35231]: pgmap v53: 97 pgs: 97 active+clean; 1.6 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.6 MiB/s wr, 625 op/s 2024-09-10T10:38:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 80.0 s, 3822.2 tps, lat 26.191 ms stddev 26.017 2024-09-10T10:38:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:19 smithi097 ceph-mon[35213]: pgmap v54: 97 pgs: 97 active+clean; 1.6 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.6 MiB/s wr, 625 op/s 2024-09-10T10:38:19.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:19 smithi092 ceph-mon[30834]: pgmap v54: 97 pgs: 97 active+clean; 1.6 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.6 MiB/s wr, 625 op/s 2024-09-10T10:38:20.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:19 smithi121 ceph-mon[35231]: pgmap v54: 97 pgs: 97 active+clean; 1.6 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.6 MiB/s wr, 625 op/s 2024-09-10T10:38:21.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:21 smithi097 ceph-mon[35213]: pgmap v55: 97 pgs: 97 active+clean; 1.6 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 957 op/s 2024-09-10T10:38:21.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:21 smithi092 ceph-mon[30834]: pgmap v55: 97 pgs: 97 active+clean; 1.6 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 957 op/s 2024-09-10T10:38:22.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:21 smithi121 ceph-mon[35231]: pgmap v55: 97 pgs: 97 active+clean; 1.6 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 957 op/s 2024-09-10T10:38:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 85.0 s, 3784.2 tps, lat 26.388 ms stddev 27.053 2024-09-10T10:38:23.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:23 smithi097 ceph-mon[35213]: pgmap v56: 97 pgs: 97 active+clean; 1.6 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.7 MiB/s wr, 648 op/s 2024-09-10T10:38:23.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:23 smithi092 ceph-mon[30834]: pgmap v56: 97 pgs: 97 active+clean; 1.6 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.7 MiB/s wr, 648 op/s 2024-09-10T10:38:24.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:23 smithi121 ceph-mon[35231]: pgmap v56: 97 pgs: 97 active+clean; 1.6 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.7 MiB/s wr, 648 op/s 2024-09-10T10:38:25.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:25 smithi097 ceph-mon[35213]: pgmap v57: 97 pgs: 97 active+clean; 1.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-10T10:38:25.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:25 smithi092 ceph-mon[30834]: pgmap v57: 97 pgs: 97 active+clean; 1.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-10T10:38:26.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:25 smithi121 ceph-mon[35231]: pgmap v57: 97 pgs: 97 active+clean; 1.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-09-10T10:38:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.247+0000 7f158c511640 1 -- 172.21.15.92:0/1619939090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1584101d70 msgr2=0x7f15841021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.247+0000 7f158c511640 1 --2- 172.21.15.92:0/1619939090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1584101d70 0x7f15841021b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f157400aa10 tx=0x7f157402b750 comp rx=0 tx=0).stop 2024-09-10T10:38:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.247+0000 7f158c511640 1 -- 172.21.15.92:0/1619939090 shutdown_connections 2024-09-10T10:38:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.247+0000 7f158c511640 1 --2- 172.21.15.92:0/1619939090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15841026f0 0x7f158410d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.247+0000 7f158c511640 1 --2- 172.21.15.92:0/1619939090 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1584101d70 0x7f15841021b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.247+0000 7f158c511640 1 --2- 172.21.15.92:0/1619939090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1584100490 0x7f1584100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.247+0000 7f158c511640 1 -- 172.21.15.92:0/1619939090 >> 172.21.15.92:0/1619939090 conn(0x7f15840770f0 msgr2=0x7f15840fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.247+0000 7f158c511640 1 -- 172.21.15.92:0/1619939090 shutdown_connections 2024-09-10T10:38:26.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.247+0000 7f158c511640 1 -- 172.21.15.92:0/1619939090 wait complete. 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158c511640 1 Processor -- start 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158c511640 1 -- start start 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158c511640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1584100490 0x7f158410cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158c511640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1584101d70 0x7f158410aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158c511640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15841026f0 0x7f158410b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158c511640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f158410e460 con 0x7f1584100490 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158c511640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f158410e2e0 con 0x7f15841026f0 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158c511640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f158410e5e0 con 0x7f1584101d70 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158a2ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1584100490 0x7f158410cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158aaae640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15841026f0 0x7f158410b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158a2ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1584100490 0x7f158410cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50692/0 (socket says 172.21.15.92:50692) 2024-09-10T10:38:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158a2ad640 1 -- 172.21.15.92:0/1603186036 learned_addr learned my addr 172.21.15.92:0/1603186036 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.249+0000 7f158a2ad640 1 -- 172.21.15.92:0/1603186036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1584101d70 msgr2=0x7f158410aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.249+0000 7f158a2ad640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1584101d70 0x7f158410aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.249+0000 7f158a2ad640 1 -- 172.21.15.92:0/1603186036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15841026f0 msgr2=0x7f158410b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.248+0000 7f158aaae640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15841026f0 0x7f158410b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:47776/0 (socket says 172.21.15.92:47776) 2024-09-10T10:38:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.250+0000 7f158a2ad640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15841026f0 0x7f158410b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.250+0000 7f158a2ad640 1 -- 172.21.15.92:0/1603186036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158410bb30 con 0x7f1584100490 2024-09-10T10:38:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.250+0000 7f158aaae640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15841026f0 0x7f158410b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:38:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.250+0000 7f158a2ad640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1584100490 0x7f158410cda0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f158000e9f0 tx=0x7f158000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.251+0000 7f157b7fe640 1 -- 172.21.15.92:0/1603186036 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158000cd80 con 0x7f1584100490 2024-09-10T10:38:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.251+0000 7f158c511640 1 -- 172.21.15.92:0/1603186036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15841ab0a0 con 0x7f1584100490 2024-09-10T10:38:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.251+0000 7f157b7fe640 1 -- 172.21.15.92:0/1603186036 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1580010910 con 0x7f1584100490 2024-09-10T10:38:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.251+0000 7f158c511640 1 -- 172.21.15.92:0/1603186036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15841ab5b0 con 0x7f1584100490 2024-09-10T10:38:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.251+0000 7f157b7fe640 1 -- 172.21.15.92:0/1603186036 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158000cd80 con 0x7f1584100490 2024-09-10T10:38:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.255+0000 7f158f2ad740 1 Processor -- start 2024-09-10T10:38:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.258+0000 7f158f2ad740 1 -- start start 2024-09-10T10:38:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.258+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb849eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.258+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.258+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 0x55edb84ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.258+0000 7f158f2ad740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55edb84032f0 con 0x55edb84a9cb0 2024-09-10T10:38:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.258+0000 7f158f2ad740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55edb83ab270 con 0x55edb849eaf0 2024-09-10T10:38:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.258+0000 7f158f2ad740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edb83ff2b0 con 0x55edb849f410 2024-09-10T10:38:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.259+0000 7f157b7fe640 1 -- 172.21.15.92:0/1603186036 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1580010ac0 con 0x7f1584100490 2024-09-10T10:38:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.260+0000 7f157b7fe640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f15700a3270 0x7f15700a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.260+0000 7f158a2ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.260+0000 7f158a2ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34082/0 (socket says 172.21.15.92:34082) 2024-09-10T10:38:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.260+0000 7f158a2ad640 1 -- 172.21.15.92:0/1443922297 learned_addr learned my addr 172.21.15.92:0/1443922297 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.262+0000 7f157b7fe640 1 -- 172.21.15.92:0/1603186036 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f158000cb80 con 0x7f1584100490 2024-09-10T10:38:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.263+0000 7f158aaae640 1 --2- 172.21.15.92:0/1443922297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb849eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.264+0000 7f158a2ad640 1 -- 172.21.15.92:0/1443922297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 msgr2=0x55edb849eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.264+0000 7f158a2ad640 1 --2- 172.21.15.92:0/1443922297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb849eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.264+0000 7f158a2ad640 1 -- 172.21.15.92:0/1443922297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 msgr2=0x55edb84ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.264+0000 7f158a2ad640 1 --2- 172.21.15.92:0/1443922297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 0x55edb84ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.264+0000 7f158a2ad640 1 -- 172.21.15.92:0/1443922297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb83aa340 con 0x55edb849f410 2024-09-10T10:38:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.264+0000 7f158aaae640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f15700a3270 0x7f15700a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.265+0000 7f158a2ad640 1 --2- 172.21.15.92:0/1443922297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a9770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f158001e000 tx=0x7f158009b4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ead03ea671d20b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.265+0000 7f1578bfe640 1 -- 172.21.15.92:0/1443922297 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158009fc30 con 0x55edb849f410 2024-09-10T10:38:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.265+0000 7f1578bfe640 1 -- 172.21.15.92:0/1443922297 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15800a44f0 con 0x55edb849f410 2024-09-10T10:38:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.265+0000 7f1578bfe640 1 -- 172.21.15.92:0/1443922297 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580098050 con 0x55edb849f410 2024-09-10T10:38:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.268+0000 7f158f2ad740 1 -- 172.21.15.92:0/1443922297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 msgr2=0x55edb84a9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.268+0000 7f158f2ad740 1 --2- 172.21.15.92:0/1443922297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a9770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f158001e000 tx=0x7f158009b4c0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.269+0000 7f158f2ad740 1 -- 172.21.15.92:0/1443922297 shutdown_connections 2024-09-10T10:38:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.269+0000 7f158f2ad740 1 --2- 172.21.15.92:0/1443922297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 0x55edb84ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.269+0000 7f158f2ad740 1 --2- 172.21.15.92:0/1443922297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a9770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.269+0000 7f158f2ad740 1 --2- 172.21.15.92:0/1443922297 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb849eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.269+0000 7f158f2ad740 1 -- 172.21.15.92:0/1443922297 >> 172.21.15.92:0/1443922297 conn(0x55edb849b060 msgr2=0x55edb849b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.270+0000 7f158aaae640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f15700a3270 0x7f15700a5730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f157c013890 tx=0x7f157c004a60 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.270+0000 7f158f2ad740 1 -- 172.21.15.92:0/1443922297 shutdown_connections 2024-09-10T10:38:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.270+0000 7f158f2ad740 1 -- 172.21.15.92:0/1443922297 wait complete. 2024-09-10T10:38:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.271+0000 7f158f2ad740 1 -- start start 2024-09-10T10:38:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.271+0000 7f158f2ad740 1 Processor -- start 2024-09-10T10:38:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.271+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849eaf0 0x55edb84a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.271+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb849f410 0x55edb84a7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.271+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 0x55edb84a7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.271+0000 7f158f2ad740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55edb84bd890 con 0x55edb849f410 2024-09-10T10:38:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.271+0000 7f158f2ad740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55edb838c290 con 0x55edb84a9cb0 2024-09-10T10:38:26.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.271+0000 7f158f2ad740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edb84bda10 con 0x55edb849eaf0 2024-09-10T10:38:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.271+0000 7f158f2ad740 10 client.0 _ll_register_callbacks cb 0x55edb83bd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:38:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.272+0000 7f158a2ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849eaf0 0x55edb84a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.272+0000 7f158a2ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849eaf0 0x55edb84a6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34094/0 (socket says 172.21.15.92:34094) 2024-09-10T10:38:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.272+0000 7f158a2ad640 1 -- 172.21.15.92:0/343683723 learned_addr learned my addr 172.21.15.92:0/343683723 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:26.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.272+0000 7f158aaae640 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 0x55edb84a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.272+0000 7f158a2ad640 1 -- 172.21.15.92:0/343683723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 msgr2=0x55edb84a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.272+0000 7f158a2ad640 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 0x55edb84a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.272+0000 7f158a2ad640 1 -- 172.21.15.92:0/343683723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb849f410 msgr2=0x55edb84a7230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:38:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.272+0000 7f158a2ad640 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb849f410 0x55edb84a7230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.273+0000 7f158a2ad640 1 -- 172.21.15.92:0/343683723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edb8116210 con 0x55edb849eaf0 2024-09-10T10:38:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.273+0000 7f158aaae640 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 0x55edb84a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:38:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.273+0000 7f158a2ad640 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849eaf0 0x55edb84a6cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1580097ce0 tx=0x7f1580097b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46003b065a467022 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.273+0000 7f156dffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:38:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.273+0000 7f156dffb640 1 -- 172.21.15.92:0/343683723 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580086050 con 0x55edb849eaf0 2024-09-10T10:38:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.273+0000 7f156dffb640 1 -- 172.21.15.92:0/343683723 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f15800861f0 con 0x55edb849eaf0 2024-09-10T10:38:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.273+0000 7f158f2ad740 1 -- 172.21.15.92:0/343683723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15800a44f0 con 0x55edb849eaf0 2024-09-10T10:38:26.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.274+0000 7f156dffb640 1 -- 172.21.15.92:0/343683723 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f158009cbb0 con 0x55edb849eaf0 2024-09-10T10:38:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.275+0000 7f158f2ad740 10 client.25024 fetch_fsmap learned FSMap version 35 2024-09-10T10:38:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.275+0000 7f158f2ad740 1 -- 172.21.15.92:0/343683723 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55edb81e2620 con 0x55edb849eaf0 2024-09-10T10:38:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.275+0000 7f156dffb640 1 -- 172.21.15.92:0/343683723 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15800a44f0 con 0x55edb849eaf0 2024-09-10T10:38:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.275+0000 7f156dffb640 1 -- 172.21.15.92:0/343683723 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7f15800975d0 con 0x55edb849eaf0 2024-09-10T10:38:26.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.276+0000 7f158f2ad740 10 client.25024 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:38:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.276+0000 7f158f2ad740 10 client.25024 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:38:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.276+0000 7f158f2ad740 20 client.25024 populate_metadata read hostname 'smithi092' 2024-09-10T10:38:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.276+0000 7f158f2ad740 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edb84caf20 0x55edb84cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.276+0000 7f158f2ad740 4 client.25024 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:38:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.276+0000 7f158f2ad740 1 -- 172.21.15.92:0/343683723 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edb8410a20 con 0x55edb84caf20 2024-09-10T10:38:26.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.276+0000 7f1589aac640 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edb84caf20 0x55edb84cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.276+0000 7f1589aac640 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edb84caf20 0x55edb84cd3a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bd826354809e12f server_cookie=34b8471989a7533f in_seq=0 out_seq=0 2024-09-10T10:38:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.276+0000 7f156dffb640 10 client.25024 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.277+0000 7f156dffb640 1 -- 172.21.15.92:0/343683723 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55edb8410a20 con 0x55edb84caf20 2024-09-10T10:38:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.277+0000 7f156dffb640 10 client.25024 handle_command_reply: tid=0 2024-09-10T10:38:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.277+0000 7f158f2ad740 1 client.25024 shutdown 2024-09-10T10:38:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.278+0000 7f158f2ad740 1 -- 172.21.15.92:0/343683723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849eaf0 msgr2=0x55edb84a6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:26.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.278+0000 7f158f2ad740 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849eaf0 0x55edb84a6cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1580097ce0 tx=0x7f1580097b20 comp rx=0 tx=0).stop 2024-09-10T10:38:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f158f2ad740 1 -- 172.21.15.92:0/343683723 shutdown_connections 2024-09-10T10:38:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f158f2ad740 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edb84caf20 0x55edb84cd3a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f158f2ad740 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 0x55edb84a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f158f2ad740 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb849f410 0x55edb84a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f158f2ad740 1 --2- 172.21.15.92:0/343683723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849eaf0 0x55edb84a6cf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f158f2ad740 1 -- 172.21.15.92:0/343683723 >> 172.21.15.92:0/343683723 conn(0x55edb849b060 msgr2=0x55edb84a0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f156dffb640 0 client.25024 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f158f2ad740 1 -- 172.21.15.92:0/343683723 shutdown_connections 2024-09-10T10:38:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f158f2ad740 1 -- 172.21.15.92:0/343683723 wait complete. 2024-09-10T10:38:26.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.279+0000 7f158f2ad740 20 client.25024 trim_cache size 0 max 16384 2024-09-10T10:38:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.298+0000 7f158f2ad740 1 Processor -- start 2024-09-10T10:38:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.298+0000 7f158f2ad740 1 -- start start 2024-09-10T10:38:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.298+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb849eaf0 0x55edb849a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.298+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.298+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 0x55edb84d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f158a2ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb849eaf0 0x55edb849a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f1589aac640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f158f2ad740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f158411c060 con 0x55edb849eaf0 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f158f2ad740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f15841ad280 con 0x55edb84a9cb0 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f158f2ad740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f15841abd50 con 0x55edb849f410 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f1589aac640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34098/0 (socket says 172.21.15.92:34098) 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f1589aac640 1 -- 172.21.15.92:0/3394537567 learned_addr learned my addr 172.21.15.92:0/3394537567 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f1589aac640 1 -- 172.21.15.92:0/3394537567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 msgr2=0x55edb84d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f1589aac640 1 --2- 172.21.15.92:0/3394537567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 0x55edb84d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f1589aac640 1 -- 172.21.15.92:0/3394537567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb849eaf0 msgr2=0x55edb849a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f1589aac640 1 --2- 172.21.15.92:0/3394537567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb849eaf0 0x55edb849a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.299+0000 7f1589aac640 1 -- 172.21.15.92:0/3394537567 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb84a1b20 con 0x55edb849f410 2024-09-10T10:38:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.300+0000 7f1589aac640 1 --2- 172.21.15.92:0/3394537567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a8c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1574006010 tx=0x7f1574030560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd7780c4eb72d77b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.301+0000 7f156ffff640 1 -- 172.21.15.92:0/3394537567 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157404a070 con 0x55edb849f410 2024-09-10T10:38:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.301+0000 7f156ffff640 1 -- 172.21.15.92:0/3394537567 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1574030df0 con 0x55edb849f410 2024-09-10T10:38:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.302+0000 7f156ffff640 1 -- 172.21.15.92:0/3394537567 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574036070 con 0x55edb849f410 2024-09-10T10:38:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.303+0000 7f158f2ad740 1 -- 172.21.15.92:0/3394537567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 msgr2=0x55edb84a8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.303+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3394537567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a8c60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1574006010 tx=0x7f1574030560 comp rx=0 tx=0).stop 2024-09-10T10:38:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.303+0000 7f158f2ad740 1 -- 172.21.15.92:0/3394537567 shutdown_connections 2024-09-10T10:38:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.303+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3394537567 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb84a9cb0 0x55edb84d2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.303+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3394537567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84a8c60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.303+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3394537567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb849eaf0 0x55edb849a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.303+0000 7f158f2ad740 1 -- 172.21.15.92:0/3394537567 >> 172.21.15.92:0/3394537567 conn(0x55edb849b060 msgr2=0x55edb84a8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.303+0000 7f158f2ad740 1 -- 172.21.15.92:0/3394537567 shutdown_connections 2024-09-10T10:38:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.304+0000 7f158f2ad740 1 -- 172.21.15.92:0/3394537567 wait complete. 2024-09-10T10:38:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158f2ad740 1 -- start start 2024-09-10T10:38:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158f2ad740 1 Processor -- start 2024-09-10T10:38:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb84c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158f2ad740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 0x55edb84a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158f2ad740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f15841acbb0 con 0x55edb84a9cb0 2024-09-10T10:38:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158f2ad740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f15841ac420 con 0x55edb849eaf0 2024-09-10T10:38:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158f2ad740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f158411a040 con 0x55edb849f410 2024-09-10T10:38:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158f2ad740 10 client.0 _ll_register_callbacks cb 0x7f157c007700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:38:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158a2ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb84c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158aaae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 0x55edb84a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158a2ad640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb84c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:47818/0 (socket says 172.21.15.92:47818) 2024-09-10T10:38:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158aaae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 0x55edb84a3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50702/0 (socket says 172.21.15.92:50702) 2024-09-10T10:38:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f158a2ad640 1 -- 172.21.15.92:0/3155103235 learned_addr learned my addr 172.21.15.92:0/3155103235 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:26.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.305+0000 7f1589aac640 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.306+0000 7f158a2ad640 1 -- 172.21.15.92:0/3155103235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 msgr2=0x55edb84c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.306+0000 7f158a2ad640 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.306+0000 7f158a2ad640 1 -- 172.21.15.92:0/3155103235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 msgr2=0x55edb84a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.306+0000 7f158a2ad640 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 0x55edb84a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.306+0000 7f158a2ad640 1 -- 172.21.15.92:0/3155103235 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edb84a4100 con 0x55edb849eaf0 2024-09-10T10:38:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.306+0000 7f158a2ad640 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb84c3060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1580097fc0 tx=0x7f1580097b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=850b11061eeb51bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.306+0000 7f156dffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f156dffb640 1 -- 172.21.15.92:0/3155103235 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15800860b0 con 0x55edb849eaf0 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f158f2ad740 1 -- 172.21.15.92:0/3155103235 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1574030df0 con 0x55edb849eaf0 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f156dffb640 1 -- 172.21.15.92:0/3155103235 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f15800975d0 con 0x55edb849eaf0 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f156dffb640 1 -- 172.21.15.92:0/3155103235 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f15800977d0 con 0x55edb849eaf0 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f158f2ad740 10 client.24995 fetch_fsmap learned FSMap version 35 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f158f2ad740 1 -- 172.21.15.92:0/3155103235 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55edb8535980 con 0x55edb849eaf0 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f156dffb640 1 -- 172.21.15.92:0/3155103235 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1574030df0 con 0x55edb849eaf0 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f156dffb640 1 -- 172.21.15.92:0/3155103235 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7f15800104c0 con 0x55edb849eaf0 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f158f2ad740 10 client.24995 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f158f2ad740 10 client.24995 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f158f2ad740 20 client.24995 populate_metadata read hostname 'smithi092' 2024-09-10T10:38:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edb8535e50 0x55edb8538270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f158f2ad740 4 client.24995 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:38:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.307+0000 7f158f2ad740 1 -- 172.21.15.92:0/3155103235 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55edb840ad70 con 0x55edb8535e50 2024-09-10T10:38:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.308+0000 7f1589aac640 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edb8535e50 0x55edb8538270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.308+0000 7f1589aac640 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edb8535e50 0x55edb8538270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23abb7abaea081f6 server_cookie=2bc16f7021f1368e in_seq=0 out_seq=0 2024-09-10T10:38:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.308+0000 7f156dffb640 10 client.24995 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f156dffb640 1 -- 172.21.15.92:0/3155103235 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55edb840ad70 con 0x55edb8535e50 2024-09-10T10:38:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f156dffb640 10 client.24995 handle_command_reply: tid=0 2024-09-10T10:38:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f158f2ad740 1 client.24995 shutdown 2024-09-10T10:38:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f158f2ad740 1 -- 172.21.15.92:0/3155103235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 msgr2=0x55edb84c3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb84c3060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1580097fc0 tx=0x7f1580097b90 comp rx=0 tx=0).stop 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f158f2ad740 1 -- 172.21.15.92:0/3155103235 shutdown_connections 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edb84a9cb0 0x55edb84a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edb849f410 0x55edb84c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edb8535e50 0x55edb8538270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f158f2ad740 1 --2- 172.21.15.92:0/3155103235 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edb849eaf0 0x55edb84c3060 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f156dffb640 0 client.24995 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.320+0000 7f158f2ad740 1 -- 172.21.15.92:0/3155103235 >> 172.21.15.92:0/3155103235 conn(0x55edb849b060 msgr2=0x55edb84a0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158f2ad740 1 -- 172.21.15.92:0/3155103235 shutdown_connections 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158f2ad740 1 -- 172.21.15.92:0/3155103235 wait complete. 2024-09-10T10:38:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158f2ad740 20 client.24995 trim_cache size 0 max 16384 2024-09-10T10:38:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:38:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:38:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:38:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:38:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158c511640 1 -- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f15700a3270 msgr2=0x7f15700a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158c511640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f15700a3270 0x7f15700a5730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f157c013890 tx=0x7f157c004a60 comp rx=0 tx=0).stop 2024-09-10T10:38:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158c511640 1 -- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1584100490 msgr2=0x7f158410cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158c511640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1584100490 0x7f158410cda0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f158000e9f0 tx=0x7f158000eeb0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158c511640 1 -- 172.21.15.92:0/1603186036 shutdown_connections 2024-09-10T10:38:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158c511640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f15700a3270 0x7f15700a5730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158c511640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f15841026f0 0x7f158410b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158c511640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1584101d70 0x7f158410aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.321+0000 7f158c511640 1 --2- 172.21.15.92:0/1603186036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1584100490 0x7f158410cda0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.322+0000 7f158c511640 1 -- 172.21.15.92:0/1603186036 >> 172.21.15.92:0/1603186036 conn(0x7f15840770f0 msgr2=0x7f1584104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.322+0000 7f158c511640 1 -- 172.21.15.92:0/1603186036 shutdown_connections 2024-09-10T10:38:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:26.322+0000 7f158c511640 1 -- 172.21.15.92:0/1603186036 wait complete. 2024-09-10T10:38:27.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:27 smithi097 ceph-mon[35213]: pgmap v58: 97 pgs: 97 active+clean; 1.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 693 op/s 2024-09-10T10:38:27.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:27 smithi092 ceph-mon[30834]: pgmap v58: 97 pgs: 97 active+clean; 1.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 693 op/s 2024-09-10T10:38:28.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:27 smithi121 ceph-mon[35231]: pgmap v58: 97 pgs: 97 active+clean; 1.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 693 op/s 2024-09-10T10:38:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 90.0 s, 3523.0 tps, lat 28.434 ms stddev 28.872 2024-09-10T10:38:29.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:29 smithi097 ceph-mon[35213]: pgmap v59: 97 pgs: 97 active+clean; 1.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 693 op/s 2024-09-10T10:38:29.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:29 smithi092 ceph-mon[30834]: pgmap v59: 97 pgs: 97 active+clean; 1.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 693 op/s 2024-09-10T10:38:30.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:29 smithi121 ceph-mon[35231]: pgmap v59: 97 pgs: 97 active+clean; 1.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 693 op/s 2024-09-10T10:38:31.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:31 smithi092 ceph-mon[30834]: pgmap v60: 97 pgs: 97 active+clean; 1.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-09-10T10:38:32.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:31 smithi121 ceph-mon[35231]: pgmap v60: 97 pgs: 97 active+clean; 1.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-09-10T10:38:32.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:31 smithi097 ceph-mon[35213]: pgmap v60: 97 pgs: 97 active+clean; 1.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2024-09-10T10:38:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 95.0 s, 3656.8 tps, lat 27.346 ms stddev 28.629 2024-09-10T10:38:33.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:33 smithi092 ceph-mon[30834]: pgmap v61: 97 pgs: 97 active+clean; 1.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.9 MiB/s wr, 733 op/s 2024-09-10T10:38:34.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:33 smithi121 ceph-mon[35231]: pgmap v61: 97 pgs: 97 active+clean; 1.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.9 MiB/s wr, 733 op/s 2024-09-10T10:38:34.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:33 smithi097 ceph-mon[35213]: pgmap v61: 97 pgs: 97 active+clean; 1.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.9 MiB/s wr, 733 op/s 2024-09-10T10:38:35.842 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:35 smithi121 ceph-mon[35231]: pgmap v62: 97 pgs: 97 active+clean; 1.7 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 1.07k op/s 2024-09-10T10:38:35.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:35 smithi092 ceph-mon[30834]: pgmap v62: 97 pgs: 97 active+clean; 1.7 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 1.07k op/s 2024-09-10T10:38:36.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:35 smithi097 ceph-mon[35213]: pgmap v62: 97 pgs: 97 active+clean; 1.7 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 12 MiB/s wr, 1.07k op/s 2024-09-10T10:38:37.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:37 smithi092 ceph-mon[30834]: pgmap v63: 97 pgs: 97 active+clean; 1.7 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.3 MiB/s wr, 707 op/s 2024-09-10T10:38:37.871 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:37 smithi097 ceph-mon[35213]: pgmap v63: 97 pgs: 97 active+clean; 1.7 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.3 MiB/s wr, 707 op/s 2024-09-10T10:38:38.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:37 smithi121 ceph-mon[35231]: pgmap v63: 97 pgs: 97 active+clean; 1.7 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.3 MiB/s wr, 707 op/s 2024-09-10T10:38:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 100.0 s, 3719.6 tps, lat 26.777 ms stddev 28.541 2024-09-10T10:38:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.445+0000 7f29a16dd640 1 -- 172.21.15.92:0/1329678224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f299c102840 msgr2=0x7f299c102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.445+0000 7f29a16dd640 1 --2- 172.21.15.92:0/1329678224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f299c102840 0x7f299c102c20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f298c009900 tx=0x7f298c02a410 comp rx=0 tx=0).stop 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.446+0000 7f29a16dd640 1 -- 172.21.15.92:0/1329678224 shutdown_connections 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.446+0000 7f29a16dd640 1 --2- 172.21.15.92:0/1329678224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c101b10 0x7f299c10d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.446+0000 7f29a16dd640 1 --2- 172.21.15.92:0/1329678224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299c101190 0x7f299c1015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.446+0000 7f29a16dd640 1 --2- 172.21.15.92:0/1329678224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f299c102840 0x7f299c102c20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.446+0000 7f29a16dd640 1 -- 172.21.15.92:0/1329678224 >> 172.21.15.92:0/1329678224 conn(0x7f299c0770f0 msgr2=0x7f299c0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.446+0000 7f29a16dd640 1 -- 172.21.15.92:0/1329678224 shutdown_connections 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.446+0000 7f29a16dd640 1 -- 172.21.15.92:0/1329678224 wait complete. 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.447+0000 7f29a16dd640 1 Processor -- start 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.447+0000 7f29a16dd640 1 -- start start 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.447+0000 7f29a16dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f299c101190 0x7f299c10d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.447+0000 7f29a16dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c101b10 0x7f299c10a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.447+0000 7f29a16dd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299c102840 0x7f299c10aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.447+0000 7f29a16dd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f299c10fd60 con 0x7f299c101190 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.447+0000 7f29a16dd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f299c10fbe0 con 0x7f299c101b10 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.447+0000 7f29a16dd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f299c10fee0 con 0x7f299c102840 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f299c101190 0x7f299c10d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299c102840 0x7f299c10aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f299c101190 0x7f299c10d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39632/0 (socket says 172.21.15.92:39632) 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299a7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c101b10 0x7f299c10a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299affd640 1 -- 172.21.15.92:0/3375849263 learned_addr learned my addr 172.21.15.92:0/3375849263 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299b7fe640 1 -- 172.21.15.92:0/3375849263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c101b10 msgr2=0x7f299c10a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299b7fe640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c101b10 0x7f299c10a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299b7fe640 1 -- 172.21.15.92:0/3375849263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f299c101190 msgr2=0x7f299c10d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:39.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299b7fe640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f299c101190 0x7f299c10d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299b7fe640 1 -- 172.21.15.92:0/3375849263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c10af90 con 0x7f299c102840 2024-09-10T10:38:39.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f299b7fe640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299c102840 0x7f299c10aa50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f299400cab0 tx=0x7f299400cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:39.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f2983fff640 1 -- 172.21.15.92:0/3375849263 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299400ae20 con 0x7f299c102840 2024-09-10T10:38:39.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f29a16dd640 1 -- 172.21.15.92:0/3375849263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c10b280 con 0x7f299c102840 2024-09-10T10:38:39.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f29a16dd640 1 -- 172.21.15.92:0/3375849263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c1ab410 con 0x7f299c102840 2024-09-10T10:38:39.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f2983fff640 1 -- 172.21.15.92:0/3375849263 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f299400f930 con 0x7f299c102840 2024-09-10T10:38:39.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.448+0000 7f2983fff640 1 -- 172.21.15.92:0/3375849263 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994018b10 con 0x7f299c102840 2024-09-10T10:38:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.452+0000 7f29a447b740 1 Processor -- start 2024-09-10T10:38:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.452+0000 7f2983fff640 1 -- 172.21.15.92:0/3375849263 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f299400f450 con 0x7f299c102840 2024-09-10T10:38:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.452+0000 7f29a447b740 1 -- start start 2024-09-10T10:38:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f29a447b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a370ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f29a447b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a37b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f29a447b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a37e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f29a447b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561b6a2d52f0 con 0x561b6a371410 2024-09-10T10:38:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f29a447b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561b6a27d270 con 0x561b6a37bcb0 2024-09-10T10:38:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f29a447b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561b6a2d12b0 con 0x561b6a370af0 2024-09-10T10:38:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a37b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a37b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39644/0 (socket says 172.21.15.92:39644) 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299affd640 1 -- 172.21.15.92:0/2650879973 learned_addr learned my addr 172.21.15.92:0/2650879973 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299a7fc640 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a37e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299a7fc640 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a370ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299affd640 1 -- 172.21.15.92:0/2650879973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 msgr2=0x561b6a370ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299affd640 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a370ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299affd640 1 -- 172.21.15.92:0/2650879973 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 msgr2=0x561b6a37e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299affd640 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a37e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299affd640 1 -- 172.21.15.92:0/2650879973 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6a27c340 con 0x561b6a371410 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f2983fff640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f29840a2e20 0x7f29840a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299a7fc640 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a370ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299affd640 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a37b770 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f298c0040f0 tx=0x7f298c004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36512e563e2e6385 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f2983fff640 1 -- 172.21.15.92:0/3375849263 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f29940cf810 con 0x7f299c102840 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.453+0000 7f299a7fc640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f29840a2e20 0x7f29840a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.454+0000 7f29817fa640 1 -- 172.21.15.92:0/2650879973 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c040070 con 0x561b6a371410 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.454+0000 7f29817fa640 1 -- 172.21.15.92:0/2650879973 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f298c005500 con 0x561b6a371410 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.454+0000 7f29817fa640 1 -- 172.21.15.92:0/2650879973 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c035040 con 0x561b6a371410 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f29a447b740 1 -- 172.21.15.92:0/2650879973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 msgr2=0x561b6a37b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f29a447b740 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a37b770 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f298c0040f0 tx=0x7f298c004120 comp rx=0 tx=0).stop 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f299a7fc640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f29840a2e20 0x7f29840a52e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x561b6a36e3e0 tx=0x7f29900046c0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f29a447b740 1 -- 172.21.15.92:0/2650879973 shutdown_connections 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f29a447b740 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a37e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f29a447b740 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a37b770 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f29a447b740 1 --2- 172.21.15.92:0/2650879973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a370ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f29a447b740 1 -- 172.21.15.92:0/2650879973 >> 172.21.15.92:0/2650879973 conn(0x561b6a36d060 msgr2=0x561b6a36d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f29a447b740 1 -- 172.21.15.92:0/2650879973 shutdown_connections 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.455+0000 7f29a447b740 1 -- 172.21.15.92:0/2650879973 wait complete. 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f29a447b740 1 -- start start 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f29a447b740 1 Processor -- start 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f29a447b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a370af0 0x561b6a378b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f29a447b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a371410 0x561b6a379060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f29a447b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a37bcb0 0x561b6a3795a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f299affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a370af0 0x561b6a378b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f299affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a370af0 0x561b6a378b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39650/0 (socket says 172.21.15.92:39650) 2024-09-10T10:38:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f299affd640 1 -- 172.21.15.92:0/3790193008 learned_addr learned my addr 172.21.15.92:0/3790193008 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561b6a37e880 con 0x561b6a370af0 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561b6a25e290 con 0x561b6a371410 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561b6a37ea00 con 0x561b6a37bcb0 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f299a7fc640 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a371410 0x561b6a379060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.456+0000 7f299b7fe640 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a37bcb0 0x561b6a3795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f29a447b740 10 client.0 _ll_register_callbacks cb 0x561b6a28f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f299affd640 1 -- 172.21.15.92:0/3790193008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a37bcb0 msgr2=0x561b6a3795a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f299affd640 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a37bcb0 0x561b6a3795a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f299affd640 1 -- 172.21.15.92:0/3790193008 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a371410 msgr2=0x561b6a379060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f299affd640 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a371410 0x561b6a379060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f299affd640 1 -- 172.21.15.92:0/3790193008 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b69fe8210 con 0x561b6a370af0 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f299affd640 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a370af0 0x561b6a378b20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f298c006010 tx=0x7f298c0049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d46222139d1107 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f297eff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f297eff5640 1 -- 172.21.15.92:0/3790193008 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c040070 con 0x561b6a370af0 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f297eff5640 1 -- 172.21.15.92:0/3790193008 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f298c005230 con 0x561b6a370af0 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f298c005500 con 0x561b6a370af0 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f297eff5640 1 -- 172.21.15.92:0/3790193008 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f298c056050 con 0x561b6a370af0 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f29a447b740 10 client.15483 fetch_fsmap learned FSMap version 35 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561b6a0b4620 con 0x561b6a370af0 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.457+0000 7f297eff5640 1 -- 172.21.15.92:0/3790193008 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f298c005500 con 0x561b6a370af0 2024-09-10T10:38:39.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.458+0000 7f297eff5640 1 -- 172.21.15.92:0/3790193008 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7f298c031540 con 0x561b6a370af0 2024-09-10T10:38:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.458+0000 7f29a447b740 10 client.15483 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:38:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.458+0000 7f29a447b740 10 client.15483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:38:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.458+0000 7f29a447b740 20 client.15483 populate_metadata read hostname 'smithi092' 2024-09-10T10:38:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.458+0000 7f29a447b740 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561b6a38ba80 0x561b6a38de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.458+0000 7f29a447b740 4 client.15483 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:38:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.458+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b6a2e2a20 con 0x561b6a38ba80 2024-09-10T10:38:39.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.459+0000 7f299a7fc640 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561b6a38ba80 0x561b6a38de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.460+0000 7f299a7fc640 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561b6a38ba80 0x561b6a38de70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4adeadb3976fc79 server_cookie=38ae40000d1f3d70 in_seq=0 out_seq=0 2024-09-10T10:38:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.460+0000 7f297eff5640 10 client.15483 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f297eff5640 1 -- 172.21.15.92:0/3790193008 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b6a2e2a20 con 0x561b6a38ba80 2024-09-10T10:38:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f297eff5640 10 client.15483 handle_command_reply: tid=0 2024-09-10T10:38:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 client.15483 shutdown 2024-09-10T10:38:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a370af0 msgr2=0x561b6a378b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a370af0 0x561b6a378b20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f298c006010 tx=0x7f298c0049c0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 shutdown_connections 2024-09-10T10:38:39.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a37bcb0 0x561b6a3795a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561b6a38ba80 0x561b6a38de70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f297eff5640 0 client.15483 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a371410 0x561b6a379060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 --2- 172.21.15.92:0/3790193008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a370af0 0x561b6a378b20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 >> 172.21.15.92:0/3790193008 conn(0x561b6a36d060 msgr2=0x561b6a372d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 shutdown_connections 2024-09-10T10:38:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 1 -- 172.21.15.92:0/3790193008 wait complete. 2024-09-10T10:38:39.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.461+0000 7f29a447b740 20 client.15483 trim_cache size 0 max 16384 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.480+0000 7f29a447b740 1 Processor -- start 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f29a447b740 1 -- start start 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f29a447b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a3793d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f29a447b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a393630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f29a447b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a393b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f29a447b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f298800e5d0 con 0x561b6a371410 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f29a447b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2988010230 con 0x561b6a37bcb0 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f29a447b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f298800ed00 con 0x561b6a370af0 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a393630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a3793d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a393630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39654/0 (socket says 172.21.15.92:39654) 2024-09-10T10:38:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299a7fc640 1 -- 172.21.15.92:0/3558643089 learned_addr learned my addr 172.21.15.92:0/3558643089 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299b7fe640 1 --2- 172.21.15.92:0/3558643089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a393b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299a7fc640 1 -- 172.21.15.92:0/3558643089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 msgr2=0x561b6a3793d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299a7fc640 1 --2- 172.21.15.92:0/3558643089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a3793d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299a7fc640 1 -- 172.21.15.92:0/3558643089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 msgr2=0x561b6a393b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299a7fc640 1 --2- 172.21.15.92:0/3558643089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a393b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299a7fc640 1 -- 172.21.15.92:0/3558643089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b6a36ce90 con 0x561b6a371410 2024-09-10T10:38:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.481+0000 7f299affd640 1 --2- 172.21.15.92:0/3558643089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a3793d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.482+0000 7f299a7fc640 1 --2- 172.21.15.92:0/3558643089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a393630 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f299c10bcd0 tx=0x7f2990012070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cae89f59b0d222f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.482+0000 7f2980ff9640 1 -- 172.21.15.92:0/3558643089 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29900043a0 con 0x561b6a371410 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.482+0000 7f2980ff9640 1 -- 172.21.15.92:0/3558643089 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2990022910 con 0x561b6a371410 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.482+0000 7f2980ff9640 1 -- 172.21.15.92:0/3558643089 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990010690 con 0x561b6a371410 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.484+0000 7f29a447b740 1 -- 172.21.15.92:0/3558643089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 msgr2=0x561b6a393630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.484+0000 7f29a447b740 1 --2- 172.21.15.92:0/3558643089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a393630 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f299c10bcd0 tx=0x7f2990012070 comp rx=0 tx=0).stop 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.484+0000 7f29a447b740 1 -- 172.21.15.92:0/3558643089 shutdown_connections 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.484+0000 7f29a447b740 1 --2- 172.21.15.92:0/3558643089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a393b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.484+0000 7f29a447b740 1 --2- 172.21.15.92:0/3558643089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a393630 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.484+0000 7f29a447b740 1 --2- 172.21.15.92:0/3558643089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a3793d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.484+0000 7f29a447b740 1 -- 172.21.15.92:0/3558643089 >> 172.21.15.92:0/3558643089 conn(0x561b6a36d060 msgr2=0x561b6a37aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.484+0000 7f29a447b740 1 -- 172.21.15.92:0/3558643089 shutdown_connections 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 1 -- 172.21.15.92:0/3558643089 wait complete. 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 1 -- start start 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 1 Processor -- start 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a384360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a375770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a375cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f298800fb60 con 0x561b6a371410 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f298800f3d0 con 0x561b6a37bcb0 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f298800c5b0 con 0x561b6a370af0 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f29a447b740 10 client.0 _ll_register_callbacks cb 0x7f29900099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f299a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a375770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f299a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a375770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39666/0 (socket says 172.21.15.92:39666) 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f299a7fc640 1 -- 172.21.15.92:0/148673288 learned_addr learned my addr 172.21.15.92:0/148673288 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f299b7fe640 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a375cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.485+0000 7f299affd640 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a384360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f299a7fc640 1 -- 172.21.15.92:0/148673288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 msgr2=0x561b6a384360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f299a7fc640 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a384360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f299a7fc640 1 -- 172.21.15.92:0/148673288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 msgr2=0x561b6a375cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f299a7fc640 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a375cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f299a7fc640 1 -- 172.21.15.92:0/148673288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b6a3763a0 con 0x561b6a371410 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f299b7fe640 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a375cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f299affd640 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a384360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f299a7fc640 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a375770 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f299001b040 tx=0x7f2990003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e668f674507cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f297eff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f297eff5640 1 -- 172.21.15.92:0/148673288 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29900044a0 con 0x561b6a371410 2024-09-10T10:38:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f297eff5640 1 -- 172.21.15.92:0/148673288 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f2990022430 con 0x561b6a371410 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f29a447b740 1 -- 172.21.15.92:0/148673288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2990022910 con 0x561b6a371410 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f297eff5640 1 -- 172.21.15.92:0/148673288 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2990022630 con 0x561b6a371410 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f29a447b740 10 client.15489 fetch_fsmap learned FSMap version 35 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f29a447b740 1 -- 172.21.15.92:0/148673288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561b6a3f64f0 con 0x561b6a371410 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f297eff5640 1 -- 172.21.15.92:0/148673288 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2990022910 con 0x561b6a371410 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f297eff5640 1 -- 172.21.15.92:0/148673288 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7f29900047c0 con 0x561b6a371410 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f29a447b740 10 client.15489 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f29a447b740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f29a447b740 20 client.15489 populate_metadata read hostname 'smithi092' 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f29a447b740 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561b6a38ba80 0x561b6a3f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f29a447b740 4 client.15489 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.486+0000 7f29a447b740 1 -- 172.21.15.92:0/148673288 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b6a2dcd70 con 0x561b6a38ba80 2024-09-10T10:38:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.487+0000 7f299affd640 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561b6a38ba80 0x561b6a3f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.488+0000 7f299affd640 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561b6a38ba80 0x561b6a3f8c90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5dd197b95f64786 server_cookie=ea3ff27c6f958fe8 in_seq=0 out_seq=0 2024-09-10T10:38:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.488+0000 7f297eff5640 10 client.15489 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f297eff5640 1 -- 172.21.15.92:0/148673288 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b6a2dcd70 con 0x561b6a38ba80 2024-09-10T10:38:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f297eff5640 10 client.15489 handle_command_reply: tid=0 2024-09-10T10:38:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 client.15489 shutdown 2024-09-10T10:38:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 -- 172.21.15.92:0/148673288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 msgr2=0x561b6a375770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a375770 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f299001b040 tx=0x7f2990003fd0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 -- 172.21.15.92:0/148673288 shutdown_connections 2024-09-10T10:38:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561b6a38ba80 0x561b6a3f8c90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561b6a37bcb0 0x561b6a375cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f297eff5640 0 client.15489 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561b6a371410 0x561b6a375770 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 --2- 172.21.15.92:0/148673288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6a370af0 0x561b6a384360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 -- 172.21.15.92:0/148673288 >> 172.21.15.92:0/148673288 conn(0x561b6a36d060 msgr2=0x561b6a37a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 -- 172.21.15.92:0/148673288 shutdown_connections 2024-09-10T10:38:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 1 -- 172.21.15.92:0/148673288 wait complete. 2024-09-10T10:38:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.500+0000 7f29a447b740 20 client.15489 trim_cache size 0 max 16384 2024-09-10T10:38:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:38:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:38:39.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:38:39.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:38:39.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.501+0000 7f29a16dd640 1 -- 172.21.15.92:0/3375849263 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f29840a2e20 msgr2=0x7f29840a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.501+0000 7f29a16dd640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f29840a2e20 0x7f29840a52e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x561b6a36e3e0 tx=0x7f29900046c0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.501+0000 7f29a16dd640 1 -- 172.21.15.92:0/3375849263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299c102840 msgr2=0x7f299c10aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.501+0000 7f29a16dd640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299c102840 0x7f299c10aa50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f299400cab0 tx=0x7f299400cf70 comp rx=0 tx=0).stop 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.502+0000 7f29a16dd640 1 -- 172.21.15.92:0/3375849263 shutdown_connections 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.502+0000 7f29a16dd640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299c102840 0x7f299c10aa50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.502+0000 7f29a16dd640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f29840a2e20 0x7f29840a52e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.502+0000 7f29a16dd640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f299c101b10 0x7f299c10a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.502+0000 7f29a16dd640 1 --2- 172.21.15.92:0/3375849263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f299c101190 0x7f299c10d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.502+0000 7f29a16dd640 1 -- 172.21.15.92:0/3375849263 >> 172.21.15.92:0/3375849263 conn(0x7f299c0770f0 msgr2=0x7f299c104620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.502+0000 7f29a16dd640 1 -- 172.21.15.92:0/3375849263 shutdown_connections 2024-09-10T10:38:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:39.502+0000 7f29a16dd640 1 -- 172.21.15.92:0/3375849263 wait complete. 2024-09-10T10:38:39.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:39 smithi092 ceph-mon[30834]: pgmap v64: 97 pgs: 97 active+clean; 1.7 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.3 MiB/s wr, 707 op/s 2024-09-10T10:38:40.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:39 smithi121 ceph-mon[35231]: pgmap v64: 97 pgs: 97 active+clean; 1.7 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.3 MiB/s wr, 707 op/s 2024-09-10T10:38:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:39 smithi097 ceph-mon[35213]: pgmap v64: 97 pgs: 97 active+clean; 1.7 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.3 MiB/s wr, 707 op/s 2024-09-10T10:38:41.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:41 smithi092 ceph-mon[30834]: pgmap v65: 97 pgs: 97 active+clean; 1.7 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-09-10T10:38:42.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:41 smithi121 ceph-mon[35231]: pgmap v65: 97 pgs: 97 active+clean; 1.7 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-09-10T10:38:42.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:41 smithi097 ceph-mon[35213]: pgmap v65: 97 pgs: 97 active+clean; 1.7 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-09-10T10:38:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 105.0 s, 3567.8 tps, lat 28.078 ms stddev 28.114 2024-09-10T10:38:43.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:43 smithi092 ceph-mon[30834]: pgmap v66: 97 pgs: 97 active+clean; 1.7 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 657 op/s 2024-09-10T10:38:43.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:38:44.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:43 smithi121 ceph-mon[35231]: pgmap v66: 97 pgs: 97 active+clean; 1.7 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 657 op/s 2024-09-10T10:38:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:38:44.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:43 smithi097 ceph-mon[35213]: pgmap v66: 97 pgs: 97 active+clean; 1.7 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 657 op/s 2024-09-10T10:38:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:38:44.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:44 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:44.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:44 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:44.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:44 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:44.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:44 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:44.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:44 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:44.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:44 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:44.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:44 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:38:44.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:44 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:38:44.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:44 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:44 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:44 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:44 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:44 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:44 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:44 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:44 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:38:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:44 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:38:45.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:44 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:44 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:44 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:44 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:44 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:44 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:44 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:44 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:38:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:44 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:38:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:44 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:38:46.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:46 smithi121 ceph-mon[35231]: pgmap v67: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 975 op/s 2024-09-10T10:38:46.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:46 smithi097 ceph-mon[35213]: pgmap v67: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 975 op/s 2024-09-10T10:38:46.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:46 smithi092 ceph-mon[30834]: pgmap v67: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 975 op/s 2024-09-10T10:38:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 110.0 s, 3571.0 tps, lat 27.998 ms stddev 30.532 2024-09-10T10:38:48.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:48 smithi121 ceph-mon[35231]: pgmap v68: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 640 op/s 2024-09-10T10:38:48.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:48 smithi097 ceph-mon[35213]: pgmap v68: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 640 op/s 2024-09-10T10:38:48.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:48 smithi092 ceph-mon[30834]: pgmap v68: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 640 op/s 2024-09-10T10:38:50.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:50 smithi121 ceph-mon[35231]: pgmap v69: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 640 op/s 2024-09-10T10:38:50.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:50 smithi097 ceph-mon[35213]: pgmap v69: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 640 op/s 2024-09-10T10:38:50.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:50 smithi092 ceph-mon[30834]: pgmap v69: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.1 MiB/s wr, 640 op/s 2024-09-10T10:38:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:52 smithi121 ceph-mon[35231]: pgmap v70: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 964 op/s 2024-09-10T10:38:52.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:52 smithi097 ceph-mon[35213]: pgmap v70: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 964 op/s 2024-09-10T10:38:52.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:52 smithi092 ceph-mon[30834]: pgmap v70: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 964 op/s 2024-09-10T10:38:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.621+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3058914438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01069c0 msgr2=0x7fcbf0106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.621+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3058914438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01069c0 0x7fcbf0106da0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009930 tx=0x7fcbec02a420 comp rx=0 tx=0).stop 2024-09-10T10:38:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.622+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3058914438 shutdown_connections 2024-09-10T10:38:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.622+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3058914438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0101350 0x7fcbf010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.622+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3058914438 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbf01009b0 0x7fcbf0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.622+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3058914438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01069c0 0x7fcbf0106da0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.622+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3058914438 >> 172.21.15.92:0/3058914438 conn(0x7fcbf0077990 msgr2=0x7fcbf00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.622+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3058914438 shutdown_connections 2024-09-10T10:38:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.622+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3058914438 wait complete. 2024-09-10T10:38:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf7c74640 1 Processor -- start 2024-09-10T10:38:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf7c74640 1 -- start start 2024-09-10T10:38:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf7c74640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01009b0 0x7fcbf0195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf7c74640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbf0101350 0x7fcbf01964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf7c74640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf01069c0 0x7fcbf019a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf7c74640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf010fd40 con 0x7fcbf01009b0 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf7c74640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf010fbc0 con 0x7fcbf0101350 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf7c74640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf010fec0 con 0x7fcbf01069c0 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf5a10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01009b0 0x7fcbf0195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf5a10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01009b0 0x7fcbf0195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44170/0 (socket says 172.21.15.92:44170) 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf5a10640 1 -- 172.21.15.92:0/3155958521 learned_addr learned my addr 172.21.15.92:0/3155958521 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf6211640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf01069c0 0x7fcbf019a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.623+0000 7fcbf520f640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbf0101350 0x7fcbf01964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf5a10640 1 -- 172.21.15.92:0/3155958521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf01069c0 msgr2=0x7fcbf019a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf01069c0 0x7fcbf019a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf5a10640 1 -- 172.21.15.92:0/3155958521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbf0101350 msgr2=0x7fcbf01964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbf0101350 0x7fcbf01964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf5a10640 1 -- 172.21.15.92:0/3155958521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf019afa0 con 0x7fcbf01009b0 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf6211640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf01069c0 0x7fcbf019a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf520f640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbf0101350 0x7fcbf01964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01009b0 0x7fcbf0195fb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0305d0 tx=0x7fcbec030600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbe6ffd640 1 -- 172.21.15.92:0/3155958521 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec03f030 con 0x7fcbf01009b0 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbe6ffd640 1 -- 172.21.15.92:0/3155958521 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbec03b460 con 0x7fcbf01009b0 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3155958521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf019b230 con 0x7fcbf01009b0 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbe6ffd640 1 -- 172.21.15.92:0/3155958521 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec035070 con 0x7fcbf01009b0 2024-09-10T10:38:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.624+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3155958521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf01a2b20 con 0x7fcbf01009b0 2024-09-10T10:38:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.627+0000 7fcbe6ffd640 1 -- 172.21.15.92:0/3155958521 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fcbec042030 con 0x7fcbf01009b0 2024-09-10T10:38:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbfaa17740 1 Processor -- start 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbe6ffd640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcbdc0a7220 0x7fcbdc0a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbfaa17740 1 -- start start 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae1f9f0 0x55f71ae1fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae32f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 0x55f71ae358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbe6ffd640 1 -- 172.21.15.92:0/3155958521 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fcbec0ef9b0 con 0x7fcbf01009b0 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f71ad842f0 con 0x55f71ae20310 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f71ad2c270 con 0x55f71ae334c0 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f71ad802b0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbf6211640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcbdc0a7220 0x7fcbdc0a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.628+0000 7fcbf520f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae32f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf5a10640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae1f9f0 0x55f71ae1fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf520f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae32f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44182/0 (socket says 172.21.15.92:44182) 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf520f640 1 -- 172.21.15.92:0/204031820 learned_addr learned my addr 172.21.15.92:0/204031820 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf5a10640 1 -- 172.21.15.92:0/204031820 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 msgr2=0x55f71ae358b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/204031820 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 0x55f71ae358b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf5a10640 1 -- 172.21.15.92:0/204031820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 msgr2=0x55f71ae32f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/204031820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae32f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf5a10640 1 -- 172.21.15.92:0/204031820 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71ad2b340 con 0x55f71ae1f9f0 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf6211640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcbdc0a7220 0x7fcbdc0a96e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8005fd0 tx=0x7fcbe8009500 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/204031820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae1f9f0 0x55f71ae1fdd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0ed170 tx=0x7fcbec03b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b5d1eb0af9fe04c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbdbfff640 1 -- 172.21.15.92:0/204031820 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec049040 con 0x55f71ae1f9f0 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbdbfff640 1 -- 172.21.15.92:0/204031820 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbec0bbff0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.629+0000 7fcbdbfff640 1 -- 172.21.15.92:0/204031820 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0bc250 con 0x55f71ae1f9f0 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.631+0000 7fcbfaa17740 1 -- 172.21.15.92:0/204031820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae1f9f0 msgr2=0x55f71ae1fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.631+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/204031820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae1f9f0 0x55f71ae1fdd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0ed170 tx=0x7fcbec03b8f0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.631+0000 7fcbfaa17740 1 -- 172.21.15.92:0/204031820 shutdown_connections 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.631+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/204031820 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 0x55f71ae358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.631+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/204031820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae32f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.631+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/204031820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae1f9f0 0x55f71ae1fdd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.631+0000 7fcbfaa17740 1 -- 172.21.15.92:0/204031820 >> 172.21.15.92:0/204031820 conn(0x55f71ae1c060 msgr2=0x55f71ae1c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.631+0000 7fcbfaa17740 1 -- 172.21.15.92:0/204031820 shutdown_connections 2024-09-10T10:38:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.631+0000 7fcbfaa17740 1 -- 172.21.15.92:0/204031820 wait complete. 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbfaa17740 1 -- start start 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbfaa17740 1 Processor -- start 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae1f9f0 0x55f71ae30460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae20310 0x55f71ae309a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 0x55f71ae30ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f71ae35ee0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55f71ad0d290 con 0x55f71ae334c0 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f71ae36060 con 0x55f71ae20310 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbfaa17740 10 client.0 _ll_register_callbacks cb 0x55f71ad3e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.632+0000 7fcbf5a10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae1f9f0 0x55f71ae30460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf520f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae20310 0x55f71ae309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf6211640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 0x55f71ae30ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf5a10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae1f9f0 0x55f71ae30460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44198/0 (socket says 172.21.15.92:44198) 2024-09-10T10:38:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf5a10640 1 -- 172.21.15.92:0/3388575394 learned_addr learned my addr 172.21.15.92:0/3388575394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf5a10640 1 -- 172.21.15.92:0/3388575394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae20310 msgr2=0x55f71ae309a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae20310 0x55f71ae309a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf5a10640 1 -- 172.21.15.92:0/3388575394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 msgr2=0x55f71ae30ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 0x55f71ae30ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf5a10640 1 -- 172.21.15.92:0/3388575394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f71aa97210 con 0x55f71ae1f9f0 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf520f640 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae20310 0x55f71ae309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf6211640 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 0x55f71ae30ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae1f9f0 0x55f71ae30460 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcbec030670 tx=0x7fcbec0ed6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb05a362724bbe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbd97fa640 1 -- 172.21.15.92:0/3388575394 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec049070 con 0x55f71ae1f9f0 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbd97fa640 1 -- 172.21.15.92:0/3388575394 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fcbec0c4920 con 0x55f71ae1f9f0 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbfaa17740 1 -- 172.21.15.92:0/3388575394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbec0bbff0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbd97fa640 1 -- 172.21.15.92:0/3388575394 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcbec0a3050 con 0x55f71ae1f9f0 2024-09-10T10:38:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbfaa17740 10 client.15501 fetch_fsmap learned FSMap version 35 2024-09-10T10:38:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbfaa17740 1 -- 172.21.15.92:0/3388575394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f71ab63620 con 0x55f71ae1f9f0 2024-09-10T10:38:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.633+0000 7fcbd97fa640 1 -- 172.21.15.92:0/3388575394 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbec0bbff0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbd97fa640 1 -- 172.21.15.92:0/3388575394 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7fcbec0da070 con 0x55f71ae1f9f0 2024-09-10T10:38:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbfaa17740 10 client.15501 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:38:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbfaa17740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:38:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbfaa17740 20 client.15501 populate_metadata read hostname 'smithi092' 2024-09-10T10:38:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f71ae43090 0x55f71ae45480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbfaa17740 4 client.15501 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbfaa17740 1 -- 172.21.15.92:0/3388575394 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f71ad91a20 con 0x55f71ae43090 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbf520f640 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f71ae43090 0x55f71ae45480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbd97fa640 10 client.15501 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.634+0000 7fcbf520f640 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f71ae43090 0x55f71ae45480 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7be1bd485321285 server_cookie=1a83092937913f58 in_seq=0 out_seq=0 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbd97fa640 1 -- 172.21.15.92:0/3388575394 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f71ad91a20 con 0x55f71ae43090 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbd97fa640 10 client.15501 handle_command_reply: tid=0 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 client.15501 shutdown 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 -- 172.21.15.92:0/3388575394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae1f9f0 msgr2=0x55f71ae30460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae1f9f0 0x55f71ae30460 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcbec030670 tx=0x7fcbec0ed6a0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 -- 172.21.15.92:0/3388575394 shutdown_connections 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f71ae43090 0x55f71ae45480 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae334c0 0x55f71ae30ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae20310 0x55f71ae309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/3388575394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae1f9f0 0x55f71ae30460 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbd97fa640 0 client.15501 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 -- 172.21.15.92:0/3388575394 >> 172.21.15.92:0/3388575394 conn(0x55f71ae1c060 msgr2=0x55f71ae21dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 -- 172.21.15.92:0/3388575394 shutdown_connections 2024-09-10T10:38:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 1 -- 172.21.15.92:0/3388575394 wait complete. 2024-09-10T10:38:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.635+0000 7fcbfaa17740 20 client.15501 trim_cache size 0 max 16384 2024-09-10T10:38:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.655+0000 7fcbfaa17740 1 Processor -- start 2024-09-10T10:38:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.655+0000 7fcbfaa17740 1 -- start start 2024-09-10T10:38:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae4aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae4b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 0x55f71ae2d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01ab3c0 con 0x55f71ae20310 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01ad020 con 0x55f71ae1f9f0 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01abaf0 con 0x55f71ae334c0 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf520f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae4b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf520f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae4b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44204/0 (socket says 172.21.15.92:44204) 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf5a10640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae4aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf520f640 1 -- 172.21.15.92:0/1834640418 learned_addr learned my addr 172.21.15.92:0/1834640418 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf6211640 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 0x55f71ae2d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf5a10640 1 -- 172.21.15.92:0/1834640418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 msgr2=0x55f71ae2d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 0x55f71ae2d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf5a10640 1 -- 172.21.15.92:0/1834640418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 msgr2=0x55f71ae4b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae4b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf5a10640 1 -- 172.21.15.92:0/1834640418 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71ae2f3f0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf6211640 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 0x55f71ae2d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf520f640 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae4b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:38:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.656+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae4aba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0bbcf0 tx=0x7fcbec03b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd8bb371473f32c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbdb7fe640 1 -- 172.21.15.92:0/1834640418 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec049070 con 0x55f71ae1f9f0 2024-09-10T10:38:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbdb7fe640 1 -- 172.21.15.92:0/1834640418 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbec0bbff0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbdb7fe640 1 -- 172.21.15.92:0/1834640418 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0c4720 con 0x55f71ae1f9f0 2024-09-10T10:38:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbfaa17740 1 -- 172.21.15.92:0/1834640418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 msgr2=0x55f71ae4aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae4aba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0bbcf0 tx=0x7fcbec03b8f0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbfaa17740 1 -- 172.21.15.92:0/1834640418 shutdown_connections 2024-09-10T10:38:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 0x55f71ae2d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae4b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/1834640418 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae4aba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.657+0000 7fcbfaa17740 1 -- 172.21.15.92:0/1834640418 >> 172.21.15.92:0/1834640418 conn(0x55f71ae1c060 msgr2=0x55f71ae30c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:52.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.659+0000 7fcbfaa17740 1 -- 172.21.15.92:0/1834640418 shutdown_connections 2024-09-10T10:38:52.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.659+0000 7fcbfaa17740 1 -- 172.21.15.92:0/1834640418 wait complete. 2024-09-10T10:38:52.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.659+0000 7fcbfaa17740 1 -- start start 2024-09-10T10:38:52.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.660+0000 7fcbfaa17740 1 Processor -- start 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.660+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae3b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.660+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae369d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.660+0000 7fcbfaa17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 0x55f71ae36f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.660+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01ac950 con 0x55f71ae20310 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.660+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01ac1c0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.660+0000 7fcbfaa17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01a93a0 con 0x55f71ae334c0 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.660+0000 7fcbfaa17740 10 client.0 _ll_register_callbacks cb 0x7fcbe0009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf5a10640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae3b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf5a10640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae3b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:43110/0 (socket says 172.21.15.92:43110) 2024-09-10T10:38:52.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf5a10640 1 -- 172.21.15.92:0/2312910559 learned_addr learned my addr 172.21.15.92:0/2312910559 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf520f640 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae369d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf6211640 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 0x55f71ae36f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf5a10640 1 -- 172.21.15.92:0/2312910559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 msgr2=0x55f71ae36f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 0x55f71ae36f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf5a10640 1 -- 172.21.15.92:0/2312910559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 msgr2=0x55f71ae369d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae369d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf5a10640 1 -- 172.21.15.92:0/2312910559 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f71ae37500 con 0x55f71ae1f9f0 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbf5a10640 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae3b6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0c4680 tx=0x7fcbec0ed220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c67acc7eb6273425 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbd97fa640 1 -- 172.21.15.92:0/2312910559 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec049070 con 0x55f71ae1f9f0 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbd97fa640 1 -- 172.21.15.92:0/2312910559 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fcbec0c4930 con 0x55f71ae1f9f0 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbfaa17740 1 -- 172.21.15.92:0/2312910559 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbec0bbff0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbd97fa640 1 -- 172.21.15.92:0/2312910559 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcbec0c02f0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbfaa17740 10 client.25025 fetch_fsmap learned FSMap version 35 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.661+0000 7fcbfaa17740 1 -- 172.21.15.92:0/2312910559 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f71ae37500 con 0x55f71ae1f9f0 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbd97fa640 1 -- 172.21.15.92:0/2312910559 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbec0bbff0 con 0x55f71ae1f9f0 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbd97fa640 1 -- 172.21.15.92:0/2312910559 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7fcbec0da070 con 0x55f71ae1f9f0 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbfaa17740 10 client.25025 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbfaa17740 10 client.25025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbfaa17740 20 client.25025 populate_metadata read hostname 'smithi092' 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f71aeadd50 0x55f71aeb0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbfaa17740 4 client.25025 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbfaa17740 1 -- 172.21.15.92:0/2312910559 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f71ad8bd70 con 0x55f71aeadd50 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbf520f640 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f71aeadd50 0x55f71aeb0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbd97fa640 10 client.25025 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:52.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.662+0000 7fcbf520f640 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f71aeadd50 0x55f71aeb0170 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4ed433a56168ba server_cookie=e4494e96806b774e in_seq=0 out_seq=0 2024-09-10T10:38:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbd97fa640 1 -- 172.21.15.92:0/2312910559 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f71ad8bd70 con 0x55f71aeadd50 2024-09-10T10:38:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbd97fa640 10 client.25025 handle_command_reply: tid=0 2024-09-10T10:38:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 client.25025 shutdown 2024-09-10T10:38:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 -- 172.21.15.92:0/2312910559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 msgr2=0x55f71ae3b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae3b6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0c4680 tx=0x7fcbec0ed220 comp rx=0 tx=0).stop 2024-09-10T10:38:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 -- 172.21.15.92:0/2312910559 shutdown_connections 2024-09-10T10:38:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f71ae334c0 0x55f71ae36f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f71ae20310 0x55f71ae369d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55f71aeadd50 0x55f71aeb0170 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 --2- 172.21.15.92:0/2312910559 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55f71ae1f9f0 0x55f71ae3b6b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 -- 172.21.15.92:0/2312910559 >> 172.21.15.92:0/2312910559 conn(0x55f71ae1c060 msgr2=0x55f71ae215a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbd97fa640 0 client.25025 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:38:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 -- 172.21.15.92:0/2312910559 shutdown_connections 2024-09-10T10:38:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.673+0000 7fcbfaa17740 1 -- 172.21.15.92:0/2312910559 wait complete. 2024-09-10T10:38:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.674+0000 7fcbfaa17740 20 client.25025 trim_cache size 0 max 16384 2024-09-10T10:38:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:38:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:38:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:38:52.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:38:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcbdc0a7220 msgr2=0x7fcbdc0a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcbdc0a7220 0x7fcbdc0a96e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8005fd0 tx=0x7fcbe8009500 comp rx=0 tx=0).stop 2024-09-10T10:38:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01009b0 msgr2=0x7fcbf0195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:38:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01009b0 0x7fcbf0195fb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0305d0 tx=0x7fcbec030600 comp rx=0 tx=0).stop 2024-09-10T10:38:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3155958521 shutdown_connections 2024-09-10T10:38:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf01069c0 0x7fcbf019a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcbdc0a7220 0x7fcbdc0a96e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcbf0101350 0x7fcbf01964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 --2- 172.21.15.92:0/3155958521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbf01009b0 0x7fcbf0195fb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:38:52.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3155958521 >> 172.21.15.92:0/3155958521 conn(0x7fcbf0077990 msgr2=0x7fcbf00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:38:52.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3155958521 shutdown_connections 2024-09-10T10:38:52.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:38:52.676+0000 7fcbf7c74640 1 -- 172.21.15.92:0/3155958521 wait complete. 2024-09-10T10:38:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 115.0 s, 3460.0 tps, lat 28.908 ms stddev 30.180 2024-09-10T10:38:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:54 smithi097 ceph-mon[35213]: pgmap v71: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.6 MiB/s wr, 642 op/s 2024-09-10T10:38:54.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:54 smithi092 ceph-mon[30834]: pgmap v71: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.6 MiB/s wr, 642 op/s 2024-09-10T10:38:54.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:54 smithi121 ceph-mon[35231]: pgmap v71: 97 pgs: 97 active+clean; 1.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.6 MiB/s wr, 642 op/s 2024-09-10T10:38:56.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:56 smithi097 ceph-mon[35213]: pgmap v72: 97 pgs: 97 active+clean; 1.8 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 940 op/s 2024-09-10T10:38:56.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:56 smithi092 ceph-mon[30834]: pgmap v72: 97 pgs: 97 active+clean; 1.8 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 940 op/s 2024-09-10T10:38:56.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:56 smithi121 ceph-mon[35231]: pgmap v72: 97 pgs: 97 active+clean; 1.8 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 11 MiB/s wr, 940 op/s 2024-09-10T10:38:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 120.0 s, 3466.6 tps, lat 28.794 ms stddev 28.485 2024-09-10T10:38:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:38:58 smithi097 ceph-mon[35213]: pgmap v73: 97 pgs: 97 active+clean; 1.8 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.3 MiB/s wr, 647 op/s 2024-09-10T10:38:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:38:58 smithi092 ceph-mon[30834]: pgmap v73: 97 pgs: 97 active+clean; 1.8 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.3 MiB/s wr, 647 op/s 2024-09-10T10:38:58.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:38:58 smithi121 ceph-mon[35231]: pgmap v73: 97 pgs: 97 active+clean; 1.8 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.3 MiB/s wr, 647 op/s 2024-09-10T10:39:00.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:00 smithi097 ceph-mon[35213]: pgmap v74: 97 pgs: 97 active+clean; 1.8 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.3 MiB/s wr, 647 op/s 2024-09-10T10:39:00.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:00 smithi092 ceph-mon[30834]: pgmap v74: 97 pgs: 97 active+clean; 1.8 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.3 MiB/s wr, 647 op/s 2024-09-10T10:39:00.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:00 smithi121 ceph-mon[35231]: pgmap v74: 97 pgs: 97 active+clean; 1.8 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.3 MiB/s wr, 647 op/s 2024-09-10T10:39:02.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:02 smithi097 ceph-mon[35213]: pgmap v75: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 13 MiB/s wr, 961 op/s 2024-09-10T10:39:02.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:02 smithi092 ceph-mon[30834]: pgmap v75: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 13 MiB/s wr, 961 op/s 2024-09-10T10:39:02.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:02 smithi121 ceph-mon[35231]: pgmap v75: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 13 MiB/s wr, 961 op/s 2024-09-10T10:39:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 125.0 s, 2121.2 tps, lat 46.965 ms stddev 122.988 2024-09-10T10:39:04.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:04 smithi097 ceph-mon[35213]: pgmap v76: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.2 MiB/s wr, 637 op/s 2024-09-10T10:39:04.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:04 smithi092 ceph-mon[30834]: pgmap v76: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.2 MiB/s wr, 637 op/s 2024-09-10T10:39:04.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:04 smithi121 ceph-mon[35231]: pgmap v76: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.2 MiB/s wr, 637 op/s 2024-09-10T10:39:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.804+0000 7f0374f86640 1 -- 172.21.15.92:0/1428857755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03701080f0 msgr2=0x7f037010ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.804+0000 7f0374f86640 1 --2- 172.21.15.92:0/1428857755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03701080f0 0x7f037010ea40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0368009cd0 tx=0x7f036802a970 comp rx=0 tx=0).stop 2024-09-10T10:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.804+0000 7f0374f86640 1 -- 172.21.15.92:0/1428857755 shutdown_connections 2024-09-10T10:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.804+0000 7f0374f86640 1 --2- 172.21.15.92:0/1428857755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03701080f0 0x7f037010ea40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.804+0000 7f0374f86640 1 --2- 172.21.15.92:0/1428857755 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0370101150 0x7f0370107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.804+0000 7f0374f86640 1 --2- 172.21.15.92:0/1428857755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0370100830 0x7f0370100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.804+0000 7f0374f86640 1 -- 172.21.15.92:0/1428857755 >> 172.21.15.92:0/1428857755 conn(0x7f0370075f20 msgr2=0x7f0370076330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.804+0000 7f0374f86640 1 -- 172.21.15.92:0/1428857755 shutdown_connections 2024-09-10T10:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.804+0000 7f0374f86640 1 -- 172.21.15.92:0/1428857755 wait complete. 2024-09-10T10:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.805+0000 7f0374f86640 1 Processor -- start 2024-09-10T10:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.805+0000 7f0374f86640 1 -- start start 2024-09-10T10:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.805+0000 7f0374f86640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0370100830 0x7f0370198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f0374f86640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0370101150 0x7f0370198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f0374f86640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03701080f0 0x7f037019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f0374f86640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0370111f70 con 0x7f0370101150 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0370100830 0x7f0370198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0370100830 0x7f0370198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34512/0 (socket says 172.21.15.92:34512) 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036e59c640 1 -- 172.21.15.92:0/1726608895 learned_addr learned my addr 172.21.15.92:0/1726608895 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0370111df0 con 0x7f03701080f0 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f03701120f0 con 0x7f0370100830 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036dd9b640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0370101150 0x7f0370198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036ed9d640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03701080f0 0x7f037019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036e59c640 1 -- 172.21.15.92:0/1726608895 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03701080f0 msgr2=0x7f037019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036e59c640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03701080f0 0x7f037019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036e59c640 1 -- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0370101150 msgr2=0x7f0370198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036e59c640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0370101150 0x7f0370198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.806+0000 7f036e59c640 1 -- 172.21.15.92:0/1726608895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037019d310 con 0x7f0370100830 2024-09-10T10:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.807+0000 7f036e59c640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0370100830 0x7f0370198320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f036000e9f0 tx=0x7f036000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.807+0000 7f035f7fe640 1 -- 172.21.15.92:0/1726608895 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036000cd80 con 0x7f0370100830 2024-09-10T10:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.807+0000 7f035f7fe640 1 -- 172.21.15.92:0/1726608895 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0360005500 con 0x7f0370100830 2024-09-10T10:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.807+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037019d600 con 0x7f0370100830 2024-09-10T10:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.807+0000 7f035f7fe640 1 -- 172.21.15.92:0/1726608895 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360010690 con 0x7f0370100830 2024-09-10T10:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.807+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03701a4e90 con 0x7f0370100830 2024-09-10T10:39:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.809+0000 7f035f7fe640 1 -- 172.21.15.92:0/1726608895 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f03600046c0 con 0x7f0370100830 2024-09-10T10:39:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f0377dfa740 1 Processor -- start 2024-09-10T10:39:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f035f7fe640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f03580a2e20 0x7f03580a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f035f7fe640 1 -- 172.21.15.92:0/1726608895 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f03600cf760 con 0x7f0370100830 2024-09-10T10:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f0377dfa740 1 -- start start 2024-09-10T10:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae67365ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67366410 0x55ae67370770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 0x55ae673730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f0377dfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae672ca2f0 con 0x55ae67365af0 2024-09-10T10:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f0377dfa740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55ae67272270 con 0x55ae67370cb0 2024-09-10T10:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f0377dfa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ae672c62b0 con 0x55ae67366410 2024-09-10T10:39:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.810+0000 7f036ed9d640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f03580a2e20 0x7f03580a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.811+0000 7f036dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67366410 0x55ae67370770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.811+0000 7f036dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67366410 0x55ae67370770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34522/0 (socket says 172.21.15.92:34522) 2024-09-10T10:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.811+0000 7f036dd9b640 1 -- 172.21.15.92:0/4138326239 learned_addr learned my addr 172.21.15.92:0/4138326239 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.811+0000 7f036dd9b640 1 -- 172.21.15.92:0/4138326239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 msgr2=0x55ae673730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.811+0000 7f036dd9b640 1 --2- 172.21.15.92:0/4138326239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 0x55ae673730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.811+0000 7f036dd9b640 1 -- 172.21.15.92:0/4138326239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 msgr2=0x55ae67365ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.811+0000 7f036dd9b640 1 --2- 172.21.15.92:0/4138326239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae67365ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.811+0000 7f036dd9b640 1 -- 172.21.15.92:0/4138326239 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae67271340 con 0x55ae67366410 2024-09-10T10:39:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.811+0000 7f036ed9d640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f03580a2e20 0x7f03580a52e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0368004af0 tx=0x7f0368005d80 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.812+0000 7f036dd9b640 1 --2- 172.21.15.92:0/4138326239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67366410 0x55ae67370770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0364015c20 tx=0x7f0364009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65397b562cbc58ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.812+0000 7f035cff9640 1 -- 172.21.15.92:0/4138326239 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364004250 con 0x55ae67366410 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.812+0000 7f035cff9640 1 -- 172.21.15.92:0/4138326239 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f036400fe80 con 0x55ae67366410 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.812+0000 7f035cff9640 1 -- 172.21.15.92:0/4138326239 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364004a00 con 0x55ae67366410 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 -- 172.21.15.92:0/4138326239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67366410 msgr2=0x55ae67370770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 --2- 172.21.15.92:0/4138326239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67366410 0x55ae67370770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0364015c20 tx=0x7f0364009c20 comp rx=0 tx=0).stop 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 -- 172.21.15.92:0/4138326239 shutdown_connections 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 --2- 172.21.15.92:0/4138326239 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 0x55ae673730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 --2- 172.21.15.92:0/4138326239 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67366410 0x55ae67370770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 --2- 172.21.15.92:0/4138326239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae67365ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 -- 172.21.15.92:0/4138326239 >> 172.21.15.92:0/4138326239 conn(0x55ae67362060 msgr2=0x55ae67362440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 -- 172.21.15.92:0/4138326239 shutdown_connections 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 -- 172.21.15.92:0/4138326239 wait complete. 2024-09-10T10:39:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 -- start start 2024-09-10T10:39:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.813+0000 7f0377dfa740 1 Processor -- start 2024-09-10T10:39:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae6736dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae6736e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae6736e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f0377dfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ae67373880 con 0x55ae67365af0 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f0377dfa740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55ae67253290 con 0x55ae67366410 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f0377dfa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ae67373a00 con 0x55ae67370cb0 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f0377dfa740 10 client.0 _ll_register_callbacks cb 0x55ae67284140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae6736dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036ed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae6736e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae6736dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33350/0 (socket says 172.21.15.92:33350) 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036e59c640 1 -- 172.21.15.92:0/2151526798 learned_addr learned my addr 172.21.15.92:0/2151526798 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036dd9b640 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae6736e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036ed9d640 1 -- 172.21.15.92:0/2151526798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 msgr2=0x55ae6736e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036ed9d640 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae6736e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036ed9d640 1 -- 172.21.15.92:0/2151526798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 msgr2=0x55ae6736dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036ed9d640 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae6736dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036ed9d640 1 -- 172.21.15.92:0/2151526798 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae66fdd210 con 0x55ae67370cb0 2024-09-10T10:39:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036dd9b640 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae6736e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036e59c640 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae6736dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f036ed9d640 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae6736e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f036802ae90 tx=0x7f03680095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5030d885acec3ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.814+0000 7f0355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:39:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.815+0000 7f0355ffb640 1 -- 172.21.15.92:0/2151526798 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368034050 con 0x55ae67370cb0 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.815+0000 7f0377dfa740 1 -- 172.21.15.92:0/2151526798 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ae672d7a20 con 0x55ae67370cb0 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.815+0000 7f0355ffb640 1 -- 172.21.15.92:0/2151526798 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f0368004240 con 0x55ae67370cb0 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.815+0000 7f0355ffb640 1 -- 172.21.15.92:0/2151526798 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0368004440 con 0x55ae67370cb0 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.815+0000 7f0377dfa740 10 client.25078 fetch_fsmap learned FSMap version 35 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.815+0000 7f0377dfa740 1 -- 172.21.15.92:0/2151526798 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ae670a9620 con 0x55ae67370cb0 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f0355ffb640 1 -- 172.21.15.92:0/2151526798 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ae672d7a20 con 0x55ae67370cb0 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f0355ffb640 1 -- 172.21.15.92:0/2151526798 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7f0368058020 con 0x55ae67370cb0 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f0377dfa740 10 client.25078 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f0377dfa740 10 client.25078 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:05.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f0377dfa740 20 client.25078 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55ae67380cf0 0x55ae67383110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f0377dfa740 4 client.25078 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f0377dfa740 1 -- 172.21.15.92:0/2151526798 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae672d1d70 con 0x55ae67380cf0 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f036e59c640 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55ae67380cf0 0x55ae67383110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.816+0000 7f0355ffb640 10 client.25078 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f036e59c640 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55ae67380cf0 0x55ae67383110 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb57f5be0a49e66 server_cookie=60f702436d909c12 in_seq=0 out_seq=0 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0355ffb640 1 -- 172.21.15.92:0/2151526798 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae672d1d70 con 0x55ae67380cf0 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0355ffb640 10 client.25078 handle_command_reply: tid=0 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0377dfa740 1 client.25078 shutdown 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0377dfa740 1 -- 172.21.15.92:0/2151526798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 msgr2=0x55ae6736e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae6736e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f036802ae90 tx=0x7f03680095c0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0377dfa740 1 -- 172.21.15.92:0/2151526798 shutdown_connections 2024-09-10T10:39:05.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae6736e770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55ae67380cf0 0x55ae67383110 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae6736e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0355ffb640 0 client.25078 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2151526798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae6736dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.817+0000 7f0377dfa740 1 -- 172.21.15.92:0/2151526798 >> 172.21.15.92:0/2151526798 conn(0x55ae67362060 msgr2=0x55ae67367dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.818+0000 7f0377dfa740 1 -- 172.21.15.92:0/2151526798 shutdown_connections 2024-09-10T10:39:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.818+0000 7f0377dfa740 1 -- 172.21.15.92:0/2151526798 wait complete. 2024-09-10T10:39:05.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.818+0000 7f0377dfa740 20 client.25078 trim_cache size 0 max 16384 2024-09-10T10:39:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f0377dfa740 1 Processor -- start 2024-09-10T10:39:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f0377dfa740 1 -- start start 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67365af0 0x55ae6736e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67366410 0x55ae67388a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 0x55ae67388f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f0377dfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03701ab410 con 0x55ae67366410 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f0377dfa740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f03701ad070 con 0x55ae67370cb0 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f0377dfa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f03701abb40 con 0x55ae67365af0 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67366410 0x55ae67388a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036dd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67366410 0x55ae67388a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33364/0 (socket says 172.21.15.92:33364) 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036ed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 0x55ae67388f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036dd9b640 1 -- 172.21.15.92:0/2319192884 learned_addr learned my addr 172.21.15.92:0/2319192884 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036e59c640 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67365af0 0x55ae6736e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036ed9d640 1 -- 172.21.15.92:0/2319192884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67365af0 msgr2=0x55ae6736e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036ed9d640 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67365af0 0x55ae6736e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036ed9d640 1 -- 172.21.15.92:0/2319192884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67366410 msgr2=0x55ae67388a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036ed9d640 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67366410 0x55ae67388a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036ed9d640 1 -- 172.21.15.92:0/2319192884 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae67362cf0 con 0x55ae67370cb0 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036dd9b640 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67366410 0x55ae67388a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.838+0000 7f036e59c640 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67365af0 0x55ae6736e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.839+0000 7f036ed9d640 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 0x55ae67388f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f036802af60 tx=0x7f036802a970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4b9690b1e5ccb57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.839+0000 7f0357fff640 1 -- 172.21.15.92:0/2319192884 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368034040 con 0x55ae67370cb0 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.839+0000 7f0357fff640 1 -- 172.21.15.92:0/2319192884 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03680047e0 con 0x55ae67370cb0 2024-09-10T10:39:05.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.839+0000 7f0357fff640 1 -- 172.21.15.92:0/2319192884 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368030890 con 0x55ae67370cb0 2024-09-10T10:39:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.839+0000 7f0377dfa740 1 -- 172.21.15.92:0/2319192884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 msgr2=0x55ae67388f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.839+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 0x55ae67388f60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f036802af60 tx=0x7f036802a970 comp rx=0 tx=0).stop 2024-09-10T10:39:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 -- 172.21.15.92:0/2319192884 shutdown_connections 2024-09-10T10:39:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67370cb0 0x55ae67388f60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67366410 0x55ae67388a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 --2- 172.21.15.92:0/2319192884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67365af0 0x55ae6736e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 -- 172.21.15.92:0/2319192884 >> 172.21.15.92:0/2319192884 conn(0x55ae67362060 msgr2=0x55ae6736cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 -- 172.21.15.92:0/2319192884 shutdown_connections 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 -- 172.21.15.92:0/2319192884 wait complete. 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 -- start start 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 Processor -- start 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae67373c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae67374190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae673746d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03701ac9a0 con 0x55ae67365af0 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f03701ac210 con 0x55ae67366410 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.840+0000 7f0377dfa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f03701a93f0 con 0x55ae67370cb0 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.841+0000 7f0377dfa740 10 client.0 _ll_register_callbacks cb 0x7f0360005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.841+0000 7f036ed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae673746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.841+0000 7f036ed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae673746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34562/0 (socket says 172.21.15.92:34562) 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.841+0000 7f036ed9d640 1 -- 172.21.15.92:0/3798412843 learned_addr learned my addr 172.21.15.92:0/3798412843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.841+0000 7f036e59c640 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae67373c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.841+0000 7f036dd9b640 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae67374190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f036dd9b640 1 -- 172.21.15.92:0/3798412843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 msgr2=0x55ae673746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f036dd9b640 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae673746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f036dd9b640 1 -- 172.21.15.92:0/3798412843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 msgr2=0x55ae67373c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f036dd9b640 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae67373c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f036dd9b640 1 -- 172.21.15.92:0/3798412843 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae6736eae0 con 0x55ae67366410 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f036ed9d640 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae673746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f036dd9b640 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae67374190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0364015b40 tx=0x7f0364005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d970955b76fc6e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f0355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f0355ffb640 1 -- 172.21.15.92:0/3798412843 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364003800 con 0x55ae67366410 2024-09-10T10:39:05.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f0355ffb640 1 -- 172.21.15.92:0/3798412843 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f03640039a0 con 0x55ae67366410 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.842+0000 7f0377dfa740 1 -- 172.21.15.92:0/3798412843 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03680047e0 con 0x55ae67366410 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0355ffb640 1 -- 172.21.15.92:0/3798412843 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0364003ba0 con 0x55ae67366410 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0377dfa740 10 client.25040 fetch_fsmap learned FSMap version 35 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0377dfa740 1 -- 172.21.15.92:0/3798412843 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ae673eab50 con 0x55ae67366410 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0355ffb640 1 -- 172.21.15.92:0/3798412843 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03680047e0 con 0x55ae67366410 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0355ffb640 1 -- 172.21.15.92:0/3798412843 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 35) ==== 8386+0+0 (secure 0 0 0) 0x7f0364033400 con 0x55ae67366410 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0377dfa740 10 client.25040 fetch_fsmap finished waiting for FSMap version 35 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0377dfa740 10 client.25040 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0377dfa740 20 client.25040 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0377dfa740 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55ae673eb190 0x55ae673ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0377dfa740 4 client.25040 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0377dfa740 1 -- 172.21.15.92:0/3798412843 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae6724e900 con 0x55ae673eb190 2024-09-10T10:39:05.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f036e59c640 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55ae673eb190 0x55ae673ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f0355ffb640 10 client.25040 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:05.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.843+0000 7f036e59c640 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55ae673eb190 0x55ae673ed5b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19a0f19cc4298a53 server_cookie=1fda84b287125712 in_seq=0 out_seq=0 2024-09-10T10:39:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.852+0000 7f0355ffb640 1 -- 172.21.15.92:0/3798412843 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae6724e900 con 0x55ae673eb190 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0355ffb640 10 client.25040 handle_command_reply: tid=0 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 client.25040 shutdown 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 -- 172.21.15.92:0/3798412843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 msgr2=0x55ae67374190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae67374190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0364015b40 tx=0x7f0364005770 comp rx=0 tx=0).stop 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 -- 172.21.15.92:0/3798412843 shutdown_connections 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ae67370cb0 0x55ae673746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55ae673eb190 0x55ae673ed5b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55ae67366410 0x55ae67374190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 --2- 172.21.15.92:0/3798412843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ae67365af0 0x55ae67373c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0355ffb640 0 client.25040 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 -- 172.21.15.92:0/3798412843 >> 172.21.15.92:0/3798412843 conn(0x55ae67362060 msgr2=0x55ae673609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:39:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:39:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:39:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:39:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 -- 172.21.15.92:0/3798412843 shutdown_connections 2024-09-10T10:39:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.853+0000 7f0377dfa740 1 -- 172.21.15.92:0/3798412843 wait complete. 2024-09-10T10:39:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.854+0000 7f0377dfa740 20 client.25040 trim_cache size 0 max 16384 2024-09-10T10:39:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.855+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f03580a2e20 msgr2=0x7f03580a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.855+0000 7f0374f86640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f03580a2e20 0x7f03580a52e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0368004af0 tx=0x7f0368005d80 comp rx=0 tx=0).stop 2024-09-10T10:39:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.855+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0370100830 msgr2=0x7f0370198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.855+0000 7f0374f86640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0370100830 0x7f0370198320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f036000e9f0 tx=0x7f036000edf0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.856+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 shutdown_connections 2024-09-10T10:39:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.856+0000 7f0374f86640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f03580a2e20 0x7f03580a52e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.856+0000 7f0374f86640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f03701080f0 0x7f037019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.856+0000 7f0374f86640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0370101150 0x7f0370198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.856+0000 7f0374f86640 1 --2- 172.21.15.92:0/1726608895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0370100830 0x7f0370198320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.856+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 >> 172.21.15.92:0/1726608895 conn(0x7f0370075f20 msgr2=0x7f03700ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.856+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 shutdown_connections 2024-09-10T10:39:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:05.856+0000 7f0374f86640 1 -- 172.21.15.92:0/1726608895 wait complete. 2024-09-10T10:39:06.569 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:06 smithi097 ceph-mon[35213]: pgmap v77: 97 pgs: 97 active+clean; 2.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 39 MiB/s wr, 1.46k op/s 2024-09-10T10:39:06.592 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:06 smithi121 ceph-mon[35231]: pgmap v77: 97 pgs: 97 active+clean; 2.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 39 MiB/s wr, 1.46k op/s 2024-09-10T10:39:06.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:06 smithi092 ceph-mon[30834]: pgmap v77: 97 pgs: 97 active+clean; 2.0 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 39 MiB/s wr, 1.46k op/s 2024-09-10T10:39:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 130.0 s, 3336.8 tps, lat 30.168 ms stddev 32.515 2024-09-10T10:39:08.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:08 smithi097 ceph-mon[35213]: pgmap v78: 97 pgs: 97 active+clean; 2.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 MiB/s wr, 1.25k op/s 2024-09-10T10:39:08.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:08 smithi092 ceph-mon[30834]: pgmap v78: 97 pgs: 97 active+clean; 2.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 MiB/s wr, 1.25k op/s 2024-09-10T10:39:08.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:08 smithi121 ceph-mon[35231]: pgmap v78: 97 pgs: 97 active+clean; 2.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 MiB/s wr, 1.25k op/s 2024-09-10T10:39:09.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:09 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:39:09.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:09 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:39:09.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:09 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:39:10.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:10 smithi092 ceph-mon[30834]: pgmap v79: 97 pgs: 97 active+clean; 2.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.23k op/s 2024-09-10T10:39:10.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:10 smithi121 ceph-mon[35231]: pgmap v79: 97 pgs: 97 active+clean; 2.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.23k op/s 2024-09-10T10:39:10.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:10 smithi097 ceph-mon[35213]: pgmap v79: 97 pgs: 97 active+clean; 2.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.23k op/s 2024-09-10T10:39:12.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:12 smithi092 ceph-mon[30834]: pgmap v80: 97 pgs: 97 active+clean; 2.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 43 MiB/s wr, 1.54k op/s 2024-09-10T10:39:12.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:12 smithi121 ceph-mon[35231]: pgmap v80: 97 pgs: 97 active+clean; 2.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 43 MiB/s wr, 1.54k op/s 2024-09-10T10:39:12.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:12 smithi097 ceph-mon[35213]: pgmap v80: 97 pgs: 97 active+clean; 2.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 43 MiB/s wr, 1.54k op/s 2024-09-10T10:39:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 135.0 s, 3597.8 tps, lat 27.758 ms stddev 28.718 2024-09-10T10:39:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:14 smithi092 ceph-mon[30834]: pgmap v81: 97 pgs: 97 active+clean; 2.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 39 MiB/s wr, 1.23k op/s 2024-09-10T10:39:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:14 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:39:14.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:14 smithi121 ceph-mon[35231]: pgmap v81: 97 pgs: 97 active+clean; 2.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 39 MiB/s wr, 1.23k op/s 2024-09-10T10:39:14.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:14 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:39:14.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:14 smithi097 ceph-mon[35213]: pgmap v81: 97 pgs: 97 active+clean; 2.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 39 MiB/s wr, 1.23k op/s 2024-09-10T10:39:14.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:14 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:39:16.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:16 smithi092 ceph-mon[30834]: pgmap v82: 97 pgs: 97 active+clean; 2.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 44 MiB/s wr, 1.52k op/s 2024-09-10T10:39:16.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:16 smithi121 ceph-mon[35231]: pgmap v82: 97 pgs: 97 active+clean; 2.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 44 MiB/s wr, 1.52k op/s 2024-09-10T10:39:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:16 smithi097 ceph-mon[35213]: pgmap v82: 97 pgs: 97 active+clean; 2.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 44 MiB/s wr, 1.52k op/s 2024-09-10T10:39:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 140.0 s, 3083.0 tps, lat 32.440 ms stddev 36.571 2024-09-10T10:39:18.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:18 smithi092 ceph-mon[30834]: pgmap v83: 97 pgs: 97 active+clean; 2.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 13 MiB/s wr, 728 op/s 2024-09-10T10:39:18.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:18 smithi121 ceph-mon[35231]: pgmap v83: 97 pgs: 97 active+clean; 2.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 13 MiB/s wr, 728 op/s 2024-09-10T10:39:18.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:18 smithi097 ceph-mon[35213]: pgmap v83: 97 pgs: 97 active+clean; 2.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 13 MiB/s wr, 728 op/s 2024-09-10T10:39:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.981+0000 7f553b74b640 1 -- 172.21.15.92:0/2245333662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5534108cf0 msgr2=0x7f553410cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:18.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.982+0000 7f553b74b640 1 --2- 172.21.15.92:0/2245333662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5534108cf0 0x7f553410cd30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5524009900 tx=0x7f552402a410 comp rx=0 tx=0).stop 2024-09-10T10:39:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.982+0000 7f553b74b640 1 -- 172.21.15.92:0/2245333662 shutdown_connections 2024-09-10T10:39:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.982+0000 7f553b74b640 1 --2- 172.21.15.92:0/2245333662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f553410d490 0x7f5534114fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.982+0000 7f553b74b640 1 --2- 172.21.15.92:0/2245333662 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5534108cf0 0x7f553410cd30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.982+0000 7f553b74b640 1 --2- 172.21.15.92:0/2245333662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5534108340 0x7f5534108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:18.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.982+0000 7f553b74b640 1 -- 172.21.15.92:0/2245333662 >> 172.21.15.92:0/2245333662 conn(0x7f5534077a40 msgr2=0x7f5534079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.984+0000 7f553b74b640 1 -- 172.21.15.92:0/2245333662 shutdown_connections 2024-09-10T10:39:18.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.984+0000 7f553b74b640 1 -- 172.21.15.92:0/2245333662 wait complete. 2024-09-10T10:39:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.986+0000 7f553b74b640 1 Processor -- start 2024-09-10T10:39:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.986+0000 7f553b74b640 1 -- start start 2024-09-10T10:39:18.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.986+0000 7f553b74b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5534108340 0x7f553419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.986+0000 7f553b74b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f553410d490 0x7f553419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.986+0000 7f553b74b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55341a3330 0x7f55341a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.986+0000 7f553b74b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5534118490 con 0x7f5534108340 2024-09-10T10:39:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.986+0000 7f553b74b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5534118310 con 0x7f553410d490 2024-09-10T10:39:18.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.986+0000 7f553b74b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5534118610 con 0x7f55341a3330 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f55394e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5534108340 0x7f553419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5539ce8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55341a3330 0x7f55341a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f55394e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5534108340 0x7f553419ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36612/0 (socket says 172.21.15.92:36612) 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5539ce8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55341a3330 0x7f55341a37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:48848/0 (socket says 172.21.15.92:48848) 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f55394e7640 1 -- 172.21.15.92:0/3338930372 learned_addr learned my addr 172.21.15.92:0/3338930372 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5538ce6640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f553410d490 0x7f553419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5539ce8640 1 -- 172.21.15.92:0/3338930372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f553410d490 msgr2=0x7f553419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5539ce8640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f553410d490 0x7f553419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5539ce8640 1 -- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5534108340 msgr2=0x7f553419ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5539ce8640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5534108340 0x7f553419ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:18.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5539ce8640 1 -- 172.21.15.92:0/3338930372 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55341a3e20 con 0x7f55341a3330 2024-09-10T10:39:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5538ce6640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f553410d490 0x7f553419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f55394e7640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5534108340 0x7f553419ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f5539ce8640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55341a3330 0x7f55341a37e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f552c009fd0 tx=0x7f552c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.987+0000 7f552a7fc640 1 -- 172.21.15.92:0/3338930372 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c00ce20 con 0x7f55341a3330 2024-09-10T10:39:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.988+0000 7f552a7fc640 1 -- 172.21.15.92:0/3338930372 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f552c005020 con 0x7f55341a3330 2024-09-10T10:39:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.988+0000 7f552a7fc640 1 -- 172.21.15.92:0/3338930372 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c010720 con 0x7f55341a3330 2024-09-10T10:39:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.988+0000 7f553b74b640 1 -- 172.21.15.92:0/3338930372 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55341a4110 con 0x7f55341a3330 2024-09-10T10:39:18.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.988+0000 7f553b74b640 1 -- 172.21.15.92:0/3338930372 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55341ab880 con 0x7f55341a3330 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.992+0000 7f552a7fc640 1 -- 172.21.15.92:0/3338930372 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f552c005540 con 0x7f55341a3330 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.992+0000 7f553e5c2740 1 Processor -- start 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f553e5c2740 1 -- start start 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821ad410 0x559a821b7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821b7cb0 0x559a821ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f553e5c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559a821112f0 con 0x559a821b7cb0 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f553e5c2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559a820b9270 con 0x559a821acaf0 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f553e5c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559a8210d2b0 con 0x559a821ad410 2024-09-10T10:39:18.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f5538ce6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f55394e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821ad410 0x559a821b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f5538ce6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:57992/0 (socket says 172.21.15.92:57992) 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f5538ce6640 1 -- 172.21.15.92:0/7187031 learned_addr learned my addr 172.21.15.92:0/7187031 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f552a7fc640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f55200a2e20 0x7f55200a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f5538ce6640 1 --2- 172.21.15.92:0/7187031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821b7cb0 0x559a821ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f5539ce8640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f55200a2e20 0x7f55200a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f552a7fc640 1 -- 172.21.15.92:0/3338930372 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f552c0cf9f0 con 0x7f55341a3330 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f55394e7640 1 -- 172.21.15.92:0/7187031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 msgr2=0x559a821aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f55394e7640 1 --2- 172.21.15.92:0/7187031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f55394e7640 1 -- 172.21.15.92:0/7187031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821b7cb0 msgr2=0x559a821ba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f55394e7640 1 --2- 172.21.15.92:0/7187031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821b7cb0 0x559a821ba0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:18.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f55394e7640 1 -- 172.21.15.92:0/7187031 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a820b8340 con 0x559a821ad410 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.993+0000 7f5538ce6640 1 --2- 172.21.15.92:0/7187031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.994+0000 7f55394e7640 1 --2- 172.21.15.92:0/7187031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821ad410 0x559a821b7770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55300058c0 tx=0x7f55300109e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=573443dcf3d714ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.994+0000 7f5539ce8640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f55200a2e20 0x7f55200a52e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f552c0cd7b0 tx=0x7f552c013b60 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.994+0000 7f551f7fe640 1 -- 172.21.15.92:0/7187031 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55300117c0 con 0x559a821ad410 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.994+0000 7f551f7fe640 1 -- 172.21.15.92:0/7187031 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5530011e40 con 0x559a821ad410 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.994+0000 7f551f7fe640 1 -- 172.21.15.92:0/7187031 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553000d340 con 0x559a821ad410 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.994+0000 7f553e5c2740 1 -- 172.21.15.92:0/7187031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821ad410 msgr2=0x559a821b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.994+0000 7f553e5c2740 1 --2- 172.21.15.92:0/7187031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821ad410 0x559a821b7770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f55300058c0 tx=0x7f55300109e0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.995+0000 7f553e5c2740 1 -- 172.21.15.92:0/7187031 shutdown_connections 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.995+0000 7f553e5c2740 1 --2- 172.21.15.92:0/7187031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821b7cb0 0x559a821ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.995+0000 7f553e5c2740 1 --2- 172.21.15.92:0/7187031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821ad410 0x559a821b7770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.995+0000 7f553e5c2740 1 --2- 172.21.15.92:0/7187031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.995+0000 7f553e5c2740 1 -- 172.21.15.92:0/7187031 >> 172.21.15.92:0/7187031 conn(0x559a821a9060 msgr2=0x559a821a9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.995+0000 7f553e5c2740 1 -- 172.21.15.92:0/7187031 shutdown_connections 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.995+0000 7f553e5c2740 1 -- 172.21.15.92:0/7187031 wait complete. 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.995+0000 7f553e5c2740 1 -- start start 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.995+0000 7f553e5c2740 1 Processor -- start 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821b5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821b7cb0 0x559a821b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f553e5c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559a821ba880 con 0x559a821ad410 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f553e5c2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559a8209a290 con 0x559a821acaf0 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f553e5c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559a821baa00 con 0x559a821b7cb0 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f553e5c2740 10 client.0 _ll_register_callbacks cb 0x559a820cb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:19.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f55394e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f55394e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36620/0 (socket says 172.21.15.92:36620) 2024-09-10T10:39:19.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f55394e7640 1 -- 172.21.15.92:0/255068177 learned_addr learned my addr 172.21.15.92:0/255068177 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:19.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f5538ce6640 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821b7cb0 0x559a821b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.996+0000 7f5538ce6640 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f5538ce6640 1 -- 172.21.15.92:0/255068177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 msgr2=0x559a821b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f5538ce6640 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f5538ce6640 1 -- 172.21.15.92:0/255068177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 msgr2=0x559a821b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f5538ce6640 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f5538ce6640 1 -- 172.21.15.92:0/255068177 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a81e24210 con 0x559a821b7cb0 2024-09-10T10:39:19.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f55394e7640 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f5538ce6640 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821b7cb0 0x559a821b56a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5524009230 tx=0x7f552402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45503ba297b6b22b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f551cff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f551cff9640 1 -- 172.21.15.92:0/255068177 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524035030 con 0x559a821b7cb0 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f551cff9640 1 -- 172.21.15.92:0/255068177 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f5524003800 con 0x559a821b7cb0 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.997+0000 7f553e5c2740 1 -- 172.21.15.92:0/255068177 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559a8211ea20 con 0x559a821b7cb0 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f551cff9640 1 -- 172.21.15.92:0/255068177 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5524054050 con 0x559a821b7cb0 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f553e5c2740 10 client.25093 fetch_fsmap learned FSMap version 37 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f553e5c2740 1 -- 172.21.15.92:0/255068177 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559a81ef0620 con 0x559a821b7cb0 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f551cff9640 1 -- 172.21.15.92:0/255068177 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559a8211ea20 con 0x559a821b7cb0 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f551cff9640 1 -- 172.21.15.92:0/255068177 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f552404b070 con 0x559a821b7cb0 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f553e5c2740 10 client.25093 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f553e5c2740 10 client.25093 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f553e5c2740 20 client.25093 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f553e5c2740 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559a821c7ce0 0x559a821ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f553e5c2740 4 client.25093 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f553e5c2740 1 -- 172.21.15.92:0/255068177 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a82118d70 con 0x559a821c7ce0 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.998+0000 7f55394e7640 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559a821c7ce0 0x559a821ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f551cff9640 10 client.25093 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f55394e7640 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559a821c7ce0 0x559a821ca120 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f3068e029c4b26 server_cookie=d5c52f14b21ac6d6 in_seq=0 out_seq=0 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f551cff9640 1 -- 172.21.15.92:0/255068177 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a82118d70 con 0x559a821c7ce0 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f551cff9640 10 client.25093 handle_command_reply: tid=0 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f553e5c2740 1 client.25093 shutdown 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f553e5c2740 1 -- 172.21.15.92:0/255068177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821b7cb0 msgr2=0x559a821b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f553e5c2740 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821b7cb0 0x559a821b56a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5524009230 tx=0x7f552402a410 comp rx=0 tx=0).stop 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f553e5c2740 1 -- 172.21.15.92:0/255068177 shutdown_connections 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f553e5c2740 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821b7cb0 0x559a821b56a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f553e5c2740 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f553e5c2740 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559a821c7ce0 0x559a821ca120 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f553e5c2740 1 --2- 172.21.15.92:0/255068177 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821acaf0 0x559a821b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f551cff9640 0 client.25093 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:18.999+0000 7f553e5c2740 1 -- 172.21.15.92:0/255068177 >> 172.21.15.92:0/255068177 conn(0x559a821a9060 msgr2=0x559a821a81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.000+0000 7f553e5c2740 1 -- 172.21.15.92:0/255068177 shutdown_connections 2024-09-10T10:39:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.000+0000 7f553e5c2740 1 -- 172.21.15.92:0/255068177 wait complete. 2024-09-10T10:39:19.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.000+0000 7f553e5c2740 20 client.25093 trim_cache size 0 max 16384 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f553e5c2740 1 Processor -- start 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f553e5c2740 1 -- start start 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 0x559a821cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f553e5c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f55341b3c60 con 0x559a821ad410 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f553e5c2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f55341b58c0 con 0x559a821b7cb0 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f553e5c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55341b4390 con 0x559a821acaf0 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f55394e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f55394e7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36632/0 (socket says 172.21.15.92:36632) 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f55394e7640 1 -- 172.21.15.92:0/517362267 learned_addr learned my addr 172.21.15.92:0/517362267 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f5538ce6640 1 --2- 172.21.15.92:0/517362267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 0x559a821cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.019+0000 7f5538ce6640 1 --2- 172.21.15.92:0/517362267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.020+0000 7f55394e7640 1 -- 172.21.15.92:0/517362267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 msgr2=0x559a821b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.020+0000 7f55394e7640 1 --2- 172.21.15.92:0/517362267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.020+0000 7f55394e7640 1 -- 172.21.15.92:0/517362267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 msgr2=0x559a821cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.020+0000 7f55394e7640 1 --2- 172.21.15.92:0/517362267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 0x559a821cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.020+0000 7f55394e7640 1 -- 172.21.15.92:0/517362267 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a821ac920 con 0x559a821ad410 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.020+0000 7f55394e7640 1 --2- 172.21.15.92:0/517362267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821cfa30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f553000eb50 tx=0x7f553000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934b7bdeb4374e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.020+0000 7f551effd640 1 -- 172.21.15.92:0/517362267 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553002c020 con 0x559a821ad410 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.020+0000 7f551effd640 1 -- 172.21.15.92:0/517362267 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5530005520 con 0x559a821ad410 2024-09-10T10:39:19.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.020+0000 7f551effd640 1 -- 172.21.15.92:0/517362267 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530011820 con 0x559a821ad410 2024-09-10T10:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.021+0000 7f553e5c2740 1 -- 172.21.15.92:0/517362267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 msgr2=0x559a821cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.021+0000 7f553e5c2740 1 --2- 172.21.15.92:0/517362267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821cfa30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f553000eb50 tx=0x7f553000b480 comp rx=0 tx=0).stop 2024-09-10T10:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.021+0000 7f553e5c2740 1 -- 172.21.15.92:0/517362267 shutdown_connections 2024-09-10T10:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.021+0000 7f553e5c2740 1 --2- 172.21.15.92:0/517362267 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 0x559a821cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.021+0000 7f553e5c2740 1 --2- 172.21.15.92:0/517362267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821cfa30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.021+0000 7f553e5c2740 1 --2- 172.21.15.92:0/517362267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.021+0000 7f553e5c2740 1 -- 172.21.15.92:0/517362267 >> 172.21.15.92:0/517362267 conn(0x559a821a9060 msgr2=0x559a821b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.022+0000 7f553e5c2740 1 -- 172.21.15.92:0/517362267 shutdown_connections 2024-09-10T10:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.022+0000 7f553e5c2740 1 -- 172.21.15.92:0/517362267 wait complete. 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.022+0000 7f553e5c2740 1 -- start start 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.022+0000 7f553e5c2740 1 Processor -- start 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.023+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.023+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821c0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.023+0000 7f553e5c2740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 0x559a821b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.023+0000 7f553e5c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f55341b51f0 con 0x559a821ad410 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.023+0000 7f553e5c2740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f55341b4a60 con 0x559a821b7cb0 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.023+0000 7f553e5c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55341b1c60 con 0x559a821acaf0 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.023+0000 7f553e5c2740 10 client.0 _ll_register_callbacks cb 0x7f55240318d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.023+0000 7f5538ce6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f5538ce6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821bff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:48884/0 (socket says 172.21.15.92:48884) 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f5538ce6640 1 -- 172.21.15.92:0/2010005926 learned_addr learned my addr 172.21.15.92:0/2010005926 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f5538ce6640 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 0x559a821b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f55394e7640 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f5538ce6640 1 -- 172.21.15.92:0/2010005926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 msgr2=0x559a821b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f5538ce6640 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 0x559a821b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f5538ce6640 1 -- 172.21.15.92:0/2010005926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 msgr2=0x559a821c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f5538ce6640 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f5538ce6640 1 -- 172.21.15.92:0/2010005926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a821a42d0 con 0x559a821acaf0 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f55394e7640 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f5538ce6640 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821bff30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f552402a930 tx=0x7f5524009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae2de783d6c03803 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f551cff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f551cff9640 1 -- 172.21.15.92:0/2010005926 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524035040 con 0x559a821acaf0 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f551cff9640 1 -- 172.21.15.92:0/2010005926 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f552403d650 con 0x559a821acaf0 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.024+0000 7f553e5c2740 1 -- 172.21.15.92:0/2010005926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5530005520 con 0x559a821acaf0 2024-09-10T10:39:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f551cff9640 1 -- 172.21.15.92:0/2010005926 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5524066050 con 0x559a821acaf0 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f553e5c2740 10 client.25099 fetch_fsmap learned FSMap version 37 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f553e5c2740 1 -- 172.21.15.92:0/2010005926 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559a82232400 con 0x559a821acaf0 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f551cff9640 1 -- 172.21.15.92:0/2010005926 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5530005520 con 0x559a821acaf0 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f551cff9640 1 -- 172.21.15.92:0/2010005926 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7f552404b070 con 0x559a821acaf0 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f553e5c2740 10 client.25099 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f553e5c2740 10 client.25099 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f553e5c2740 20 client.25099 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f553e5c2740 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559a82232ca0 0x559a82235090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f553e5c2740 4 client.25099 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f553e5c2740 1 -- 172.21.15.92:0/2010005926 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559a82095900 con 0x559a82232ca0 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f55394e7640 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559a82232ca0 0x559a82235090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.025+0000 7f551cff9640 10 client.25099 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.026+0000 7f55394e7640 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559a82232ca0 0x559a82235090 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=406daab93e114d29 server_cookie=3ce708f1d45d2db9 in_seq=0 out_seq=0 2024-09-10T10:39:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.033+0000 7f551cff9640 1 -- 172.21.15.92:0/2010005926 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559a82095900 con 0x559a82232ca0 2024-09-10T10:39:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.033+0000 7f551cff9640 10 client.25099 handle_command_reply: tid=0 2024-09-10T10:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 client.25099 shutdown 2024-09-10T10:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 -- 172.21.15.92:0/2010005926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 msgr2=0x559a821bff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821bff30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f552402a930 tx=0x7f5524009620 comp rx=0 tx=0).stop 2024-09-10T10:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 -- 172.21.15.92:0/2010005926 shutdown_connections 2024-09-10T10:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559a82232ca0 0x559a82235090 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559a821b7cb0 0x559a821b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a821ad410 0x559a821c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 --2- 172.21.15.92:0/2010005926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559a821acaf0 0x559a821bff30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f551cff9640 0 client.25099 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 -- 172.21.15.92:0/2010005926 >> 172.21.15.92:0/2010005926 conn(0x559a821a9060 msgr2=0x559a821ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.035+0000 7f553e5c2740 1 -- 172.21.15.92:0/2010005926 shutdown_connections 2024-09-10T10:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553e5c2740 1 -- 172.21.15.92:0/2010005926 wait complete. 2024-09-10T10:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553e5c2740 20 client.25099 trim_cache size 0 max 16384 2024-09-10T10:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 -- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f55200a2e20 msgr2=0x7f55200a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f55200a2e20 0x7f55200a52e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f552c0cd7b0 tx=0x7f552c013b60 comp rx=0 tx=0).stop 2024-09-10T10:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 -- 172.21.15.92:0/3338930372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55341a3330 msgr2=0x7f55341a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55341a3330 0x7f55341a37e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f552c009fd0 tx=0x7f552c00ef10 comp rx=0 tx=0).stop 2024-09-10T10:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 -- 172.21.15.92:0/3338930372 shutdown_connections 2024-09-10T10:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55341a3330 0x7f55341a37e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f55200a2e20 0x7f55200a52e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f553410d490 0x7f553419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 --2- 172.21.15.92:0/3338930372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5534108340 0x7f553419ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 -- 172.21.15.92:0/3338930372 >> 172.21.15.92:0/3338930372 conn(0x7f5534077a40 msgr2=0x7f5534078d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 -- 172.21.15.92:0/3338930372 shutdown_connections 2024-09-10T10:39:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:19.036+0000 7f553b74b640 1 -- 172.21.15.92:0/3338930372 wait complete. 2024-09-10T10:39:20.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:20 smithi092 ceph-mon[30834]: pgmap v84: 97 pgs: 97 active+clean; 2.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.9 MiB/s wr, 636 op/s 2024-09-10T10:39:20.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:20 smithi121 ceph-mon[35231]: pgmap v84: 97 pgs: 97 active+clean; 2.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.9 MiB/s wr, 636 op/s 2024-09-10T10:39:20.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:20 smithi097 ceph-mon[35213]: pgmap v84: 97 pgs: 97 active+clean; 2.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.9 MiB/s wr, 636 op/s 2024-09-10T10:39:22.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:22 smithi092 ceph-mon[30834]: pgmap v85: 97 pgs: 97 active+clean; 2.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 937 op/s 2024-09-10T10:39:22.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:22 smithi121 ceph-mon[35231]: pgmap v85: 97 pgs: 97 active+clean; 2.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 937 op/s 2024-09-10T10:39:22.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:22 smithi097 ceph-mon[35213]: pgmap v85: 97 pgs: 97 active+clean; 2.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 937 op/s 2024-09-10T10:39:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 145.0 s, 3166.0 tps, lat 31.542 ms stddev 31.852 2024-09-10T10:39:24.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:24 smithi092 ceph-mon[30834]: pgmap v86: 97 pgs: 97 active+clean; 2.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.5 MiB/s wr, 619 op/s 2024-09-10T10:39:24.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:24 smithi121 ceph-mon[35231]: pgmap v86: 97 pgs: 97 active+clean; 2.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.5 MiB/s wr, 619 op/s 2024-09-10T10:39:24.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:24 smithi097 ceph-mon[35213]: pgmap v86: 97 pgs: 97 active+clean; 2.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.5 MiB/s wr, 619 op/s 2024-09-10T10:39:26.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:26 smithi092 ceph-mon[30834]: pgmap v87: 97 pgs: 97 active+clean; 2.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 851 op/s 2024-09-10T10:39:26.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:26 smithi121 ceph-mon[35231]: pgmap v87: 97 pgs: 97 active+clean; 2.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 851 op/s 2024-09-10T10:39:26.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:26 smithi097 ceph-mon[35213]: pgmap v87: 97 pgs: 97 active+clean; 2.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 851 op/s 2024-09-10T10:39:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 150.0 s, 3160.8 tps, lat 31.700 ms stddev 32.305 2024-09-10T10:39:28.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:28 smithi092 ceph-mon[30834]: pgmap v88: 97 pgs: 97 active+clean; 2.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 636 op/s 2024-09-10T10:39:28.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:28 smithi121 ceph-mon[35231]: pgmap v88: 97 pgs: 97 active+clean; 2.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 636 op/s 2024-09-10T10:39:28.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:28 smithi097 ceph-mon[35213]: pgmap v88: 97 pgs: 97 active+clean; 2.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 636 op/s 2024-09-10T10:39:30.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:30 smithi121 ceph-mon[35231]: pgmap v89: 97 pgs: 97 active+clean; 2.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 607 op/s 2024-09-10T10:39:30.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:30 smithi097 ceph-mon[35213]: pgmap v89: 97 pgs: 97 active+clean; 2.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 607 op/s 2024-09-10T10:39:30.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:30 smithi092 ceph-mon[30834]: pgmap v89: 97 pgs: 97 active+clean; 2.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 607 op/s 2024-09-10T10:39:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.151+0000 7fe6f340e640 1 -- 172.21.15.92:0/1594798415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec1009d0 msgr2=0x7fe6ec100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.151+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1594798415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec1009d0 0x7fe6ec100e30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009cd0 tx=0x7fe6e002a8e0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.151+0000 7fe6f340e640 1 -- 172.21.15.92:0/1594798415 shutdown_connections 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.151+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1594798415 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6ec101370 0x7fe6ec10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.151+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1594798415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec1009d0 0x7fe6ec100e30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.151+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1594798415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6ec1069e0 0x7fe6ec106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.151+0000 7fe6f340e640 1 -- 172.21.15.92:0/1594798415 >> 172.21.15.92:0/1594798415 conn(0x7fe6ec0fc6b0 msgr2=0x7fe6ec0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.151+0000 7fe6f340e640 1 -- 172.21.15.92:0/1594798415 shutdown_connections 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f340e640 1 -- 172.21.15.92:0/1594798415 wait complete. 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f340e640 1 Processor -- start 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f340e640 1 -- start start 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f340e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6ec1009d0 0x7fe6ec1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f340e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec101370 0x7fe6ec199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f340e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6ec1069e0 0x7fe6ec1a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f340e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec110e20 con 0x7fe6ec101370 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f340e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec110ca0 con 0x7fe6ec1009d0 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f340e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec110fa0 con 0x7fe6ec1069e0 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f09a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec101370 0x7fe6ec199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f09a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec101370 0x7fe6ec199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56708/0 (socket says 172.21.15.92:56708) 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f09a9640 1 -- 172.21.15.92:0/1864280976 learned_addr learned my addr 172.21.15.92:0/1864280976 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f11aa640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6ec1009d0 0x7fe6ec1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.152+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6ec1069e0 0x7fe6ec1a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6f09a9640 1 -- 172.21.15.92:0/1864280976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6ec1069e0 msgr2=0x7fe6ec1a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6ec1069e0 0x7fe6ec1a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6f09a9640 1 -- 172.21.15.92:0/1864280976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6ec1009d0 msgr2=0x7fe6ec1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6ec1009d0 0x7fe6ec1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6f09a9640 1 -- 172.21.15.92:0/1864280976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec1a47b0 con 0x7fe6ec101370 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec101370 0x7fe6ec199730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0005e30 tx=0x7fe6e0032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:32.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6ea7fc640 1 -- 172.21.15.92:0/1864280976 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0004040 con 0x7fe6ec101370 2024-09-10T10:39:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6f340e640 1 -- 172.21.15.92:0/1864280976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec1a4980 con 0x7fe6ec101370 2024-09-10T10:39:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6ea7fc640 1 -- 172.21.15.92:0/1864280976 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6e00046c0 con 0x7fe6ec101370 2024-09-10T10:39:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6f340e640 1 -- 172.21.15.92:0/1864280976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec1a4e90 con 0x7fe6ec101370 2024-09-10T10:39:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.153+0000 7fe6ea7fc640 1 -- 172.21.15.92:0/1864280976 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0046480 con 0x7fe6ec101370 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f6284740 1 Processor -- start 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6ea7fc640 1 -- 172.21.15.92:0/1864280976 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe6e00305a0 con 0x7fe6ec101370 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f6284740 1 -- start start 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbdaf0 0x55dddcbbded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbe410 0x55dddcbc8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 0x55dddcbcb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f6284740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dddcb222f0 con 0x55dddcbbdaf0 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f6284740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dddcaca270 con 0x55dddcbbe410 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f6284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dddcb1e2b0 con 0x55dddcbc8cb0 2024-09-10T10:39:32.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f19ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbdaf0 0x55dddcbbded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f19ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbdaf0 0x55dddcbbded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56718/0 (socket says 172.21.15.92:56718) 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f19ab640 1 -- 172.21.15.92:0/367705422 learned_addr learned my addr 172.21.15.92:0/367705422 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f11aa640 1 --2- 172.21.15.92:0/367705422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbe410 0x55dddcbc8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/367705422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 0x55dddcbcb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6ea7fc640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe6dc0a2ea0 0x7fe6dc0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f19ab640 1 -- 172.21.15.92:0/367705422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 msgr2=0x55dddcbcb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/367705422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 0x55dddcbcb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f19ab640 1 -- 172.21.15.92:0/367705422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbe410 msgr2=0x55dddcbc8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/367705422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbe410 0x55dddcbc8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.158+0000 7fe6f19ab640 1 -- 172.21.15.92:0/367705422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddcac9340 con 0x55dddcbbdaf0 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.159+0000 7fe6ea7fc640 1 -- 172.21.15.92:0/1864280976 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fe6e002e030 con 0x7fe6ec101370 2024-09-10T10:39:32.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.159+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe6dc0a2ea0 0x7fe6dc0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.159+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/367705422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbdaf0 0x55dddcbbded0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800acc0 tx=0x7fe6d800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cef0d9eb123578 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.159+0000 7fe6d77fe640 1 -- 172.21.15.92:0/367705422 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8016e30 con 0x55dddcbbdaf0 2024-09-10T10:39:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.159+0000 7fe6d77fe640 1 -- 172.21.15.92:0/367705422 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6d8028910 con 0x55dddcbbdaf0 2024-09-10T10:39:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.159+0000 7fe6d77fe640 1 -- 172.21.15.92:0/367705422 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d801d720 con 0x55dddcbbdaf0 2024-09-10T10:39:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.160+0000 7fe6f6284740 1 -- 172.21.15.92:0/367705422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbdaf0 msgr2=0x55dddcbbded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.160+0000 7fe6f6284740 1 --2- 172.21.15.92:0/367705422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbdaf0 0x55dddcbbded0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe6d800acc0 tx=0x7fe6d800f790 comp rx=0 tx=0).stop 2024-09-10T10:39:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.160+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe6dc0a2ea0 0x7fe6dc0a5360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8023000 tx=0x7fe6d8020000 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.160+0000 7fe6f6284740 1 -- 172.21.15.92:0/367705422 shutdown_connections 2024-09-10T10:39:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.160+0000 7fe6f6284740 1 --2- 172.21.15.92:0/367705422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 0x55dddcbcb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.160+0000 7fe6f6284740 1 --2- 172.21.15.92:0/367705422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbe410 0x55dddcbc8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.160+0000 7fe6f6284740 1 --2- 172.21.15.92:0/367705422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbdaf0 0x55dddcbbded0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.160+0000 7fe6f6284740 1 -- 172.21.15.92:0/367705422 >> 172.21.15.92:0/367705422 conn(0x55dddcbba060 msgr2=0x55dddcbba440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.161+0000 7fe6f6284740 1 -- 172.21.15.92:0/367705422 shutdown_connections 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.161+0000 7fe6f6284740 1 -- 172.21.15.92:0/367705422 wait complete. 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.161+0000 7fe6f6284740 1 -- start start 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.161+0000 7fe6f6284740 1 Processor -- start 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbdaf0 0x55dddcbc5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbc60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f6284740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dddcbcb880 con 0x55dddcbbe410 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f6284740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dddcaab290 con 0x55dddcbc8cb0 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f6284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dddcbcba00 con 0x55dddcbbdaf0 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f6284740 10 client.0 _ll_register_callbacks cb 0x55dddcadc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f11aa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbdaf0 0x55dddcbc5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f09a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbc60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f19ab640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f09a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbc60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56728/0 (socket says 172.21.15.92:56728) 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f09a9640 1 -- 172.21.15.92:0/2903312029 learned_addr learned my addr 172.21.15.92:0/2903312029 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f11aa640 1 -- 172.21.15.92:0/2903312029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbc8cb0 msgr2=0x55dddcbc6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f11aa640 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f11aa640 1 -- 172.21.15.92:0/2903312029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 msgr2=0x55dddcbc60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f11aa640 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbc60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f11aa640 1 -- 172.21.15.92:0/2903312029 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddc835210 con 0x55dddcbbdaf0 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.162+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbc60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.163+0000 7fe6f11aa640 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbdaf0 0x55dddcbc5b90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4012700 tx=0x7fe6e4012b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1214ea41ee26078 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.163+0000 7fe6d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.163+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/2903312029 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4005020 con 0x55dddcbbdaf0 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.163+0000 7fe6f6284740 1 -- 172.21.15.92:0/2903312029 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6d8028910 con 0x55dddcbbdaf0 2024-09-10T10:39:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.163+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/2903312029 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fe6e40051c0 con 0x55dddcbbdaf0 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.163+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/2903312029 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe6e40053c0 con 0x55dddcbbdaf0 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.163+0000 7fe6f6284740 10 client.25111 fetch_fsmap learned FSMap version 37 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.164+0000 7fe6f6284740 1 -- 172.21.15.92:0/2903312029 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dddc901620 con 0x55dddcbbdaf0 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.164+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/2903312029 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6e4004c80 con 0x55dddcbbdaf0 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.164+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/2903312029 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fe6e4024020 con 0x55dddcbbdaf0 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.164+0000 7fe6f6284740 10 client.25111 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.164+0000 7fe6f6284740 10 client.25111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.164+0000 7fe6f6284740 20 client.25111 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.165+0000 7fe6f6284740 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dddcbd9140 0x55dddcbdb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.165+0000 7fe6f6284740 4 client.25111 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:39:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.165+0000 7fe6f6284740 1 -- 172.21.15.92:0/2903312029 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe6d8028910 con 0x55dddcbd9140 2024-09-10T10:39:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.165+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dddcbd9140 0x55dddcbdb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.165+0000 7fe6d4ff9640 10 client.25111 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.165+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dddcbd9140 0x55dddcbdb5e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1958583788ae4231 server_cookie=8d93853969d34be3 in_seq=0 out_seq=0 2024-09-10T10:39:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/2903312029 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe6d8028910 con 0x55dddcbd9140 2024-09-10T10:39:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6d4ff9640 10 client.25111 handle_command_reply: tid=0 2024-09-10T10:39:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 client.25111 shutdown 2024-09-10T10:39:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 -- 172.21.15.92:0/2903312029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbdaf0 msgr2=0x55dddcbc5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbdaf0 0x55dddcbc5b90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4012700 tx=0x7fe6e4012b00 comp rx=0 tx=0).stop 2024-09-10T10:39:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 -- 172.21.15.92:0/2903312029 shutdown_connections 2024-09-10T10:39:32.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dddcbd9140 0x55dddcbdb5e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbc60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 --2- 172.21.15.92:0/2903312029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbdaf0 0x55dddcbc5b90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 -- 172.21.15.92:0/2903312029 >> 172.21.15.92:0/2903312029 conn(0x55dddcbba060 msgr2=0x55dddcbbfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6d4ff9640 0 client.25111 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 -- 172.21.15.92:0/2903312029 shutdown_connections 2024-09-10T10:39:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.166+0000 7fe6f6284740 1 -- 172.21.15.92:0/2903312029 wait complete. 2024-09-10T10:39:32.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.167+0000 7fe6f6284740 20 client.25111 trim_cache size 0 max 16384 2024-09-10T10:39:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.186+0000 7fe6f6284740 1 Processor -- start 2024-09-10T10:39:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f6284740 1 -- start start 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbc0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbe410 0x55dddcbc7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f6284740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec1ab3e0 con 0x55dddcbc8cb0 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f6284740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec1ad040 con 0x55dddcbbdaf0 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f6284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec1abb10 con 0x55dddcbbe410 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f19ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f19ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56742/0 (socket says 172.21.15.92:56742) 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f19ab640 1 -- 172.21.15.92:0/4022104417 learned_addr learned my addr 172.21.15.92:0/4022104417 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/4022104417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbe410 0x55dddcbc7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f11aa640 1 --2- 172.21.15.92:0/4022104417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbc0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f19ab640 1 -- 172.21.15.92:0/4022104417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbe410 msgr2=0x55dddcbc7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/4022104417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbe410 0x55dddcbc7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f19ab640 1 -- 172.21.15.92:0/4022104417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 msgr2=0x55dddcbc0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/4022104417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbc0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f19ab640 1 -- 172.21.15.92:0/4022104417 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddcbd8e90 con 0x55dddcbc8cb0 2024-09-10T10:39:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.187+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/4022104417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6440 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe6d801edb0 tx=0x7fe6d802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16fe6e9ad8592e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.188+0000 7fe6d6ffd640 1 -- 172.21.15.92:0/4022104417 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8039070 con 0x55dddcbc8cb0 2024-09-10T10:39:32.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.188+0000 7fe6d6ffd640 1 -- 172.21.15.92:0/4022104417 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6d802e040 con 0x55dddcbc8cb0 2024-09-10T10:39:32.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.188+0000 7fe6d6ffd640 1 -- 172.21.15.92:0/4022104417 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d802d070 con 0x55dddcbc8cb0 2024-09-10T10:39:32.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.189+0000 7fe6f6284740 1 -- 172.21.15.92:0/4022104417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbc8cb0 msgr2=0x55dddcbc6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.189+0000 7fe6f6284740 1 --2- 172.21.15.92:0/4022104417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6440 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe6d801edb0 tx=0x7fe6d802a000 comp rx=0 tx=0).stop 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.189+0000 7fe6f6284740 1 -- 172.21.15.92:0/4022104417 shutdown_connections 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.189+0000 7fe6f6284740 1 --2- 172.21.15.92:0/4022104417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbc8cb0 0x55dddcbc6440 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.189+0000 7fe6f6284740 1 --2- 172.21.15.92:0/4022104417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbbe410 0x55dddcbc7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.189+0000 7fe6f6284740 1 --2- 172.21.15.92:0/4022104417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbc0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.189+0000 7fe6f6284740 1 -- 172.21.15.92:0/4022104417 >> 172.21.15.92:0/4022104417 conn(0x55dddcbba060 msgr2=0x55dddcbc73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.190+0000 7fe6f6284740 1 -- 172.21.15.92:0/4022104417 shutdown_connections 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.190+0000 7fe6f6284740 1 -- 172.21.15.92:0/4022104417 wait complete. 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.190+0000 7fe6f6284740 1 -- start start 2024-09-10T10:39:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.190+0000 7fe6f6284740 1 Processor -- start 2024-09-10T10:39:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbcc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbcc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f6284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 0x55dddcc41eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f6284740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec1ac970 con 0x55dddcbbe410 2024-09-10T10:39:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f6284740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec1ac1e0 con 0x55dddcbbdaf0 2024-09-10T10:39:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f6284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec1a9440 con 0x55dddcbc8cb0 2024-09-10T10:39:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f6284740 10 client.0 _ll_register_callbacks cb 0x7fe6e4009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f09a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbcc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f11aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbcc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f11aa640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbcc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:59898/0 (socket says 172.21.15.92:59898) 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f11aa640 1 -- 172.21.15.92:0/3431019023 learned_addr learned my addr 172.21.15.92:0/3431019023 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f09a9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbcc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56754/0 (socket says 172.21.15.92:56754) 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f19ab640 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 0x55dddcc41eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f11aa640 1 -- 172.21.15.92:0/3431019023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 msgr2=0x55dddcc41eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f11aa640 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 0x55dddcc41eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f11aa640 1 -- 172.21.15.92:0/3431019023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 msgr2=0x55dddcbcc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.191+0000 7fe6f11aa640 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbcc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.192+0000 7fe6f11aa640 1 -- 172.21.15.92:0/3431019023 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddcc42440 con 0x55dddcbbdaf0 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.192+0000 7fe6f11aa640 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbcc260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40059f0 tx=0x7fe6e400fd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699f1b3df2f04e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.192+0000 7fe6d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:39:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.192+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/3431019023 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400f5c0 con 0x55dddcbbdaf0 2024-09-10T10:39:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.192+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/3431019023 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fe6e400f760 con 0x55dddcbbdaf0 2024-09-10T10:39:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.193+0000 7fe6f6284740 1 -- 172.21.15.92:0/3431019023 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6d802e040 con 0x55dddcbbdaf0 2024-09-10T10:39:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.193+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/3431019023 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe6e40035f0 con 0x55dddcbbdaf0 2024-09-10T10:39:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.194+0000 7fe6f6284740 10 client.25073 fetch_fsmap learned FSMap version 37 2024-09-10T10:39:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.194+0000 7fe6f6284740 1 -- 172.21.15.92:0/3431019023 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dddcc43750 con 0x55dddcbbdaf0 2024-09-10T10:39:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.198+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/3431019023 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6d802e040 con 0x55dddcbbdaf0 2024-09-10T10:39:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.199+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/3431019023 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7fe6e4024040 con 0x55dddcbbdaf0 2024-09-10T10:39:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.199+0000 7fe6f6284740 10 client.25073 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T10:39:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.199+0000 7fe6f6284740 10 client.25073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.199+0000 7fe6f6284740 20 client.25073 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.199+0000 7fe6f6284740 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dddcc43ec0 0x55dddcc462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.199+0000 7fe6f6284740 4 client.25073 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:39:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.199+0000 7fe6f6284740 1 -- 172.21.15.92:0/3431019023 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dddcb2fa20 con 0x55dddcc43ec0 2024-09-10T10:39:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.209+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dddcc43ec0 0x55dddcc462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.220+0000 7fe6f09a9640 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dddcc43ec0 0x55dddcc462e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b0e0ff664485ce server_cookie=d942a02de53d46a4 in_seq=0 out_seq=0 2024-09-10T10:39:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.220+0000 7fe6d4ff9640 10 client.25073 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.236+0000 7fe6d4ff9640 1 -- 172.21.15.92:0/3431019023 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dddcb2fa20 con 0x55dddcc43ec0 2024-09-10T10:39:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.236+0000 7fe6d4ff9640 10 client.25073 handle_command_reply: tid=0 2024-09-10T10:39:32.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.236+0000 7fe6f6284740 1 client.25073 shutdown 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 -- 172.21.15.92:0/3431019023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 msgr2=0x55dddcbcc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbcc260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40059f0 tx=0x7fe6e400fd00 comp rx=0 tx=0).stop 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 -- 172.21.15.92:0/3431019023 shutdown_connections 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dddcbc8cb0 0x55dddcc41eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dddcbbe410 0x55dddcbcc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dddcc43ec0 0x55dddcc462e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 --2- 172.21.15.92:0/3431019023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dddcbbdaf0 0x55dddcbcc260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6d4ff9640 0 client.25073 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 -- 172.21.15.92:0/3431019023 >> 172.21.15.92:0/3431019023 conn(0x55dddcbba060 msgr2=0x55dddcbb91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 -- 172.21.15.92:0/3431019023 shutdown_connections 2024-09-10T10:39:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 1 -- 172.21.15.92:0/3431019023 wait complete. 2024-09-10T10:39:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.237+0000 7fe6f6284740 20 client.25073 trim_cache size 0 max 16384 2024-09-10T10:39:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:39:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:39:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:39:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:39:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 -- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe6dc0a2ea0 msgr2=0x7fe6dc0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe6dc0a2ea0 0x7fe6dc0a5360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8023000 tx=0x7fe6d8020000 comp rx=0 tx=0).stop 2024-09-10T10:39:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 -- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec101370 msgr2=0x7fe6ec199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec101370 0x7fe6ec199730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0005e30 tx=0x7fe6e0032fb0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 -- 172.21.15.92:0/1864280976 shutdown_connections 2024-09-10T10:39:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6ec1069e0 0x7fe6ec1a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6ec101370 0x7fe6ec199730 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe6dc0a2ea0 0x7fe6dc0a5360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 --2- 172.21.15.92:0/1864280976 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe6ec1009d0 0x7fe6ec1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.238+0000 7fe6f340e640 1 -- 172.21.15.92:0/1864280976 >> 172.21.15.92:0/1864280976 conn(0x7fe6ec0fc6b0 msgr2=0x7fe6ec0fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.239+0000 7fe6f340e640 1 -- 172.21.15.92:0/1864280976 shutdown_connections 2024-09-10T10:39:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:32.239+0000 7fe6f340e640 1 -- 172.21.15.92:0/1864280976 wait complete. 2024-09-10T10:39:32.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:32 smithi121 ceph-mon[35231]: pgmap v90: 97 pgs: 97 active+clean; 2.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 948 op/s 2024-09-10T10:39:32.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:32 smithi097 ceph-mon[35213]: pgmap v90: 97 pgs: 97 active+clean; 2.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 948 op/s 2024-09-10T10:39:32.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:32 smithi092 ceph-mon[30834]: pgmap v90: 97 pgs: 97 active+clean; 2.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 948 op/s 2024-09-10T10:39:33.153 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 155.0 s, 3111.6 tps, lat 31.795 ms stddev 34.068 2024-09-10T10:39:34.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:34 smithi121 ceph-mon[35231]: pgmap v91: 97 pgs: 97 active+clean; 2.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 647 op/s 2024-09-10T10:39:34.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:34 smithi097 ceph-mon[35213]: pgmap v91: 97 pgs: 97 active+clean; 2.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 647 op/s 2024-09-10T10:39:34.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:34 smithi092 ceph-mon[30834]: pgmap v91: 97 pgs: 97 active+clean; 2.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 647 op/s 2024-09-10T10:39:36.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:36 smithi121 ceph-mon[35231]: pgmap v92: 97 pgs: 97 active+clean; 2.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 839 op/s 2024-09-10T10:39:36.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:36 smithi097 ceph-mon[35213]: pgmap v92: 97 pgs: 97 active+clean; 2.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 839 op/s 2024-09-10T10:39:36.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:36 smithi092 ceph-mon[30834]: pgmap v92: 97 pgs: 97 active+clean; 2.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 839 op/s 2024-09-10T10:39:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 160.0 s, 2979.4 tps, lat 33.733 ms stddev 34.171 2024-09-10T10:39:38.621 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:38 smithi097 ceph-mon[35213]: pgmap v93: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 762 op/s 2024-09-10T10:39:38.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:38 smithi121 ceph-mon[35231]: pgmap v93: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 762 op/s 2024-09-10T10:39:38.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:38 smithi092 ceph-mon[30834]: pgmap v93: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 762 op/s 2024-09-10T10:39:40.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:40 smithi121 ceph-mon[35231]: pgmap v94: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 MiB/s wr, 687 op/s 2024-09-10T10:39:40.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:40 smithi097 ceph-mon[35213]: pgmap v94: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 MiB/s wr, 687 op/s 2024-09-10T10:39:40.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:40 smithi092 ceph-mon[30834]: pgmap v94: 97 pgs: 97 active+clean; 2.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 MiB/s wr, 687 op/s 2024-09-10T10:39:42.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:42 smithi121 ceph-mon[35231]: pgmap v95: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 986 op/s 2024-09-10T10:39:42.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:42 smithi097 ceph-mon[35213]: pgmap v95: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 986 op/s 2024-09-10T10:39:42.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:42 smithi092 ceph-mon[30834]: pgmap v95: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 986 op/s 2024-09-10T10:39:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 165.0 s, 3239.4 tps, lat 31.048 ms stddev 32.351 2024-09-10T10:39:44.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:44 smithi121 ceph-mon[35231]: pgmap v96: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.7 MiB/s wr, 646 op/s 2024-09-10T10:39:44.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:44 smithi097 ceph-mon[35213]: pgmap v96: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.7 MiB/s wr, 646 op/s 2024-09-10T10:39:44.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:44 smithi092 ceph-mon[30834]: pgmap v96: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.7 MiB/s wr, 646 op/s 2024-09-10T10:39:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.373+0000 7faa27e23640 1 -- 172.21.15.92:0/1746242757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 msgr2=0x7faa2010ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.373+0000 7faa27e23640 1 --2- 172.21.15.92:0/1746242757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 0x7faa2010ea40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009900 tx=0x7faa1c02a410 comp rx=0 tx=0).stop 2024-09-10T10:39:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.373+0000 7faa27e23640 1 -- 172.21.15.92:0/1746242757 shutdown_connections 2024-09-10T10:39:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.373+0000 7faa27e23640 1 --2- 172.21.15.92:0/1746242757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 0x7faa2010ea40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.373+0000 7faa27e23640 1 --2- 172.21.15.92:0/1746242757 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa200fff60 0x7faa201003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.373+0000 7faa27e23640 1 --2- 172.21.15.92:0/1746242757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa20103aa0 0x7faa20103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.373+0000 7faa27e23640 1 -- 172.21.15.92:0/1746242757 >> 172.21.15.92:0/1746242757 conn(0x7faa200770f0 msgr2=0x7faa200fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.374+0000 7faa27e23640 1 -- 172.21.15.92:0/1746242757 shutdown_connections 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.374+0000 7faa27e23640 1 -- 172.21.15.92:0/1746242757 wait complete. 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa27e23640 1 Processor -- start 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa27e23640 1 -- start start 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa27e23640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa200fff60 0x7faa2019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa27e23640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 0x7faa2019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa27e23640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa20103aa0 0x7faa2019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa27e23640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa201142d0 con 0x7faa200fff60 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa27e23640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faa20114150 con 0x7faa20103aa0 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa27e23640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa20114450 con 0x7faa201008e0 2024-09-10T10:39:45.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa263c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa20103aa0 0x7faa2019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa253be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 0x7faa2019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa263c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa20103aa0 0x7faa2019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:53126/0 (socket says 172.21.15.92:53126) 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa253be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 0x7faa2019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:48432/0 (socket says 172.21.15.92:48432) 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa263c0640 1 -- 172.21.15.92:0/1598781946 learned_addr learned my addr 172.21.15.92:0/1598781946 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa25bbf640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa200fff60 0x7faa2019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.375+0000 7faa253be640 1 -- 172.21.15.92:0/1598781946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa20103aa0 msgr2=0x7faa2019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.376+0000 7faa253be640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa20103aa0 0x7faa2019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.376+0000 7faa253be640 1 -- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa200fff60 msgr2=0x7faa2019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.376+0000 7faa253be640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa200fff60 0x7faa2019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.376+0000 7faa253be640 1 -- 172.21.15.92:0/1598781946 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2019f680 con 0x7faa201008e0 2024-09-10T10:39:45.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.376+0000 7faa263c0640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa20103aa0 0x7faa2019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.376+0000 7faa253be640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 0x7faa2019abd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faa1000b3f0 tx=0x7faa1000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.376+0000 7faa16ffd640 1 -- 172.21.15.92:0/1598781946 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10015020 con 0x7faa201008e0 2024-09-10T10:39:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.376+0000 7faa16ffd640 1 -- 172.21.15.92:0/1598781946 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa10011d10 con 0x7faa201008e0 2024-09-10T10:39:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.376+0000 7faa16ffd640 1 -- 172.21.15.92:0/1598781946 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1000f2e0 con 0x7faa201008e0 2024-09-10T10:39:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.377+0000 7faa27e23640 1 -- 172.21.15.92:0/1598781946 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa2019f970 con 0x7faa201008e0 2024-09-10T10:39:45.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.377+0000 7faa27e23640 1 -- 172.21.15.92:0/1598781946 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa201a7200 con 0x7faa201008e0 2024-09-10T10:39:45.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.379+0000 7faa16ffd640 1 -- 172.21.15.92:0/1598781946 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7faa10018020 con 0x7faa201008e0 2024-09-10T10:39:45.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.379+0000 7faa2abbc740 1 Processor -- start 2024-09-10T10:39:45.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa2abbc740 1 -- start start 2024-09-10T10:39:45.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e8af0 0x557e3a6e8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e9410 0x557e3a6f3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa16ffd640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faa0c0a2f00 0x7faa0c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6f3cb0 0x557e3a6f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa2abbc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557e3a64d2f0 con 0x557e3a6e8af0 2024-09-10T10:39:45.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa2abbc740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557e3a5f5270 con 0x557e3a6e9410 2024-09-10T10:39:45.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa2abbc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557e3a6492b0 con 0x557e3a6f3cb0 2024-09-10T10:39:45.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa253be640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e9410 0x557e3a6f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa16ffd640 1 -- 172.21.15.92:0/1598781946 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7faa100ce910 con 0x7faa201008e0 2024-09-10T10:39:45.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa253be640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e9410 0x557e3a6f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:53138/0 (socket says 172.21.15.92:53138) 2024-09-10T10:39:45.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa253be640 1 -- 172.21.15.92:0/820480785 learned_addr learned my addr 172.21.15.92:0/820480785 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:45.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa263c0640 1 --2- 172.21.15.92:0/820480785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e8af0 0x557e3a6e8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.380+0000 7faa263c0640 1 --2- 172.21.15.92:0/820480785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6f3cb0 0x557e3a6f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.381+0000 7faa25bbf640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faa0c0a2f00 0x7faa0c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.381+0000 7faa253be640 1 -- 172.21.15.92:0/820480785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6f3cb0 msgr2=0x557e3a6f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:45.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.381+0000 7faa253be640 1 --2- 172.21.15.92:0/820480785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6f3cb0 0x557e3a6f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.381+0000 7faa253be640 1 -- 172.21.15.92:0/820480785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e8af0 msgr2=0x557e3a6e8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:45.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.381+0000 7faa253be640 1 --2- 172.21.15.92:0/820480785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e8af0 0x557e3a6e8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.381+0000 7faa253be640 1 -- 172.21.15.92:0/820480785 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3a5f4340 con 0x557e3a6e9410 2024-09-10T10:39:45.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.382+0000 7faa253be640 1 --2- 172.21.15.92:0/820480785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e9410 0x557e3a6f3770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa10097410 tx=0x7faa100642e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ebb584860565849 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.382+0000 7faa25bbf640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faa0c0a2f00 0x7faa0c0a53c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faa18007ec0 tx=0x7faa180075b0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa0bfff640 1 -- 172.21.15.92:0/820480785 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10009200 con 0x557e3a6e9410 2024-09-10T10:39:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa0bfff640 1 -- 172.21.15.92:0/820480785 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa10010eb0 con 0x557e3a6e9410 2024-09-10T10:39:45.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa0bfff640 1 -- 172.21.15.92:0/820480785 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa100bb0b0 con 0x557e3a6e9410 2024-09-10T10:39:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa2abbc740 1 -- 172.21.15.92:0/820480785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e9410 msgr2=0x557e3a6f3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa2abbc740 1 --2- 172.21.15.92:0/820480785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e9410 0x557e3a6f3770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa10097410 tx=0x7faa100642e0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa2abbc740 1 -- 172.21.15.92:0/820480785 shutdown_connections 2024-09-10T10:39:45.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa2abbc740 1 --2- 172.21.15.92:0/820480785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6f3cb0 0x557e3a6f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa2abbc740 1 --2- 172.21.15.92:0/820480785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e9410 0x557e3a6f3770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa2abbc740 1 --2- 172.21.15.92:0/820480785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e8af0 0x557e3a6e8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.383+0000 7faa2abbc740 1 -- 172.21.15.92:0/820480785 >> 172.21.15.92:0/820480785 conn(0x557e3a6e5060 msgr2=0x557e3a6e5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.384+0000 7faa2abbc740 1 -- 172.21.15.92:0/820480785 shutdown_connections 2024-09-10T10:39:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.384+0000 7faa2abbc740 1 -- 172.21.15.92:0/820480785 wait complete. 2024-09-10T10:39:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.384+0000 7faa2abbc740 1 -- start start 2024-09-10T10:39:45.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.384+0000 7faa2abbc740 1 Processor -- start 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 0x557e3a6f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 0x557e3a6f1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa2abbc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557e3a6f6880 con 0x557e3a6e9410 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa2abbc740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x557e3a5d6290 con 0x557e3a6f3cb0 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa2abbc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557e3a6f6a00 con 0x557e3a6e8af0 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa2abbc740 10 client.0 _ll_register_callbacks cb 0x557e3a607140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa253be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa253be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6f11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50918/0 (socket says 172.21.15.92:50918) 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa253be640 1 -- 172.21.15.92:0/2896323145 learned_addr learned my addr 172.21.15.92:0/2896323145 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:45.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.385+0000 7faa263c0640 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 0x557e3a6f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa253be640 1 -- 172.21.15.92:0/2896323145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 msgr2=0x557e3a6f0cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa253be640 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 0x557e3a6f0cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa253be640 1 -- 172.21.15.92:0/2896323145 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 msgr2=0x557e3a6f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa253be640 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 0x557e3a6f1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa253be640 1 -- 172.21.15.92:0/2896323145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e3a360210 con 0x557e3a6e9410 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa263c0640 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 0x557e3a6f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa253be640 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6f11f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faa1000bdb0 tx=0x7faa1006ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3f4088a8513ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa097fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa097fa640 1 -- 172.21.15.92:0/2896323145 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa100bb0b0 con 0x557e3a6e9410 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.386+0000 7faa097fa640 1 -- 172.21.15.92:0/2896323145 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7faa10097620 con 0x557e3a6e9410 2024-09-10T10:39:45.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.387+0000 7faa2abbc740 1 -- 172.21.15.92:0/2896323145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557e3a65aa20 con 0x557e3a6e9410 2024-09-10T10:39:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.387+0000 7faa097fa640 1 -- 172.21.15.92:0/2896323145 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7faa1009b6b0 con 0x557e3a6e9410 2024-09-10T10:39:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.387+0000 7faa2abbc740 10 client.15564 fetch_fsmap learned FSMap version 37 2024-09-10T10:39:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.387+0000 7faa2abbc740 1 -- 172.21.15.92:0/2896323145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557e3a42c620 con 0x557e3a6e9410 2024-09-10T10:39:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.387+0000 7faa097fa640 1 -- 172.21.15.92:0/2896323145 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa1009afb0 con 0x557e3a6e9410 2024-09-10T10:39:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.388+0000 7faa097fa640 1 -- 172.21.15.92:0/2896323145 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7faa1006d910 con 0x557e3a6e9410 2024-09-10T10:39:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.388+0000 7faa2abbc740 10 client.15564 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T10:39:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.388+0000 7faa2abbc740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:45.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.388+0000 7faa2abbc740 20 client.15564 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.388+0000 7faa2abbc740 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x557e3a703ba0 0x557e3a705f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.388+0000 7faa2abbc740 4 client.15564 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:39:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.388+0000 7faa2abbc740 1 -- 172.21.15.92:0/2896323145 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e3a65aa20 con 0x557e3a703ba0 2024-09-10T10:39:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.388+0000 7faa25bbf640 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x557e3a703ba0 0x557e3a705f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.389+0000 7faa25bbf640 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x557e3a703ba0 0x557e3a705f90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf93a8ac90026cc6 server_cookie=75baca021d5f2b95 in_seq=0 out_seq=0 2024-09-10T10:39:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.389+0000 7faa097fa640 10 client.15564 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa097fa640 1 -- 172.21.15.92:0/2896323145 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e3a65aa20 con 0x557e3a703ba0 2024-09-10T10:39:45.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa097fa640 10 client.15564 handle_command_reply: tid=0 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa2abbc740 1 client.15564 shutdown 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa2abbc740 1 -- 172.21.15.92:0/2896323145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 msgr2=0x557e3a6f11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa2abbc740 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6f11f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faa1000bdb0 tx=0x7faa1006ddd0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa2abbc740 1 -- 172.21.15.92:0/2896323145 shutdown_connections 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa2abbc740 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x557e3a703ba0 0x557e3a705f90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa2abbc740 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 0x557e3a6f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa2abbc740 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6f11f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa2abbc740 1 --2- 172.21.15.92:0/2896323145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 0x557e3a6f0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa2abbc740 1 -- 172.21.15.92:0/2896323145 >> 172.21.15.92:0/2896323145 conn(0x557e3a6e5060 msgr2=0x557e3a6eadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:45.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.390+0000 7faa097fa640 0 client.15564 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.391+0000 7faa2abbc740 1 -- 172.21.15.92:0/2896323145 shutdown_connections 2024-09-10T10:39:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.391+0000 7faa2abbc740 1 -- 172.21.15.92:0/2896323145 wait complete. 2024-09-10T10:39:45.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.391+0000 7faa2abbc740 20 client.15564 trim_cache size 0 max 16384 2024-09-10T10:39:45.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa2abbc740 1 Processor -- start 2024-09-10T10:39:45.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa2abbc740 1 -- start start 2024-09-10T10:39:45.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 0x557e3a6f1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6eacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 0x557e3a70b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa253be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6eacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa253be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6eacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50926/0 (socket says 172.21.15.92:50926) 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa253be640 1 -- 172.21.15.92:0/4062697568 learned_addr learned my addr 172.21.15.92:0/4062697568 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa25bbf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 0x557e3a6f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa2abbc740 1 -- 172.21.15.92:0/4062697568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa201ab590 con 0x557e3a6e9410 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa2abbc740 1 -- 172.21.15.92:0/4062697568 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faa201ad1f0 con 0x557e3a6f3cb0 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.409+0000 7faa2abbc740 1 -- 172.21.15.92:0/4062697568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa201abcc0 con 0x557e3a6e8af0 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa263c0640 1 --2- 172.21.15.92:0/4062697568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 0x557e3a70b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa25bbf640 1 -- 172.21.15.92:0/4062697568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 msgr2=0x557e3a70b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa25bbf640 1 --2- 172.21.15.92:0/4062697568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 0x557e3a70b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa25bbf640 1 -- 172.21.15.92:0/4062697568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 msgr2=0x557e3a6eacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa25bbf640 1 --2- 172.21.15.92:0/4062697568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6eacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa25bbf640 1 -- 172.21.15.92:0/4062697568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3a6e02d0 con 0x557e3a6e8af0 2024-09-10T10:39:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa25bbf640 1 --2- 172.21.15.92:0/4062697568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 0x557e3a6f1560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x557e3a706590 tx=0x7faa18012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749f5c47424b030a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa0b7fe640 1 -- 172.21.15.92:0/4062697568 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1801e4f0 con 0x557e3a6e8af0 2024-09-10T10:39:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa0b7fe640 1 -- 172.21.15.92:0/4062697568 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa1801eb70 con 0x557e3a6e8af0 2024-09-10T10:39:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.410+0000 7faa0b7fe640 1 -- 172.21.15.92:0/4062697568 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18024b00 con 0x557e3a6e8af0 2024-09-10T10:39:45.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 -- 172.21.15.92:0/4062697568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 msgr2=0x557e3a6f1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 --2- 172.21.15.92:0/4062697568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 0x557e3a6f1560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x557e3a706590 tx=0x7faa18012000 comp rx=0 tx=0).stop 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 -- 172.21.15.92:0/4062697568 shutdown_connections 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 --2- 172.21.15.92:0/4062697568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6f3cb0 0x557e3a70b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 --2- 172.21.15.92:0/4062697568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6e9410 0x557e3a6eacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 --2- 172.21.15.92:0/4062697568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e8af0 0x557e3a6f1560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 -- 172.21.15.92:0/4062697568 >> 172.21.15.92:0/4062697568 conn(0x557e3a6e5060 msgr2=0x557e3a6ea5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 -- 172.21.15.92:0/4062697568 shutdown_connections 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 -- 172.21.15.92:0/4062697568 wait complete. 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 -- start start 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.411+0000 7faa2abbc740 1 Processor -- start 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e8af0 0x557e3a6fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e9410 0x557e3a6ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa2abbc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6f3cb0 0x557e3a6edc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa2abbc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa201acb20 con 0x557e3a6f3cb0 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa2abbc740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faa201ac390 con 0x557e3a6e8af0 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa2abbc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa201a95f0 con 0x557e3a6e9410 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa2abbc740 10 client.0 _ll_register_callbacks cb 0x7faa1c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa263c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6f3cb0 0x557e3a6edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa263c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6f3cb0 0x557e3a6edc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50940/0 (socket says 172.21.15.92:50940) 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa263c0640 1 -- 172.21.15.92:0/1107109599 learned_addr learned my addr 172.21.15.92:0/1107109599 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa253be640 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e9410 0x557e3a6ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.412+0000 7faa25bbf640 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e8af0 0x557e3a6fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.413+0000 7faa263c0640 1 -- 172.21.15.92:0/1107109599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e9410 msgr2=0x557e3a6ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.413+0000 7faa263c0640 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e9410 0x557e3a6ed6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.413+0000 7faa263c0640 1 -- 172.21.15.92:0/1107109599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e8af0 msgr2=0x557e3a6fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.413+0000 7faa263c0640 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e8af0 0x557e3a6fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.413+0000 7faa263c0640 1 -- 172.21.15.92:0/1107109599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e3a6ee160 con 0x557e3a6f3cb0 2024-09-10T10:39:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.413+0000 7faa263c0640 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6f3cb0 0x557e3a6edc20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faa1c02a930 tx=0x7faa1c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d1ba78ed0ee9ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.413+0000 7faa097fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:39:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.413+0000 7faa097fa640 1 -- 172.21.15.92:0/1107109599 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c004e20 con 0x557e3a6f3cb0 2024-09-10T10:39:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.413+0000 7faa2abbc740 1 -- 172.21.15.92:0/1107109599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa1801eb70 con 0x557e3a6f3cb0 2024-09-10T10:39:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.414+0000 7faa097fa640 1 -- 172.21.15.92:0/1107109599 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7faa1c03f440 con 0x557e3a6f3cb0 2024-09-10T10:39:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.414+0000 7faa097fa640 1 -- 172.21.15.92:0/1107109599 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7faa1c05a050 con 0x557e3a6f3cb0 2024-09-10T10:39:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.414+0000 7faa2abbc740 10 client.15570 fetch_fsmap learned FSMap version 37 2024-09-10T10:39:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.414+0000 7faa2abbc740 1 -- 172.21.15.92:0/1107109599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557e3a76e300 con 0x557e3a6f3cb0 2024-09-10T10:39:45.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.414+0000 7faa097fa640 1 -- 172.21.15.92:0/1107109599 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa1801eb70 con 0x557e3a6f3cb0 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa097fa640 1 -- 172.21.15.92:0/1107109599 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7faa1c031920 con 0x557e3a6f3cb0 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa2abbc740 10 client.15570 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa2abbc740 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa2abbc740 20 client.15570 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa2abbc740 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x557e3a76eb20 0x557e3a770f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa2abbc740 4 client.15570 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa2abbc740 1 -- 172.21.15.92:0/1107109599 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e3a654d70 con 0x557e3a76eb20 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa25bbf640 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x557e3a76eb20 0x557e3a770f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa097fa640 10 client.15570 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:45.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.415+0000 7faa25bbf640 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x557e3a76eb20 0x557e3a770f40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7431b8cc07f18e66 server_cookie=bd3ccb564fa2d9ce in_seq=0 out_seq=0 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa097fa640 1 -- 172.21.15.92:0/1107109599 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e3a654d70 con 0x557e3a76eb20 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa097fa640 10 client.15570 handle_command_reply: tid=0 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 client.15570 shutdown 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 -- 172.21.15.92:0/1107109599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6f3cb0 msgr2=0x557e3a6edc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6f3cb0 0x557e3a6edc20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faa1c02a930 tx=0x7faa1c004b50 comp rx=0 tx=0).stop 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 -- 172.21.15.92:0/1107109599 shutdown_connections 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e3a6f3cb0 0x557e3a6edc20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557e3a6e9410 0x557e3a6ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x557e3a76eb20 0x557e3a770f40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 --2- 172.21.15.92:0/1107109599 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x557e3a6e8af0 0x557e3a6fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa097fa640 0 client.15570 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 -- 172.21.15.92:0/1107109599 >> 172.21.15.92:0/1107109599 conn(0x557e3a6e5060 msgr2=0x557e3a6e41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 -- 172.21.15.92:0/1107109599 shutdown_connections 2024-09-10T10:39:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 1 -- 172.21.15.92:0/1107109599 wait complete. 2024-09-10T10:39:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.424+0000 7faa2abbc740 20 client.15570 trim_cache size 0 max 16384 2024-09-10T10:39:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:39:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:39:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:39:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:39:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 -- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faa0c0a2f00 msgr2=0x7faa0c0a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faa0c0a2f00 0x7faa0c0a53c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faa18007ec0 tx=0x7faa180075b0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 -- 172.21.15.92:0/1598781946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 msgr2=0x7faa2019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 0x7faa2019abd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faa1000b3f0 tx=0x7faa1000b8b0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 -- 172.21.15.92:0/1598781946 shutdown_connections 2024-09-10T10:39:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faa0c0a2f00 0x7faa0c0a53c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faa20103aa0 0x7faa2019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201008e0 0x7faa2019abd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 --2- 172.21.15.92:0/1598781946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa200fff60 0x7faa2019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 -- 172.21.15.92:0/1598781946 >> 172.21.15.92:0/1598781946 conn(0x7faa200770f0 msgr2=0x7faa20105960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 -- 172.21.15.92:0/1598781946 shutdown_connections 2024-09-10T10:39:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:45.425+0000 7faa27e23640 1 -- 172.21.15.92:0/1598781946 wait complete. 2024-09-10T10:39:45.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:45 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:39:45.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:45 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:39:45.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:45 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:39:45.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:45 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:39:45.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:45 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:39:45.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:45 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:39:45.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:45 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:39:45.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:45 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:39:45.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:45 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:39:45.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:45 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:39:45.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:45 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:39:45.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:45 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:39:46.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:46 smithi121 ceph-mon[35231]: pgmap v97: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 MiB/s wr, 790 op/s 2024-09-10T10:39:46.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:46 smithi097 ceph-mon[35213]: pgmap v97: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 MiB/s wr, 790 op/s 2024-09-10T10:39:46.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:46 smithi092 ceph-mon[30834]: pgmap v97: 97 pgs: 97 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 MiB/s wr, 790 op/s 2024-09-10T10:39:47.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:47 smithi121 ceph-mon[35231]: pgmap v98: 97 pgs: 97 active+clean; 2.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 763 op/s 2024-09-10T10:39:47.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:47 smithi097 ceph-mon[35213]: pgmap v98: 97 pgs: 97 active+clean; 2.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 763 op/s 2024-09-10T10:39:47.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:47 smithi092 ceph-mon[30834]: pgmap v98: 97 pgs: 97 active+clean; 2.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.4 MiB/s wr, 763 op/s 2024-09-10T10:39:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 170.0 s, 3406.8 tps, lat 29.364 ms stddev 29.351 2024-09-10T10:39:49.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:49 smithi121 ceph-mon[35231]: pgmap v99: 97 pgs: 97 active+clean; 2.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 608 op/s 2024-09-10T10:39:49.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:49 smithi097 ceph-mon[35213]: pgmap v99: 97 pgs: 97 active+clean; 2.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 608 op/s 2024-09-10T10:39:49.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:49 smithi092 ceph-mon[30834]: pgmap v99: 97 pgs: 97 active+clean; 2.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 608 op/s 2024-09-10T10:39:51.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:51 smithi121 ceph-mon[35231]: pgmap v100: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 917 op/s 2024-09-10T10:39:51.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:51 smithi097 ceph-mon[35213]: pgmap v100: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 917 op/s 2024-09-10T10:39:51.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:51 smithi092 ceph-mon[30834]: pgmap v100: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 917 op/s 2024-09-10T10:39:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 175.0 s, 3319.6 tps, lat 30.028 ms stddev 31.179 2024-09-10T10:39:53.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:53 smithi121 ceph-mon[35231]: pgmap v101: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 618 op/s 2024-09-10T10:39:53.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:53 smithi097 ceph-mon[35213]: pgmap v101: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 618 op/s 2024-09-10T10:39:53.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:53 smithi092 ceph-mon[30834]: pgmap v101: 97 pgs: 97 active+clean; 2.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 618 op/s 2024-09-10T10:39:55.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:55 smithi121 ceph-mon[35231]: pgmap v102: 97 pgs: 97 active+clean; 2.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.8 MiB/s wr, 820 op/s 2024-09-10T10:39:55.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:55 smithi097 ceph-mon[35213]: pgmap v102: 97 pgs: 97 active+clean; 2.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.8 MiB/s wr, 820 op/s 2024-09-10T10:39:55.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:55 smithi092 ceph-mon[30834]: pgmap v102: 97 pgs: 97 active+clean; 2.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.8 MiB/s wr, 820 op/s 2024-09-10T10:39:57.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:57 smithi121 ceph-mon[35231]: pgmap v103: 97 pgs: 97 active+clean; 2.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 MiB/s wr, 795 op/s 2024-09-10T10:39:57.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:57 smithi097 ceph-mon[35213]: pgmap v103: 97 pgs: 97 active+clean; 2.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 MiB/s wr, 795 op/s 2024-09-10T10:39:57.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:57 smithi092 ceph-mon[30834]: pgmap v103: 97 pgs: 97 active+clean; 2.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 MiB/s wr, 795 op/s 2024-09-10T10:39:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 180.0 s, 3331.0 tps, lat 30.024 ms stddev 35.068 2024-09-10T10:39:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.562+0000 7efeac191640 1 -- 172.21.15.92:0/2744084086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea4102cc0 msgr2=0x7efea41030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.562+0000 7efeac191640 1 --2- 172.21.15.92:0/2744084086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea4102cc0 0x7efea41030a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efea0009900 tx=0x7efea002a480 comp rx=0 tx=0).stop 2024-09-10T10:39:58.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.562+0000 7efeac191640 1 -- 172.21.15.92:0/2744084086 shutdown_connections 2024-09-10T10:39:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.562+0000 7efeac191640 1 --2- 172.21.15.92:0/2744084086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efea410c0e0 0x7efea410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.562+0000 7efeac191640 1 --2- 172.21.15.92:0/2744084086 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea41035e0 0x7efea410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.562+0000 7efeac191640 1 --2- 172.21.15.92:0/2744084086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea4102cc0 0x7efea41030a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.562+0000 7efeac191640 1 -- 172.21.15.92:0/2744084086 >> 172.21.15.92:0/2744084086 conn(0x7efea4077990 msgr2=0x7efea40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.563+0000 7efeac191640 1 -- 172.21.15.92:0/2744084086 shutdown_connections 2024-09-10T10:39:58.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.563+0000 7efeac191640 1 -- 172.21.15.92:0/2744084086 wait complete. 2024-09-10T10:39:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.563+0000 7efeac191640 1 Processor -- start 2024-09-10T10:39:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.563+0000 7efeac191640 1 -- start start 2024-09-10T10:39:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efeac191640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea4102cc0 0x7efea41a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efeac191640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efea41035e0 0x7efea41a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efeac191640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea410c0e0 0x7efea410a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efeac191640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efea4111f00 con 0x7efea410c0e0 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efea9f2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea4102cc0 0x7efea41a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efea9f2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea4102cc0 0x7efea41a4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:38948/0 (socket says 172.21.15.92:38948) 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efea9f2d640 1 -- 172.21.15.92:0/2907303643 learned_addr learned my addr 172.21.15.92:0/2907303643 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efea4111d80 con 0x7efea4102cc0 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efea4112080 con 0x7efea41035e0 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.564+0000 7efeaa72e640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea410c0e0 0x7efea410a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.565+0000 7efea972c640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efea41035e0 0x7efea41a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.565+0000 7efea9f2d640 1 -- 172.21.15.92:0/2907303643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efea41035e0 msgr2=0x7efea41a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.565+0000 7efea9f2d640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efea41035e0 0x7efea41a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.565+0000 7efea9f2d640 1 -- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea410c0e0 msgr2=0x7efea410a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:58.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.565+0000 7efea9f2d640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea410c0e0 0x7efea410a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.565+0000 7efea9f2d640 1 -- 172.21.15.92:0/2907303643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea410b170 con 0x7efea4102cc0 2024-09-10T10:39:58.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.565+0000 7efeaa72e640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea410c0e0 0x7efea410a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:58.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.565+0000 7efea9f2d640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea4102cc0 0x7efea41a4400 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efea0009850 tx=0x7efea0030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.565+0000 7efe9affd640 1 -- 172.21.15.92:0/2907303643 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea003f070 con 0x7efea4102cc0 2024-09-10T10:39:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.566+0000 7efe9affd640 1 -- 172.21.15.92:0/2907303643 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea0004460 con 0x7efea4102cc0 2024-09-10T10:39:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.566+0000 7efe9affd640 1 -- 172.21.15.92:0/2907303643 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0035030 con 0x7efea4102cc0 2024-09-10T10:39:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.566+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea410b400 con 0x7efea4102cc0 2024-09-10T10:39:58.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.566+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea41ab250 con 0x7efea4102cc0 2024-09-10T10:39:58.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.569+0000 7efe9affd640 1 -- 172.21.15.92:0/2907303643 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7efea0042070 con 0x7efea4102cc0 2024-09-10T10:39:58.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.569+0000 7efeaf00d740 1 Processor -- start 2024-09-10T10:39:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efeaf00d740 1 -- start start 2024-09-10T10:39:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c2977eaf0 0x556c2977eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c29789770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c29789cb0 0x556c2978c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efeaf00d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c296e32f0 con 0x556c29789cb0 2024-09-10T10:39:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efeaf00d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556c2968b270 con 0x556c2977f410 2024-09-10T10:39:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efeaf00d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556c296df2b0 con 0x556c2977eaf0 2024-09-10T10:39:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efea9f2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c29789770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efea972c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c29789cb0 0x556c2978c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efea9f2d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c29789770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:38958/0 (socket says 172.21.15.92:38958) 2024-09-10T10:39:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efea9f2d640 1 -- 172.21.15.92:0/3543312447 learned_addr learned my addr 172.21.15.92:0/3543312447 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efeaa72e640 1 --2- 172.21.15.92:0/3543312447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c2977eaf0 0x556c2977eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efea9f2d640 1 -- 172.21.15.92:0/3543312447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c2977eaf0 msgr2=0x556c2977eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efea9f2d640 1 --2- 172.21.15.92:0/3543312447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c2977eaf0 0x556c2977eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efea9f2d640 1 -- 172.21.15.92:0/3543312447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c29789cb0 msgr2=0x556c2978c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:58.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efea9f2d640 1 --2- 172.21.15.92:0/3543312447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c29789cb0 0x556c2978c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.570+0000 7efea9f2d640 1 -- 172.21.15.92:0/3543312447 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c2968a340 con 0x556c2977f410 2024-09-10T10:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.571+0000 7efea972c640 1 --2- 172.21.15.92:0/3543312447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c29789cb0 0x556c2978c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.571+0000 7efea9f2d640 1 --2- 172.21.15.92:0/3543312447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c29789770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efea00ecf60 tx=0x7efea00f5cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=501d7b22be89983f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.571+0000 7efe9affd640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe900a2e20 0x7efe900a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.571+0000 7efe8ffff640 1 -- 172.21.15.92:0/3543312447 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00fe070 con 0x556c2977f410 2024-09-10T10:39:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.571+0000 7efe8ffff640 1 -- 172.21.15.92:0/3543312447 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea00b8510 con 0x556c2977f410 2024-09-10T10:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.571+0000 7efe8ffff640 1 -- 172.21.15.92:0/3543312447 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00f7c90 con 0x556c2977f410 2024-09-10T10:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.571+0000 7efeaa72e640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe900a2e20 0x7efe900a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.571+0000 7efe9affd640 1 -- 172.21.15.92:0/2907303643 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7efea00ef8c0 con 0x7efea4102cc0 2024-09-10T10:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.572+0000 7efeaf00d740 1 -- 172.21.15.92:0/3543312447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 msgr2=0x556c29789770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.572+0000 7efeaf00d740 1 --2- 172.21.15.92:0/3543312447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c29789770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efea00ecf60 tx=0x7efea00f5cb0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.572+0000 7efeaf00d740 1 -- 172.21.15.92:0/3543312447 shutdown_connections 2024-09-10T10:39:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.572+0000 7efeaf00d740 1 --2- 172.21.15.92:0/3543312447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c29789cb0 0x556c2978c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.572+0000 7efeaf00d740 1 --2- 172.21.15.92:0/3543312447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c29789770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.572+0000 7efeaf00d740 1 --2- 172.21.15.92:0/3543312447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c2977eaf0 0x556c2977eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.572+0000 7efeaf00d740 1 -- 172.21.15.92:0/3543312447 >> 172.21.15.92:0/3543312447 conn(0x556c2977b060 msgr2=0x556c2977b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.572+0000 7efeaa72e640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe900a2e20 0x7efe900a52e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009fd0 tx=0x7efe9c009500 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.573+0000 7efeaf00d740 1 -- 172.21.15.92:0/3543312447 shutdown_connections 2024-09-10T10:39:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.573+0000 7efeaf00d740 1 -- 172.21.15.92:0/3543312447 wait complete. 2024-09-10T10:39:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.574+0000 7efeaf00d740 1 -- start start 2024-09-10T10:39:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.574+0000 7efeaf00d740 1 Processor -- start 2024-09-10T10:39:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.575+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29786bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.575+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297870f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.575+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 0x556c29787630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.575+0000 7efeaf00d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c2979d650 con 0x556c2977eaf0 2024-09-10T10:39:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.575+0000 7efeaf00d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556c2966c290 con 0x556c2977f410 2024-09-10T10:39:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.575+0000 7efeaf00d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556c2979d7d0 con 0x556c29789cb0 2024-09-10T10:39:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.575+0000 7efeaf00d740 10 client.0 _ll_register_callbacks cb 0x556c2969d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efeaa72e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 0x556c29787630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea9f2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29786bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea9f2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29786bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42402/0 (socket says 172.21.15.92:42402) 2024-09-10T10:39:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea9f2d640 1 -- 172.21.15.92:0/1903294635 learned_addr learned my addr 172.21.15.92:0/1903294635 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea972c640 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297870f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea9f2d640 1 -- 172.21.15.92:0/1903294635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 msgr2=0x556c29787630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea9f2d640 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 0x556c29787630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea9f2d640 1 -- 172.21.15.92:0/1903294635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 msgr2=0x556c297870f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea9f2d640 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297870f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea9f2d640 1 -- 172.21.15.92:0/1903294635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c293f6210 con 0x556c2977eaf0 2024-09-10T10:39:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.576+0000 7efea972c640 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297870f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.577+0000 7efea9f2d640 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29786bb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efea00c4530 tx=0x7efea0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44b06be6226e93a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.577+0000 7efe8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:39:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.577+0000 7efe8d7fa640 1 -- 172.21.15.92:0/1903294635 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0049030 con 0x556c2977eaf0 2024-09-10T10:39:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.578+0000 7efeaf00d740 1 -- 172.21.15.92:0/1903294635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea00b8510 con 0x556c2977eaf0 2024-09-10T10:39:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.578+0000 7efe8d7fa640 1 -- 172.21.15.92:0/1903294635 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7efea00f5730 con 0x556c2977eaf0 2024-09-10T10:39:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.578+0000 7efe8d7fa640 1 -- 172.21.15.92:0/1903294635 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7efea00fe070 con 0x556c2977eaf0 2024-09-10T10:39:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.578+0000 7efeaf00d740 10 client.15582 fetch_fsmap learned FSMap version 37 2024-09-10T10:39:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.578+0000 7efeaf00d740 1 -- 172.21.15.92:0/1903294635 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556c294c2620 con 0x556c2977eaf0 2024-09-10T10:39:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.579+0000 7efe8d7fa640 1 -- 172.21.15.92:0/1903294635 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea00bf070 con 0x556c2977eaf0 2024-09-10T10:39:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.579+0000 7efe8d7fa640 1 -- 172.21.15.92:0/1903294635 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7efea00ed2a0 con 0x556c2977eaf0 2024-09-10T10:39:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.579+0000 7efeaf00d740 10 client.15582 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T10:39:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.579+0000 7efeaf00d740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.579+0000 7efeaf00d740 20 client.15582 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.579+0000 7efeaf00d740 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556c297aa8d0 0x556c297accc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.579+0000 7efeaf00d740 4 client.15582 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:39:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.579+0000 7efeaf00d740 1 -- 172.21.15.92:0/1903294635 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efea00b8510 con 0x556c297aa8d0 2024-09-10T10:39:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.580+0000 7efea972c640 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556c297aa8d0 0x556c297accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.580+0000 7efea972c640 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556c297aa8d0 0x556c297accc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=229eaa2cb2f29d2c server_cookie=ddd7d2a991335730 in_seq=0 out_seq=0 2024-09-10T10:39:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.580+0000 7efe8d7fa640 10 client.15582 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.581+0000 7efe8d7fa640 1 -- 172.21.15.92:0/1903294635 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7efea00b8510 con 0x556c297aa8d0 2024-09-10T10:39:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.581+0000 7efe8d7fa640 10 client.15582 handle_command_reply: tid=0 2024-09-10T10:39:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.581+0000 7efeaf00d740 1 client.15582 shutdown 2024-09-10T10:39:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 -- 172.21.15.92:0/1903294635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 msgr2=0x556c29786bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29786bb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efea00c4530 tx=0x7efea0004610 comp rx=0 tx=0).stop 2024-09-10T10:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 -- 172.21.15.92:0/1903294635 shutdown_connections 2024-09-10T10:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 0x556c29787630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556c297aa8d0 0x556c297accc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297870f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 --2- 172.21.15.92:0/1903294635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29786bb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efe8d7fa640 0 client.15582 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 -- 172.21.15.92:0/1903294635 >> 172.21.15.92:0/1903294635 conn(0x556c2977b060 msgr2=0x556c29780d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 -- 172.21.15.92:0/1903294635 shutdown_connections 2024-09-10T10:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 1 -- 172.21.15.92:0/1903294635 wait complete. 2024-09-10T10:39:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.582+0000 7efeaf00d740 20 client.15582 trim_cache size 0 max 16384 2024-09-10T10:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.609+0000 7efeaf00d740 1 Processor -- start 2024-09-10T10:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.609+0000 7efeaf00d740 1 -- start start 2024-09-10T10:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.609+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29788b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.609+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c2977f410 0x556c29787460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.609+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c29789cb0 0x556c297b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.609+0000 7efeaf00d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efea41ab560 con 0x556c2977eaf0 2024-09-10T10:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.609+0000 7efeaf00d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efea41ad1c0 con 0x556c29789cb0 2024-09-10T10:39:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.609+0000 7efeaf00d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efea41abc90 con 0x556c2977f410 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efeaa72e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c29789cb0 0x556c297b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efea9f2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29788b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efeaa72e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c29789cb0 0x556c297b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:38974/0 (socket says 172.21.15.92:38974) 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efeaa72e640 1 -- 172.21.15.92:0/3531402000 learned_addr learned my addr 172.21.15.92:0/3531402000 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efeaa72e640 1 -- 172.21.15.92:0/3531402000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c2977f410 msgr2=0x556c29787460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efeaa72e640 1 --2- 172.21.15.92:0/3531402000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c2977f410 0x556c29787460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efeaa72e640 1 -- 172.21.15.92:0/3531402000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 msgr2=0x556c29788b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efeaa72e640 1 --2- 172.21.15.92:0/3531402000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29788b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efeaa72e640 1 -- 172.21.15.92:0/3531402000 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c297ad030 con 0x556c29789cb0 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efea9f2d640 1 --2- 172.21.15.92:0/3531402000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29788b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.610+0000 7efeaa72e640 1 --2- 172.21.15.92:0/3531402000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c29789cb0 0x556c297b2540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe9c003e10 tx=0x7efe9c01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31433e56a656fe55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.611+0000 7efe8f7fe640 1 -- 172.21.15.92:0/3531402000 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00fda0 con 0x556c29789cb0 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.611+0000 7efe8f7fe640 1 -- 172.21.15.92:0/3531402000 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe9c0045c0 con 0x556c29789cb0 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.611+0000 7efe8f7fe640 1 -- 172.21.15.92:0/3531402000 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c01f690 con 0x556c29789cb0 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.611+0000 7efeaf00d740 1 -- 172.21.15.92:0/3531402000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c29789cb0 msgr2=0x556c297b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.612+0000 7efeaf00d740 1 --2- 172.21.15.92:0/3531402000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c29789cb0 0x556c297b2540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe9c003e10 tx=0x7efe9c01b000 comp rx=0 tx=0).stop 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.612+0000 7efeaf00d740 1 -- 172.21.15.92:0/3531402000 shutdown_connections 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.612+0000 7efeaf00d740 1 --2- 172.21.15.92:0/3531402000 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c29789cb0 0x556c297b2540 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.612+0000 7efeaf00d740 1 --2- 172.21.15.92:0/3531402000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c2977f410 0x556c29787460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.612+0000 7efeaf00d740 1 --2- 172.21.15.92:0/3531402000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c29788b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.612+0000 7efeaf00d740 1 -- 172.21.15.92:0/3531402000 >> 172.21.15.92:0/3531402000 conn(0x556c2977b060 msgr2=0x556c29788410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.612+0000 7efeaf00d740 1 -- 172.21.15.92:0/3531402000 shutdown_connections 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.612+0000 7efeaf00d740 1 -- 172.21.15.92:0/3531402000 wait complete. 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efeaf00d740 1 -- start start 2024-09-10T10:39:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efeaf00d740 1 Processor -- start 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c297a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297a3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efeaf00d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 0x556c2979e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efeaf00d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efea41acaf0 con 0x556c2977eaf0 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efeaf00d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efea41ac360 con 0x556c2977f410 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efeaf00d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efea419df10 con 0x556c29789cb0 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efeaf00d740 10 client.0 _ll_register_callbacks cb 0x7efe940097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efea9f2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c297a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efea9f2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c297a2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42424/0 (socket says 172.21.15.92:42424) 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efea9f2d640 1 -- 172.21.15.92:0/2073056497 learned_addr learned my addr 172.21.15.92:0/2073056497 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.613+0000 7efea972c640 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efeaa72e640 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 0x556c2979e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efea9f2d640 1 -- 172.21.15.92:0/2073056497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 msgr2=0x556c2979e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efea9f2d640 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 0x556c2979e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efea9f2d640 1 -- 172.21.15.92:0/2073056497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 msgr2=0x556c297a3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efea9f2d640 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297a3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efea9f2d640 1 -- 172.21.15.92:0/2073056497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c2979eb80 con 0x556c2977eaf0 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efea972c640 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297a3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efea9f2d640 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c297a2de0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efea00f7670 tx=0x7efea00f5cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06a1db34be23289 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efe8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efe8d7fa640 1 -- 172.21.15.92:0/2073056497 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0049040 con 0x556c2977eaf0 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.614+0000 7efe8d7fa640 1 -- 172.21.15.92:0/2073056497 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7efea00ed2a0 con 0x556c2977eaf0 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.615+0000 7efeaf00d740 1 -- 172.21.15.92:0/2073056497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe9c0045c0 con 0x556c2977eaf0 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.615+0000 7efe8d7fa640 1 -- 172.21.15.92:0/2073056497 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7efea000b0b0 con 0x556c2977eaf0 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.615+0000 7efeaf00d740 10 client.15588 fetch_fsmap learned FSMap version 37 2024-09-10T10:39:58.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.615+0000 7efeaf00d740 1 -- 172.21.15.92:0/2073056497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556c2979eb80 con 0x556c2977eaf0 2024-09-10T10:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.616+0000 7efe8d7fa640 1 -- 172.21.15.92:0/2073056497 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efea00bf040 con 0x556c2977eaf0 2024-09-10T10:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.616+0000 7efe8d7fa640 1 -- 172.21.15.92:0/2073056497 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) ==== 8402+0+0 (secure 0 0 0) 0x7efea00c45d0 con 0x556c2977eaf0 2024-09-10T10:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.616+0000 7efeaf00d740 10 client.15588 fetch_fsmap finished waiting for FSMap version 37 2024-09-10T10:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.616+0000 7efeaf00d740 10 client.15588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.616+0000 7efeaf00d740 20 client.15588 populate_metadata read hostname 'smithi092' 2024-09-10T10:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.616+0000 7efeaf00d740 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556c297aa8d0 0x556c298175b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.616+0000 7efeaf00d740 4 client.15588 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:39:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.616+0000 7efeaf00d740 1 -- 172.21.15.92:0/2073056497 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7efe9c0045c0 con 0x556c297aa8d0 2024-09-10T10:39:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.617+0000 7efea972c640 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556c297aa8d0 0x556c298175b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:39:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.618+0000 7efea972c640 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556c297aa8d0 0x556c298175b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=889c7f8792818b57 server_cookie=f0385e7548a53702 in_seq=0 out_seq=0 2024-09-10T10:39:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.618+0000 7efe8d7fa640 10 client.15588 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efe8d7fa640 1 -- 172.21.15.92:0/2073056497 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7efe9c0045c0 con 0x556c297aa8d0 2024-09-10T10:39:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efe8d7fa640 10 client.15588 handle_command_reply: tid=0 2024-09-10T10:39:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 client.15588 shutdown 2024-09-10T10:39:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 -- 172.21.15.92:0/2073056497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 msgr2=0x556c297a2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:58.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c297a2de0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efea00f7670 tx=0x7efea00f5cb0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 -- 172.21.15.92:0/2073056497 shutdown_connections 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c29789cb0 0x556c2979e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556c297aa8d0 0x556c298175b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556c2977f410 0x556c297a3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efe8d7fa640 0 client.15588 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 --2- 172.21.15.92:0/2073056497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c2977eaf0 0x556c297a2de0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 -- 172.21.15.92:0/2073056497 >> 172.21.15.92:0/2073056497 conn(0x556c2977b060 msgr2=0x556c29780d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 -- 172.21.15.92:0/2073056497 shutdown_connections 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.627+0000 7efeaf00d740 1 -- 172.21.15.92:0/2073056497 wait complete. 2024-09-10T10:39:58.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.628+0000 7efeaf00d740 20 client.15588 trim_cache size 0 max 16384 2024-09-10T10:39:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:39:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:39:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:39:58.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:39:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe900a2e20 msgr2=0x7efe900a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe900a2e20 0x7efe900a52e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe9c009fd0 tx=0x7efe9c009500 comp rx=0 tx=0).stop 2024-09-10T10:39:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea4102cc0 msgr2=0x7efea41a4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:39:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea4102cc0 0x7efea41a4400 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efea0009850 tx=0x7efea0030650 comp rx=0 tx=0).stop 2024-09-10T10:39:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 shutdown_connections 2024-09-10T10:39:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efea410c0e0 0x7efea410a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efea41035e0 0x7efea41a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe900a2e20 0x7efe900a52e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 --2- 172.21.15.92:0/2907303643 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efea4102cc0 0x7efea41a4400 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:39:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.629+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 >> 172.21.15.92:0/2907303643 conn(0x7efea4077990 msgr2=0x7efea4100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:39:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.630+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 shutdown_connections 2024-09-10T10:39:58.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:39:58.630+0000 7efeac191640 1 -- 172.21.15.92:0/2907303643 wait complete. 2024-09-10T10:39:59.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:39:59 smithi121 ceph-mon[35231]: pgmap v104: 97 pgs: 97 active+clean; 2.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 629 op/s 2024-09-10T10:39:59.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:39:59 smithi097 ceph-mon[35213]: pgmap v104: 97 pgs: 97 active+clean; 2.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 629 op/s 2024-09-10T10:39:59.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:39:59 smithi092 ceph-mon[30834]: pgmap v104: 97 pgs: 97 active+clean; 2.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 629 op/s 2024-09-10T10:40:00.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:00 smithi121 ceph-mon[35231]: overall HEALTH_OK 2024-09-10T10:40:00.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:00 smithi097 ceph-mon[35213]: overall HEALTH_OK 2024-09-10T10:40:00.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:00 smithi092 ceph-mon[30834]: overall HEALTH_OK 2024-09-10T10:40:01.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:01 smithi121 ceph-mon[35231]: pgmap v105: 97 pgs: 97 active+clean; 2.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 29 MiB/s wr, 1.07k op/s 2024-09-10T10:40:01.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:01 smithi097 ceph-mon[35213]: pgmap v105: 97 pgs: 97 active+clean; 2.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 29 MiB/s wr, 1.07k op/s 2024-09-10T10:40:01.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:01 smithi092 ceph-mon[30834]: pgmap v105: 97 pgs: 97 active+clean; 2.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 29 MiB/s wr, 1.07k op/s 2024-09-10T10:40:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 185.0 s, 2750.4 tps, lat 36.442 ms stddev 73.404 2024-09-10T10:40:03.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:03 smithi097 ceph-mon[35213]: pgmap v106: 97 pgs: 97 active+clean; 2.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 25 MiB/s wr, 759 op/s 2024-09-10T10:40:03.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:03 smithi092 ceph-mon[30834]: pgmap v106: 97 pgs: 97 active+clean; 2.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 25 MiB/s wr, 759 op/s 2024-09-10T10:40:04.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:03 smithi121 ceph-mon[35231]: pgmap v106: 97 pgs: 97 active+clean; 2.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 25 MiB/s wr, 759 op/s 2024-09-10T10:40:05.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:05 smithi097 ceph-mon[35213]: pgmap v107: 97 pgs: 97 active+clean; 2.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 47 MiB/s wr, 1.37k op/s 2024-09-10T10:40:05.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:05 smithi092 ceph-mon[30834]: pgmap v107: 97 pgs: 97 active+clean; 2.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 47 MiB/s wr, 1.37k op/s 2024-09-10T10:40:06.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:05 smithi121 ceph-mon[35231]: pgmap v107: 97 pgs: 97 active+clean; 2.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 47 MiB/s wr, 1.37k op/s 2024-09-10T10:40:07.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:07 smithi097 ceph-mon[35213]: pgmap v108: 97 pgs: 97 active+clean; 2.8 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 69 MiB/s wr, 1.76k op/s 2024-09-10T10:40:07.843 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:07 smithi121 ceph-mon[35231]: pgmap v108: 97 pgs: 97 active+clean; 2.8 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 69 MiB/s wr, 1.76k op/s 2024-09-10T10:40:07.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:07 smithi092 ceph-mon[30834]: pgmap v108: 97 pgs: 97 active+clean; 2.8 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 69 MiB/s wr, 1.76k op/s 2024-09-10T10:40:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 190.0 s, 4029.4 tps, lat 24.800 ms stddev 39.832 2024-09-10T10:40:09.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:09 smithi097 ceph-mon[35213]: pgmap v109: 97 pgs: 97 active+clean; 2.8 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 68 MiB/s wr, 1.64k op/s 2024-09-10T10:40:09.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:09 smithi092 ceph-mon[30834]: pgmap v109: 97 pgs: 97 active+clean; 2.8 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 68 MiB/s wr, 1.64k op/s 2024-09-10T10:40:10.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:09 smithi121 ceph-mon[35231]: pgmap v109: 97 pgs: 97 active+clean; 2.8 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 68 MiB/s wr, 1.64k op/s 2024-09-10T10:40:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.762+0000 7f63882ba640 1 -- 172.21.15.92:0/3573591359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6380100930 msgr2=0x7f6380104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.762+0000 7f63882ba640 1 --2- 172.21.15.92:0/3573591359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6380100930 0x7f6380104970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f637c00d960 tx=0x7f637c02c2b0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.762+0000 7f63882ba640 1 -- 172.21.15.92:0/3573591359 shutdown_connections 2024-09-10T10:40:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.762+0000 7f63882ba640 1 --2- 172.21.15.92:0/3573591359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63801050d0 0x7f638010cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.762+0000 7f63882ba640 1 --2- 172.21.15.92:0/3573591359 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6380100930 0x7f6380104970 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.762+0000 7f63882ba640 1 --2- 172.21.15.92:0/3573591359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63800fff80 0x7f6380100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.762+0000 7f63882ba640 1 -- 172.21.15.92:0/3573591359 >> 172.21.15.92:0/3573591359 conn(0x7f63800fba30 msgr2=0x7f63800fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.763+0000 7f63882ba640 1 -- 172.21.15.92:0/3573591359 shutdown_connections 2024-09-10T10:40:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.763+0000 7f63882ba640 1 -- 172.21.15.92:0/3573591359 wait complete. 2024-09-10T10:40:11.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.764+0000 7f63882ba640 1 Processor -- start 2024-09-10T10:40:11.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.764+0000 7f63882ba640 1 -- start start 2024-09-10T10:40:11.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.764+0000 7f63882ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63800fff80 0x7f6380196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.764+0000 7f63882ba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63801050d0 0x7f6380196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.764+0000 7f63882ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638019aaf0 0x7f638019afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f63882ba640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f638010fca0 con 0x7f638019aaf0 2024-09-10T10:40:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f6386857640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638019aaf0 0x7f638019afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f6386857640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638019aaf0 0x7f638019afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60334/0 (socket says 172.21.15.92:60334) 2024-09-10T10:40:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f6386857640 1 -- 172.21.15.92:0/4174205033 learned_addr learned my addr 172.21.15.92:0/4174205033 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f638010fb20 con 0x7f63801050d0 2024-09-10T10:40:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f6385855640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63801050d0 0x7f6380196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f638010fe20 con 0x7f63800fff80 2024-09-10T10:40:11.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f6386857640 1 -- 172.21.15.92:0/4174205033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63800fff80 msgr2=0x7f6380196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:11.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f6386857640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63800fff80 0x7f6380196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f6386857640 1 -- 172.21.15.92:0/4174205033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63801050d0 msgr2=0x7f6380196770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:11.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f6386857640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63801050d0 0x7f6380196770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.765+0000 7f6386857640 1 -- 172.21.15.92:0/4174205033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638019b5e0 con 0x7f638019aaf0 2024-09-10T10:40:11.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.766+0000 7f6385855640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63801050d0 0x7f6380196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:40:11.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.766+0000 7f6386857640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638019aaf0 0x7f638019afa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6378009fd0 tx=0x7f637800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.766+0000 7f63777fe640 1 -- 172.21.15.92:0/4174205033 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378004b20 con 0x7f638019aaf0 2024-09-10T10:40:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.766+0000 7f63777fe640 1 -- 172.21.15.92:0/4174205033 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6378003e50 con 0x7f638019aaf0 2024-09-10T10:40:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.766+0000 7f63777fe640 1 -- 172.21.15.92:0/4174205033 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637800b630 con 0x7f638019aaf0 2024-09-10T10:40:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.766+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638019b8d0 con 0x7f638019aaf0 2024-09-10T10:40:11.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.766+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63801a3040 con 0x7f638019aaf0 2024-09-10T10:40:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.770+0000 7f638b057740 1 Processor -- start 2024-09-10T10:40:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.772+0000 7f63777fe640 1 -- 172.21.15.92:0/4174205033 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f637801d020 con 0x7f638019aaf0 2024-09-10T10:40:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.772+0000 7f638b057740 1 -- start start 2024-09-10T10:40:11.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.773+0000 7f638b057740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x56354103fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.774+0000 7f63777fe640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f636c0a2ea0 0x7f636c0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.774+0000 7f63777fe640 1 -- 172.21.15.92:0/4174205033 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f63780cf3c0 con 0x7f638019aaf0 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.774+0000 7f638b057740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354105b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.774+0000 7f638b057740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354105bcc0 0x56354105e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f6385855640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354105b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f6385855640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354105b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:56948/0 (socket says 172.21.15.92:56948) 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f6385855640 1 -- 172.21.15.92:0/3545457772 learned_addr learned my addr 172.21.15.92:0/3545457772 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f638b057740 1 -- 172.21.15.92:0/3545457772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563540fa42f0 con 0x56354105bcc0 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f638b057740 1 -- 172.21.15.92:0/3545457772 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563540f4c270 con 0x56354103f990 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f638b057740 1 -- 172.21.15.92:0/3545457772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563540fa02b0 con 0x5635410402b0 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f6385855640 1 --2- 172.21.15.92:0/3545457772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x56354103fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f6385855640 1 -- 172.21.15.92:0/3545457772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 msgr2=0x56354103fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f6385855640 1 --2- 172.21.15.92:0/3545457772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x56354103fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f6385855640 1 -- 172.21.15.92:0/3545457772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354105bcc0 msgr2=0x56354105e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f6385855640 1 --2- 172.21.15.92:0/3545457772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354105bcc0 0x56354105e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.775+0000 7f6385855640 1 -- 172.21.15.92:0/3545457772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563540f4b340 con 0x5635410402b0 2024-09-10T10:40:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.776+0000 7f6385855640 1 --2- 172.21.15.92:0/3545457772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354105b780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f637c02c8a0 tx=0x7f637c02e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aa4a5df747ab4ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.778+0000 7f6386056640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f636c0a2ea0 0x7f636c0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.779+0000 7f6374bfe640 1 -- 172.21.15.92:0/3545457772 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c039040 con 0x5635410402b0 2024-09-10T10:40:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.779+0000 7f6374bfe640 1 -- 172.21.15.92:0/3545457772 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c032720 con 0x5635410402b0 2024-09-10T10:40:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.779+0000 7f6374bfe640 1 -- 172.21.15.92:0/3545457772 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c003af0 con 0x5635410402b0 2024-09-10T10:40:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.780+0000 7f638b057740 1 -- 172.21.15.92:0/3545457772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 msgr2=0x56354105b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.780+0000 7f638b057740 1 --2- 172.21.15.92:0/3545457772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354105b780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f637c02c8a0 tx=0x7f637c02e040 comp rx=0 tx=0).stop 2024-09-10T10:40:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.782+0000 7f6386056640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f636c0a2ea0 0x7f636c0a5360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f637000a660 tx=0x7f637000c040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.784+0000 7f638b057740 1 -- 172.21.15.92:0/3545457772 shutdown_connections 2024-09-10T10:40:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.784+0000 7f638b057740 1 --2- 172.21.15.92:0/3545457772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354105bcc0 0x56354105e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.784+0000 7f638b057740 1 --2- 172.21.15.92:0/3545457772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354105b780 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.784+0000 7f638b057740 1 --2- 172.21.15.92:0/3545457772 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x56354103fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.784+0000 7f638b057740 1 -- 172.21.15.92:0/3545457772 >> 172.21.15.92:0/3545457772 conn(0x56354103c060 msgr2=0x56354103c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.793+0000 7f638b057740 1 -- 172.21.15.92:0/3545457772 shutdown_connections 2024-09-10T10:40:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.793+0000 7f638b057740 1 -- 172.21.15.92:0/3545457772 wait complete. 2024-09-10T10:40:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.793+0000 7f638b057740 1 -- start start 2024-09-10T10:40:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.793+0000 7f638b057740 1 Processor -- start 2024-09-10T10:40:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f638b057740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x563541058e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f638b057740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635410402b0 0x5635410593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f638b057740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 0x5635410598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f638b057740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563541067010 con 0x5635410402b0 2024-09-10T10:40:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f638b057740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563540f2d290 con 0x56354103f990 2024-09-10T10:40:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f638b057740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563541067190 con 0x56354105bcc0 2024-09-10T10:40:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f6386056640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x563541058e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f638b057740 10 client.0 _ll_register_callbacks cb 0x563540f5e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:40:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f6386056640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x563541058e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:39820/0 (socket says 172.21.15.92:39820) 2024-09-10T10:40:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f6386056640 1 -- 172.21.15.92:0/1829027720 learned_addr learned my addr 172.21.15.92:0/1829027720 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.794+0000 7f6385855640 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635410402b0 0x5635410593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.795+0000 7f6386857640 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 0x5635410598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.795+0000 7f6386056640 1 -- 172.21.15.92:0/1829027720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 msgr2=0x5635410598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.795+0000 7f6386056640 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 0x5635410598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.795+0000 7f6386056640 1 -- 172.21.15.92:0/1829027720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635410402b0 msgr2=0x5635410593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.795+0000 7f6386056640 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635410402b0 0x5635410593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.795+0000 7f6386056640 1 -- 172.21.15.92:0/1829027720 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563540cb7210 con 0x56354103f990 2024-09-10T10:40:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.795+0000 7f6386056640 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x563541058e60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6370009e30 tx=0x7f63700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ce9249f89238a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.795+0000 7f6369ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:40:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.795+0000 7f6369ffb640 1 -- 172.21.15.92:0/1829027720 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63700205f0 con 0x56354103f990 2024-09-10T10:40:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.796+0000 7f638b057740 1 -- 172.21.15.92:0/1829027720 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f637c032720 con 0x56354103f990 2024-09-10T10:40:11.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.796+0000 7f6369ffb640 1 -- 172.21.15.92:0/1829027720 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f6370020790 con 0x56354103f990 2024-09-10T10:40:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.796+0000 7f6369ffb640 1 -- 172.21.15.92:0/1829027720 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f637002e050 con 0x56354103f990 2024-09-10T10:40:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.796+0000 7f638b057740 10 client.25118 fetch_fsmap learned FSMap version 38 2024-09-10T10:40:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.796+0000 7f638b057740 1 -- 172.21.15.92:0/1829027720 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563540d83620 con 0x56354103f990 2024-09-10T10:40:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.797+0000 7f6369ffb640 1 -- 172.21.15.92:0/1829027720 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6370025070 con 0x56354103f990 2024-09-10T10:40:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.797+0000 7f6369ffb640 1 -- 172.21.15.92:0/1829027720 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 38) ==== 8410+0+0 (secure 0 0 0) 0x7f6370015980 con 0x56354103f990 2024-09-10T10:40:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.797+0000 7f638b057740 10 client.25118 fetch_fsmap finished waiting for FSMap version 38 2024-09-10T10:40:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.797+0000 7f638b057740 10 client.25118 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:40:11.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.797+0000 7f638b057740 20 client.25118 populate_metadata read hostname 'smithi092' 2024-09-10T10:40:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.797+0000 7f638b057740 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563541074730 0x563541076b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.797+0000 7f638b057740 4 client.25118 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:40:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.797+0000 7f638b057740 1 -- 172.21.15.92:0/1829027720 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f637c032720 con 0x563541074730 2024-09-10T10:40:11.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.797+0000 7f6385855640 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563541074730 0x563541076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.798+0000 7f6385855640 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563541074730 0x563541076b70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddb42c5448c781d4 server_cookie=c9b0279a7132e188 in_seq=0 out_seq=0 2024-09-10T10:40:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.798+0000 7f6369ffb640 10 client.25118 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f6369ffb640 1 -- 172.21.15.92:0/1829027720 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f637c032720 con 0x563541074730 2024-09-10T10:40:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f6369ffb640 10 client.25118 handle_command_reply: tid=0 2024-09-10T10:40:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 client.25118 shutdown 2024-09-10T10:40:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 -- 172.21.15.92:0/1829027720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 msgr2=0x563541058e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x563541058e60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6370009e30 tx=0x7f63700046c0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 -- 172.21.15.92:0/1829027720 shutdown_connections 2024-09-10T10:40:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 0x5635410598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5635410402b0 0x5635410593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563541074730 0x563541076b70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 --2- 172.21.15.92:0/1829027720 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x563541058e60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 -- 172.21.15.92:0/1829027720 >> 172.21.15.92:0/1829027720 conn(0x56354103c060 msgr2=0x563541041dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f6369ffb640 0 client.25118 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.799+0000 7f638b057740 1 -- 172.21.15.92:0/1829027720 shutdown_connections 2024-09-10T10:40:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.800+0000 7f638b057740 1 -- 172.21.15.92:0/1829027720 wait complete. 2024-09-10T10:40:11.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.800+0000 7f638b057740 20 client.25118 trim_cache size 0 max 16384 2024-09-10T10:40:11.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:11 smithi097 ceph-mon[35213]: pgmap v110: 97 pgs: 97 active+clean; 2.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 84 MiB/s wr, 2.01k op/s 2024-09-10T10:40:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.821+0000 7f638b057740 1 Processor -- start 2024-09-10T10:40:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f638b057740 1 -- start start 2024-09-10T10:40:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f638b057740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354103f990 0x563541059710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f638b057740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635410402b0 0x56354107c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f6386056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354103f990 0x563541059710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f6386056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354103f990 0x563541059710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60354/0 (socket says 172.21.15.92:60354) 2024-09-10T10:40:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f638b057740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 0x56354107c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f6386056640 1 -- 172.21.15.92:0/2974285832 learned_addr learned my addr 172.21.15.92:0/2974285832 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:11.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f638b057740 1 -- 172.21.15.92:0/2974285832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6380073ee0 con 0x56354103f990 2024-09-10T10:40:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f638b057740 1 -- 172.21.15.92:0/2974285832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f63801a49f0 con 0x5635410402b0 2024-09-10T10:40:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f638b057740 1 -- 172.21.15.92:0/2974285832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f63801a3460 con 0x56354105bcc0 2024-09-10T10:40:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.822+0000 7f6385855640 1 --2- 172.21.15.92:0/2974285832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635410402b0 0x56354107c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f6386857640 1 --2- 172.21.15.92:0/2974285832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 0x56354107c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f6385855640 1 -- 172.21.15.92:0/2974285832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 msgr2=0x56354107c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f6385855640 1 --2- 172.21.15.92:0/2974285832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 0x56354107c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f6385855640 1 -- 172.21.15.92:0/2974285832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354103f990 msgr2=0x563541059710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f6385855640 1 --2- 172.21.15.92:0/2974285832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354103f990 0x563541059710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.825 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f6385855640 1 -- 172.21.15.92:0/2974285832 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354103ffb0 con 0x5635410402b0 2024-09-10T10:40:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f6385855640 1 --2- 172.21.15.92:0/2974285832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635410402b0 0x56354107c480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f637c00d930 tx=0x7f637c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a72b25fde6ecae16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f636bfff640 1 -- 172.21.15.92:0/2974285832 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c039040 con 0x5635410402b0 2024-09-10T10:40:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f636bfff640 1 -- 172.21.15.92:0/2974285832 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c0327a0 con 0x5635410402b0 2024-09-10T10:40:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.823+0000 7f636bfff640 1 -- 172.21.15.92:0/2974285832 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c0346a0 con 0x5635410402b0 2024-09-10T10:40:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.824+0000 7f638b057740 1 -- 172.21.15.92:0/2974285832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635410402b0 msgr2=0x56354107c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.824+0000 7f638b057740 1 --2- 172.21.15.92:0/2974285832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635410402b0 0x56354107c480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f637c00d930 tx=0x7f637c000bc0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.824+0000 7f638b057740 1 -- 172.21.15.92:0/2974285832 shutdown_connections 2024-09-10T10:40:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.824+0000 7f638b057740 1 --2- 172.21.15.92:0/2974285832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56354105bcc0 0x56354107c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.824+0000 7f638b057740 1 --2- 172.21.15.92:0/2974285832 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5635410402b0 0x56354107c480 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.824+0000 7f638b057740 1 --2- 172.21.15.92:0/2974285832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354103f990 0x563541059710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.824+0000 7f638b057740 1 -- 172.21.15.92:0/2974285832 >> 172.21.15.92:0/2974285832 conn(0x56354103c060 msgr2=0x563541057f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:11.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.825+0000 7f638b057740 1 -- 172.21.15.92:0/2974285832 shutdown_connections 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.825+0000 7f638b057740 1 -- 172.21.15.92:0/2974285832 wait complete. 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.826+0000 7f638b057740 1 -- start start 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.826+0000 7f638b057740 1 Processor -- start 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.826+0000 7f638b057740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x56354106c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.826+0000 7f638b057740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354106cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6386056640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x56354106c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6386056640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x56354106c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:39838/0 (socket says 172.21.15.92:39838) 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6386056640 1 -- 172.21.15.92:0/3285765805 learned_addr learned my addr 172.21.15.92:0/3285765805 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f638b057740 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354105bcc0 0x5635410554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6385855640 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354106cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f63801a4320 con 0x56354105bcc0 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f63801a3b90 con 0x56354103f990 2024-09-10T10:40:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6386857640 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354105bcc0 0x5635410554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6380071f20 con 0x5635410402b0 2024-09-10T10:40:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f638b057740 10 client.0 _ll_register_callbacks cb 0x7f63700097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:40:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6385855640 1 -- 172.21.15.92:0/3285765805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 msgr2=0x56354106c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6385855640 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x56354106c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6385855640 1 -- 172.21.15.92:0/3285765805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354105bcc0 msgr2=0x5635410554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6385855640 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354105bcc0 0x5635410554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.827+0000 7f6385855640 1 -- 172.21.15.92:0/3285765805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563541055c00 con 0x5635410402b0 2024-09-10T10:40:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.828+0000 7f6385855640 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354106cc30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56354105b630 tx=0x7f637c005bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98b9c99c37e1c4f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.828+0000 7f6369ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.828+0000 7f6369ffb640 1 -- 172.21.15.92:0/3285765805 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c039030 con 0x5635410402b0 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.828+0000 7f6369ffb640 1 -- 172.21.15.92:0/3285765805 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f637c04f3b0 con 0x5635410402b0 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.828+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f637c0327a0 con 0x5635410402b0 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.828+0000 7f6369ffb640 1 -- 172.21.15.92:0/3285765805 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f637c066050 con 0x5635410402b0 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.828+0000 7f638b057740 10 client.25159 fetch_fsmap learned FSMap version 38 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.828+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5635410dedc0 con 0x5635410402b0 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.828+0000 7f6369ffb640 1 -- 172.21.15.92:0/3285765805 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c0327a0 con 0x5635410402b0 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.829+0000 7f6369ffb640 1 -- 172.21.15.92:0/3285765805 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 38) ==== 8410+0+0 (secure 0 0 0) 0x7f637c03f070 con 0x5635410402b0 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.829+0000 7f638b057740 10 client.25159 fetch_fsmap finished waiting for FSMap version 38 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.829+0000 7f638b057740 10 client.25159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.829+0000 7f638b057740 20 client.25159 populate_metadata read hostname 'smithi092' 2024-09-10T10:40:11.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.829+0000 7f638b057740 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5635410df050 0x5635410e1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.829+0000 7f638b057740 4 client.25159 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:40:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.829+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563540fb1a20 con 0x5635410df050 2024-09-10T10:40:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.829+0000 7f6386056640 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5635410df050 0x5635410e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.829+0000 7f6369ffb640 10 client.25159 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.830+0000 7f6386056640 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5635410df050 0x5635410e1440 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a19780a33cb85f7 server_cookie=b6c28f1ce37bfe0a in_seq=0 out_seq=0 2024-09-10T10:40:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.840+0000 7f6369ffb640 1 -- 172.21.15.92:0/3285765805 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563540fb1a20 con 0x5635410df050 2024-09-10T10:40:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.840+0000 7f6369ffb640 10 client.25159 handle_command_reply: tid=0 2024-09-10T10:40:11.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.840+0000 7f638b057740 1 client.25159 shutdown 2024-09-10T10:40:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.841+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 msgr2=0x56354106cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:11.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.841+0000 7f638b057740 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354106cc30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x56354105b630 tx=0x7f637c005bf0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.842+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 shutdown_connections 2024-09-10T10:40:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.842+0000 7f638b057740 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56354105bcc0 0x5635410554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.842+0000 7f638b057740 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635410402b0 0x56354106cc30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.842+0000 7f638b057740 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5635410df050 0x5635410e1440 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.842+0000 7f638b057740 1 --2- 172.21.15.92:0/3285765805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56354103f990 0x56354106c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.842+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 >> 172.21.15.92:0/3285765805 conn(0x56354103c060 msgr2=0x563541041540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.842+0000 7f6369ffb640 0 client.25159 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.842+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 shutdown_connections 2024-09-10T10:40:11.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.843+0000 7f638b057740 1 -- 172.21.15.92:0/3285765805 wait complete. 2024-09-10T10:40:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.843+0000 7f638b057740 20 client.25159 trim_cache size 0 max 16384 2024-09-10T10:40:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:40:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:40:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:40:11.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:40:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f636c0a2ea0 msgr2=0x7f636c0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f636c0a2ea0 0x7f636c0a5360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f637000a660 tx=0x7f637000c040 comp rx=0 tx=0).stop 2024-09-10T10:40:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638019aaf0 msgr2=0x7f638019afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638019aaf0 0x7f638019afa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6378009fd0 tx=0x7f637800c800 comp rx=0 tx=0).stop 2024-09-10T10:40:11.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 shutdown_connections 2024-09-10T10:40:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f638019aaf0 0x7f638019afa0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f636c0a2ea0 0x7f636c0a5360 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f63801050d0 0x7f6380196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 --2- 172.21.15.92:0/4174205033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f63800fff80 0x7f6380196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.844+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 >> 172.21.15.92:0/4174205033 conn(0x7f63800fba30 msgr2=0x7f63800fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.845+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 shutdown_connections 2024-09-10T10:40:11.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:11.845+0000 7f63882ba640 1 -- 172.21.15.92:0/4174205033 wait complete. 2024-09-10T10:40:11.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:11 smithi092 ceph-mon[30834]: pgmap v110: 97 pgs: 97 active+clean; 2.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 84 MiB/s wr, 2.01k op/s 2024-09-10T10:40:12.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:11 smithi121 ceph-mon[35231]: pgmap v110: 97 pgs: 97 active+clean; 2.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 84 MiB/s wr, 2.01k op/s 2024-09-10T10:40:12.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:12 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:12.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:12 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:13.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:12 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 195.0 s, 3672.0 tps, lat 27.237 ms stddev 35.136 2024-09-10T10:40:13.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:13 smithi097 ceph-mon[35213]: pgmap v111: 97 pgs: 97 active+clean; 2.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 62 MiB/s wr, 1.57k op/s 2024-09-10T10:40:13.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:13 smithi092 ceph-mon[30834]: pgmap v111: 97 pgs: 97 active+clean; 2.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 62 MiB/s wr, 1.57k op/s 2024-09-10T10:40:14.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:13 smithi121 ceph-mon[35231]: pgmap v111: 97 pgs: 97 active+clean; 2.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 62 MiB/s wr, 1.57k op/s 2024-09-10T10:40:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:15 smithi092 ceph-mon[30834]: pgmap v112: 97 pgs: 97 active+clean; 3.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 70 MiB/s wr, 1.77k op/s 2024-09-10T10:40:16.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:15 smithi121 ceph-mon[35231]: pgmap v112: 97 pgs: 97 active+clean; 3.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 70 MiB/s wr, 1.77k op/s 2024-09-10T10:40:16.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:15 smithi097 ceph-mon[35213]: pgmap v112: 97 pgs: 97 active+clean; 3.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 70 MiB/s wr, 1.77k op/s 2024-09-10T10:40:17.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:17 smithi092 ceph-mon[30834]: pgmap v113: 97 pgs: 97 active+clean; 3.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 54 MiB/s wr, 1.32k op/s 2024-09-10T10:40:17.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:17 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:17 smithi121 ceph-mon[35231]: pgmap v113: 97 pgs: 97 active+clean; 3.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 54 MiB/s wr, 1.32k op/s 2024-09-10T10:40:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:17 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:18.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:17 smithi097 ceph-mon[35213]: pgmap v113: 97 pgs: 97 active+clean; 3.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 54 MiB/s wr, 1.32k op/s 2024-09-10T10:40:18.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:17 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 200.0 s, 3648.4 tps, lat 27.360 ms stddev 56.973 2024-09-10T10:40:19.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:19 smithi092 ceph-mon[30834]: pgmap v114: 97 pgs: 97 active+clean; 3.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 30 MiB/s wr, 726 op/s 2024-09-10T10:40:20.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:19 smithi121 ceph-mon[35231]: pgmap v114: 97 pgs: 97 active+clean; 3.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 30 MiB/s wr, 726 op/s 2024-09-10T10:40:20.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:19 smithi097 ceph-mon[35213]: pgmap v114: 97 pgs: 97 active+clean; 3.0 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 30 MiB/s wr, 726 op/s 2024-09-10T10:40:21.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:21 smithi092 ceph-mon[30834]: pgmap v115: 97 pgs: 97 active+clean; 3.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 57 MiB/s wr, 2.25k op/s 2024-09-10T10:40:21.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:21 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:22.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:21 smithi121 ceph-mon[35231]: pgmap v115: 97 pgs: 97 active+clean; 3.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 57 MiB/s wr, 2.25k op/s 2024-09-10T10:40:22.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:21 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:22.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:21 smithi097 ceph-mon[35213]: pgmap v115: 97 pgs: 97 active+clean; 3.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 57 MiB/s wr, 2.25k op/s 2024-09-10T10:40:22.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:21 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 205.0 s, 4162.8 tps, lat 24.067 ms stddev 26.340 2024-09-10T10:40:23.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:23 smithi092 ceph-mon[30834]: pgmap v116: 97 pgs: 97 active+clean; 3.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 41 MiB/s wr, 1.88k op/s 2024-09-10T10:40:24.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:23 smithi121 ceph-mon[35231]: pgmap v116: 97 pgs: 97 active+clean; 3.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 41 MiB/s wr, 1.88k op/s 2024-09-10T10:40:24.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:23 smithi097 ceph-mon[35213]: pgmap v116: 97 pgs: 97 active+clean; 3.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 41 MiB/s wr, 1.88k op/s 2024-09-10T10:40:24.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.976+0000 7f36b7f2c640 1 -- 172.21.15.92:0/1897085363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36b01009b0 msgr2=0x7f36b0100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.976+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/1897085363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36b01009b0 0x7f36b0100e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f36a000d960 tx=0x7f36a002c2b0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.976+0000 7f36b7f2c640 1 -- 172.21.15.92:0/1897085363 shutdown_connections 2024-09-10T10:40:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.976+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/1897085363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b0101350 0x7f36b010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.976+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/1897085363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36b01009b0 0x7f36b0100e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.976+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/1897085363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b01069c0 0x7f36b0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.976+0000 7f36b7f2c640 1 -- 172.21.15.92:0/1897085363 >> 172.21.15.92:0/1897085363 conn(0x7f36b0077990 msgr2=0x7f36b00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.976+0000 7f36b7f2c640 1 -- 172.21.15.92:0/1897085363 shutdown_connections 2024-09-10T10:40:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.977+0000 7f36b7f2c640 1 -- 172.21.15.92:0/1897085363 wait complete. 2024-09-10T10:40:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b7f2c640 1 Processor -- start 2024-09-10T10:40:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b7f2c640 1 -- start start 2024-09-10T10:40:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b7f2c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b01009b0 0x7f36b0196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b7f2c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36b0101350 0x7f36b0196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b7f2c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b01069c0 0x7f36b019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b7f2c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36b010fd00 con 0x7f36b01069c0 2024-09-10T10:40:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b7f2c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f36b010fb80 con 0x7f36b0101350 2024-09-10T10:40:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b7f2c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f36b010fe80 con 0x7f36b01009b0 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b64c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b01069c0 0x7f36b019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b5cc8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b01009b0 0x7f36b0196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b5cc8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b01009b0 0x7f36b0196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:54100/0 (socket says 172.21.15.92:54100) 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b5cc8640 1 -- 172.21.15.92:0/3595490220 learned_addr learned my addr 172.21.15.92:0/3595490220 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.978+0000 7f36b54c7640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36b0101350 0x7f36b0196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36b5cc8640 1 -- 172.21.15.92:0/3595490220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36b0101350 msgr2=0x7f36b0196650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36b5cc8640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36b0101350 0x7f36b0196650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36b5cc8640 1 -- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b01069c0 msgr2=0x7f36b019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36b5cc8640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b01069c0 0x7f36b019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36b5cc8640 1 -- 172.21.15.92:0/3595490220 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b019b100 con 0x7f36b01009b0 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36b64c9640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b01069c0 0x7f36b019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:40:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36b5cc8640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b01009b0 0x7f36b0196110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00e9c0 tx=0x7f36ac00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36a6ffd640 1 -- 172.21.15.92:0/3595490220 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00ccc0 con 0x7f36b01009b0 2024-09-10T10:40:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36a6ffd640 1 -- 172.21.15.92:0/3595490220 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36ac005500 con 0x7f36b01009b0 2024-09-10T10:40:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36b7f2c640 1 -- 172.21.15.92:0/3595490220 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b019b3f0 con 0x7f36b01009b0 2024-09-10T10:40:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36a6ffd640 1 -- 172.21.15.92:0/3595490220 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac010430 con 0x7f36b01009b0 2024-09-10T10:40:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.979+0000 7f36b7f2c640 1 -- 172.21.15.92:0/3595490220 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b01a2c80 con 0x7f36b01009b0 2024-09-10T10:40:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.983+0000 7f36bacbf740 1 Processor -- start 2024-09-10T10:40:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.983+0000 7f36bacbf740 1 -- start start 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.983+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 0x5584a5d20ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.983+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d21410 0x5584a5d2b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.983+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d2bcb0 0x5584a5d2e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.983+0000 7f36bacbf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5584a5c852f0 con 0x5584a5d20af0 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.983+0000 7f36bacbf740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5584a5c2d270 con 0x5584a5d21410 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.983+0000 7f36bacbf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5584a5c812b0 con 0x5584a5d2bcb0 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b54c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d2bcb0 0x5584a5d2e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b54c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d2bcb0 0x5584a5d2e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:54116/0 (socket says 172.21.15.92:54116) 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b54c7640 1 -- 172.21.15.92:0/2818554754 learned_addr learned my addr 172.21.15.92:0/2818554754 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b64c9640 1 --2- 172.21.15.92:0/2818554754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 0x5584a5d20ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:24.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b54c7640 1 -- 172.21.15.92:0/2818554754 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d21410 msgr2=0x5584a5d2b770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:40:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b54c7640 1 --2- 172.21.15.92:0/2818554754 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d21410 0x5584a5d2b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b54c7640 1 -- 172.21.15.92:0/2818554754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 msgr2=0x5584a5d20ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b54c7640 1 --2- 172.21.15.92:0/2818554754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 0x5584a5d20ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b54c7640 1 -- 172.21.15.92:0/2818554754 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a5c2c340 con 0x5584a5d2bcb0 2024-09-10T10:40:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f36b54c7640 1 --2- 172.21.15.92:0/2818554754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d2bcb0 0x5584a5d2e0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36a0005e00 tx=0x7f36a000d610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2e7ff64cec2f4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f369bfff640 1 -- 172.21.15.92:0/2818554754 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0039040 con 0x5584a5d2bcb0 2024-09-10T10:40:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f369bfff640 1 -- 172.21.15.92:0/2818554754 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36a002cdf0 con 0x5584a5d2bcb0 2024-09-10T10:40:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.984+0000 7f369bfff640 1 -- 172.21.15.92:0/2818554754 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a00035f0 con 0x5584a5d2bcb0 2024-09-10T10:40:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.985+0000 7f36bacbf740 1 -- 172.21.15.92:0/2818554754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d2bcb0 msgr2=0x5584a5d2e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.985+0000 7f36bacbf740 1 --2- 172.21.15.92:0/2818554754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d2bcb0 0x5584a5d2e0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36a0005e00 tx=0x7f36a000d610 comp rx=0 tx=0).stop 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.985+0000 7f36a6ffd640 1 -- 172.21.15.92:0/3595490220 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f36ac0046c0 con 0x7f36b01009b0 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.986+0000 7f36bacbf740 1 -- 172.21.15.92:0/2818554754 shutdown_connections 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.986+0000 7f36bacbf740 1 --2- 172.21.15.92:0/2818554754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d2bcb0 0x5584a5d2e0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.986+0000 7f36bacbf740 1 --2- 172.21.15.92:0/2818554754 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d21410 0x5584a5d2b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.986+0000 7f36bacbf740 1 --2- 172.21.15.92:0/2818554754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 0x5584a5d20ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.986+0000 7f36bacbf740 1 -- 172.21.15.92:0/2818554754 >> 172.21.15.92:0/2818554754 conn(0x5584a5d1d060 msgr2=0x5584a5d1d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.986+0000 7f36bacbf740 1 -- 172.21.15.92:0/2818554754 shutdown_connections 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.987+0000 7f36a6ffd640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f369c0a2cb0 0x7f369c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.987+0000 7f36b54c7640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f369c0a2cb0 0x7f369c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.987+0000 7f36a6ffd640 1 -- 172.21.15.92:0/3595490220 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f36ac0cf620 con 0x7f36b01009b0 2024-09-10T10:40:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.987+0000 7f36bacbf740 1 -- 172.21.15.92:0/2818554754 wait complete. 2024-09-10T10:40:24.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.988+0000 7f36bacbf740 1 -- start start 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.988+0000 7f36bacbf740 1 Processor -- start 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.988+0000 7f36b54c7640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f369c0a2cb0 0x7f369c0a5170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f36a0037040 tx=0x7f36a002e040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d28bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d21410 0x5584a5d29130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 0x5584a5d29670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36bacbf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5584a5d37090 con 0x5584a5d21410 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36bacbf740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5584a5c0e290 con 0x5584a5d2bcb0 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36bacbf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5584a5d37210 con 0x5584a5d20af0 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36bacbf740 10 client.0 _ll_register_callbacks cb 0x5584a5c3f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36b54c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d21410 0x5584a5d29130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36b5cc8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d28bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:24.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36b54c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d21410 0x5584a5d29130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37934/0 (socket says 172.21.15.92:37934) 2024-09-10T10:40:24.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.989+0000 7f36b54c7640 1 -- 172.21.15.92:0/3669736194 learned_addr learned my addr 172.21.15.92:0/3669736194 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.990+0000 7f36b54c7640 1 -- 172.21.15.92:0/3669736194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 msgr2=0x5584a5d28bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.990+0000 7f36b54c7640 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d28bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.990+0000 7f36b54c7640 1 -- 172.21.15.92:0/3669736194 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 msgr2=0x5584a5d29670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:40:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.990+0000 7f36b54c7640 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 0x5584a5d29670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.990+0000 7f36b54c7640 1 -- 172.21.15.92:0/3669736194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a5998210 con 0x5584a5d21410 2024-09-10T10:40:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.990+0000 7f36b54c7640 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d21410 0x5584a5d29130 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f36a002e010 tx=0x7f36a00040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62dcffd1aacbd4b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.990+0000 7f36997fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.991+0000 7f36997fa640 1 -- 172.21.15.92:0/3669736194 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a004b050 con 0x5584a5d21410 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.991+0000 7f36997fa640 1 -- 172.21.15.92:0/3669736194 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f36a0003ac0 con 0x5584a5d21410 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.991+0000 7f36bacbf740 1 -- 172.21.15.92:0/3669736194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a002cdf0 con 0x5584a5d21410 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.991+0000 7f36997fa640 1 -- 172.21.15.92:0/3669736194 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f36a0039040 con 0x5584a5d21410 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.991+0000 7f36bacbf740 10 client.15615 fetch_fsmap learned FSMap version 40 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.991+0000 7f36bacbf740 1 -- 172.21.15.92:0/3669736194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5584a5a64620 con 0x5584a5d21410 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.991+0000 7f36997fa640 1 -- 172.21.15.92:0/3669736194 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36a002cdf0 con 0x5584a5d21410 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.991+0000 7f36997fa640 1 -- 172.21.15.92:0/3669736194 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 40) ==== 8410+0+0 (secure 0 0 0) 0x7f36a0047460 con 0x5584a5d21410 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.992+0000 7f36bacbf740 10 client.15615 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.992+0000 7f36bacbf740 10 client.15615 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.992+0000 7f36bacbf740 20 client.15615 populate_metadata read hostname 'smithi092' 2024-09-10T10:40:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.992+0000 7f36bacbf740 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5584a5d442f0 0x5584a5d466e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.992+0000 7f36bacbf740 4 client.15615 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:40:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.992+0000 7f36bacbf740 1 -- 172.21.15.92:0/3669736194 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584a5c92a20 con 0x5584a5d442f0 2024-09-10T10:40:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.992+0000 7f36b5cc8640 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5584a5d442f0 0x5584a5d466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.992+0000 7f36997fa640 10 client.15615 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.992+0000 7f36b5cc8640 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5584a5d442f0 0x5584a5d466e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc8ef040264c70f server_cookie=ddc4ab3fbe7eb478 in_seq=0 out_seq=0 2024-09-10T10:40:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.993+0000 7f36997fa640 1 -- 172.21.15.92:0/3669736194 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584a5c92a20 con 0x5584a5d442f0 2024-09-10T10:40:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.993+0000 7f36997fa640 10 client.15615 handle_command_reply: tid=0 2024-09-10T10:40:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.993+0000 7f36bacbf740 1 client.15615 shutdown 2024-09-10T10:40:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.993+0000 7f36bacbf740 1 -- 172.21.15.92:0/3669736194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d21410 msgr2=0x5584a5d29130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.993+0000 7f36bacbf740 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d21410 0x5584a5d29130 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f36a002e010 tx=0x7f36a00040d0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.994+0000 7f36bacbf740 1 -- 172.21.15.92:0/3669736194 shutdown_connections 2024-09-10T10:40:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.994+0000 7f36bacbf740 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5584a5d442f0 0x5584a5d466e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.994+0000 7f36bacbf740 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 0x5584a5d29670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.994+0000 7f36bacbf740 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d21410 0x5584a5d29130 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.994+0000 7f36bacbf740 1 --2- 172.21.15.92:0/3669736194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d28bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.994+0000 7f36bacbf740 1 -- 172.21.15.92:0/3669736194 >> 172.21.15.92:0/3669736194 conn(0x5584a5d1d060 msgr2=0x5584a5d22dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.994+0000 7f36997fa640 0 client.15615 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.994+0000 7f36bacbf740 1 -- 172.21.15.92:0/3669736194 shutdown_connections 2024-09-10T10:40:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.994+0000 7f36bacbf740 1 -- 172.21.15.92:0/3669736194 wait complete. 2024-09-10T10:40:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:24.995+0000 7f36bacbf740 20 client.15615 trim_cache size 0 max 16384 2024-09-10T10:40:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.020+0000 7f36bacbf740 1 Processor -- start 2024-09-10T10:40:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.020+0000 7f36bacbf740 1 -- start start 2024-09-10T10:40:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.020+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 0x5584a5d235b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.020+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d21410 0x5584a5d2ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.020+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 0x5584a5d4be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36bacbf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36b01ab480 con 0x5584a5d20af0 2024-09-10T10:40:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b5cc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 0x5584a5d235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36bacbf740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f36b01ad140 con 0x5584a5d2bcb0 2024-09-10T10:40:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b54c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d21410 0x5584a5d2ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36bacbf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f36b01abb80 con 0x5584a5d21410 2024-09-10T10:40:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b54c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d21410 0x5584a5d2ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:54138/0 (socket says 172.21.15.92:54138) 2024-09-10T10:40:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b54c7640 1 -- 172.21.15.92:0/2466298654 learned_addr learned my addr 172.21.15.92:0/2466298654 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b64c9640 1 --2- 172.21.15.92:0/2466298654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 0x5584a5d4be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b64c9640 1 -- 172.21.15.92:0/2466298654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d21410 msgr2=0x5584a5d2ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b64c9640 1 --2- 172.21.15.92:0/2466298654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d21410 0x5584a5d2ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b64c9640 1 -- 172.21.15.92:0/2466298654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 msgr2=0x5584a5d235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b64c9640 1 --2- 172.21.15.92:0/2466298654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 0x5584a5d235b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b64c9640 1 -- 172.21.15.92:0/2466298654 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a5d20920 con 0x5584a5d2bcb0 2024-09-10T10:40:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.021+0000 7f36b64c9640 1 --2- 172.21.15.92:0/2466298654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 0x5584a5d4be50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f36a8005fd0 tx=0x7f36a8012c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e47cea9ffb76d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.022+0000 7f369b7fe640 1 -- 172.21.15.92:0/2466298654 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a80121d0 con 0x5584a5d2bcb0 2024-09-10T10:40:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.022+0000 7f369b7fe640 1 -- 172.21.15.92:0/2466298654 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36a8003e50 con 0x5584a5d2bcb0 2024-09-10T10:40:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.022+0000 7f369b7fe640 1 -- 172.21.15.92:0/2466298654 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a80043d0 con 0x5584a5d2bcb0 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.023+0000 7f36bacbf740 1 -- 172.21.15.92:0/2466298654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 msgr2=0x5584a5d4be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.023+0000 7f36bacbf740 1 --2- 172.21.15.92:0/2466298654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 0x5584a5d4be50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f36a8005fd0 tx=0x7f36a8012c00 comp rx=0 tx=0).stop 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.023+0000 7f36bacbf740 1 -- 172.21.15.92:0/2466298654 shutdown_connections 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.023+0000 7f36bacbf740 1 --2- 172.21.15.92:0/2466298654 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d2bcb0 0x5584a5d4be50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.023+0000 7f36bacbf740 1 --2- 172.21.15.92:0/2466298654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d21410 0x5584a5d2ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.023+0000 7f36bacbf740 1 --2- 172.21.15.92:0/2466298654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d20af0 0x5584a5d235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.023+0000 7f36bacbf740 1 -- 172.21.15.92:0/2466298654 >> 172.21.15.92:0/2466298654 conn(0x5584a5d1d060 msgr2=0x5584a5d2a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.024+0000 7f36bacbf740 1 -- 172.21.15.92:0/2466298654 shutdown_connections 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.024+0000 7f36bacbf740 1 -- 172.21.15.92:0/2466298654 wait complete. 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.024+0000 7f36bacbf740 1 -- start start 2024-09-10T10:40:25.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.024+0000 7f36bacbf740 1 Processor -- start 2024-09-10T10:40:25.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d3c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:25.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d21410 0x5584a5d25650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:25.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36bacbf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d2bcb0 0x5584a5d25b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:25.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36bacbf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36b01aca70 con 0x5584a5d2bcb0 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36bacbf740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f36b01ac2e0 con 0x5584a5d21410 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36b5cc8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d3c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36bacbf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f36b01a9460 con 0x5584a5d20af0 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36b5cc8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d3c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:54152/0 (socket says 172.21.15.92:54152) 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36b5cc8640 1 -- 172.21.15.92:0/1188942466 learned_addr learned my addr 172.21.15.92:0/1188942466 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36b64c9640 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d2bcb0 0x5584a5d25b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36bacbf740 10 client.0 _ll_register_callbacks cb 0x7f36a80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.025+0000 7f36b54c7640 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d21410 0x5584a5d25650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.026+0000 7f36b5cc8640 1 -- 172.21.15.92:0/1188942466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d21410 msgr2=0x5584a5d25650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.026+0000 7f36b5cc8640 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d21410 0x5584a5d25650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.026+0000 7f36b5cc8640 1 -- 172.21.15.92:0/1188942466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d2bcb0 msgr2=0x5584a5d25b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.026+0000 7f36b5cc8640 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d2bcb0 0x5584a5d25b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.026+0000 7f36b5cc8640 1 -- 172.21.15.92:0/1188942466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a5d260d0 con 0x5584a5d20af0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.027+0000 7f36997fa640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.027+0000 7f36b5cc8640 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d3c930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f36ac098580 tx=0x7f36ac097f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd98a5e92b09e5ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.027+0000 7f36997fa640 1 -- 172.21.15.92:0/1188942466 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac09ff60 con 0x5584a5d20af0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.027+0000 7f36bacbf740 1 -- 172.21.15.92:0/1188942466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a8003e50 con 0x5584a5d20af0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.027+0000 7f36997fa640 1 -- 172.21.15.92:0/1188942466 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f36ac0cd060 con 0x5584a5d20af0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.027+0000 7f36997fa640 1 -- 172.21.15.92:0/1188942466 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f36ac09ff60 con 0x5584a5d20af0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.027+0000 7f36bacbf740 10 client.25177 fetch_fsmap learned FSMap version 40 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.027+0000 7f36bacbf740 1 -- 172.21.15.92:0/1188942466 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5584a5daebf0 con 0x5584a5d20af0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.028+0000 7f36997fa640 1 -- 172.21.15.92:0/1188942466 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36a8003e50 con 0x5584a5d20af0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.028+0000 7f36997fa640 1 -- 172.21.15.92:0/1188942466 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 40) ==== 8410+0+0 (secure 0 0 0) 0x7f36ac09b000 con 0x5584a5d20af0 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.028+0000 7f36bacbf740 10 client.25177 fetch_fsmap finished waiting for FSMap version 40 2024-09-10T10:40:25.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.028+0000 7f36bacbf740 10 client.25177 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:40:25.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.028+0000 7f36bacbf740 20 client.25177 populate_metadata read hostname 'smithi092' 2024-09-10T10:40:25.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.028+0000 7f36bacbf740 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5584a5daf3b0 0x5584a5db17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:25.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.028+0000 7f36bacbf740 4 client.25177 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:40:25.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.028+0000 7f36bacbf740 1 -- 172.21.15.92:0/1188942466 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584a5c8cd70 con 0x5584a5daf3b0 2024-09-10T10:40:25.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.028+0000 7f36b54c7640 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5584a5daf3b0 0x5584a5db17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:25.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.029+0000 7f36997fa640 10 client.25177 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:25.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.029+0000 7f36b54c7640 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5584a5daf3b0 0x5584a5db17d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c433306768940c83 server_cookie=d4ac4490a0e52de8 in_seq=0 out_seq=0 2024-09-10T10:40:25.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.037+0000 7f36997fa640 1 -- 172.21.15.92:0/1188942466 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584a5c8cd70 con 0x5584a5daf3b0 2024-09-10T10:40:25.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.037+0000 7f36997fa640 10 client.25177 handle_command_reply: tid=0 2024-09-10T10:40:25.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.037+0000 7f36bacbf740 1 client.25177 shutdown 2024-09-10T10:40:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.037+0000 7f36bacbf740 1 -- 172.21.15.92:0/1188942466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 msgr2=0x5584a5d3c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.037+0000 7f36bacbf740 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d3c930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f36ac098580 tx=0x7f36ac097f10 comp rx=0 tx=0).stop 2024-09-10T10:40:25.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.038+0000 7f36bacbf740 1 -- 172.21.15.92:0/1188942466 shutdown_connections 2024-09-10T10:40:25.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.038+0000 7f36bacbf740 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5584a5d2bcb0 0x5584a5d25b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.038+0000 7f36bacbf740 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5584a5daf3b0 0x5584a5db17d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.038+0000 7f36bacbf740 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5584a5d21410 0x5584a5d25650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.038+0000 7f36997fa640 0 client.25177 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:25.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.038+0000 7f36bacbf740 1 --2- 172.21.15.92:0/1188942466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5584a5d20af0 0x5584a5d3c930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.038+0000 7f36bacbf740 1 -- 172.21.15.92:0/1188942466 >> 172.21.15.92:0/1188942466 conn(0x5584a5d1d060 msgr2=0x5584a5d293d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:25.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.038+0000 7f36bacbf740 1 -- 172.21.15.92:0/1188942466 shutdown_connections 2024-09-10T10:40:25.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.038+0000 7f36bacbf740 1 -- 172.21.15.92:0/1188942466 wait complete. 2024-09-10T10:40:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.039+0000 7f36bacbf740 20 client.25177 trim_cache size 0 max 16384 2024-09-10T10:40:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:40:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:40:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:40:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:40:25.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 -- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f369c0a2cb0 msgr2=0x7f369c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:25.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f369c0a2cb0 0x7f369c0a5170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f36a0037040 tx=0x7f36a002e040 comp rx=0 tx=0).stop 2024-09-10T10:40:25.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 -- 172.21.15.92:0/3595490220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b01009b0 msgr2=0x7f36b0196110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:25.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b01009b0 0x7f36b0196110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00e9c0 tx=0x7f36ac00ee80 comp rx=0 tx=0).stop 2024-09-10T10:40:25.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 -- 172.21.15.92:0/3595490220 shutdown_connections 2024-09-10T10:40:25.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36b01069c0 0x7f36b019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f369c0a2cb0 0x7f369c0a5170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f36b0101350 0x7f36b0196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 --2- 172.21.15.92:0/3595490220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36b01009b0 0x7f36b0196110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.040+0000 7f36b7f2c640 1 -- 172.21.15.92:0/3595490220 >> 172.21.15.92:0/3595490220 conn(0x7f36b0077990 msgr2=0x7f36b0103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.041+0000 7f36b7f2c640 1 -- 172.21.15.92:0/3595490220 shutdown_connections 2024-09-10T10:40:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:25.041+0000 7f36b7f2c640 1 -- 172.21.15.92:0/3595490220 wait complete. 2024-09-10T10:40:25.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:25 smithi092 ceph-mon[30834]: pgmap v117: 97 pgs: 97 active+clean; 3.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 43 MiB/s wr, 2.00k op/s 2024-09-10T10:40:26.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:25 smithi121 ceph-mon[35231]: pgmap v117: 97 pgs: 97 active+clean; 3.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 43 MiB/s wr, 2.00k op/s 2024-09-10T10:40:26.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:25 smithi097 ceph-mon[35213]: pgmap v117: 97 pgs: 97 active+clean; 3.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 43 MiB/s wr, 2.00k op/s 2024-09-10T10:40:27.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:27 smithi092 ceph-mon[30834]: pgmap v118: 97 pgs: 97 active+clean; 3.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 39 MiB/s wr, 2.00k op/s 2024-09-10T10:40:28.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:27 smithi121 ceph-mon[35231]: pgmap v118: 97 pgs: 97 active+clean; 3.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 39 MiB/s wr, 2.00k op/s 2024-09-10T10:40:28.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:27 smithi097 ceph-mon[35213]: pgmap v118: 97 pgs: 97 active+clean; 3.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 39 MiB/s wr, 2.00k op/s 2024-09-10T10:40:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 210.0 s, 3547.4 tps, lat 28.095 ms stddev 30.291 2024-09-10T10:40:29.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:29 smithi092 ceph-mon[30834]: pgmap v119: 97 pgs: 97 active+clean; 3.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 33 MiB/s wr, 1.85k op/s 2024-09-10T10:40:30.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:29 smithi121 ceph-mon[35231]: pgmap v119: 97 pgs: 97 active+clean; 3.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 33 MiB/s wr, 1.85k op/s 2024-09-10T10:40:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:29 smithi097 ceph-mon[35213]: pgmap v119: 97 pgs: 97 active+clean; 3.3 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 33 MiB/s wr, 1.85k op/s 2024-09-10T10:40:31.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:31 smithi092 ceph-mon[30834]: pgmap v120: 97 pgs: 97 active+clean; 3.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 38 MiB/s wr, 2.25k op/s 2024-09-10T10:40:32.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:31 smithi121 ceph-mon[35231]: pgmap v120: 97 pgs: 97 active+clean; 3.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 38 MiB/s wr, 2.25k op/s 2024-09-10T10:40:32.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:31 smithi097 ceph-mon[35213]: pgmap v120: 97 pgs: 97 active+clean; 3.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 38 MiB/s wr, 2.25k op/s 2024-09-10T10:40:32.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:32 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:33.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:32 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:33.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:32 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 215.0 s, 3764.6 tps, lat 26.604 ms stddev 28.528 2024-09-10T10:40:34.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:33 smithi121 ceph-mon[35231]: pgmap v121: 97 pgs: 97 active+clean; 3.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 722 op/s 2024-09-10T10:40:34.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:33 smithi097 ceph-mon[35213]: pgmap v121: 97 pgs: 97 active+clean; 3.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 722 op/s 2024-09-10T10:40:34.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:33 smithi092 ceph-mon[30834]: pgmap v121: 97 pgs: 97 active+clean; 3.3 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 722 op/s 2024-09-10T10:40:36.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:35 smithi121 ceph-mon[35231]: pgmap v122: 97 pgs: 97 active+clean; 3.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 881 op/s 2024-09-10T10:40:36.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:35 smithi097 ceph-mon[35213]: pgmap v122: 97 pgs: 97 active+clean; 3.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 881 op/s 2024-09-10T10:40:36.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:35 smithi092 ceph-mon[30834]: pgmap v122: 97 pgs: 97 active+clean; 3.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 881 op/s 2024-09-10T10:40:38.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:37 smithi121 ceph-mon[35231]: pgmap v123: 97 pgs: 97 active+clean; 3.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 989 op/s 2024-09-10T10:40:38.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:37 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:38.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:37 smithi097 ceph-mon[35213]: pgmap v123: 97 pgs: 97 active+clean; 3.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 989 op/s 2024-09-10T10:40:38.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:37 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:38.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:37 smithi092 ceph-mon[30834]: pgmap v123: 97 pgs: 97 active+clean; 3.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 989 op/s 2024-09-10T10:40:38.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:37 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 220.0 s, 2913.8 tps, lat 34.290 ms stddev 37.569 2024-09-10T10:40:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.166+0000 7f822e58d640 1 -- 172.21.15.92:0/3736659186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f822810ead0 msgr2=0x7f822810eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.166+0000 7f822e58d640 1 --2- 172.21.15.92:0/3736659186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f822810ead0 0x7f822810eeb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f821800aa10 tx=0x7f821802b720 comp rx=0 tx=0).stop 2024-09-10T10:40:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.166+0000 7f822e58d640 1 -- 172.21.15.92:0/3736659186 shutdown_connections 2024-09-10T10:40:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.166+0000 7f822e58d640 1 --2- 172.21.15.92:0/3736659186 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f8228109b90 0x7f8228115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 --2- 172.21.15.92:0/3736659186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82281091f0 0x7f8228109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 --2- 172.21.15.92:0/3736659186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f822810ead0 0x7f822810eeb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 -- 172.21.15.92:0/3736659186 >> 172.21.15.92:0/3736659186 conn(0x7f822806d210 msgr2=0x7f822806d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 -- 172.21.15.92:0/3736659186 shutdown_connections 2024-09-10T10:40:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 -- 172.21.15.92:0/3736659186 wait complete. 2024-09-10T10:40:38.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 Processor -- start 2024-09-10T10:40:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 -- start start 2024-09-10T10:40:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82281091f0 0x7f82281a6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8228109b90 0x7f82281a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f822810ead0 0x7f82281a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8228118540 con 0x7f82281091f0 2024-09-10T10:40:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f82281183c0 con 0x7f822810ead0 2024-09-10T10:40:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.167+0000 7f822e58d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f82281186c0 con 0x7f8228109b90 2024-09-10T10:40:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f8227fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82281091f0 0x7f82281a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f821f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8228109b90 0x7f82281a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f8227fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82281091f0 0x7f82281a6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57012/0 (socket says 172.21.15.92:57012) 2024-09-10T10:40:38.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f821f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8228109b90 0x7f82281a6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:35788/0 (socket says 172.21.15.92:35788) 2024-09-10T10:40:38.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f8227fff640 1 -- 172.21.15.92:0/318126744 learned_addr learned my addr 172.21.15.92:0/318126744 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:38.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f822cb2a640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f822810ead0 0x7f82281a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f821f7fe640 1 -- 172.21.15.92:0/318126744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f822810ead0 msgr2=0x7f82281a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:38.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f821f7fe640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f822810ead0 0x7f82281a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f821f7fe640 1 -- 172.21.15.92:0/318126744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82281091f0 msgr2=0x7f82281a6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f821f7fe640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82281091f0 0x7f82281a6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f821f7fe640 1 -- 172.21.15.92:0/318126744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82281a1170 con 0x7f8228109b90 2024-09-10T10:40:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f822cb2a640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f822810ead0 0x7f82281a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:40:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f821f7fe640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8228109b90 0x7f82281a6d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f821000d6d0 tx=0x7f821000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:38.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f8225ffb640 1 -- 172.21.15.92:0/318126744 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210017070 con 0x7f8228109b90 2024-09-10T10:40:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f8225ffb640 1 -- 172.21.15.92:0/318126744 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8210009820 con 0x7f8228109b90 2024-09-10T10:40:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f822e58d640 1 -- 172.21.15.92:0/318126744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82281a1460 con 0x7f8228109b90 2024-09-10T10:40:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.168+0000 7f8225ffb640 1 -- 172.21.15.92:0/318126744 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210004d00 con 0x7f8228109b90 2024-09-10T10:40:38.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.169+0000 7f822e58d640 1 -- 172.21.15.92:0/318126744 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82281ad700 con 0x7f8228109b90 2024-09-10T10:40:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.172+0000 7f8231406740 1 Processor -- start 2024-09-10T10:40:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.172+0000 7f8231406740 1 -- start start 2024-09-10T10:40:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.172+0000 7f8225ffb640 1 -- 172.21.15.92:0/318126744 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f82100099d0 con 0x7f8228109b90 2024-09-10T10:40:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8231406740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 0x55a85e4fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8231406740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4faae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8231406740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fb020 0x55a85e506ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8231406740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a85e4552f0 con 0x55a85e4fa680 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8231406740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a85e3fd270 con 0x55a85e4febc0 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8231406740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a85e4512b0 con 0x55a85e4fb020 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8227fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4faae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8227fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4faae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57014/0 (socket says 172.21.15.92:57014) 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8227fff640 1 -- 172.21.15.92:0/570273284 learned_addr learned my addr 172.21.15.92:0/570273284 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f822cb2a640 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 0x55a85e4fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f821f7fe640 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fb020 0x55a85e506ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8227fff640 1 -- 172.21.15.92:0/570273284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fb020 msgr2=0x55a85e506ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8227fff640 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fb020 0x55a85e506ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8227fff640 1 -- 172.21.15.92:0/570273284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 msgr2=0x55a85e4fefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8227fff640 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 0x55a85e4fefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8227fff640 1 -- 172.21.15.92:0/570273284 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a85e3fc340 con 0x55a85e4fa680 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f822cb2a640 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 0x55a85e4fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8225ffb640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f82080a2da0 0x7f82080a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.173+0000 7f8227fff640 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4faae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8218006010 tx=0x7f8218005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80860dc3bfcd5463 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.174+0000 7f822cb2a640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f82080a2da0 0x7f82080a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.174+0000 7f8225ffb640 1 -- 172.21.15.92:0/318126744 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f82100ceeb0 con 0x7f8228109b90 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.174+0000 7f821e7fc640 1 -- 172.21.15.92:0/570273284 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218041030 con 0x55a85e4fa680 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.174+0000 7f821e7fc640 1 -- 172.21.15.92:0/570273284 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8218005500 con 0x55a85e4fa680 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.174+0000 7f821e7fc640 1 -- 172.21.15.92:0/570273284 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218036040 con 0x55a85e4fa680 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.174+0000 7f8231406740 1 -- 172.21.15.92:0/570273284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 msgr2=0x55a85e4faae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.174+0000 7f822cb2a640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f82080a2da0 0x7f82080a5260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8220009fd0 tx=0x7f8220009500 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.174+0000 7f8231406740 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4faae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8218006010 tx=0x7f8218005e80 comp rx=0 tx=0).stop 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.175+0000 7f8231406740 1 -- 172.21.15.92:0/570273284 shutdown_connections 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.175+0000 7f8231406740 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fb020 0x55a85e506ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.175+0000 7f8231406740 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4faae0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.175+0000 7f8231406740 1 --2- 172.21.15.92:0/570273284 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 0x55a85e4fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.175+0000 7f8231406740 1 -- 172.21.15.92:0/570273284 >> 172.21.15.92:0/570273284 conn(0x55a85e4ecb10 msgr2=0x55a85e4ecef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.175+0000 7f8231406740 1 -- 172.21.15.92:0/570273284 shutdown_connections 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.175+0000 7f8231406740 1 -- 172.21.15.92:0/570273284 wait complete. 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.175+0000 7f8231406740 1 -- start start 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.175+0000 7f8231406740 1 Processor -- start 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8231406740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e503e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8231406740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 0x55a85e504370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8231406740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4febc0 0x55a85e5048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8231406740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a85e507060 con 0x55a85e4febc0 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8231406740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a85e3de290 con 0x55a85e4fb020 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8231406740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a85e5071e0 con 0x55a85e4fa680 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8231406740 10 client.0 _ll_register_callbacks cb 0x55a85e40f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f822cb2a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4febc0 0x55a85e5048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f822cb2a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4febc0 0x55a85e5048b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57018/0 (socket says 172.21.15.92:57018) 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f822cb2a640 1 -- 172.21.15.92:0/4262387922 learned_addr learned my addr 172.21.15.92:0/4262387922 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8227fff640 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e503e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f821f7fe640 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 0x55a85e504370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8227fff640 1 -- 172.21.15.92:0/4262387922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 msgr2=0x55a85e504370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8227fff640 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 0x55a85e504370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.176+0000 7f8227fff640 1 -- 172.21.15.92:0/4262387922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4febc0 msgr2=0x55a85e5048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.177+0000 7f8227fff640 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4febc0 0x55a85e5048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.177+0000 7f8227fff640 1 -- 172.21.15.92:0/4262387922 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a85e168210 con 0x55a85e4fa680 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.177+0000 7f822cb2a640 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4febc0 0x55a85e5048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.177+0000 7f8227fff640 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e503e30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8218005c40 tx=0x7f8218004a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83446e6cf64c04b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.177+0000 7f82177fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.177+0000 7f82177fe640 1 -- 172.21.15.92:0/4262387922 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218036030 con 0x55a85e4fa680 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.178+0000 7f82177fe640 1 -- 172.21.15.92:0/4262387922 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f8218004e50 con 0x55a85e4fa680 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.178+0000 7f8231406740 1 -- 172.21.15.92:0/4262387922 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8218005500 con 0x55a85e4fa680 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.178+0000 7f82177fe640 1 -- 172.21.15.92:0/4262387922 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8218056050 con 0x55a85e4fa680 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.178+0000 7f8231406740 10 client.25189 fetch_fsmap learned FSMap version 42 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.178+0000 7f8231406740 1 -- 172.21.15.92:0/4262387922 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a85e234620 con 0x55a85e4fa680 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f82177fe640 1 -- 172.21.15.92:0/4262387922 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f821800a630 con 0x55a85e4fa680 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f82177fe640 1 -- 172.21.15.92:0/4262387922 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f821803b040 con 0x55a85e4fa680 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f8231406740 10 client.25189 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T10:40:38.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f8231406740 10 client.25189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f8231406740 20 client.25189 populate_metadata read hostname 'smithi092' 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f8231406740 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a85e5141e0 0x55a85e5165d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f8231406740 4 client.25189 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f8231406740 1 -- 172.21.15.92:0/4262387922 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8218005500 con 0x55a85e5141e0 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f821f7fe640 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a85e5141e0 0x55a85e5165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f821f7fe640 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a85e5141e0 0x55a85e5165d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2652bbc3ea003d44 server_cookie=3bab75a37cc36c44 in_seq=0 out_seq=0 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.179+0000 7f82177fe640 10 client.25189 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.180+0000 7f82177fe640 1 -- 172.21.15.92:0/4262387922 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8218005500 con 0x55a85e5141e0 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.180+0000 7f82177fe640 10 client.25189 handle_command_reply: tid=0 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.180+0000 7f8231406740 1 client.25189 shutdown 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 -- 172.21.15.92:0/4262387922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 msgr2=0x55a85e503e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e503e30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8218005c40 tx=0x7f8218004a30 comp rx=0 tx=0).stop 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 -- 172.21.15.92:0/4262387922 shutdown_connections 2024-09-10T10:40:38.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4febc0 0x55a85e5048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a85e5141e0 0x55a85e5165d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 0x55a85e504370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 --2- 172.21.15.92:0/4262387922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e503e30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f82177fe640 0 client.25189 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 -- 172.21.15.92:0/4262387922 >> 172.21.15.92:0/4262387922 conn(0x55a85e4ecb10 msgr2=0x55a85e4f9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 -- 172.21.15.92:0/4262387922 shutdown_connections 2024-09-10T10:40:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 1 -- 172.21.15.92:0/4262387922 wait complete. 2024-09-10T10:40:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.181+0000 7f8231406740 20 client.25189 trim_cache size 0 max 16384 2024-09-10T10:40:38.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.202+0000 7f8231406740 1 Processor -- start 2024-09-10T10:40:38.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.202+0000 7f8231406740 1 -- start start 2024-09-10T10:40:38.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.202+0000 7f8231406740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4fe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.202+0000 7f8231406740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 0x55a85e4fc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.202+0000 7f8231406740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4febc0 0x55a85e5046e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.202+0000 7f8231406740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b3bf0 con 0x55a85e4fa680 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.202+0000 7f8231406740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b5820 con 0x55a85e4fb020 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.202+0000 7f8231406740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b42f0 con 0x55a85e4febc0 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f8227fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f822cb2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4febc0 0x55a85e5046e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f8227fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4fe310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57034/0 (socket says 172.21.15.92:57034) 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f8227fff640 1 -- 172.21.15.92:0/3889886623 learned_addr learned my addr 172.21.15.92:0/3889886623 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f821f7fe640 1 --2- 172.21.15.92:0/3889886623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 0x55a85e4fc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f8227fff640 1 -- 172.21.15.92:0/3889886623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4febc0 msgr2=0x55a85e5046e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f8227fff640 1 --2- 172.21.15.92:0/3889886623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4febc0 0x55a85e5046e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f8227fff640 1 -- 172.21.15.92:0/3889886623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 msgr2=0x55a85e4fc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f8227fff640 1 --2- 172.21.15.92:0/3889886623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 0x55a85e4fc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f8227fff640 1 -- 172.21.15.92:0/3889886623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a85e4f0980 con 0x55a85e4fa680 2024-09-10T10:40:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f8227fff640 1 --2- 172.21.15.92:0/3889886623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4fe310 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8218030660 tx=0x7f8218005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1486e4ff762d4710 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.203+0000 7f821dffb640 1 -- 172.21.15.92:0/3889886623 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218036030 con 0x55a85e4fa680 2024-09-10T10:40:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.204+0000 7f821dffb640 1 -- 172.21.15.92:0/3889886623 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8218003d60 con 0x55a85e4fa680 2024-09-10T10:40:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.204+0000 7f821dffb640 1 -- 172.21.15.92:0/3889886623 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218041040 con 0x55a85e4fa680 2024-09-10T10:40:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 -- 172.21.15.92:0/3889886623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 msgr2=0x55a85e4fe310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 --2- 172.21.15.92:0/3889886623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4fe310 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8218030660 tx=0x7f8218005e80 comp rx=0 tx=0).stop 2024-09-10T10:40:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 -- 172.21.15.92:0/3889886623 shutdown_connections 2024-09-10T10:40:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 --2- 172.21.15.92:0/3889886623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4febc0 0x55a85e5046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 --2- 172.21.15.92:0/3889886623 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4fb020 0x55a85e4fc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 --2- 172.21.15.92:0/3889886623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fa680 0x55a85e4fe310 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 -- 172.21.15.92:0/3889886623 >> 172.21.15.92:0/3889886623 conn(0x55a85e4ecb10 msgr2=0x55a85e4f9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 -- 172.21.15.92:0/3889886623 shutdown_connections 2024-09-10T10:40:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 -- 172.21.15.92:0/3889886623 wait complete. 2024-09-10T10:40:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.205+0000 7f8231406740 1 -- start start 2024-09-10T10:40:38.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.206+0000 7f8231406740 1 Processor -- start 2024-09-10T10:40:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.206+0000 7f8231406740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e515410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.206+0000 7f8231406740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fb020 0x55a85e515950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.206+0000 7f8231406740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 0x55a85e515e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.206+0000 7f8231406740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b5150 con 0x55a85e4fb020 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.206+0000 7f8231406740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b4a50 con 0x55a85e4febc0 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8231406740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b1bd0 con 0x55a85e4fa680 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8227fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e515410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8231406740 10 client.0 _ll_register_callbacks cb 0x7f8220009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8227fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e515410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:35820/0 (socket says 172.21.15.92:35820) 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8227fff640 1 -- 172.21.15.92:0/3881037215 learned_addr learned my addr 172.21.15.92:0/3881037215 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8227fff640 1 -- 172.21.15.92:0/3881037215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 msgr2=0x55a85e515e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8227fff640 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 0x55a85e515e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8227fff640 1 -- 172.21.15.92:0/3881037215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fb020 msgr2=0x55a85e515950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:38.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8227fff640 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fb020 0x55a85e515950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8227fff640 1 -- 172.21.15.92:0/3881037215 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a85e57db90 con 0x55a85e4fa680 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f8227fff640 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e515410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8218030e60 tx=0x7f8218003a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82d392c79546d5e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.207+0000 7f82177fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f82177fe640 1 -- 172.21.15.92:0/3881037215 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821805f070 con 0x55a85e4fa680 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f82177fe640 1 -- 172.21.15.92:0/3881037215 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f82180308d0 con 0x55a85e4fa680 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f8231406740 1 -- 172.21.15.92:0/3881037215 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8218003d60 con 0x55a85e4fa680 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f82177fe640 1 -- 172.21.15.92:0/3881037215 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f821806b050 con 0x55a85e4fa680 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f8231406740 10 client.25195 fetch_fsmap learned FSMap version 42 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f8231406740 1 -- 172.21.15.92:0/3881037215 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a85e57ee80 con 0x55a85e4fa680 2024-09-10T10:40:38.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f82177fe640 1 -- 172.21.15.92:0/3881037215 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8218030ad0 con 0x55a85e4fa680 2024-09-10T10:40:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f82177fe640 1 -- 172.21.15.92:0/3881037215 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 42) ==== 8398+0+0 (secure 0 0 0) 0x7f821800b040 con 0x55a85e4fa680 2024-09-10T10:40:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f8231406740 10 client.25195 fetch_fsmap finished waiting for FSMap version 42 2024-09-10T10:40:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f8231406740 10 client.25195 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:40:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f8231406740 20 client.25195 populate_metadata read hostname 'smithi092' 2024-09-10T10:40:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f8231406740 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a85e57f430 0x55a85e581890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f8231406740 4 client.25195 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:40:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f8231406740 1 -- 172.21.15.92:0/3881037215 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8218003d60 con 0x55a85e57f430 2024-09-10T10:40:38.213 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.208+0000 7f821f7fe640 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a85e57f430 0x55a85e581890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.209+0000 7f821f7fe640 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a85e57f430 0x55a85e581890 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ded639f4099db5e server_cookie=fd0ef65a4e675b5f in_seq=0 out_seq=0 2024-09-10T10:40:38.214 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.209+0000 7f82177fe640 10 client.25195 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.216+0000 7f82177fe640 1 -- 172.21.15.92:0/3881037215 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8218003d60 con 0x55a85e57f430 2024-09-10T10:40:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.216+0000 7f82177fe640 10 client.25195 handle_command_reply: tid=0 2024-09-10T10:40:38.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f8231406740 1 client.25195 shutdown 2024-09-10T10:40:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f8231406740 1 -- 172.21.15.92:0/3881037215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 msgr2=0x55a85e515410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:38.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f8231406740 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e515410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8218030e60 tx=0x7f8218003a20 comp rx=0 tx=0).stop 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f8231406740 1 -- 172.21.15.92:0/3881037215 shutdown_connections 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f8231406740 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a85e57f430 0x55a85e581890 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f8231406740 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a85e4febc0 0x55a85e515e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f82177fe640 0 client.25195 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f8231406740 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a85e4fb020 0x55a85e515950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f8231406740 1 --2- 172.21.15.92:0/3881037215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a85e4fa680 0x55a85e515410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.217+0000 7f8231406740 1 -- 172.21.15.92:0/3881037215 >> 172.21.15.92:0/3881037215 conn(0x55a85e4ecb10 msgr2=0x55a85e504370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.218+0000 7f8231406740 1 -- 172.21.15.92:0/3881037215 shutdown_connections 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.218+0000 7f8231406740 1 -- 172.21.15.92:0/3881037215 wait complete. 2024-09-10T10:40:38.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.218+0000 7f8231406740 20 client.25195 trim_cache size 0 max 16384 2024-09-10T10:40:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:40:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:40:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:40:38.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:40:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 -- 172.21.15.92:0/318126744 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f82080a2da0 msgr2=0x7f82080a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f82080a2da0 0x7f82080a5260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8220009fd0 tx=0x7f8220009500 comp rx=0 tx=0).stop 2024-09-10T10:40:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 -- 172.21.15.92:0/318126744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8228109b90 msgr2=0x7f82281a6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8228109b90 0x7f82281a6d80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f821000d6d0 tx=0x7f821000db90 comp rx=0 tx=0).stop 2024-09-10T10:40:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 -- 172.21.15.92:0/318126744 shutdown_connections 2024-09-10T10:40:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f82080a2da0 0x7f82080a5260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f822810ead0 0x7f82281a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8228109b90 0x7f82281a6d80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 --2- 172.21.15.92:0/318126744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f82281091f0 0x7f82281a6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 -- 172.21.15.92:0/318126744 >> 172.21.15.92:0/318126744 conn(0x7f822806d210 msgr2=0x7f8228072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 -- 172.21.15.92:0/318126744 shutdown_connections 2024-09-10T10:40:38.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:38.219+0000 7f822e58d640 1 -- 172.21.15.92:0/318126744 wait complete. 2024-09-10T10:40:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:39 smithi121 ceph-mon[35231]: pgmap v124: 97 pgs: 97 active+clean; 3.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-09-10T10:40:40.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:39 smithi097 ceph-mon[35213]: pgmap v124: 97 pgs: 97 active+clean; 3.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-09-10T10:40:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:39 smithi092 ceph-mon[30834]: pgmap v124: 97 pgs: 97 active+clean; 3.4 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-09-10T10:40:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:41 smithi121 ceph-mon[35231]: pgmap v125: 97 pgs: 97 active+clean; 3.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 1.09k op/s 2024-09-10T10:40:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:41 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:42.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:41 smithi097 ceph-mon[35213]: pgmap v125: 97 pgs: 97 active+clean; 3.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 1.09k op/s 2024-09-10T10:40:42.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:41 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:41 smithi092 ceph-mon[30834]: pgmap v125: 97 pgs: 97 active+clean; 3.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 14 MiB/s wr, 1.09k op/s 2024-09-10T10:40:42.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:41 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 225.0 s, 3508.8 tps, lat 28.416 ms stddev 30.981 2024-09-10T10:40:44.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:43 smithi121 ceph-mon[35231]: pgmap v126: 97 pgs: 97 active+clean; 3.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 693 op/s 2024-09-10T10:40:44.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:43 smithi097 ceph-mon[35213]: pgmap v126: 97 pgs: 97 active+clean; 3.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 693 op/s 2024-09-10T10:40:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:43 smithi092 ceph-mon[30834]: pgmap v126: 97 pgs: 97 active+clean; 3.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.4 MiB/s wr, 693 op/s 2024-09-10T10:40:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:45 smithi121 ceph-mon[35231]: pgmap v127: 97 pgs: 97 active+clean; 3.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 834 op/s 2024-09-10T10:40:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:45 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:40:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:45 smithi097 ceph-mon[35213]: pgmap v127: 97 pgs: 97 active+clean; 3.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 834 op/s 2024-09-10T10:40:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:45 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:40:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:45 smithi092 ceph-mon[30834]: pgmap v127: 97 pgs: 97 active+clean; 3.4 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 10 MiB/s wr, 834 op/s 2024-09-10T10:40:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:45 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:40:47.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:46 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:40:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:46 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:40:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:46 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:40:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:46 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:40:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:46 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:40:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:46 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:40:47.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:46 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:40:47.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:46 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:40:47.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:46 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:40:48.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:47 smithi121 ceph-mon[35231]: pgmap v128: 97 pgs: 97 active+clean; 3.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.7 MiB/s wr, 843 op/s 2024-09-10T10:40:48.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:47 smithi097 ceph-mon[35213]: pgmap v128: 97 pgs: 97 active+clean; 3.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.7 MiB/s wr, 843 op/s 2024-09-10T10:40:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:47 smithi092 ceph-mon[30834]: pgmap v128: 97 pgs: 97 active+clean; 3.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.7 MiB/s wr, 843 op/s 2024-09-10T10:40:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 230.0 s, 2667.8 tps, lat 37.589 ms stddev 40.654 2024-09-10T10:40:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:49 smithi121 ceph-mon[35231]: pgmap v129: 97 pgs: 97 active+clean; 3.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.2 MiB/s wr, 612 op/s 2024-09-10T10:40:50.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:49 smithi097 ceph-mon[35213]: pgmap v129: 97 pgs: 97 active+clean; 3.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.2 MiB/s wr, 612 op/s 2024-09-10T10:40:50.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:49 smithi092 ceph-mon[30834]: pgmap v129: 97 pgs: 97 active+clean; 3.4 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.2 MiB/s wr, 612 op/s 2024-09-10T10:40:51.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.336+0000 7f0f73531640 1 -- 172.21.15.92:0/3377472635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c1035c0 msgr2=0x7f0f6c10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.336+0000 7f0f73531640 1 --2- 172.21.15.92:0/3377472635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c1035c0 0x7f0f6c10baa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009900 tx=0x7f0f5c02a480 comp rx=0 tx=0).stop 2024-09-10T10:40:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.336+0000 7f0f73531640 1 -- 172.21.15.92:0/3377472635 shutdown_connections 2024-09-10T10:40:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.336+0000 7f0f73531640 1 --2- 172.21.15.92:0/3377472635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6c10c0f0 0x7f0f6c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.336+0000 7f0f73531640 1 --2- 172.21.15.92:0/3377472635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c1035c0 0x7f0f6c10baa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.336+0000 7f0f73531640 1 --2- 172.21.15.92:0/3377472635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f6c102ca0 0x7f0f6c103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.336+0000 7f0f73531640 1 -- 172.21.15.92:0/3377472635 >> 172.21.15.92:0/3377472635 conn(0x7f0f6c0fc6b0 msgr2=0x7f0f6c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.336+0000 7f0f73531640 1 -- 172.21.15.92:0/3377472635 shutdown_connections 2024-09-10T10:40:51.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.336+0000 7f0f73531640 1 -- 172.21.15.92:0/3377472635 wait complete. 2024-09-10T10:40:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.337+0000 7f0f73531640 1 Processor -- start 2024-09-10T10:40:51.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.337+0000 7f0f73531640 1 -- start start 2024-09-10T10:40:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f73531640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f6c102ca0 0x7f0f6c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f73531640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6c1035c0 0x7f0f6c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f73531640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c10c0f0 0x7f0f6c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f73531640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c111f20 con 0x7f0f6c1035c0 2024-09-10T10:40:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f73531640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c111da0 con 0x7f0f6c102ca0 2024-09-10T10:40:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f73531640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c1120a0 con 0x7f0f6c10c0f0 2024-09-10T10:40:51.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f712cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f6c102ca0 0x7f0f6c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f71ace640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c10c0f0 0x7f0f6c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f71ace640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c10c0f0 0x7f0f6c19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:48976/0 (socket says 172.21.15.92:48976) 2024-09-10T10:40:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f71ace640 1 -- 172.21.15.92:0/2402208044 learned_addr learned my addr 172.21.15.92:0/2402208044 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f71ace640 1 -- 172.21.15.92:0/2402208044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f6c102ca0 msgr2=0x7f0f6c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f71ace640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f6c102ca0 0x7f0f6c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.338+0000 7f0f71ace640 1 -- 172.21.15.92:0/2402208044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6c1035c0 msgr2=0x7f0f6c1987f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:40:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.339+0000 7f0f71ace640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6c1035c0 0x7f0f6c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.339+0000 7f0f71ace640 1 -- 172.21.15.92:0/2402208044 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c19d2a0 con 0x7f0f6c10c0f0 2024-09-10T10:40:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.339+0000 7f0f71ace640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c10c0f0 0x7f0f6c19cb70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400eaa0 tx=0x7f0f6400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.339+0000 7f0f627fc640 1 -- 172.21.15.92:0/2402208044 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64004d20 con 0x7f0f6c10c0f0 2024-09-10T10:40:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.339+0000 7f0f627fc640 1 -- 172.21.15.92:0/2402208044 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f64005020 con 0x7f0f6c10c0f0 2024-09-10T10:40:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.339+0000 7f0f73531640 1 -- 172.21.15.92:0/2402208044 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c19d590 con 0x7f0f6c10c0f0 2024-09-10T10:40:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.339+0000 7f0f627fc640 1 -- 172.21.15.92:0/2402208044 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f640116b0 con 0x7f0f6c10c0f0 2024-09-10T10:40:51.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.339+0000 7f0f73531640 1 -- 172.21.15.92:0/2402208044 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c1a4e20 con 0x7f0f6c10c0f0 2024-09-10T10:40:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f762ce740 1 Processor -- start 2024-09-10T10:40:51.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f627fc640 1 -- 172.21.15.92:0/2402208044 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0f640051d0 con 0x7f0f6c10c0f0 2024-09-10T10:40:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f762ce740 1 -- start start 2024-09-10T10:40:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a970a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a92660 0x556e55a92ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 0x556e55a9e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f762ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556e559ed2f0 con 0x556e55a93000 2024-09-10T10:40:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f762ce740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556e55995270 con 0x556e55a96cc0 2024-09-10T10:40:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f762ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556e559e92b0 con 0x556e55a92660 2024-09-10T10:40:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.344+0000 7f0f70acc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f70acc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:34512/0 (socket says 172.21.15.92:34512) 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f70acc640 1 -- 172.21.15.92:0/191298922 learned_addr learned my addr 172.21.15.92:0/191298922 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f712cd640 1 --2- 172.21.15.92:0/191298922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a92660 0x556e55a92ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f70acc640 1 --2- 172.21.15.92:0/191298922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 0x556e55a9e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f70acc640 1 -- 172.21.15.92:0/191298922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a92660 msgr2=0x556e55a92ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f70acc640 1 --2- 172.21.15.92:0/191298922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a92660 0x556e55a92ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f70acc640 1 -- 172.21.15.92:0/191298922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 msgr2=0x556e55a9e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f70acc640 1 --2- 172.21.15.92:0/191298922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 0x556e55a9e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f70acc640 1 -- 172.21.15.92:0/191298922 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e55994340 con 0x556e55a96cc0 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f627fc640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0f580a2e70 0x7f0f580a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f70acc640 1 --2- 172.21.15.92:0/191298922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a970a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c005ab0 tx=0x7f0f5c005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ee403003b9d231 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f627fc640 1 -- 172.21.15.92:0/2402208044 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f0f640cf5e0 con 0x7f0f6c10c0f0 2024-09-10T10:40:51.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f712cd640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0f580a2e70 0x7f0f580a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f577fe640 1 -- 172.21.15.92:0/191298922 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c035070 con 0x556e55a96cc0 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f577fe640 1 -- 172.21.15.92:0/191298922 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5c005530 con 0x556e55a96cc0 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.345+0000 7f0f577fe640 1 -- 172.21.15.92:0/191298922 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c004ba0 con 0x556e55a96cc0 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f762ce740 1 -- 172.21.15.92:0/191298922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 msgr2=0x556e55a970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f712cd640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0f580a2e70 0x7f0f580a5330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x556e55a86260 tx=0x7f0f6800a2d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f762ce740 1 --2- 172.21.15.92:0/191298922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a970a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c005ab0 tx=0x7f0f5c005d50 comp rx=0 tx=0).stop 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f762ce740 1 -- 172.21.15.92:0/191298922 shutdown_connections 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f762ce740 1 --2- 172.21.15.92:0/191298922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 0x556e55a9e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f762ce740 1 --2- 172.21.15.92:0/191298922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a92660 0x556e55a92ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f762ce740 1 --2- 172.21.15.92:0/191298922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a970a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f762ce740 1 -- 172.21.15.92:0/191298922 >> 172.21.15.92:0/191298922 conn(0x556e55a84b10 msgr2=0x556e55a84ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f762ce740 1 -- 172.21.15.92:0/191298922 shutdown_connections 2024-09-10T10:40:51.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.346+0000 7f0f762ce740 1 -- 172.21.15.92:0/191298922 wait complete. 2024-09-10T10:40:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.347+0000 7f0f762ce740 1 -- start start 2024-09-10T10:40:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.347+0000 7f0f762ce740 1 Processor -- start 2024-09-10T10:40:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.347+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a92660 0x556e55a9bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.347+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 0x556e55a9c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.347+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a9c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f762ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556e55a9f050 con 0x556e55a92660 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f762ce740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556e55976290 con 0x556e55a96cc0 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f762ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556e55a9f1d0 con 0x556e55a93000 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f762ce740 10 client.0 _ll_register_callbacks cb 0x556e559a7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f71ace640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a9c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f71ace640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a9c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:34526/0 (socket says 172.21.15.92:34526) 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f71ace640 1 -- 172.21.15.92:0/1860136743 learned_addr learned my addr 172.21.15.92:0/1860136743 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f70acc640 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 0x556e55a9c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f712cd640 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a92660 0x556e55a9bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f71ace640 1 -- 172.21.15.92:0/1860136743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 msgr2=0x556e55a9c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f71ace640 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 0x556e55a9c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f71ace640 1 -- 172.21.15.92:0/1860136743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a92660 msgr2=0x556e55a9bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f71ace640 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a92660 0x556e55a9bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f71ace640 1 -- 172.21.15.92:0/1860136743 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e55700210 con 0x556e55a96cc0 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f712cd640 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a92660 0x556e55a9bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f71ace640 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a9c920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f6409b810 tx=0x7f0f6409c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7540a9c17b90d6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.348+0000 7f0f54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.349+0000 7f0f54ff9640 1 -- 172.21.15.92:0/1860136743 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6401f070 con 0x556e55a96cc0 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.349+0000 7f0f762ce740 1 -- 172.21.15.92:0/1860136743 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f5c005530 con 0x556e55a96cc0 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.349+0000 7f0f54ff9640 1 -- 172.21.15.92:0/1860136743 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f0f640cf0e0 con 0x556e55a96cc0 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.349+0000 7f0f54ff9640 1 -- 172.21.15.92:0/1860136743 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f0f640cf2e0 con 0x556e55a96cc0 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.349+0000 7f0f762ce740 10 client.25160 fetch_fsmap learned FSMap version 43 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.349+0000 7f0f762ce740 1 -- 172.21.15.92:0/1860136743 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x556e557cc620 con 0x556e55a96cc0 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.349+0000 7f0f54ff9640 1 -- 172.21.15.92:0/1860136743 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5c005530 con 0x556e55a96cc0 2024-09-10T10:40:51.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f54ff9640 1 -- 172.21.15.92:0/1860136743 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7f0f6400f040 con 0x556e55a96cc0 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f762ce740 10 client.25160 fetch_fsmap finished waiting for FSMap version 43 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f762ce740 10 client.25160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f762ce740 20 client.25160 populate_metadata read hostname 'smithi092' 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f762ce740 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556e55a8cd90 0x556e55a8f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f762ce740 4 client.25160 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f762ce740 1 -- 172.21.15.92:0/1860136743 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e559faa20 con 0x556e55a8cd90 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f712cd640 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556e55a8cd90 0x556e55a8f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f712cd640 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556e55a8cd90 0x556e55a8f1e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d57868325223a34 server_cookie=a2e9fa25d2a633a3 in_seq=0 out_seq=0 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.350+0000 7f0f54ff9640 10 client.25160 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f54ff9640 1 -- 172.21.15.92:0/1860136743 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e559faa20 con 0x556e55a8cd90 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f54ff9640 10 client.25160 handle_command_reply: tid=0 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f762ce740 1 client.25160 shutdown 2024-09-10T10:40:51.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f762ce740 1 -- 172.21.15.92:0/1860136743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 msgr2=0x556e55a9c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f762ce740 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a9c920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f6409b810 tx=0x7f0f6409c340 comp rx=0 tx=0).stop 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f762ce740 1 -- 172.21.15.92:0/1860136743 shutdown_connections 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f762ce740 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556e55a8cd90 0x556e55a8f1e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f762ce740 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a96cc0 0x556e55a9c920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f762ce740 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 0x556e55a9c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f762ce740 1 --2- 172.21.15.92:0/1860136743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a92660 0x556e55a9bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f762ce740 1 -- 172.21.15.92:0/1860136743 >> 172.21.15.92:0/1860136743 conn(0x556e55a84b10 msgr2=0x556e55a91e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.351+0000 7f0f54ff9640 0 client.25160 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.352+0000 7f0f762ce740 1 -- 172.21.15.92:0/1860136743 shutdown_connections 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.352+0000 7f0f762ce740 1 -- 172.21.15.92:0/1860136743 wait complete. 2024-09-10T10:40:51.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.352+0000 7f0f762ce740 20 client.25160 trim_cache size 0 max 16384 2024-09-10T10:40:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.376+0000 7f0f762ce740 1 Processor -- start 2024-09-10T10:40:51.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f762ce740 1 -- start start 2024-09-10T10:40:51.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aad560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 0x556e55aadaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a96cc0 0x556e55a99100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f712cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f762ce740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c1ab450 con 0x556e55a96cc0 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f762ce740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c1ad050 con 0x556e55a92660 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f762ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c1abb20 con 0x556e55a93000 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f712cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aad560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:34530/0 (socket says 172.21.15.92:34530) 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.377+0000 7f0f712cd640 1 -- 172.21.15.92:0/2249724360 learned_addr learned my addr 172.21.15.92:0/2249724360 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.378+0000 7f0f70acc640 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 0x556e55aadaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.378+0000 7f0f71ace640 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a96cc0 0x556e55a99100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.378+0000 7f0f712cd640 1 -- 172.21.15.92:0/2249724360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 msgr2=0x556e55aadaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.378+0000 7f0f712cd640 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 0x556e55aadaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.378+0000 7f0f712cd640 1 -- 172.21.15.92:0/2249724360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a96cc0 msgr2=0x556e55a99100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.378+0000 7f0f712cd640 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a96cc0 0x556e55a99100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.378+0000 7f0f712cd640 1 -- 172.21.15.92:0/2249724360 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e55a85cd0 con 0x556e55a92660 2024-09-10T10:40:51.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.378+0000 7f0f71ace640 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a96cc0 0x556e55a99100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:40:51.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.383+0000 7f0f712cd640 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aad560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f68010c90 tx=0x7f0f68017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edee10859984e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:51.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.388+0000 7f0f56ffd640 1 -- 172.21.15.92:0/2249724360 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6801bbd0 con 0x556e55a92660 2024-09-10T10:40:51.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.388+0000 7f0f56ffd640 1 -- 172.21.15.92:0/2249724360 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f6801bd70 con 0x556e55a92660 2024-09-10T10:40:51.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.388+0000 7f0f56ffd640 1 -- 172.21.15.92:0/2249724360 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68027420 con 0x556e55a92660 2024-09-10T10:40:51.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.392+0000 7f0f762ce740 1 -- 172.21.15.92:0/2249724360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 msgr2=0x556e55aad560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:51.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.392+0000 7f0f762ce740 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aad560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f68010c90 tx=0x7f0f68017000 comp rx=0 tx=0).stop 2024-09-10T10:40:51.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.398+0000 7f0f762ce740 1 -- 172.21.15.92:0/2249724360 shutdown_connections 2024-09-10T10:40:51.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.398+0000 7f0f762ce740 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a96cc0 0x556e55a99100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.398+0000 7f0f762ce740 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a93000 0x556e55aadaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.398+0000 7f0f762ce740 1 --2- 172.21.15.92:0/2249724360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aad560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.398+0000 7f0f762ce740 1 -- 172.21.15.92:0/2249724360 >> 172.21.15.92:0/2249724360 conn(0x556e55a84b10 msgr2=0x556e55a9a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:51.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.402+0000 7f0f762ce740 1 -- 172.21.15.92:0/2249724360 shutdown_connections 2024-09-10T10:40:51.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.403+0000 7f0f762ce740 1 -- 172.21.15.92:0/2249724360 wait complete. 2024-09-10T10:40:51.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.403+0000 7f0f762ce740 1 -- start start 2024-09-10T10:40:51.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.404+0000 7f0f762ce740 1 Processor -- start 2024-09-10T10:40:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.404+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aa4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 0x556e55aa49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f712cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aa4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f712cd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aa4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:34534/0 (socket says 172.21.15.92:34534) 2024-09-10T10:40:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f762ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a96cc0 0x556e55a9f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f712cd640 1 -- 172.21.15.92:0/3481068756 learned_addr learned my addr 172.21.15.92:0/3481068756 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:40:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c1ac980 con 0x556e55a93000 2024-09-10T10:40:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c1ac280 con 0x556e55a92660 2024-09-10T10:40:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c1a9450 con 0x556e55a96cc0 2024-09-10T10:40:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f762ce740 10 client.0 _ll_register_callbacks cb 0x7f0f64004f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:40:51.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.405+0000 7f0f70acc640 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 0x556e55aa49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.406+0000 7f0f70acc640 1 -- 172.21.15.92:0/3481068756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a96cc0 msgr2=0x556e55a9f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.406+0000 7f0f70acc640 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a96cc0 0x556e55a9f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.406+0000 7f0f70acc640 1 -- 172.21.15.92:0/3481068756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 msgr2=0x556e55aa4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:40:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.406+0000 7f0f70acc640 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aa4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.406+0000 7f0f70acc640 1 -- 172.21.15.92:0/3481068756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e55aa5070 con 0x556e55a93000 2024-09-10T10:40:51.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.409+0000 7f0f70acc640 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 0x556e55aa49b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c005d00 tx=0x7f0f5c031c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd0e7f1b116afcc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:40:51.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.409+0000 7f0f54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:40:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.410+0000 7f0f54ff9640 1 -- 172.21.15.92:0/3481068756 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c035040 con 0x556e55a93000 2024-09-10T10:40:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.410+0000 7f0f54ff9640 1 -- 172.21.15.92:0/3481068756 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f0f5c004240 con 0x556e55a93000 2024-09-10T10:40:51.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.410+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f6801bd70 con 0x556e55a93000 2024-09-10T10:40:51.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.413+0000 7f0f54ff9640 1 -- 172.21.15.92:0/3481068756 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f0f5c07b050 con 0x556e55a93000 2024-09-10T10:40:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.417+0000 7f0f762ce740 10 client.15648 fetch_fsmap learned FSMap version 43 2024-09-10T10:40:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.417+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x556e55b0eb00 con 0x556e55a93000 2024-09-10T10:40:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.417+0000 7f0f54ff9640 1 -- 172.21.15.92:0/3481068756 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5c004440 con 0x556e55a93000 2024-09-10T10:40:51.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.418+0000 7f0f54ff9640 1 -- 172.21.15.92:0/3481068756 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) ==== 8394+0+0 (secure 0 0 0) 0x7f0f5c03a040 con 0x556e55a93000 2024-09-10T10:40:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.419+0000 7f0f762ce740 10 client.15648 fetch_fsmap finished waiting for FSMap version 43 2024-09-10T10:40:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.419+0000 7f0f762ce740 10 client.15648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:40:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.419+0000 7f0f762ce740 20 client.15648 populate_metadata read hostname 'smithi092' 2024-09-10T10:40:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.419+0000 7f0f762ce740 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556e55b0ee30 0x556e55b11220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:40:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.419+0000 7f0f762ce740 4 client.15648 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:40:51.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.419+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0f6801bd70 con 0x556e55b0ee30 2024-09-10T10:40:51.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.421+0000 7f0f712cd640 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556e55b0ee30 0x556e55b11220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:40:51.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.425+0000 7f0f712cd640 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556e55b0ee30 0x556e55b11220 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=873690150182bb4f server_cookie=eb2cb14859a71bd3 in_seq=0 out_seq=0 2024-09-10T10:40:51.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.425+0000 7f0f54ff9640 10 client.15648 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.442+0000 7f0f54ff9640 1 -- 172.21.15.92:0/3481068756 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0f6801bd70 con 0x556e55b0ee30 2024-09-10T10:40:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.442+0000 7f0f54ff9640 10 client.15648 handle_command_reply: tid=0 2024-09-10T10:40:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.442+0000 7f0f762ce740 1 client.15648 shutdown 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 msgr2=0x556e55aa49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 0x556e55aa49b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c005d00 tx=0x7f0f5c031c80 comp rx=0 tx=0).stop 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 shutdown_connections 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e55a96cc0 0x556e55a9f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556e55a93000 0x556e55aa49b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556e55b0ee30 0x556e55b11220 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 --2- 172.21.15.92:0/3481068756 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556e55a92660 0x556e55aa4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 >> 172.21.15.92:0/3481068756 conn(0x556e55a84b10 msgr2=0x556e55a9d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f54ff9640 0 client.15648 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:40:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 shutdown_connections 2024-09-10T10:40:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 1 -- 172.21.15.92:0/3481068756 wait complete. 2024-09-10T10:40:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.443+0000 7f0f762ce740 20 client.15648 trim_cache size 0 max 16384 2024-09-10T10:40:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:40:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:40:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:40:51.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:40:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 -- 172.21.15.92:0/2402208044 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0f580a2e70 msgr2=0x7f0f580a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0f580a2e70 0x7f0f580a5330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x556e55a86260 tx=0x7f0f6800a2d0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 -- 172.21.15.92:0/2402208044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c10c0f0 msgr2=0x7f0f6c19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:40:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c10c0f0 0x7f0f6c19cb70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400eaa0 tx=0x7f0f6400eea0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 -- 172.21.15.92:0/2402208044 shutdown_connections 2024-09-10T10:40:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f6c10c0f0 0x7f0f6c19cb70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f6c1035c0 0x7f0f6c1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0f580a2e70 0x7f0f580a5330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 --2- 172.21.15.92:0/2402208044 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0f6c102ca0 0x7f0f6c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:40:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 -- 172.21.15.92:0/2402208044 >> 172.21.15.92:0/2402208044 conn(0x7f0f6c0fc6b0 msgr2=0x7f0f6c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:40:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 -- 172.21.15.92:0/2402208044 shutdown_connections 2024-09-10T10:40:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:40:51.444+0000 7f0f73531640 1 -- 172.21.15.92:0/2402208044 wait complete. 2024-09-10T10:40:52.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:51 smithi121 ceph-mon[35231]: pgmap v130: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 905 op/s 2024-09-10T10:40:52.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:51 smithi097 ceph-mon[35213]: pgmap v130: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 905 op/s 2024-09-10T10:40:52.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:51 smithi092 ceph-mon[30834]: pgmap v130: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 905 op/s 2024-09-10T10:40:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 235.0 s, 3828.0 tps, lat 26.204 ms stddev 28.140 2024-09-10T10:40:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:53 smithi121 ceph-mon[35231]: pgmap v131: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-09-10T10:40:54.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:53 smithi097 ceph-mon[35213]: pgmap v131: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-09-10T10:40:54.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:53 smithi092 ceph-mon[30834]: pgmap v131: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-09-10T10:40:56.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:55 smithi121 ceph-mon[35231]: pgmap v132: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.5 MiB/s wr, 784 op/s 2024-09-10T10:40:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:55 smithi097 ceph-mon[35213]: pgmap v132: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.5 MiB/s wr, 784 op/s 2024-09-10T10:40:56.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:55 smithi092 ceph-mon[30834]: pgmap v132: 97 pgs: 97 active+clean; 3.4 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.5 MiB/s wr, 784 op/s 2024-09-10T10:40:58.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:57 smithi121 ceph-mon[35231]: pgmap v133: 97 pgs: 97 active+clean; 3.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.4 MiB/s wr, 805 op/s 2024-09-10T10:40:58.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:57 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:58.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:57 smithi097 ceph-mon[35213]: pgmap v133: 97 pgs: 97 active+clean; 3.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.4 MiB/s wr, 805 op/s 2024-09-10T10:40:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:57 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:57 smithi092 ceph-mon[30834]: pgmap v133: 97 pgs: 97 active+clean; 3.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.4 MiB/s wr, 805 op/s 2024-09-10T10:40:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:57 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:40:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 240.0 s, 3755.8 tps, lat 26.611 ms stddev 28.743 2024-09-10T10:41:00.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:59 smithi121 ceph-mon[35231]: pgmap v134: 97 pgs: 97 active+clean; 3.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.7 MiB/s wr, 637 op/s 2024-09-10T10:41:00.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:40:59 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:41:00.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:59 smithi097 ceph-mon[35213]: pgmap v134: 97 pgs: 97 active+clean; 3.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.7 MiB/s wr, 637 op/s 2024-09-10T10:41:00.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:40:59 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:41:00.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:59 smithi092 ceph-mon[30834]: pgmap v134: 97 pgs: 97 active+clean; 3.5 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.7 MiB/s wr, 637 op/s 2024-09-10T10:41:00.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:40:59 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:41:02.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:01 smithi121 ceph-mon[35231]: pgmap v135: 97 pgs: 97 active+clean; 3.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 969 op/s 2024-09-10T10:41:02.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:01 smithi097 ceph-mon[35213]: pgmap v135: 97 pgs: 97 active+clean; 3.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 969 op/s 2024-09-10T10:41:02.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:01 smithi092 ceph-mon[30834]: pgmap v135: 97 pgs: 97 active+clean; 3.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 969 op/s 2024-09-10T10:41:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 245.0 s, 1756.4 tps, lat 54.421 ms stddev 109.238 2024-09-10T10:41:04.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:03 smithi121 ceph-mon[35231]: pgmap v136: 97 pgs: 97 active+clean; 3.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.5 MiB/s wr, 676 op/s 2024-09-10T10:41:04.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:03 smithi097 ceph-mon[35213]: pgmap v136: 97 pgs: 97 active+clean; 3.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.5 MiB/s wr, 676 op/s 2024-09-10T10:41:04.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:03 smithi092 ceph-mon[30834]: pgmap v136: 97 pgs: 97 active+clean; 3.5 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.5 MiB/s wr, 676 op/s 2024-09-10T10:41:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.546+0000 7f44a84ac640 1 -- 172.21.15.92:0/1398231949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0101ae0 msgr2=0x7f44a0101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:04.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.546+0000 7f44a84ac640 1 --2- 172.21.15.92:0/1398231949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0101ae0 0x7f44a0101f40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f449c009930 tx=0x7f449c02a420 comp rx=0 tx=0).stop 2024-09-10T10:41:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.547+0000 7f44a84ac640 1 -- 172.21.15.92:0/1398231949 shutdown_connections 2024-09-10T10:41:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.547+0000 7f44a84ac640 1 --2- 172.21.15.92:0/1398231949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a0102480 0x7f44a010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.547+0000 7f44a84ac640 1 --2- 172.21.15.92:0/1398231949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0101ae0 0x7f44a0101f40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.547+0000 7f44a84ac640 1 --2- 172.21.15.92:0/1398231949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a0107b80 0x7f44a0107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.547+0000 7f44a84ac640 1 -- 172.21.15.92:0/1398231949 >> 172.21.15.92:0/1398231949 conn(0x7f44a00fd7e0 msgr2=0x7f44a00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.547+0000 7f44a84ac640 1 -- 172.21.15.92:0/1398231949 shutdown_connections 2024-09-10T10:41:04.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.547+0000 7f44a84ac640 1 -- 172.21.15.92:0/1398231949 wait complete. 2024-09-10T10:41:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.547+0000 7f44a84ac640 1 Processor -- start 2024-09-10T10:41:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a84ac640 1 -- start start 2024-09-10T10:41:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a84ac640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a0101ae0 0x7f44a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a84ac640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a0102480 0x7f44a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a84ac640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0107b80 0x7f44a0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a84ac640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0111f30 con 0x7f44a0107b80 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a84ac640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0111db0 con 0x7f44a0101ae0 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a84ac640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01120b0 con 0x7f44a0102480 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6248640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a0101ae0 0x7f44a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a5a47640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a0102480 0x7f44a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6a49640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0107b80 0x7f44a0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6248640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a0101ae0 0x7f44a00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:58404/0 (socket says 172.21.15.92:58404) 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6248640 1 -- 172.21.15.92:0/2277875208 learned_addr learned my addr 172.21.15.92:0/2277875208 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6a49640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0107b80 0x7f44a0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46330/0 (socket says 172.21.15.92:46330) 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6248640 1 -- 172.21.15.92:0/2277875208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a0102480 msgr2=0x7f44a0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6248640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a0102480 0x7f44a0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6248640 1 -- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0107b80 msgr2=0x7f44a0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6248640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0107b80 0x7f44a0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6248640 1 -- 172.21.15.92:0/2277875208 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a01a6890 con 0x7f44a0101ae0 2024-09-10T10:41:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.548+0000 7f44a6a49640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0107b80 0x7f44a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:41:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.549+0000 7f44a6248640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a0101ae0 0x7f44a00744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f449000e9f0 tx=0x7f449000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.549+0000 7f44977fe640 1 -- 172.21.15.92:0/2277875208 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449000cd80 con 0x7f44a0101ae0 2024-09-10T10:41:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.549+0000 7f44977fe640 1 -- 172.21.15.92:0/2277875208 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4490005500 con 0x7f44a0101ae0 2024-09-10T10:41:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.549+0000 7f44a84ac640 1 -- 172.21.15.92:0/2277875208 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a01a6b80 con 0x7f44a0101ae0 2024-09-10T10:41:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.549+0000 7f44977fe640 1 -- 172.21.15.92:0/2277875208 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490010690 con 0x7f44a0101ae0 2024-09-10T10:41:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.549+0000 7f44a84ac640 1 -- 172.21.15.92:0/2277875208 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a01a7050 con 0x7f44a0101ae0 2024-09-10T10:41:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.552+0000 7f44977fe640 1 -- 172.21.15.92:0/2277875208 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4490004f60 con 0x7f44a0101ae0 2024-09-10T10:41:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.553+0000 7f44977fe640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f448c0a2da0 0x7f448c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.553+0000 7f44ab24b740 1 Processor -- start 2024-09-10T10:41:04.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.553+0000 7f44977fe640 1 -- 172.21.15.92:0/2277875208 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f44900cf760 con 0x7f44a0101ae0 2024-09-10T10:41:04.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.553+0000 7f44a5a47640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f448c0a2da0 0x7f448c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.553+0000 7f44ab24b740 1 -- start start 2024-09-10T10:41:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3486af0 0x55cec3486ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec3491770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3491cb0 0x55cec34940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44ab24b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cec33eb2f0 con 0x55cec3486af0 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44ab24b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55cec3393270 con 0x55cec3487410 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44ab24b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cec33e72b0 con 0x55cec3491cb0 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6248640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3486af0 0x55cec3486ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6248640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3486af0 0x55cec3486ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46334/0 (socket says 172.21.15.92:46334) 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6248640 1 -- 172.21.15.92:0/1079035270 learned_addr learned my addr 172.21.15.92:0/1079035270 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6a49640 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3491cb0 0x55cec34940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a5a47640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f448c0a2da0 0x7f448c0a5260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f449c009900 tx=0x7f449c0058d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a5a47640 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec3491770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6248640 1 -- 172.21.15.92:0/1079035270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3491cb0 msgr2=0x55cec34940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6248640 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3491cb0 0x55cec34940a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6248640 1 -- 172.21.15.92:0/1079035270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 msgr2=0x55cec3491770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6248640 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec3491770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6248640 1 -- 172.21.15.92:0/1079035270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec3392340 con 0x55cec3486af0 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6a49640 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3491cb0 0x55cec34940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a5a47640 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec3491770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.554+0000 7f44a6248640 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3486af0 0x55cec3486ed0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f44900a4430 tx=0x7f449009b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b38ada71f6454c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.555+0000 7f4494bfe640 1 -- 172.21.15.92:0/1079035270 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900a00a0 con 0x55cec3486af0 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.555+0000 7f4494bfe640 1 -- 172.21.15.92:0/1079035270 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44900a4960 con 0x55cec3486af0 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.555+0000 7f4494bfe640 1 -- 172.21.15.92:0/1079035270 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900984f0 con 0x55cec3486af0 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.555+0000 7f44ab24b740 1 -- 172.21.15.92:0/1079035270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3486af0 msgr2=0x55cec3486ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.555+0000 7f44ab24b740 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3486af0 0x55cec3486ed0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f44900a4430 tx=0x7f449009b710 comp rx=0 tx=0).stop 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 -- 172.21.15.92:0/1079035270 shutdown_connections 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3491cb0 0x55cec34940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec3491770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 --2- 172.21.15.92:0/1079035270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3486af0 0x55cec3486ed0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 -- 172.21.15.92:0/1079035270 >> 172.21.15.92:0/1079035270 conn(0x55cec3483060 msgr2=0x55cec3483440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 -- 172.21.15.92:0/1079035270 shutdown_connections 2024-09-10T10:41:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 -- 172.21.15.92:0/1079035270 wait complete. 2024-09-10T10:41:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 -- start start 2024-09-10T10:41:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 Processor -- start 2024-09-10T10:41:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3486af0 0x55cec348ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3487410 0x55cec348f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec348f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cec3494880 con 0x55cec3491cb0 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55cec3374290 con 0x55cec3486af0 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cec3494a00 con 0x55cec3487410 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.556+0000 7f44ab24b740 10 client.0 _ll_register_callbacks cb 0x55cec33a5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a6248640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3486af0 0x55cec348ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a5a47640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3487410 0x55cec348f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a6a49640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec348f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a6248640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3486af0 0x55cec348ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:58414/0 (socket says 172.21.15.92:58414) 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a5a47640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3487410 0x55cec348f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:48550/0 (socket says 172.21.15.92:48550) 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a6248640 1 -- 172.21.15.92:0/298121111 learned_addr learned my addr 172.21.15.92:0/298121111 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a5a47640 1 -- 172.21.15.92:0/298121111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3486af0 msgr2=0x55cec348ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a5a47640 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3486af0 0x55cec348ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a5a47640 1 -- 172.21.15.92:0/298121111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 msgr2=0x55cec348f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a5a47640 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec348f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a5a47640 1 -- 172.21.15.92:0/298121111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec30fe210 con 0x55cec3487410 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a6248640 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3486af0 0x55cec348ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f4489ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.557+0000 7f44a5a47640 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3487410 0x55cec348f1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f449c005940 tx=0x7f449c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bc2cc0874b91b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.558+0000 7f4489ffb640 1 -- 172.21.15.92:0/298121111 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c035040 con 0x55cec3487410 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.558+0000 7f4489ffb640 1 -- 172.21.15.92:0/298121111 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f449c003a00 con 0x55cec3487410 2024-09-10T10:41:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.558+0000 7f44ab24b740 1 -- 172.21.15.92:0/298121111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44900a4960 con 0x55cec3487410 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f4489ffb640 1 -- 172.21.15.92:0/298121111 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f449c003c00 con 0x55cec3487410 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f44ab24b740 10 client.25222 fetch_fsmap learned FSMap version 45 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f44ab24b740 1 -- 172.21.15.92:0/298121111 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55cec31ca620 con 0x55cec3487410 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f4489ffb640 1 -- 172.21.15.92:0/298121111 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44900a4960 con 0x55cec3487410 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f4489ffb640 1 -- 172.21.15.92:0/298121111 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f449c05a020 con 0x55cec3487410 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f44ab24b740 10 client.25222 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f44ab24b740 10 client.25222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f44ab24b740 20 client.25222 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f44ab24b740 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cec34aa4c0 0x55cec34ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f44ab24b740 4 client.25222 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f44ab24b740 1 -- 172.21.15.92:0/298121111 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cec33f8a20 con 0x55cec34aa4c0 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.559+0000 7f44a6248640 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cec34aa4c0 0x55cec34ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.560+0000 7f44a6248640 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cec34aa4c0 0x55cec34ac8b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e8fdd5593d96e46 server_cookie=84a9e20ec7cb1750 in_seq=0 out_seq=0 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.560+0000 7f4489ffb640 10 client.25222 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.560+0000 7f4489ffb640 1 -- 172.21.15.92:0/298121111 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cec33f8a20 con 0x55cec34aa4c0 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.560+0000 7f4489ffb640 10 client.25222 handle_command_reply: tid=0 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.560+0000 7f44ab24b740 1 client.25222 shutdown 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 -- 172.21.15.92:0/298121111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3487410 msgr2=0x55cec348f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3487410 0x55cec348f1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f449c005940 tx=0x7f449c009260 comp rx=0 tx=0).stop 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 -- 172.21.15.92:0/298121111 shutdown_connections 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec348f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3487410 0x55cec348f1a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cec34aa4c0 0x55cec34ac8b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 --2- 172.21.15.92:0/298121111 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3486af0 0x55cec348ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f4489ffb640 0 client.25222 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 -- 172.21.15.92:0/298121111 >> 172.21.15.92:0/298121111 conn(0x55cec3483060 msgr2=0x55cec3488dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 -- 172.21.15.92:0/298121111 shutdown_connections 2024-09-10T10:41:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 1 -- 172.21.15.92:0/298121111 wait complete. 2024-09-10T10:41:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.561+0000 7f44ab24b740 20 client.25222 trim_cache size 0 max 16384 2024-09-10T10:41:04.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.578+0000 7f44ab24b740 1 Processor -- start 2024-09-10T10:41:04.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44ab24b740 1 -- start start 2024-09-10T10:41:04.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec3490bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec34b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec34b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44ab24b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01ab5a0 con 0x55cec3491cb0 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44ab24b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01ad170 con 0x55cec3487410 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44ab24b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01abc70 con 0x55cec3486af0 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6a49640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec34b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6248640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec3490bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6a49640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec34b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46340/0 (socket says 172.21.15.92:46340) 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6a49640 1 -- 172.21.15.92:0/2807678277 learned_addr learned my addr 172.21.15.92:0/2807678277 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a5a47640 1 --2- 172.21.15.92:0/2807678277 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec34b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6248640 1 -- 172.21.15.92:0/2807678277 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 msgr2=0x55cec34b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6248640 1 --2- 172.21.15.92:0/2807678277 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec34b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6248640 1 -- 172.21.15.92:0/2807678277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 msgr2=0x55cec34b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:04.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6248640 1 --2- 172.21.15.92:0/2807678277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec34b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6248640 1 -- 172.21.15.92:0/2807678277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec3484110 con 0x55cec3486af0 2024-09-10T10:41:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.579+0000 7f44a6248640 1 --2- 172.21.15.92:0/2807678277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec3490bd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f449000e9c0 tx=0x7f4490004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3198b4c97add2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f448bfff640 1 -- 172.21.15.92:0/2807678277 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900a4960 con 0x55cec3486af0 2024-09-10T10:41:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f448bfff640 1 -- 172.21.15.92:0/2807678277 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44900a00a0 con 0x55cec3486af0 2024-09-10T10:41:04.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f448bfff640 1 -- 172.21.15.92:0/2807678277 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900a4730 con 0x55cec3486af0 2024-09-10T10:41:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f44ab24b740 1 -- 172.21.15.92:0/2807678277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 msgr2=0x55cec3490bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2807678277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec3490bd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f449000e9c0 tx=0x7f4490004a40 comp rx=0 tx=0).stop 2024-09-10T10:41:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f44ab24b740 1 -- 172.21.15.92:0/2807678277 shutdown_connections 2024-09-10T10:41:04.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2807678277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec34b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2807678277 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec34b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2807678277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec3490bd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f44ab24b740 1 -- 172.21.15.92:0/2807678277 >> 172.21.15.92:0/2807678277 conn(0x55cec3483060 msgr2=0x55cec34904c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f44ab24b740 1 -- 172.21.15.92:0/2807678277 shutdown_connections 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.580+0000 7f44ab24b740 1 -- 172.21.15.92:0/2807678277 wait complete. 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44ab24b740 1 -- start start 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44ab24b740 1 Processor -- start 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec348bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec348c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44ab24b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec348c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44ab24b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01acaa0 con 0x55cec3491cb0 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44ab24b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01ac3d0 con 0x55cec3487410 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44ab24b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01a9580 con 0x55cec3486af0 2024-09-10T10:41:04.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44ab24b740 10 client.0 _ll_register_callbacks cb 0x7f449c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a6248640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec348bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a6a49640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec348c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a6248640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec348bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:48564/0 (socket says 172.21.15.92:48564) 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a6248640 1 -- 172.21.15.92:0/2244800914 learned_addr learned my addr 172.21.15.92:0/2244800914 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a5a47640 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec348c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a6248640 1 -- 172.21.15.92:0/2244800914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 msgr2=0x55cec348c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a6248640 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec348c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a6248640 1 -- 172.21.15.92:0/2244800914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 msgr2=0x55cec348c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a6248640 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec348c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.581+0000 7f44a6248640 1 -- 172.21.15.92:0/2244800914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec35140a0 con 0x55cec3486af0 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44a6248640 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec348bc50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44900986c0 tx=0x7f449009be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce26cd897289c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f4489ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:41:04.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f4489ffb640 1 -- 172.21.15.92:0/2244800914 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900a4960 con 0x55cec3486af0 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44ab24b740 1 -- 172.21.15.92:0/2244800914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44900a00a0 con 0x55cec3486af0 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f4489ffb640 1 -- 172.21.15.92:0/2244800914 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f44900a44d0 con 0x55cec3486af0 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f4489ffb640 1 -- 172.21.15.92:0/2244800914 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f44900a46d0 con 0x55cec3486af0 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44ab24b740 10 client.25228 fetch_fsmap learned FSMap version 45 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44ab24b740 1 -- 172.21.15.92:0/2244800914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55cec3515340 con 0x55cec3486af0 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f4489ffb640 1 -- 172.21.15.92:0/2244800914 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44900a00a0 con 0x55cec3486af0 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f4489ffb640 1 -- 172.21.15.92:0/2244800914 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f449009b1d0 con 0x55cec3486af0 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44ab24b740 10 client.25228 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44ab24b740 10 client.25228 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44ab24b740 20 client.25228 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cec34aa4c0 0x55cec3517630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44ab24b740 4 client.25228 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.582+0000 7f44ab24b740 1 -- 172.21.15.92:0/2244800914 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cec33f2d70 con 0x55cec34aa4c0 2024-09-10T10:41:04.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.583+0000 7f44a5a47640 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cec34aa4c0 0x55cec3517630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.583+0000 7f44a5a47640 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cec34aa4c0 0x55cec3517630 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5b6aa6d80071a54 server_cookie=570080d3e813191f in_seq=0 out_seq=0 2024-09-10T10:41:04.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.583+0000 7f4489ffb640 10 client.25228 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f4489ffb640 1 -- 172.21.15.92:0/2244800914 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cec33f2d70 con 0x55cec34aa4c0 2024-09-10T10:41:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f4489ffb640 10 client.25228 handle_command_reply: tid=0 2024-09-10T10:41:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 client.25228 shutdown 2024-09-10T10:41:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 -- 172.21.15.92:0/2244800914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 msgr2=0x55cec348bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec348bc50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44900986c0 tx=0x7f449009be70 comp rx=0 tx=0).stop 2024-09-10T10:41:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 -- 172.21.15.92:0/2244800914 shutdown_connections 2024-09-10T10:41:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec3491cb0 0x55cec348c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55cec34aa4c0 0x55cec3517630 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55cec3487410 0x55cec348c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f4489ffb640 0 client.25228 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 --2- 172.21.15.92:0/2244800914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cec3486af0 0x55cec348bc50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 -- 172.21.15.92:0/2244800914 >> 172.21.15.92:0/2244800914 conn(0x55cec3483060 msgr2=0x55cec3488d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 -- 172.21.15.92:0/2244800914 shutdown_connections 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 1 -- 172.21.15.92:0/2244800914 wait complete. 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.591+0000 7f44ab24b740 20 client.25228 trim_cache size 0 max 16384 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:41:04.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:41:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:41:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 -- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f448c0a2da0 msgr2=0x7f448c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f448c0a2da0 0x7f448c0a5260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f449c009900 tx=0x7f449c0058d0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 -- 172.21.15.92:0/2277875208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a0101ae0 msgr2=0x7f44a00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a0101ae0 0x7f44a00744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f449000e9f0 tx=0x7f449000edf0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 -- 172.21.15.92:0/2277875208 shutdown_connections 2024-09-10T10:41:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44a0107b80 0x7f44a0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44a0102480 0x7f44a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f448c0a2da0 0x7f448c0a5260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 --2- 172.21.15.92:0/2277875208 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f44a0101ae0 0x7f44a00744f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 -- 172.21.15.92:0/2277875208 >> 172.21.15.92:0/2277875208 conn(0x7f44a00fd7e0 msgr2=0x7f44a00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 -- 172.21.15.92:0/2277875208 shutdown_connections 2024-09-10T10:41:04.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:04.592+0000 7f44a84ac640 1 -- 172.21.15.92:0/2277875208 wait complete. 2024-09-10T10:41:06.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:05 smithi121 ceph-mon[35231]: pgmap v137: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 10 MiB/s wr, 779 op/s 2024-09-10T10:41:06.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:05 smithi097 ceph-mon[35213]: pgmap v137: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 10 MiB/s wr, 779 op/s 2024-09-10T10:41:06.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:05 smithi092 ceph-mon[30834]: pgmap v137: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 10 MiB/s wr, 779 op/s 2024-09-10T10:41:08.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:07 smithi121 ceph-mon[35231]: pgmap v138: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.4 MiB/s wr, 792 op/s 2024-09-10T10:41:08.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:07 smithi097 ceph-mon[35213]: pgmap v138: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.4 MiB/s wr, 792 op/s 2024-09-10T10:41:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:07 smithi092 ceph-mon[30834]: pgmap v138: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.4 MiB/s wr, 792 op/s 2024-09-10T10:41:08.153 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 250.0 s, 280.8 tps, lat 351.952 ms stddev 206.125 2024-09-10T10:41:10.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:09 smithi121 ceph-mon[35231]: pgmap v139: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.7 MiB/s wr, 630 op/s 2024-09-10T10:41:10.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:09 smithi097 ceph-mon[35213]: pgmap v139: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.7 MiB/s wr, 630 op/s 2024-09-10T10:41:10.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:09 smithi092 ceph-mon[30834]: pgmap v139: 97 pgs: 97 active+clean; 3.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.7 MiB/s wr, 630 op/s 2024-09-10T10:41:12.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:11 smithi121 ceph-mon[35231]: pgmap v140: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 MiB/s wr, 1.29k op/s 2024-09-10T10:41:12.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:11 smithi097 ceph-mon[35213]: pgmap v140: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 MiB/s wr, 1.29k op/s 2024-09-10T10:41:12.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:11 smithi092 ceph-mon[30834]: pgmap v140: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 MiB/s wr, 1.29k op/s 2024-09-10T10:41:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 255.0 s, 2231.8 tps, lat 47.166 ms stddev 109.737 2024-09-10T10:41:14.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:13 smithi121 ceph-mon[35231]: pgmap v141: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 963 op/s 2024-09-10T10:41:14.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:13 smithi097 ceph-mon[35213]: pgmap v141: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 963 op/s 2024-09-10T10:41:14.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:13 smithi092 ceph-mon[30834]: pgmap v141: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 MiB/s wr, 963 op/s 2024-09-10T10:41:16.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:15 smithi121 ceph-mon[35231]: pgmap v142: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 28 MiB/s wr, 1.03k op/s 2024-09-10T10:41:16.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:15 smithi097 ceph-mon[35213]: pgmap v142: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 28 MiB/s wr, 1.03k op/s 2024-09-10T10:41:16.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:15 smithi092 ceph-mon[30834]: pgmap v142: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 28 MiB/s wr, 1.03k op/s 2024-09-10T10:41:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.722+0000 7f064b198640 1 -- 172.21.15.92:0/4271296801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 msgr2=0x7f064410d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.722+0000 7f064b198640 1 --2- 172.21.15.92:0/4271296801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 0x7f064410d110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f063c009c10 tx=0x7f063c02a460 comp rx=0 tx=0).stop 2024-09-10T10:41:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.722+0000 7f064b198640 1 -- 172.21.15.92:0/4271296801 shutdown_connections 2024-09-10T10:41:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.722+0000 7f064b198640 1 --2- 172.21.15.92:0/4271296801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 0x7f064410d110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.722+0000 7f064b198640 1 --2- 172.21.15.92:0/4271296801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0644101d70 0x7f06441021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.722+0000 7f064b198640 1 --2- 172.21.15.92:0/4271296801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0644100490 0x7f0644100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.722+0000 7f064b198640 1 -- 172.21.15.92:0/4271296801 >> 172.21.15.92:0/4271296801 conn(0x7f06440770f0 msgr2=0x7f06440fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.722+0000 7f064b198640 1 -- 172.21.15.92:0/4271296801 shutdown_connections 2024-09-10T10:41:17.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.722+0000 7f064b198640 1 -- 172.21.15.92:0/4271296801 wait complete. 2024-09-10T10:41:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.723+0000 7f064b198640 1 Processor -- start 2024-09-10T10:41:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.723+0000 7f064b198640 1 -- start start 2024-09-10T10:41:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.723+0000 7f064b198640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0644100490 0x7f0644196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.723+0000 7f064b198640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0644101d70 0x7f0644196540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.723+0000 7f064b198640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 0x7f064419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.723+0000 7f064b198640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f064410fdd0 con 0x7f0644101d70 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.723+0000 7f064b198640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f064410fc50 con 0x7f0644100490 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.723+0000 7f064b198640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f064410ff50 con 0x7f06441026f0 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0649735640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 0x7f064419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0648f34640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0644100490 0x7f0644196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0649735640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 0x7f064419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:45570/0 (socket says 172.21.15.92:45570) 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0649735640 1 -- 172.21.15.92:0/426406890 learned_addr learned my addr 172.21.15.92:0/426406890 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0648f34640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0644100490 0x7f0644196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:42788/0 (socket says 172.21.15.92:42788) 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0643fff640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0644101d70 0x7f0644196540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0648f34640 1 -- 172.21.15.92:0/426406890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 msgr2=0x7f064419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0648f34640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 0x7f064419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0648f34640 1 -- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0644101d70 msgr2=0x7f0644196540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0648f34640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0644101d70 0x7f0644196540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0648f34640 1 -- 172.21.15.92:0/426406890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064419aff0 con 0x7f0644100490 2024-09-10T10:41:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.724+0000 7f0649735640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 0x7f064419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:41:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.725+0000 7f0648f34640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0644100490 0x7f0644196000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f063400ab60 tx=0x7f063400c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.725+0000 7f0641ffb640 1 -- 172.21.15.92:0/426406890 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063400ae60 con 0x7f0644100490 2024-09-10T10:41:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.725+0000 7f0641ffb640 1 -- 172.21.15.92:0/426406890 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06340035f0 con 0x7f0644100490 2024-09-10T10:41:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.725+0000 7f064b198640 1 -- 172.21.15.92:0/426406890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064419b2e0 con 0x7f0644100490 2024-09-10T10:41:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.725+0000 7f0641ffb640 1 -- 172.21.15.92:0/426406890 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634017680 con 0x7f0644100490 2024-09-10T10:41:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.725+0000 7f064b198640 1 -- 172.21.15.92:0/426406890 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06441a2b70 con 0x7f0644100490 2024-09-10T10:41:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.728+0000 7f0641ffb640 1 -- 172.21.15.92:0/426406890 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0634004020 con 0x7f0644100490 2024-09-10T10:41:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.729+0000 7f064e012740 1 Processor -- start 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.730+0000 7f0641ffb640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f062c0a2df0 0x7f062c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.730+0000 7f064e012740 1 -- start start 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.730+0000 7f0641ffb640 1 -- 172.21.15.92:0/426406890 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f06340cf300 con 0x7f0644100490 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.730+0000 7f064e012740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce417eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.730+0000 7f064e012740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4189770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.730+0000 7f064e012740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce418c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.730+0000 7f064e012740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562ce40e32f0 con 0x562ce417eaf0 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.730+0000 7f064e012740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562ce408b270 con 0x562ce417f410 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.730+0000 7f064e012740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562ce40df2b0 con 0x562ce4189cb0 2024-09-10T10:41:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0643fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4189770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0643fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4189770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:42798/0 (socket says 172.21.15.92:42798) 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0643fff640 1 -- 172.21.15.92:0/2470308209 learned_addr learned my addr 172.21.15.92:0/2470308209 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0649735640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f062c0a2df0 0x7f062c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0648f34640 1 --2- 172.21.15.92:0/2470308209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce417eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0649735640 1 --2- 172.21.15.92:0/2470308209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce418c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0643fff640 1 -- 172.21.15.92:0/2470308209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 msgr2=0x562ce418c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0643fff640 1 --2- 172.21.15.92:0/2470308209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce418c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0643fff640 1 -- 172.21.15.92:0/2470308209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 msgr2=0x562ce417eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0643fff640 1 --2- 172.21.15.92:0/2470308209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce417eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.731+0000 7f0643fff640 1 -- 172.21.15.92:0/2470308209 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce408a340 con 0x562ce417f410 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.732+0000 7f0643fff640 1 --2- 172.21.15.92:0/2470308209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4189770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0638009ba0 tx=0x7f06380117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40159f4396c0dc58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.732+0000 7f0649735640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f062c0a2df0 0x7f062c0a52b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f063c0099a0 tx=0x7f063c030e00 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.732+0000 7f062affd640 1 -- 172.21.15.92:0/2470308209 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638012450 con 0x562ce417f410 2024-09-10T10:41:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.732+0000 7f062affd640 1 -- 172.21.15.92:0/2470308209 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0638012ad0 con 0x562ce417f410 2024-09-10T10:41:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.732+0000 7f062affd640 1 -- 172.21.15.92:0/2470308209 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063800fb50 con 0x562ce417f410 2024-09-10T10:41:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.733+0000 7f064e012740 1 -- 172.21.15.92:0/2470308209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 msgr2=0x562ce4189770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.733+0000 7f064e012740 1 --2- 172.21.15.92:0/2470308209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4189770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0638009ba0 tx=0x7f06380117b0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.733+0000 7f064e012740 1 -- 172.21.15.92:0/2470308209 shutdown_connections 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.733+0000 7f064e012740 1 --2- 172.21.15.92:0/2470308209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce418c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.733+0000 7f064e012740 1 --2- 172.21.15.92:0/2470308209 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4189770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.733+0000 7f064e012740 1 --2- 172.21.15.92:0/2470308209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce417eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.733+0000 7f064e012740 1 -- 172.21.15.92:0/2470308209 >> 172.21.15.92:0/2470308209 conn(0x562ce417b060 msgr2=0x562ce417b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.733+0000 7f064e012740 1 -- 172.21.15.92:0/2470308209 shutdown_connections 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.733+0000 7f064e012740 1 -- 172.21.15.92:0/2470308209 wait complete. 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.734+0000 7f064e012740 1 -- start start 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.734+0000 7f064e012740 1 Processor -- start 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.734+0000 7f064e012740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce4186b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.734+0000 7f064e012740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4187080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.734+0000 7f064e012740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41875c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.734+0000 7f064e012740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562ce418c8d0 con 0x562ce417eaf0 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.734+0000 7f064e012740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562ce406c290 con 0x562ce417f410 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.734+0000 7f064e012740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562ce418ca50 con 0x562ce4189cb0 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f064e012740 10 client.0 _ll_register_callbacks cb 0x562ce409d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0648f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce4186b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0648f34640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce4186b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39698/0 (socket says 172.21.15.92:39698) 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0648f34640 1 -- 172.21.15.92:0/1003372729 learned_addr learned my addr 172.21.15.92:0/1003372729 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0649735640 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0643fff640 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4187080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0648f34640 1 -- 172.21.15.92:0/1003372729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 msgr2=0x562ce41875c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0648f34640 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41875c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0648f34640 1 -- 172.21.15.92:0/1003372729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 msgr2=0x562ce4187080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0648f34640 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4187080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0648f34640 1 -- 172.21.15.92:0/1003372729 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce3df6210 con 0x562ce417eaf0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.735+0000 7f0643fff640 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4187080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.736+0000 7f0648f34640 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce4186b40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0634098260 tx=0x7f063409b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691ab2890b156aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.736+0000 7f0623fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.736+0000 7f0623fff640 1 -- 172.21.15.92:0/1003372729 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634004310 con 0x562ce417eaf0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.736+0000 7f064e012740 1 -- 172.21.15.92:0/1003372729 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0638012ad0 con 0x562ce417eaf0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.736+0000 7f0623fff640 1 -- 172.21.15.92:0/1003372729 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f0634097f00 con 0x562ce417eaf0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.737+0000 7f0623fff640 1 -- 172.21.15.92:0/1003372729 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f063409baf0 con 0x562ce417eaf0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.737+0000 7f064e012740 10 client.15678 fetch_fsmap learned FSMap version 45 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.737+0000 7f064e012740 1 -- 172.21.15.92:0/1003372729 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x562ce3ec2620 con 0x562ce417eaf0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.737+0000 7f0623fff640 1 -- 172.21.15.92:0/1003372729 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0638012ad0 con 0x562ce417eaf0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.738+0000 7f0623fff640 1 -- 172.21.15.92:0/1003372729 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f063400b040 con 0x562ce417eaf0 2024-09-10T10:41:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.738+0000 7f064e012740 10 client.15678 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T10:41:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.738+0000 7f064e012740 10 client.15678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.738+0000 7f064e012740 20 client.15678 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.738+0000 7f064e012740 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ce41ab170 0x562ce41ad610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.738+0000 7f064e012740 4 client.15678 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:41:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.738+0000 7f064e012740 1 -- 172.21.15.92:0/1003372729 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ce40f0a20 con 0x562ce41ab170 2024-09-10T10:41:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.738+0000 7f0643fff640 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ce41ab170 0x562ce41ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.739+0000 7f0643fff640 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ce41ab170 0x562ce41ad610 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f63b72e79b687b server_cookie=b0b43635cbd8100e in_seq=0 out_seq=0 2024-09-10T10:41:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.739+0000 7f0623fff640 10 client.15678 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.739+0000 7f0623fff640 1 -- 172.21.15.92:0/1003372729 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ce40f0a20 con 0x562ce41ab170 2024-09-10T10:41:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f0623fff640 10 client.15678 handle_command_reply: tid=0 2024-09-10T10:41:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 client.15678 shutdown 2024-09-10T10:41:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 -- 172.21.15.92:0/1003372729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 msgr2=0x562ce4186b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce4186b40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0634098260 tx=0x7f063409b890 comp rx=0 tx=0).stop 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 -- 172.21.15.92:0/1003372729 shutdown_connections 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41875c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ce41ab170 0x562ce41ad610 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4187080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 --2- 172.21.15.92:0/1003372729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce4186b40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 -- 172.21.15.92:0/1003372729 >> 172.21.15.92:0/1003372729 conn(0x562ce417b060 msgr2=0x562ce4180dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f0623fff640 0 client.15678 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 -- 172.21.15.92:0/1003372729 shutdown_connections 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 1 -- 172.21.15.92:0/1003372729 wait complete. 2024-09-10T10:41:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.740+0000 7f064e012740 20 client.15678 trim_cache size 0 max 16384 2024-09-10T10:41:17.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.761+0000 7f064e012740 1 Processor -- start 2024-09-10T10:41:17.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.761+0000 7f064e012740 1 -- start start 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f064e012740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce41873f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f064e012740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4188ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f064e012740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f064e012740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06441a2e10 con 0x562ce417eaf0 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f064e012740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f06441a49e0 con 0x562ce417f410 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f064e012740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f06441a34e0 con 0x562ce4189cb0 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f0649735640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f0649735640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:45594/0 (socket says 172.21.15.92:45594) 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f0649735640 1 -- 172.21.15.92:0/1811778118 learned_addr learned my addr 172.21.15.92:0/1811778118 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f0648f34640 1 --2- 172.21.15.92:0/1811778118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce41873f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f0649735640 1 -- 172.21.15.92:0/1811778118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 msgr2=0x562ce4188ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f0649735640 1 --2- 172.21.15.92:0/1811778118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4188ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f0649735640 1 -- 172.21.15.92:0/1811778118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 msgr2=0x562ce41873f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f0649735640 1 --2- 172.21.15.92:0/1811778118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce41873f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.762+0000 7f0649735640 1 -- 172.21.15.92:0/1811778118 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce417f240 con 0x562ce4189cb0 2024-09-10T10:41:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.763+0000 7f0649735640 1 --2- 172.21.15.92:0/1811778118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41b2f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f063c034040 tx=0x7f063c04c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd7240a63a1fb9bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.763+0000 7f062a7fc640 1 -- 172.21.15.92:0/1811778118 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c05a070 con 0x562ce4189cb0 2024-09-10T10:41:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.763+0000 7f062a7fc640 1 -- 172.21.15.92:0/1811778118 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f063c003e50 con 0x562ce4189cb0 2024-09-10T10:41:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.763+0000 7f062a7fc640 1 -- 172.21.15.92:0/1811778118 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c031440 con 0x562ce4189cb0 2024-09-10T10:41:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 -- 172.21.15.92:0/1811778118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 msgr2=0x562ce41b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 --2- 172.21.15.92:0/1811778118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41b2f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f063c034040 tx=0x7f063c04c000 comp rx=0 tx=0).stop 2024-09-10T10:41:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 -- 172.21.15.92:0/1811778118 shutdown_connections 2024-09-10T10:41:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 --2- 172.21.15.92:0/1811778118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce4189cb0 0x562ce41b2f20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 --2- 172.21.15.92:0/1811778118 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4188ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 --2- 172.21.15.92:0/1811778118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce417eaf0 0x562ce41873f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 -- 172.21.15.92:0/1811778118 >> 172.21.15.92:0/1811778118 conn(0x562ce417b060 msgr2=0x562ce41883a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 -- 172.21.15.92:0/1811778118 shutdown_connections 2024-09-10T10:41:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 -- 172.21.15.92:0/1811778118 wait complete. 2024-09-10T10:41:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 -- start start 2024-09-10T10:41:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.764+0000 7f064e012740 1 Processor -- start 2024-09-10T10:41:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.765+0000 7f064e012740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce417eaf0 0x562ce4191d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.765+0000 7f064e012740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4192250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.765+0000 7f064e012740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce4189cb0 0x562ce4183180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.765+0000 7f0648f34640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce417eaf0 0x562ce4191d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.765+0000 7f0648f34640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce417eaf0 0x562ce4191d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:45606/0 (socket says 172.21.15.92:45606) 2024-09-10T10:41:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.765+0000 7f0649735640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce4189cb0 0x562ce4183180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.765+0000 7f0648f34640 1 -- 172.21.15.92:0/88578779 learned_addr learned my addr 172.21.15.92:0/88578779 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06441a4310 con 0x562ce4189cb0 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.765+0000 7f0643fff640 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4192250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f06441a3c40 con 0x562ce417f410 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0644072530 con 0x562ce417eaf0 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f064e012740 10 client.0 _ll_register_callbacks cb 0x7f063409b660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f0648f34640 1 -- 172.21.15.92:0/88578779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 msgr2=0x562ce4192250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f0648f34640 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4192250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f0648f34640 1 -- 172.21.15.92:0/88578779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce4189cb0 msgr2=0x562ce4183180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f0648f34640 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce4189cb0 0x562ce4183180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f0648f34640 1 -- 172.21.15.92:0/88578779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce41836c0 con 0x562ce417eaf0 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f0648f34640 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce417eaf0 0x562ce4191d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0634097cf0 tx=0x7f063409b0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e12ebfe983bbaf1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.766+0000 7f0623fff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f0623fff640 1 -- 172.21.15.92:0/88578779 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634004310 con 0x562ce417eaf0 2024-09-10T10:41:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f0623fff640 1 -- 172.21.15.92:0/88578779 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f0634097f00 con 0x562ce417eaf0 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f063c003e50 con 0x562ce417eaf0 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f0623fff640 1 -- 172.21.15.92:0/88578779 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f06340ba2a0 con 0x562ce417eaf0 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f064e012740 10 client.25243 fetch_fsmap learned FSMap version 45 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x562ce42156a0 con 0x562ce417eaf0 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f0623fff640 1 -- 172.21.15.92:0/88578779 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f063c003e50 con 0x562ce417eaf0 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f0623fff640 1 -- 172.21.15.92:0/88578779 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f06340b4b70 con 0x562ce417eaf0 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f064e012740 10 client.25243 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f064e012740 10 client.25243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f064e012740 20 client.25243 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f064e012740 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ce4215c60 0x562ce4218080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f064e012740 4 client.25243 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.767+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ce40ead70 con 0x562ce4215c60 2024-09-10T10:41:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.768+0000 7f0643fff640 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ce4215c60 0x562ce4218080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.768+0000 7f0623fff640 10 client.25243 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.768+0000 7f0643fff640 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ce4215c60 0x562ce4218080 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2985fde591a882bb server_cookie=1940bb6b6ca0986 in_seq=0 out_seq=0 2024-09-10T10:41:17.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.775+0000 7f0623fff640 1 -- 172.21.15.92:0/88578779 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562ce40ead70 con 0x562ce4215c60 2024-09-10T10:41:17.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.775+0000 7f0623fff640 10 client.25243 handle_command_reply: tid=0 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.775+0000 7f064e012740 1 client.25243 shutdown 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.775+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce417eaf0 msgr2=0x562ce4191d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.775+0000 7f064e012740 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce417eaf0 0x562ce4191d10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0634097cf0 tx=0x7f063409b0b0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 shutdown_connections 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f064e012740 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ce4189cb0 0x562ce4183180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f064e012740 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ce4215c60 0x562ce4218080 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f064e012740 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ce417f410 0x562ce4192250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f064e012740 1 --2- 172.21.15.92:0/88578779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ce417eaf0 0x562ce4191d10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 >> 172.21.15.92:0/88578779 conn(0x562ce417b060 msgr2=0x562ce4180d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f0623fff640 0 client.25243 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 shutdown_connections 2024-09-10T10:41:17.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f064e012740 1 -- 172.21.15.92:0/88578779 wait complete. 2024-09-10T10:41:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.776+0000 7f064e012740 20 client.25243 trim_cache size 0 max 16384 2024-09-10T10:41:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:41:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:41:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:41:17.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:41:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 -- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f062c0a2df0 msgr2=0x7f062c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f062c0a2df0 0x7f062c0a52b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f063c0099a0 tx=0x7f063c030e00 comp rx=0 tx=0).stop 2024-09-10T10:41:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 -- 172.21.15.92:0/426406890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0644100490 msgr2=0x7f0644196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0644100490 0x7f0644196000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f063400ab60 tx=0x7f063400c740 comp rx=0 tx=0).stop 2024-09-10T10:41:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 -- 172.21.15.92:0/426406890 shutdown_connections 2024-09-10T10:41:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06441026f0 0x7f064419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0644101d70 0x7f0644196540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f062c0a2df0 0x7f062c0a52b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 --2- 172.21.15.92:0/426406890 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0644100490 0x7f0644196000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.777+0000 7f064b198640 1 -- 172.21.15.92:0/426406890 >> 172.21.15.92:0/426406890 conn(0x7f06440770f0 msgr2=0x7f0644103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.778+0000 7f064b198640 1 -- 172.21.15.92:0/426406890 shutdown_connections 2024-09-10T10:41:17.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:17.778+0000 7f064b198640 1 -- 172.21.15.92:0/426406890 wait complete. 2024-09-10T10:41:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:17 smithi121 ceph-mon[35231]: pgmap v143: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 1.39k op/s 2024-09-10T10:41:18.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:17 smithi097 ceph-mon[35213]: pgmap v143: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 1.39k op/s 2024-09-10T10:41:18.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:17 smithi092 ceph-mon[30834]: pgmap v143: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 1.39k op/s 2024-09-10T10:41:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 260.0 s, 3029.2 tps, lat 32.975 ms stddev 35.152 2024-09-10T10:41:20.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:19 smithi121 ceph-mon[35231]: pgmap v144: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 1.19k op/s 2024-09-10T10:41:20.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:19 smithi097 ceph-mon[35213]: pgmap v144: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 1.19k op/s 2024-09-10T10:41:20.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:19 smithi092 ceph-mon[30834]: pgmap v144: 97 pgs: 97 active+clean; 3.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 MiB/s wr, 1.19k op/s 2024-09-10T10:41:22.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:21 smithi121 ceph-mon[35231]: pgmap v145: 97 pgs: 97 active+clean; 3.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 1.49k op/s 2024-09-10T10:41:22.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:21 smithi097 ceph-mon[35213]: pgmap v145: 97 pgs: 97 active+clean; 3.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 1.49k op/s 2024-09-10T10:41:22.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:21 smithi092 ceph-mon[30834]: pgmap v145: 97 pgs: 97 active+clean; 3.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 MiB/s wr, 1.49k op/s 2024-09-10T10:41:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 265.0 s, 2998.4 tps, lat 33.486 ms stddev 34.500 2024-09-10T10:41:24.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:23 smithi121 ceph-mon[35231]: pgmap v146: 97 pgs: 97 active+clean; 3.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 13 MiB/s wr, 825 op/s 2024-09-10T10:41:24.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:23 smithi097 ceph-mon[35213]: pgmap v146: 97 pgs: 97 active+clean; 3.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 13 MiB/s wr, 825 op/s 2024-09-10T10:41:24.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:23 smithi092 ceph-mon[30834]: pgmap v146: 97 pgs: 97 active+clean; 3.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 13 MiB/s wr, 825 op/s 2024-09-10T10:41:26.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:25 smithi121 ceph-mon[35231]: pgmap v147: 97 pgs: 97 active+clean; 3.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 15 MiB/s wr, 929 op/s 2024-09-10T10:41:26.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:25 smithi097 ceph-mon[35213]: pgmap v147: 97 pgs: 97 active+clean; 3.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 15 MiB/s wr, 929 op/s 2024-09-10T10:41:26.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:25 smithi092 ceph-mon[30834]: pgmap v147: 97 pgs: 97 active+clean; 3.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 15 MiB/s wr, 929 op/s 2024-09-10T10:41:28.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:27 smithi121 ceph-mon[35231]: pgmap v148: 97 pgs: 97 active+clean; 3.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-10T10:41:28.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:27 smithi097 ceph-mon[35213]: pgmap v148: 97 pgs: 97 active+clean; 3.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-10T10:41:28.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:27 smithi092 ceph-mon[30834]: pgmap v148: 97 pgs: 97 active+clean; 3.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-10T10:41:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 270.0 s, 3135.6 tps, lat 31.788 ms stddev 33.830 2024-09-10T10:41:30.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:29 smithi121 ceph-mon[35231]: pgmap v149: 97 pgs: 97 active+clean; 3.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-09-10T10:41:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:29 smithi097 ceph-mon[35213]: pgmap v149: 97 pgs: 97 active+clean; 3.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-09-10T10:41:30.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:29 smithi092 ceph-mon[30834]: pgmap v149: 97 pgs: 97 active+clean; 3.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-09-10T10:41:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.896+0000 7f452b39b640 1 -- 172.21.15.92:0/3458234131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4524108c40 msgr2=0x7f452410cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.896+0000 7f452b39b640 1 --2- 172.21.15.92:0/3458234131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4524108c40 0x7f452410cb70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4514009900 tx=0x7f451402a410 comp rx=0 tx=0).stop 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.896+0000 7f452b39b640 1 -- 172.21.15.92:0/3458234131 shutdown_connections 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.896+0000 7f452b39b640 1 --2- 172.21.15.92:0/3458234131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452410d2d0 0x7f4524114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.896+0000 7f452b39b640 1 --2- 172.21.15.92:0/3458234131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4524108c40 0x7f452410cb70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.896+0000 7f452b39b640 1 --2- 172.21.15.92:0/3458234131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4524108290 0x7f4524108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.896+0000 7f452b39b640 1 -- 172.21.15.92:0/3458234131 >> 172.21.15.92:0/3458234131 conn(0x7f45240778f0 msgr2=0x7f4524079d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.896+0000 7f452b39b640 1 -- 172.21.15.92:0/3458234131 shutdown_connections 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.896+0000 7f452b39b640 1 -- 172.21.15.92:0/3458234131 wait complete. 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452b39b640 1 Processor -- start 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452b39b640 1 -- start start 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452b39b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4524108290 0x7f45241a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452b39b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f452410d2d0 0x7f45241a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452b39b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452419e720 0x7f452419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452b39b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45241182d0 con 0x7f452410d2d0 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452b39b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4524118150 con 0x7f452419e720 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452b39b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4524118450 con 0x7f4524108290 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f4529b98640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f452410d2d0 0x7f45241a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452ab9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452419e720 0x7f452419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f4529b98640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f452410d2d0 0x7f45241a4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38580/0 (socket says 172.21.15.92:38580) 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f4529b98640 1 -- 172.21.15.92:0/3249786542 learned_addr learned my addr 172.21.15.92:0/3249786542 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.897+0000 7f452ab9a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452419e720 0x7f452419ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35544/0 (socket says 172.21.15.92:35544) 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.898+0000 7f4529b98640 1 -- 172.21.15.92:0/3249786542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4524108290 msgr2=0x7f45241a45d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.898+0000 7f4529b98640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4524108290 0x7f45241a45d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.898+0000 7f4529b98640 1 -- 172.21.15.92:0/3249786542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452419e720 msgr2=0x7f452419ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.898+0000 7f4529b98640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452419e720 0x7f452419ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.898+0000 7f4529b98640 1 -- 172.21.15.92:0/3249786542 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452419f300 con 0x7f452410d2d0 2024-09-10T10:41:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.899+0000 7f4529b98640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f452410d2d0 0x7f45241a4b10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4514005940 tx=0x7f4514031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.899+0000 7f451b7fe640 1 -- 172.21.15.92:0/3249786542 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514050030 con 0x7f452410d2d0 2024-09-10T10:41:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.899+0000 7f451b7fe640 1 -- 172.21.15.92:0/3249786542 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4514003ad0 con 0x7f452410d2d0 2024-09-10T10:41:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.899+0000 7f451b7fe640 1 -- 172.21.15.92:0/3249786542 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514035070 con 0x7f452410d2d0 2024-09-10T10:41:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.899+0000 7f452b39b640 1 -- 172.21.15.92:0/3249786542 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452406bc10 con 0x7f452410d2d0 2024-09-10T10:41:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.899+0000 7f452b39b640 1 -- 172.21.15.92:0/3249786542 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452406c040 con 0x7f452410d2d0 2024-09-10T10:41:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.903+0000 7f452f481740 1 Processor -- start 2024-09-10T10:41:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452f481740 1 -- start start 2024-09-10T10:41:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452f481740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077307cc0 0x55a0773080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452f481740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077312940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452f481740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 0x55a077315270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452f481740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a07726c2f0 con 0x55a077312e80 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452f481740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a077214270 con 0x55a0773085e0 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452f481740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a0772682b0 con 0x55a077307cc0 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452a399640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077312940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f451b7fe640 1 -- 172.21.15.92:0/3249786542 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4514053030 con 0x7f452410d2d0 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452a399640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077312940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35550/0 (socket says 172.21.15.92:35550) 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452a399640 1 -- 172.21.15.92:0/1579858351 learned_addr learned my addr 172.21.15.92:0/1579858351 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452ab9a640 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077307cc0 0x55a0773080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452a399640 1 -- 172.21.15.92:0/1579858351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077307cc0 msgr2=0x55a0773080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452a399640 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077307cc0 0x55a0773080a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.904+0000 7f452a399640 1 -- 172.21.15.92:0/1579858351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 msgr2=0x55a077315270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:30.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f4529b98640 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 0x55a077315270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f452a399640 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 0x55a077315270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f452a399640 1 -- 172.21.15.92:0/1579858351 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a077213340 con 0x55a0773085e0 2024-09-10T10:41:30.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f452ab9a640 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077307cc0 0x55a0773080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:41:30.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f4529b98640 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 0x55a077315270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:41:30.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f452a399640 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077312940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f452000aa20 tx=0x7f452000aee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9a15f491c6c6ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:30.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f451b7fe640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f45100a2cf0 0x7f45100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f452ab9a640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f45100a2cf0 0x7f45100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f4518bfe640 1 -- 172.21.15.92:0/1579858351 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452000ce40 con 0x55a0773085e0 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.905+0000 7f451b7fe640 1 -- 172.21.15.92:0/3249786542 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f45141009a0 con 0x7f452410d2d0 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.906+0000 7f4518bfe640 1 -- 172.21.15.92:0/1579858351 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f452000f930 con 0x55a0773085e0 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.906+0000 7f4518bfe640 1 -- 172.21.15.92:0/1579858351 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452000ea00 con 0x55a0773085e0 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452ab9a640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f45100a2cf0 0x7f45100a51b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f451c005fd0 tx=0x7f451c009500 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452f481740 1 -- 172.21.15.92:0/1579858351 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 msgr2=0x55a077312940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452f481740 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077312940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f452000aa20 tx=0x7f452000aee0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452f481740 1 -- 172.21.15.92:0/1579858351 shutdown_connections 2024-09-10T10:41:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452f481740 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 0x55a077315270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452f481740 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077312940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452f481740 1 --2- 172.21.15.92:0/1579858351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077307cc0 0x55a0773080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452f481740 1 -- 172.21.15.92:0/1579858351 >> 172.21.15.92:0/1579858351 conn(0x55a077304230 msgr2=0x55a077304610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452f481740 1 -- 172.21.15.92:0/1579858351 shutdown_connections 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.907+0000 7f452f481740 1 -- 172.21.15.92:0/1579858351 wait complete. 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452f481740 1 -- start start 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452f481740 1 Processor -- start 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452f481740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07730fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452f481740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077310280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452f481740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077312e80 0x55a0773107c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452f481740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a077315a50 con 0x55a077307cc0 2024-09-10T10:41:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452f481740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a0771f5290 con 0x55a0773085e0 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452f481740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a077315bd0 con 0x55a077312e80 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452f481740 10 client.0 _ll_register_callbacks cb 0x55a077226140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452a399640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07730fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452a399640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07730fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38598/0 (socket says 172.21.15.92:38598) 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452a399640 1 -- 172.21.15.92:0/2519656775 learned_addr learned my addr 172.21.15.92:0/2519656775 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f4529b98640 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077310280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.908+0000 7f452ab9a640 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077312e80 0x55a0773107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f452a399640 1 -- 172.21.15.92:0/2519656775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077312e80 msgr2=0x55a0773107c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f452a399640 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077312e80 0x55a0773107c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f452a399640 1 -- 172.21.15.92:0/2519656775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 msgr2=0x55a077310280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f452a399640 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077310280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f452a399640 1 -- 172.21.15.92:0/2519656775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a076f7f210 con 0x55a077307cc0 2024-09-10T10:41:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f4529b98640 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077310280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f452a399640 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07730fd40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4520005c90 tx=0x7f452000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b204465ea541769b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f450dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f450dffb640 1 -- 172.21.15.92:0/2519656775 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520026060 con 0x55a077307cc0 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f450dffb640 1 -- 172.21.15.92:0/2519656775 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f452000f660 con 0x55a077307cc0 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f452f481740 1 -- 172.21.15.92:0/2519656775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f452000f930 con 0x55a077307cc0 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f450dffb640 1 -- 172.21.15.92:0/2519656775 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f452000fdb0 con 0x55a077307cc0 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f452f481740 10 client.15693 fetch_fsmap learned FSMap version 45 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f452f481740 1 -- 172.21.15.92:0/2519656775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55a07704b620 con 0x55a077307cc0 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.909+0000 7f450dffb640 1 -- 172.21.15.92:0/2519656775 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4520005520 con 0x55a077307cc0 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f450dffb640 1 -- 172.21.15.92:0/2519656775 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f4520029020 con 0x55a077307cc0 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f452f481740 10 client.15693 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T10:41:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f452f481740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f452f481740 20 client.15693 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f452f481740 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a077322d10 0x55a077325100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f452f481740 4 client.15693 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f452f481740 1 -- 172.21.15.92:0/2519656775 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f452000f930 con 0x55a077322d10 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f4529b98640 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a077322d10 0x55a077325100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f450dffb640 10 client.15693 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.910+0000 7f4529b98640 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a077322d10 0x55a077325100 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20f2a0192e0fb752 server_cookie=f5f2eb22668e6df in_seq=0 out_seq=0 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f450dffb640 1 -- 172.21.15.92:0/2519656775 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f452000f930 con 0x55a077322d10 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f450dffb640 10 client.15693 handle_command_reply: tid=0 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 client.15693 shutdown 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 -- 172.21.15.92:0/2519656775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 msgr2=0x55a07730fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07730fd40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4520005c90 tx=0x7f452000fd10 comp rx=0 tx=0).stop 2024-09-10T10:41:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 -- 172.21.15.92:0/2519656775 shutdown_connections 2024-09-10T10:41:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a077312e80 0x55a0773107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a077322d10 0x55a077325100 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f450dffb640 0 client.15693 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a0773085e0 0x55a077310280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 --2- 172.21.15.92:0/2519656775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07730fd40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 -- 172.21.15.92:0/2519656775 >> 172.21.15.92:0/2519656775 conn(0x55a077304230 msgr2=0x55a077309f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 -- 172.21.15.92:0/2519656775 shutdown_connections 2024-09-10T10:41:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 1 -- 172.21.15.92:0/2519656775 wait complete. 2024-09-10T10:41:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.911+0000 7f452f481740 20 client.15693 trim_cache size 0 max 16384 2024-09-10T10:41:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.931+0000 7f452f481740 1 Processor -- start 2024-09-10T10:41:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.931+0000 7f452f481740 1 -- start start 2024-09-10T10:41:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.931+0000 7f452f481740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07731e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452f481740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077310270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452f481740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077312e80 0x55a0773107b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452f481740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45241ab3e0 con 0x55a077307cc0 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452f481740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f45241ace90 con 0x55a077312e80 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452f481740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f45241ab990 con 0x55a0773085e0 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452a399640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07731e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452a399640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07731e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38614/0 (socket says 172.21.15.92:38614) 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452a399640 1 -- 172.21.15.92:0/2688858013 learned_addr learned my addr 172.21.15.92:0/2688858013 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452ab9a640 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077312e80 0x55a0773107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f4529b98640 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077310270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452a399640 1 -- 172.21.15.92:0/2688858013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 msgr2=0x55a077310270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452a399640 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077310270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452a399640 1 -- 172.21.15.92:0/2688858013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077312e80 msgr2=0x55a0773107b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452a399640 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077312e80 0x55a0773107b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452a399640 1 -- 172.21.15.92:0/2688858013 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a077312890 con 0x55a077307cc0 2024-09-10T10:41:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f4529b98640 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077310270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:41:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f452a399640 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07731e570 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4520000c00 tx=0x7f452000ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad35114c395891 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f450ffff640 1 -- 172.21.15.92:0/2688858013 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452000c760 con 0x55a077307cc0 2024-09-10T10:41:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f450ffff640 1 -- 172.21.15.92:0/2688858013 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f452000e3b0 con 0x55a077307cc0 2024-09-10T10:41:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.932+0000 7f450ffff640 1 -- 172.21.15.92:0/2688858013 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452000ebf0 con 0x55a077307cc0 2024-09-10T10:41:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.934+0000 7f452f481740 1 -- 172.21.15.92:0/2688858013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 msgr2=0x55a07731e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.935+0000 7f452f481740 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07731e570 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4520000c00 tx=0x7f452000ea30 comp rx=0 tx=0).stop 2024-09-10T10:41:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.935+0000 7f452f481740 1 -- 172.21.15.92:0/2688858013 shutdown_connections 2024-09-10T10:41:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.935+0000 7f452f481740 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077312e80 0x55a0773107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.935+0000 7f452f481740 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077310270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.935+0000 7f452f481740 1 --2- 172.21.15.92:0/2688858013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077307cc0 0x55a07731e570 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.936+0000 7f452f481740 1 -- 172.21.15.92:0/2688858013 >> 172.21.15.92:0/2688858013 conn(0x55a077304230 msgr2=0x55a07731de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.936+0000 7f452f481740 1 -- 172.21.15.92:0/2688858013 shutdown_connections 2024-09-10T10:41:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.936+0000 7f452f481740 1 -- 172.21.15.92:0/2688858013 wait complete. 2024-09-10T10:41:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.936+0000 7f452f481740 1 -- start start 2024-09-10T10:41:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.936+0000 7f452f481740 1 Processor -- start 2024-09-10T10:41:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452f481740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077307cc0 0x55a077325680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452f481740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077325bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452f481740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 0x55a07738b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452f481740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45241ac7c0 con 0x55a077312e80 2024-09-10T10:41:30.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452f481740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f45241ac0f0 con 0x55a077307cc0 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452f481740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4524072330 con 0x55a0773085e0 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452f481740 10 client.0 _ll_register_callbacks cb 0x7f452000a870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452a399640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077307cc0 0x55a077325680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452a399640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077307cc0 0x55a077325680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35580/0 (socket says 172.21.15.92:35580) 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452ab9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 0x55a07738b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452a399640 1 -- 172.21.15.92:0/2110430706 learned_addr learned my addr 172.21.15.92:0/2110430706 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f4529b98640 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077325bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452a399640 1 -- 172.21.15.92:0/2110430706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 msgr2=0x55a077325bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452a399640 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077325bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452a399640 1 -- 172.21.15.92:0/2110430706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 msgr2=0x55a07738b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452a399640 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 0x55a07738b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f452a399640 1 -- 172.21.15.92:0/2110430706 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a07738bc50 con 0x55a077307cc0 2024-09-10T10:41:30.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.937+0000 7f4529b98640 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077325bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:41:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.938+0000 7f452a399640 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077307cc0 0x55a077325680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f452000a4d0 tx=0x7f452000cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51b1ee0eaa419616 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.938+0000 7f450dffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:41:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.938+0000 7f450dffb640 1 -- 172.21.15.92:0/2110430706 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452000f870 con 0x55a077307cc0 2024-09-10T10:41:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.938+0000 7f450dffb640 1 -- 172.21.15.92:0/2110430706 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f452000ead0 con 0x55a077307cc0 2024-09-10T10:41:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.938+0000 7f452f481740 1 -- 172.21.15.92:0/2110430706 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f452000e3b0 con 0x55a077307cc0 2024-09-10T10:41:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.938+0000 7f450dffb640 1 -- 172.21.15.92:0/2110430706 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f4520042050 con 0x55a077307cc0 2024-09-10T10:41:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f452f481740 10 client.25214 fetch_fsmap learned FSMap version 45 2024-09-10T10:41:30.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f452f481740 1 -- 172.21.15.92:0/2110430706 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55a07738cf40 con 0x55a077307cc0 2024-09-10T10:41:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f450dffb640 1 -- 172.21.15.92:0/2110430706 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f452000e3b0 con 0x55a077307cc0 2024-09-10T10:41:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f450dffb640 1 -- 172.21.15.92:0/2110430706 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f4520004980 con 0x55a077307cc0 2024-09-10T10:41:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f452f481740 10 client.25214 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T10:41:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f452f481740 10 client.25214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:30.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f452f481740 20 client.25214 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f452f481740 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a077322d10 0x55a07738f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f452f481740 4 client.25214 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:41:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.939+0000 7f452f481740 1 -- 172.21.15.92:0/2110430706 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a077279a20 con 0x55a077322d10 2024-09-10T10:41:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.940+0000 7f4529b98640 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a077322d10 0x55a07738f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.940+0000 7f450dffb640 10 client.25214 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:30.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.940+0000 7f4529b98640 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a077322d10 0x55a07738f550 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca2f94594aadcc9b server_cookie=dd6c0aa4cab0f64f in_seq=0 out_seq=0 2024-09-10T10:41:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.947+0000 7f450dffb640 1 -- 172.21.15.92:0/2110430706 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a077279a20 con 0x55a077322d10 2024-09-10T10:41:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.947+0000 7f450dffb640 10 client.25214 handle_command_reply: tid=0 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.947+0000 7f452f481740 1 client.25214 shutdown 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.947+0000 7f452f481740 1 -- 172.21.15.92:0/2110430706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077307cc0 msgr2=0x55a077325680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.947+0000 7f452f481740 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077307cc0 0x55a077325680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f452000a4d0 tx=0x7f452000cf50 comp rx=0 tx=0).stop 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452f481740 1 -- 172.21.15.92:0/2110430706 shutdown_connections 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452f481740 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a077312e80 0x55a07738b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452f481740 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0773085e0 0x55a077325bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452f481740 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a077322d10 0x55a07738f550 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452f481740 1 --2- 172.21.15.92:0/2110430706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a077307cc0 0x55a077325680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f450dffb640 0 client.25214 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452f481740 1 -- 172.21.15.92:0/2110430706 >> 172.21.15.92:0/2110430706 conn(0x55a077304230 msgr2=0x55a077302fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452f481740 1 -- 172.21.15.92:0/2110430706 shutdown_connections 2024-09-10T10:41:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452f481740 1 -- 172.21.15.92:0/2110430706 wait complete. 2024-09-10T10:41:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452f481740 20 client.25214 trim_cache size 0 max 16384 2024-09-10T10:41:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:41:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:41:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:41:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:41:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452b39b640 1 -- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f45100a2cf0 msgr2=0x7f45100a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.948+0000 7f452b39b640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f45100a2cf0 0x7f45100a51b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f451c005fd0 tx=0x7f451c009500 comp rx=0 tx=0).stop 2024-09-10T10:41:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 -- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f452410d2d0 msgr2=0x7f45241a4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f452410d2d0 0x7f45241a4b10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4514005940 tx=0x7f4514031a60 comp rx=0 tx=0).stop 2024-09-10T10:41:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 -- 172.21.15.92:0/3249786542 shutdown_connections 2024-09-10T10:41:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f45100a2cf0 0x7f45100a51b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f452419e720 0x7f452419ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f452410d2d0 0x7f45241a4b10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 --2- 172.21.15.92:0/3249786542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4524108290 0x7f45241a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 -- 172.21.15.92:0/3249786542 >> 172.21.15.92:0/3249786542 conn(0x7f45240778f0 msgr2=0x7f4524078c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 -- 172.21.15.92:0/3249786542 shutdown_connections 2024-09-10T10:41:30.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:30.949+0000 7f452b39b640 1 -- 172.21.15.92:0/3249786542 wait complete. 2024-09-10T10:41:32.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:31 smithi121 ceph-mon[35231]: pgmap v150: 97 pgs: 97 active+clean; 3.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 935 op/s 2024-09-10T10:41:32.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:31 smithi097 ceph-mon[35213]: pgmap v150: 97 pgs: 97 active+clean; 3.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 935 op/s 2024-09-10T10:41:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:31 smithi092 ceph-mon[30834]: pgmap v150: 97 pgs: 97 active+clean; 3.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 935 op/s 2024-09-10T10:41:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 275.0 s, 2831.6 tps, lat 35.149 ms stddev 38.725 2024-09-10T10:41:34.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:33 smithi121 ceph-mon[35231]: pgmap v151: 97 pgs: 97 active+clean; 3.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 640 op/s 2024-09-10T10:41:34.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:33 smithi097 ceph-mon[35213]: pgmap v151: 97 pgs: 97 active+clean; 3.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 640 op/s 2024-09-10T10:41:34.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:33 smithi092 ceph-mon[30834]: pgmap v151: 97 pgs: 97 active+clean; 3.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 640 op/s 2024-09-10T10:41:36.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:35 smithi121 ceph-mon[35231]: pgmap v152: 97 pgs: 97 active+clean; 3.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 666 op/s 2024-09-10T10:41:36.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:35 smithi097 ceph-mon[35213]: pgmap v152: 97 pgs: 97 active+clean; 3.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 666 op/s 2024-09-10T10:41:36.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:35 smithi092 ceph-mon[30834]: pgmap v152: 97 pgs: 97 active+clean; 3.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.0 MiB/s wr, 666 op/s 2024-09-10T10:41:38.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:37 smithi121 ceph-mon[35231]: pgmap v153: 97 pgs: 97 active+clean; 3.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 884 op/s 2024-09-10T10:41:38.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:37 smithi097 ceph-mon[35213]: pgmap v153: 97 pgs: 97 active+clean; 3.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 884 op/s 2024-09-10T10:41:38.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:37 smithi092 ceph-mon[30834]: pgmap v153: 97 pgs: 97 active+clean; 3.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 884 op/s 2024-09-10T10:41:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 280.0 s, 2842.4 tps, lat 35.453 ms stddev 40.473 2024-09-10T10:41:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:39 smithi121 ceph-mon[35231]: pgmap v154: 97 pgs: 97 active+clean; 3.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 682 op/s 2024-09-10T10:41:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:39 smithi097 ceph-mon[35213]: pgmap v154: 97 pgs: 97 active+clean; 3.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 682 op/s 2024-09-10T10:41:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:39 smithi092 ceph-mon[30834]: pgmap v154: 97 pgs: 97 active+clean; 3.8 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 682 op/s 2024-09-10T10:41:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:41 smithi121 ceph-mon[35231]: pgmap v155: 97 pgs: 97 active+clean; 3.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 978 op/s 2024-09-10T10:41:42.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:41 smithi097 ceph-mon[35213]: pgmap v155: 97 pgs: 97 active+clean; 3.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 978 op/s 2024-09-10T10:41:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:41 smithi092 ceph-mon[30834]: pgmap v155: 97 pgs: 97 active+clean; 3.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 MiB/s wr, 978 op/s 2024-09-10T10:41:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 285.0 s, 2594.0 tps, lat 38.546 ms stddev 41.435 2024-09-10T10:41:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:43 smithi121 ceph-mon[35231]: pgmap v156: 97 pgs: 97 active+clean; 3.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-09-10T10:41:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.058+0000 7f59d248d640 1 -- 172.21.15.92:0/2920241522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1069e0 msgr2=0x7f59cc106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:44.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.058+0000 7f59d248d640 1 --2- 172.21.15.92:0/2920241522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1069e0 0x7f59cc106dc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009930 tx=0x7f59bc02a420 comp rx=0 tx=0).stop 2024-09-10T10:41:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.059+0000 7f59d248d640 1 -- 172.21.15.92:0/2920241522 shutdown_connections 2024-09-10T10:41:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.059+0000 7f59d248d640 1 --2- 172.21.15.92:0/2920241522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc101370 0x7f59cc10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.059+0000 7f59d248d640 1 --2- 172.21.15.92:0/2920241522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59cc1009d0 0x7f59cc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.059+0000 7f59d248d640 1 --2- 172.21.15.92:0/2920241522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1069e0 0x7f59cc106dc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.059+0000 7f59d248d640 1 -- 172.21.15.92:0/2920241522 >> 172.21.15.92:0/2920241522 conn(0x7f59cc0fc6f0 msgr2=0x7f59cc0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.059+0000 7f59d248d640 1 -- 172.21.15.92:0/2920241522 shutdown_connections 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.059+0000 7f59d248d640 1 -- 172.21.15.92:0/2920241522 wait complete. 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59d248d640 1 Processor -- start 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59d248d640 1 -- start start 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59d248d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1009d0 0x7f59cc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59d248d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc101370 0x7f59cc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59d248d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59cc1069e0 0x7f59cc19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59d248d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc110e20 con 0x7f59cc1009d0 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59d248d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc110ca0 con 0x7f59cc1069e0 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59d248d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc110fa0 con 0x7f59cc101370 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1009d0 0x7f59cc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59cbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1009d0 0x7f59cc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33650/0 (socket says 172.21.15.92:33650) 2024-09-10T10:41:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59cbfff640 1 -- 172.21.15.92:0/4132995527 learned_addr learned my addr 172.21.15.92:0/4132995527 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59d0a2a640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59cc1069e0 0x7f59cc19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59c3fff640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc101370 0x7f59cc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59cbfff640 1 -- 172.21.15.92:0/4132995527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc101370 msgr2=0x7f59cc1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59cbfff640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc101370 0x7f59cc1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59cbfff640 1 -- 172.21.15.92:0/4132995527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59cc1069e0 msgr2=0x7f59cc19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.060+0000 7f59cbfff640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59cc1069e0 0x7f59cc19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.061+0000 7f59cbfff640 1 -- 172.21.15.92:0/4132995527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc19d350 con 0x7f59cc1009d0 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.061+0000 7f59d0a2a640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59cc1069e0 0x7f59cc19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.061+0000 7f59cbfff640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1009d0 0x7f59cc198360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009230 tx=0x7f59bc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.061+0000 7f59c9ffb640 1 -- 172.21.15.92:0/4132995527 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc03f030 con 0x7f59cc1009d0 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.061+0000 7f59d248d640 1 -- 172.21.15.92:0/4132995527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc19d5e0 con 0x7f59cc1009d0 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.061+0000 7f59c9ffb640 1 -- 172.21.15.92:0/4132995527 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59bc004440 con 0x7f59cc1009d0 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.061+0000 7f59c9ffb640 1 -- 172.21.15.92:0/4132995527 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc035070 con 0x7f59cc1009d0 2024-09-10T10:41:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.061+0000 7f59d248d640 1 -- 172.21.15.92:0/4132995527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc1a4ed0 con 0x7f59cc1009d0 2024-09-10T10:41:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.064+0000 7f59d522d740 1 Processor -- start 2024-09-10T10:41:44.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.064+0000 7f59d522d740 1 -- start start 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.064+0000 7f59c9ffb640 1 -- 172.21.15.92:0/4132995527 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f59bc042030 con 0x7f59cc1009d0 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.064+0000 7f59d522d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc98d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.064+0000 7f59d522d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.064+0000 7f59d522d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 0x55654bcaa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.064+0000 7f59d522d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55654bbfd2f0 con 0x55654bc992d0 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.065+0000 7f59d522d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55654bba5270 con 0x55654bca80c0 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.065+0000 7f59d522d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55654bbf92b0 con 0x55654bc989b0 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.065+0000 7f59d0a2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc98d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.065+0000 7f59d0a2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc98d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:39892/0 (socket says 172.21.15.92:39892) 2024-09-10T10:41:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.065+0000 7f59d0a2a640 1 -- 172.21.15.92:0/4152695900 learned_addr learned my addr 172.21.15.92:0/4152695900 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.065+0000 7f59c3fff640 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 0x55654bcaa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.065+0000 7f59cbfff640 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.065+0000 7f59c9ffb640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f59b80a2da0 0x7f59b80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.066+0000 7f59c9ffb640 1 -- 172.21.15.92:0/4132995527 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f59bc0ef6c0 con 0x7f59cc1009d0 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.066+0000 7f59c3fff640 1 -- 172.21.15.92:0/4152695900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 msgr2=0x55654bc98d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.066+0000 7f59c3fff640 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc98d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.066+0000 7f59c3fff640 1 -- 172.21.15.92:0/4152695900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 msgr2=0x55654bca7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.066+0000 7f59c3fff640 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.066+0000 7f59d0a2a640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f59b80a2da0 0x7f59b80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.066+0000 7f59c3fff640 1 -- 172.21.15.92:0/4152695900 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654bba4340 con 0x55654bca80c0 2024-09-10T10:41:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.066+0000 7f59cbfff640 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:41:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:43 smithi097 ceph-mon[35213]: pgmap v156: 97 pgs: 97 active+clean; 3.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-09-10T10:41:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.067+0000 7f59c3fff640 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 0x55654bcaa4b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009bf0 tx=0x7f59b4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580ffb59223ed54d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.067+0000 7f59d0a2a640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f59b80a2da0 0x7f59b80a5260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009fd0 tx=0x7f59c4004ab0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.067+0000 7f59c27fc640 1 -- 172.21.15.92:0/4152695900 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4004050 con 0x55654bca80c0 2024-09-10T10:41:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.067+0000 7f59c27fc640 1 -- 172.21.15.92:0/4152695900 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59b4005500 con 0x55654bca80c0 2024-09-10T10:41:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.067+0000 7f59c27fc640 1 -- 172.21.15.92:0/4152695900 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4004e00 con 0x55654bca80c0 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 -- 172.21.15.92:0/4152695900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 msgr2=0x55654bcaa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 0x55654bcaa4b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009bf0 tx=0x7f59b4011810 comp rx=0 tx=0).stop 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 -- 172.21.15.92:0/4152695900 shutdown_connections 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 0x55654bcaa4b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 --2- 172.21.15.92:0/4152695900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc98d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 -- 172.21.15.92:0/4152695900 >> 172.21.15.92:0/4152695900 conn(0x55654bc95060 msgr2=0x55654bc95440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 -- 172.21.15.92:0/4152695900 shutdown_connections 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 -- 172.21.15.92:0/4152695900 wait complete. 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 -- start start 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.068+0000 7f59d522d740 1 Processor -- start 2024-09-10T10:41:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59d522d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bc989b0 0x55654bca4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59d522d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59d522d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bca80c0 0x55654bca5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59d522d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55654bcaac90 con 0x55654bc992d0 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59d522d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55654bb86290 con 0x55654bc989b0 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59d522d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55654bcaae10 con 0x55654bca80c0 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bc989b0 0x55654bca4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59d522d740 10 client.0 _ll_register_callbacks cb 0x55654bbb7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59cbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bc989b0 0x55654bca4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:45084/0 (socket says 172.21.15.92:45084) 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59cbfff640 1 -- 172.21.15.92:0/3023245365 learned_addr learned my addr 172.21.15.92:0/3023245365 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59d0a2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bca80c0 0x55654bca5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59c3fff640 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59cbfff640 1 -- 172.21.15.92:0/3023245365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bca80c0 msgr2=0x55654bca5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:44.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59cbfff640 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bca80c0 0x55654bca5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59cbfff640 1 -- 172.21.15.92:0/3023245365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 msgr2=0x55654bca54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59cbfff640 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59cbfff640 1 -- 172.21.15.92:0/3023245365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654b910210 con 0x55654bc989b0 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59c3fff640 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59cbfff640 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bc989b0 0x55654bca4f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0bbc90 tx=0x7f59bc0bbb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506dd222f2480037 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.069+0000 7f59ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.070+0000 7f59ab7fe640 1 -- 172.21.15.92:0/3023245365 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc049070 con 0x55654bc989b0 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.070+0000 7f59ab7fe640 1 -- 172.21.15.92:0/3023245365 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f59bc0b8370 con 0x55654bc989b0 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.070+0000 7f59d522d740 1 -- 172.21.15.92:0/3023245365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b4005500 con 0x55654bc989b0 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.070+0000 7f59ab7fe640 1 -- 172.21.15.92:0/3023245365 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f59bc0d1020 con 0x55654bc989b0 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.070+0000 7f59d522d740 10 client.25226 fetch_fsmap learned FSMap version 45 2024-09-10T10:41:44.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.070+0000 7f59d522d740 1 -- 172.21.15.92:0/3023245365 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55654b9dc620 con 0x55654bc989b0 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.071+0000 7f59ab7fe640 1 -- 172.21.15.92:0/3023245365 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59b4005500 con 0x55654bc989b0 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.071+0000 7f59ab7fe640 1 -- 172.21.15.92:0/3023245365 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f59bc0c4430 con 0x55654bc989b0 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.071+0000 7f59d522d740 10 client.25226 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.071+0000 7f59d522d740 10 client.25226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.071+0000 7f59d522d740 20 client.25226 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.071+0000 7f59d522d740 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55654bcb7f70 0x55654bcba360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.071+0000 7f59d522d740 4 client.25226 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.071+0000 7f59d522d740 1 -- 172.21.15.92:0/3023245365 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55654bc0aa20 con 0x55654bcb7f70 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.071+0000 7f59c3fff640 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55654bcb7f70 0x55654bcba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59c3fff640 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55654bcb7f70 0x55654bcba360 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e29bba393158a00 server_cookie=4e94058ff5a3a2d3 in_seq=0 out_seq=0 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59ab7fe640 10 client.25226 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59ab7fe640 1 -- 172.21.15.92:0/3023245365 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55654bc0aa20 con 0x55654bcb7f70 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59ab7fe640 10 client.25226 handle_command_reply: tid=0 2024-09-10T10:41:44.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59d522d740 1 client.25226 shutdown 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59d522d740 1 -- 172.21.15.92:0/3023245365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bc989b0 msgr2=0x55654bca4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59d522d740 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bc989b0 0x55654bca4f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0bbc90 tx=0x7f59bc0bbb90 comp rx=0 tx=0).stop 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59d522d740 1 -- 172.21.15.92:0/3023245365 shutdown_connections 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59d522d740 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bca80c0 0x55654bca5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.072+0000 7f59d522d740 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bca54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.073+0000 7f59d522d740 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55654bcb7f70 0x55654bcba360 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.073+0000 7f59d522d740 1 --2- 172.21.15.92:0/3023245365 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bc989b0 0x55654bca4f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.073+0000 7f59ab7fe640 0 client.25226 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.073+0000 7f59d522d740 1 -- 172.21.15.92:0/3023245365 >> 172.21.15.92:0/3023245365 conn(0x55654bc95060 msgr2=0x55654bc9ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.073+0000 7f59d522d740 1 -- 172.21.15.92:0/3023245365 shutdown_connections 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.073+0000 7f59d522d740 1 -- 172.21.15.92:0/3023245365 wait complete. 2024-09-10T10:41:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.073+0000 7f59d522d740 20 client.25226 trim_cache size 0 max 16384 2024-09-10T10:41:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:43 smithi092 ceph-mon[30834]: pgmap v156: 97 pgs: 97 active+clean; 3.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-09-10T10:41:44.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.112+0000 7f59d522d740 1 Processor -- start 2024-09-10T10:41:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.119+0000 7f59d522d740 1 -- start start 2024-09-10T10:41:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.119+0000 7f59d522d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc940b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.120+0000 7f59d522d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bcbfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.120+0000 7f59d522d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 0x55654bcc0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.120+0000 7f59d522d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc1ab4d0 con 0x55654bc992d0 2024-09-10T10:41:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.120+0000 7f59d522d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc1ad0a0 con 0x55654bca80c0 2024-09-10T10:41:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.120+0000 7f59d522d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc1abba0 con 0x55654bc989b0 2024-09-10T10:41:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.120+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bcbfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.121+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bcbfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33682/0 (socket says 172.21.15.92:33682) 2024-09-10T10:41:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.121+0000 7f59c3fff640 1 -- 172.21.15.92:0/3926995690 learned_addr learned my addr 172.21.15.92:0/3926995690 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.121+0000 7f59cbfff640 1 --2- 172.21.15.92:0/3926995690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.122+0000 7f59d0a2a640 1 --2- 172.21.15.92:0/3926995690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 0x55654bcc0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.123+0000 7f59cbfff640 1 -- 172.21.15.92:0/3926995690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 msgr2=0x55654bcc0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.123+0000 7f59cbfff640 1 --2- 172.21.15.92:0/3926995690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 0x55654bcc0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.123+0000 7f59cbfff640 1 -- 172.21.15.92:0/3926995690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 msgr2=0x55654bcbfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.123+0000 7f59cbfff640 1 --2- 172.21.15.92:0/3926995690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bcbfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.123+0000 7f59cbfff640 1 -- 172.21.15.92:0/3926995690 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654bc94e90 con 0x55654bc989b0 2024-09-10T10:41:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.124+0000 7f59cbfff640 1 --2- 172.21.15.92:0/3926995690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc940b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0ed480 tx=0x7f59bc0bbe80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=653a037b728ee447 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.125+0000 7f59c1ffb640 1 -- 172.21.15.92:0/3926995690 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0d9080 con 0x55654bc989b0 2024-09-10T10:41:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.125+0000 7f59c1ffb640 1 -- 172.21.15.92:0/3926995690 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59bc0d4e50 con 0x55654bc989b0 2024-09-10T10:41:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.125+0000 7f59c1ffb640 1 -- 172.21.15.92:0/3926995690 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0d1020 con 0x55654bc989b0 2024-09-10T10:41:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.126+0000 7f59d522d740 1 -- 172.21.15.92:0/3926995690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 msgr2=0x55654bc940b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.127+0000 7f59d522d740 1 --2- 172.21.15.92:0/3926995690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc940b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0ed480 tx=0x7f59bc0bbe80 comp rx=0 tx=0).stop 2024-09-10T10:41:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.127+0000 7f59d522d740 1 -- 172.21.15.92:0/3926995690 shutdown_connections 2024-09-10T10:41:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.127+0000 7f59d522d740 1 --2- 172.21.15.92:0/3926995690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bca80c0 0x55654bcc0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.127+0000 7f59d522d740 1 --2- 172.21.15.92:0/3926995690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bc992d0 0x55654bcbfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.127+0000 7f59d522d740 1 --2- 172.21.15.92:0/3926995690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc989b0 0x55654bc940b0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0ed480 tx=0x7f59bc0bbe80 comp rx=0 tx=0).stop 2024-09-10T10:41:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.127+0000 7f59d522d740 1 -- 172.21.15.92:0/3926995690 >> 172.21.15.92:0/3926995690 conn(0x55654bc95060 msgr2=0x55654bc939a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.130+0000 7f59d522d740 1 -- 172.21.15.92:0/3926995690 shutdown_connections 2024-09-10T10:41:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.131+0000 7f59d522d740 1 -- 172.21.15.92:0/3926995690 wait complete. 2024-09-10T10:41:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.131+0000 7f59d522d740 1 -- start start 2024-09-10T10:41:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.132+0000 7f59d522d740 1 Processor -- start 2024-09-10T10:41:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.132+0000 7f59d522d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc992d0 0x55654bc9f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.132+0000 7f59d522d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bca80c0 0x55654bcb00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.132+0000 7f59d522d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bcb0610 0x55654bc9de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.132+0000 7f59d522d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc1ac9d0 con 0x55654bca80c0 2024-09-10T10:41:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.132+0000 7f59d522d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc1ac300 con 0x55654bcb0610 2024-09-10T10:41:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.132+0000 7f59d522d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc1a9470 con 0x55654bc992d0 2024-09-10T10:41:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.132+0000 7f59d522d740 10 client.0 _ll_register_callbacks cb 0x7f59bc009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.133+0000 7f59d0a2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bcb0610 0x55654bc9de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.133+0000 7f59d0a2a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bcb0610 0x55654bc9de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:45104/0 (socket says 172.21.15.92:45104) 2024-09-10T10:41:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.133+0000 7f59d0a2a640 1 -- 172.21.15.92:0/1146096899 learned_addr learned my addr 172.21.15.92:0/1146096899 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.133+0000 7f59c3fff640 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bca80c0 0x55654bcb00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.134+0000 7f59c3fff640 1 -- 172.21.15.92:0/1146096899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc992d0 msgr2=0x55654bc9f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.134+0000 7f59c3fff640 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc992d0 0x55654bc9f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.134+0000 7f59c3fff640 1 -- 172.21.15.92:0/1146096899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bcb0610 msgr2=0x55654bc9de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.134+0000 7f59c3fff640 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bcb0610 0x55654bc9de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.134+0000 7f59c3fff640 1 -- 172.21.15.92:0/1146096899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55654bcb0b90 con 0x55654bca80c0 2024-09-10T10:41:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.134+0000 7f59c3fff640 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bca80c0 0x55654bcb00d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009dc0 tx=0x7f59b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430227faf9164ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.134+0000 7f59ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:41:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.135+0000 7f59ab7fe640 1 -- 172.21.15.92:0/1146096899 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4032070 con 0x55654bca80c0 2024-09-10T10:41:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.135+0000 7f59d522d740 1 -- 172.21.15.92:0/1146096899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59bc0d4e50 con 0x55654bca80c0 2024-09-10T10:41:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.135+0000 7f59ab7fe640 1 -- 172.21.15.92:0/1146096899 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f59b40035f0 con 0x55654bca80c0 2024-09-10T10:41:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.136+0000 7f59ab7fe640 1 -- 172.21.15.92:0/1146096899 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f59b403e050 con 0x55654bca80c0 2024-09-10T10:41:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.136+0000 7f59d522d740 10 client.15714 fetch_fsmap learned FSMap version 45 2024-09-10T10:41:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.136+0000 7f59d522d740 1 -- 172.21.15.92:0/1146096899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55654bd1f020 con 0x55654bca80c0 2024-09-10T10:41:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.137+0000 7f59ab7fe640 1 -- 172.21.15.92:0/1146096899 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59bc0d4e50 con 0x55654bca80c0 2024-09-10T10:41:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.137+0000 7f59ab7fe640 1 -- 172.21.15.92:0/1146096899 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 45) ==== 8378+0+0 (secure 0 0 0) 0x7f59b402e630 con 0x55654bca80c0 2024-09-10T10:41:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.137+0000 7f59d522d740 10 client.15714 fetch_fsmap finished waiting for FSMap version 45 2024-09-10T10:41:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.137+0000 7f59d522d740 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.137+0000 7f59d522d740 20 client.15714 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.137+0000 7f59d522d740 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55654bd1f6a0 0x55654bd21ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.137+0000 7f59d522d740 4 client.15714 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:41:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.137+0000 7f59d522d740 1 -- 172.21.15.92:0/1146096899 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55654bc04d70 con 0x55654bd1f6a0 2024-09-10T10:41:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.140+0000 7f59cbfff640 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55654bd1f6a0 0x55654bd21ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.140+0000 7f59cbfff640 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55654bd1f6a0 0x55654bd21ac0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1414620ebc125b96 server_cookie=45f496a9e1cd97d9 in_seq=0 out_seq=0 2024-09-10T10:41:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.140+0000 7f59ab7fe640 10 client.15714 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.149+0000 7f59ab7fe640 1 -- 172.21.15.92:0/1146096899 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55654bc04d70 con 0x55654bd1f6a0 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.149+0000 7f59ab7fe640 10 client.15714 handle_command_reply: tid=0 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 client.15714 shutdown 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 -- 172.21.15.92:0/1146096899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bca80c0 msgr2=0x55654bcb00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bca80c0 0x55654bcb00d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009dc0 tx=0x7f59b4009260 comp rx=0 tx=0).stop 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 -- 172.21.15.92:0/1146096899 shutdown_connections 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55654bd1f6a0 0x55654bd21ac0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55654bcb0610 0x55654bc9de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55654bca80c0 0x55654bcb00d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 --2- 172.21.15.92:0/1146096899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55654bc992d0 0x55654bc9f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 -- 172.21.15.92:0/1146096899 >> 172.21.15.92:0/1146096899 conn(0x55654bc95060 msgr2=0x55654bc9ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59ab7fe640 0 client.15714 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 -- 172.21.15.92:0/1146096899 shutdown_connections 2024-09-10T10:41:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 1 -- 172.21.15.92:0/1146096899 wait complete. 2024-09-10T10:41:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.150+0000 7f59d522d740 20 client.15714 trim_cache size 0 max 16384 2024-09-10T10:41:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:41:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:41:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:41:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.151+0000 7f59d248d640 1 -- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f59b80a2da0 msgr2=0x7f59b80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.151+0000 7f59d248d640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f59b80a2da0 0x7f59b80a5260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009fd0 tx=0x7f59c4004ab0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.151+0000 7f59d248d640 1 -- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1009d0 msgr2=0x7f59cc198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.151+0000 7f59d248d640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1009d0 0x7f59cc198360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009230 tx=0x7f59bc004040 comp rx=0 tx=0).stop 2024-09-10T10:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.152+0000 7f59d248d640 1 -- 172.21.15.92:0/4132995527 shutdown_connections 2024-09-10T10:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.152+0000 7f59d248d640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f59b80a2da0 0x7f59b80a5260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.152+0000 7f59d248d640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f59cc1069e0 0x7f59cc19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.152+0000 7f59d248d640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f59cc101370 0x7f59cc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.152+0000 7f59d248d640 1 --2- 172.21.15.92:0/4132995527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59cc1009d0 0x7f59cc198360 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.152+0000 7f59d248d640 1 -- 172.21.15.92:0/4132995527 >> 172.21.15.92:0/4132995527 conn(0x7f59cc0fc6f0 msgr2=0x7f59cc06a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.152+0000 7f59d248d640 1 -- 172.21.15.92:0/4132995527 shutdown_connections 2024-09-10T10:41:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:44.152+0000 7f59d248d640 1 -- 172.21.15.92:0/4132995527 wait complete. 2024-09-10T10:41:46.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:45 smithi121 ceph-mon[35231]: pgmap v157: 97 pgs: 97 active+clean; 3.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 690 op/s 2024-09-10T10:41:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:45 smithi097 ceph-mon[35213]: pgmap v157: 97 pgs: 97 active+clean; 3.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 690 op/s 2024-09-10T10:41:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:45 smithi092 ceph-mon[30834]: pgmap v157: 97 pgs: 97 active+clean; 3.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 690 op/s 2024-09-10T10:41:47.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:46 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:41:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:46 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:41:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:46 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:41:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:46 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:41:47.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:46 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:41:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:46 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:41:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:46 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:41:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:46 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:41:47.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:46 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:41:47.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:46 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:41:47.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:46 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:41:47.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:46 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:41:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 290.0 s, 3082.2 tps, lat 32.250 ms stddev 33.413 2024-09-10T10:41:48.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:48 smithi121 ceph-mon[35231]: pgmap v158: 97 pgs: 97 active+clean; 3.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 908 op/s 2024-09-10T10:41:48.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:48 smithi097 ceph-mon[35213]: pgmap v158: 97 pgs: 97 active+clean; 3.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 908 op/s 2024-09-10T10:41:48.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:48 smithi092 ceph-mon[30834]: pgmap v158: 97 pgs: 97 active+clean; 3.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 908 op/s 2024-09-10T10:41:49.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:49 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:41:49.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:49 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:41:49.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:49 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:41:50.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:50 smithi121 ceph-mon[35231]: pgmap v159: 97 pgs: 97 active+clean; 3.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 MiB/s wr, 586 op/s 2024-09-10T10:41:50.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:50 smithi097 ceph-mon[35213]: pgmap v159: 97 pgs: 97 active+clean; 3.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 MiB/s wr, 586 op/s 2024-09-10T10:41:50.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:50 smithi092 ceph-mon[30834]: pgmap v159: 97 pgs: 97 active+clean; 3.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 MiB/s wr, 586 op/s 2024-09-10T10:41:51.761 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:51 smithi092 ceph-mon[30834]: pgmap v160: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.5 MiB/s wr, 879 op/s 2024-09-10T10:41:51.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:51 smithi121 ceph-mon[35231]: pgmap v160: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.5 MiB/s wr, 879 op/s 2024-09-10T10:41:51.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:51 smithi097 ceph-mon[35213]: pgmap v160: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.5 MiB/s wr, 879 op/s 2024-09-10T10:41:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 295.0 s, 2190.0 tps, lat 45.733 ms stddev 49.784 2024-09-10T10:41:53.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:53 smithi097 ceph-mon[35213]: pgmap v161: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 583 op/s 2024-09-10T10:41:53.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:53 smithi092 ceph-mon[30834]: pgmap v161: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 583 op/s 2024-09-10T10:41:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:53 smithi121 ceph-mon[35231]: pgmap v161: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 583 op/s 2024-09-10T10:41:55.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:55 smithi097 ceph-mon[35213]: pgmap v162: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.8 MiB/s wr, 597 op/s 2024-09-10T10:41:55.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:55 smithi092 ceph-mon[30834]: pgmap v162: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.8 MiB/s wr, 597 op/s 2024-09-10T10:41:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:55 smithi121 ceph-mon[35231]: pgmap v162: 97 pgs: 97 active+clean; 3.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.8 MiB/s wr, 597 op/s 2024-09-10T10:41:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.277+0000 7f2cd387b640 1 -- 172.21.15.92:0/952688491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc1069e0 msgr2=0x7f2ccc106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.277+0000 7f2cd387b640 1 --2- 172.21.15.92:0/952688491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc1069e0 0x7f2ccc106dc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009930 tx=0x7f2cc802a420 comp rx=0 tx=0).stop 2024-09-10T10:41:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.277+0000 7f2cd387b640 1 -- 172.21.15.92:0/952688491 shutdown_connections 2024-09-10T10:41:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.277+0000 7f2cd387b640 1 --2- 172.21.15.92:0/952688491 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ccc101370 0x7f2ccc10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.277+0000 7f2cd387b640 1 --2- 172.21.15.92:0/952688491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ccc1009d0 0x7f2ccc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.277+0000 7f2cd387b640 1 --2- 172.21.15.92:0/952688491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc1069e0 0x7f2ccc106dc0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.277+0000 7f2cd387b640 1 -- 172.21.15.92:0/952688491 >> 172.21.15.92:0/952688491 conn(0x7f2ccc0fc6f0 msgr2=0x7f2ccc0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.277+0000 7f2cd387b640 1 -- 172.21.15.92:0/952688491 shutdown_connections 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.277+0000 7f2cd387b640 1 -- 172.21.15.92:0/952688491 wait complete. 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd387b640 1 Processor -- start 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd387b640 1 -- start start 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd387b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ccc1009d0 0x7f2ccc1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd387b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc101370 0x7f2ccc199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd387b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ccc1069e0 0x7f2ccc1a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd387b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc110e20 con 0x7f2ccc101370 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd387b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc110ca0 con 0x7f2ccc1009d0 2024-09-10T10:41:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd387b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc110fa0 con 0x7f2ccc1069e0 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd0e16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc101370 0x7f2ccc199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd0e16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc101370 0x7f2ccc199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38558/0 (socket says 172.21.15.92:38558) 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd0e16640 1 -- 172.21.15.92:0/4137640601 learned_addr learned my addr 172.21.15.92:0/4137640601 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd1617640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ccc1009d0 0x7f2ccc1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.278+0000 7f2cd1e18640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ccc1069e0 0x7f2ccc1a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cd0e16640 1 -- 172.21.15.92:0/4137640601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ccc1069e0 msgr2=0x7f2ccc1a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ccc1069e0 0x7f2ccc1a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cd0e16640 1 -- 172.21.15.92:0/4137640601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ccc1009d0 msgr2=0x7f2ccc1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ccc1009d0 0x7f2ccc1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cd0e16640 1 -- 172.21.15.92:0/4137640601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc1a47b0 con 0x7f2ccc101370 2024-09-10T10:41:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc101370 0x7f2ccc199730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00d770 tx=0x7f2cbc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cc27fc640 1 -- 172.21.15.92:0/4137640601 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc017070 con 0x7f2ccc101370 2024-09-10T10:41:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cd387b640 1 -- 172.21.15.92:0/4137640601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ccc1a4980 con 0x7f2ccc101370 2024-09-10T10:41:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cc27fc640 1 -- 172.21.15.92:0/4137640601 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cbc005500 con 0x7f2ccc101370 2024-09-10T10:41:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cc27fc640 1 -- 172.21.15.92:0/4137640601 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc004e00 con 0x7f2ccc101370 2024-09-10T10:41:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.279+0000 7f2cd387b640 1 -- 172.21.15.92:0/4137640601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ccc1a4ea0 con 0x7f2ccc101370 2024-09-10T10:41:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.282+0000 7f2cd6618740 1 Processor -- start 2024-09-10T10:41:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.282+0000 7f2cd6618740 1 -- start start 2024-09-10T10:41:57.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.282+0000 7f2cc27fc640 1 -- 172.21.15.92:0/4137640601 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2cbc004fa0 con 0x7f2ccc101370 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.282+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507043af0 0x558507043ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.282+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.282+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.282+0000 7f2cd6618740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558506fa82f0 con 0x55850704ecb0 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.282+0000 7f2cd6618740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558506f50270 con 0x558507043af0 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.282+0000 7f2cd6618740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558506fa42b0 con 0x558507044410 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1617640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd0e16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1617640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:42430/0 (socket says 172.21.15.92:42430) 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1617640 1 -- 172.21.15.92:0/718314460 learned_addr learned my addr 172.21.15.92:0/718314460 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1e18640 1 --2- 172.21.15.92:0/718314460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507043af0 0x558507043ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1e18640 1 -- 172.21.15.92:0/718314460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 msgr2=0x55850704e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1e18640 1 --2- 172.21.15.92:0/718314460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1e18640 1 -- 172.21.15.92:0/718314460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 msgr2=0x5585070510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1e18640 1 --2- 172.21.15.92:0/718314460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1e18640 1 -- 172.21.15.92:0/718314460 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558506f4f340 con 0x558507043af0 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/718314460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cc27fc640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2cb80a2e20 0x7f2cb80a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1e18640 1 --2- 172.21.15.92:0/718314460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507043af0 0x558507043ed0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009f00 tx=0x7f2cc4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=308254eab7214057 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cb77fe640 1 -- 172.21.15.92:0/718314460 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4004d20 con 0x558507043af0 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cd1617640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2cb80a2e20 0x7f2cb80a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cb77fe640 1 -- 172.21.15.92:0/718314460 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc4004050 con 0x558507043af0 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cb77fe640 1 -- 172.21.15.92:0/718314460 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4005280 con 0x558507043af0 2024-09-10T10:41:57.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.283+0000 7f2cc27fc640 1 -- 172.21.15.92:0/4137640601 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f2cbc0ced40 con 0x7f2ccc101370 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd6618740 1 -- 172.21.15.92:0/718314460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507043af0 msgr2=0x558507043ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd6618740 1 --2- 172.21.15.92:0/718314460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507043af0 0x558507043ed0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009f00 tx=0x7f2cc4011810 comp rx=0 tx=0).stop 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd1617640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2cb80a2e20 0x7f2cb80a52e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80096c0 tx=0x7f2cc80058d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd6618740 1 -- 172.21.15.92:0/718314460 shutdown_connections 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd6618740 1 --2- 172.21.15.92:0/718314460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd6618740 1 --2- 172.21.15.92:0/718314460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd6618740 1 --2- 172.21.15.92:0/718314460 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507043af0 0x558507043ed0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd6618740 1 -- 172.21.15.92:0/718314460 >> 172.21.15.92:0/718314460 conn(0x558507040060 msgr2=0x558507040440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd6618740 1 -- 172.21.15.92:0/718314460 shutdown_connections 2024-09-10T10:41:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.284+0000 7f2cd6618740 1 -- 172.21.15.92:0/718314460 wait complete. 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.285+0000 7f2cd6618740 1 -- start start 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.285+0000 7f2cd6618740 1 Processor -- start 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.285+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507043af0 0x55850704bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.285+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.285+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 0x55850704c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.285+0000 7f2cd6618740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558507051880 con 0x558507043af0 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.285+0000 7f2cd6618740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558506f31290 con 0x55850704ecb0 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.285+0000 7f2cd6618740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558507051a00 con 0x558507044410 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.285+0000 7f2cd6618740 10 client.0 _ll_register_callbacks cb 0x558506f62140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.286+0000 7f2cd1617640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507043af0 0x55850704bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.286+0000 7f2cd1617640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507043af0 0x55850704bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38576/0 (socket says 172.21.15.92:38576) 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.286+0000 7f2cd1617640 1 -- 172.21.15.92:0/3118187872 learned_addr learned my addr 172.21.15.92:0/3118187872 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.286+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.286+0000 7f2cd1e18640 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 0x55850704c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.287+0000 7f2cd0e16640 1 -- 172.21.15.92:0/3118187872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 msgr2=0x55850704c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.287+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 0x55850704c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.287+0000 7f2cd0e16640 1 -- 172.21.15.92:0/3118187872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507043af0 msgr2=0x55850704bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.287+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507043af0 0x55850704bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.287+0000 7f2cd0e16640 1 -- 172.21.15.92:0/3118187872 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558506cbb210 con 0x558507044410 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.288+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704c050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0cc500 tx=0x7f2cbc0048a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81959b7a03d0afbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.288+0000 7f2cb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.288+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/3118187872 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc020070 con 0x558507044410 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.288+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/3118187872 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f2cbc0cc780 con 0x558507044410 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.288+0000 7f2cd6618740 1 -- 172.21.15.92:0/3118187872 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cc4004050 con 0x558507044410 2024-09-10T10:41:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.288+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/3118187872 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f2cbc09aec0 con 0x558507044410 2024-09-10T10:41:57.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.288+0000 7f2cd6618740 10 client.25279 fetch_fsmap learned FSMap version 46 2024-09-10T10:41:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.288+0000 7f2cd6618740 1 -- 172.21.15.92:0/3118187872 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x558506d87620 con 0x558507044410 2024-09-10T10:41:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.288+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/3118187872 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc4004050 con 0x558507044410 2024-09-10T10:41:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/3118187872 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f2cbc0979f0 con 0x558507044410 2024-09-10T10:41:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cd6618740 10 client.25279 fetch_fsmap finished waiting for FSMap version 46 2024-09-10T10:41:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cd6618740 10 client.25279 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cd6618740 20 client.25279 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cd6618740 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55850705ebc0 0x558507060fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cd6618740 4 client.25279 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:41:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cd6618740 1 -- 172.21.15.92:0/3118187872 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558506fb5a20 con 0x55850705ebc0 2024-09-10T10:41:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cd1617640 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55850705ebc0 0x558507060fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cb4ff9640 10 client.25279 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.289+0000 7f2cd1617640 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55850705ebc0 0x558507060fb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a031ac25b975a4d9 server_cookie=2b964261fd680656 in_seq=0 out_seq=0 2024-09-10T10:41:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/3118187872 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558506fb5a20 con 0x55850705ebc0 2024-09-10T10:41:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cb4ff9640 10 client.25279 handle_command_reply: tid=0 2024-09-10T10:41:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 client.25279 shutdown 2024-09-10T10:41:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 -- 172.21.15.92:0/3118187872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 msgr2=0x55850704c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704c050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0cc500 tx=0x7f2cbc0048a0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 -- 172.21.15.92:0/3118187872 shutdown_connections 2024-09-10T10:41:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55850705ebc0 0x558507060fb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 0x55850704c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cb4ff9640 0 client.25279 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507044410 0x55850704c050 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 --2- 172.21.15.92:0/3118187872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507043af0 0x55850704bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 -- 172.21.15.92:0/3118187872 >> 172.21.15.92:0/3118187872 conn(0x558507040060 msgr2=0x55850703f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:57.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 -- 172.21.15.92:0/3118187872 shutdown_connections 2024-09-10T10:41:57.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.290+0000 7f2cd6618740 1 -- 172.21.15.92:0/3118187872 wait complete. 2024-09-10T10:41:57.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.291+0000 7f2cd6618740 20 client.25279 trim_cache size 0 max 16384 2024-09-10T10:41:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd6618740 1 Processor -- start 2024-09-10T10:41:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd6618740 1 -- start start 2024-09-10T10:41:57.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507046560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507044410 0x55850704c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 0x558507066800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd6618740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc1ab4c0 con 0x558507044410 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd6618740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc1ad090 con 0x55850704ecb0 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd6618740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc1abb90 con 0x558507043af0 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd0e16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507044410 0x55850704c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd0e16640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507044410 0x55850704c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38588/0 (socket says 172.21.15.92:38588) 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd0e16640 1 -- 172.21.15.92:0/2953963582 learned_addr learned my addr 172.21.15.92:0/2953963582 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd1617640 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507046560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd1e18640 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 0x558507066800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd0e16640 1 -- 172.21.15.92:0/2953963582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 msgr2=0x558507046560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507046560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd0e16640 1 -- 172.21.15.92:0/2953963582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 msgr2=0x558507066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 0x558507066800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.307+0000 7f2cd0e16640 1 -- 172.21.15.92:0/2953963582 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558507061570 con 0x558507044410 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.308+0000 7f2cd1617640 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507046560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.308+0000 7f2cd1e18640 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 0x558507066800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.308+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507044410 0x55850704c3c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc099630 tx=0x7f2cbc099890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9b038b2ba1d70f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.308+0000 7f2cb6ffd640 1 -- 172.21.15.92:0/2953963582 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc020050 con 0x558507044410 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.308+0000 7f2cb6ffd640 1 -- 172.21.15.92:0/2953963582 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cbc0b3070 con 0x558507044410 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.308+0000 7f2cb6ffd640 1 -- 172.21.15.92:0/2953963582 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc09ace0 con 0x558507044410 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 -- 172.21.15.92:0/2953963582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507044410 msgr2=0x55850704c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507044410 0x55850704c3c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc099630 tx=0x7f2cbc099890 comp rx=0 tx=0).stop 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 -- 172.21.15.92:0/2953963582 shutdown_connections 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55850704ecb0 0x558507066800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558507044410 0x55850704c3c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 --2- 172.21.15.92:0/2953963582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507046560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 -- 172.21.15.92:0/2953963582 >> 172.21.15.92:0/2953963582 conn(0x558507040060 msgr2=0x55850704db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 -- 172.21.15.92:0/2953963582 shutdown_connections 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 -- 172.21.15.92:0/2953963582 wait complete. 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 -- start start 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.309+0000 7f2cd6618740 1 Processor -- start 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507048c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507044410 0x558507049180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd6618740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070496c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd6618740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc1ac9c0 con 0x55850704ecb0 2024-09-10T10:41:57.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd6618740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc1ac2f0 con 0x558507044410 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd6618740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ccc1a94c0 con 0x558507043af0 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd6618740 10 client.0 _ll_register_callbacks cb 0x7f2cbc0d2580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1e18640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1617640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507048c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1e18640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38600/0 (socket says 172.21.15.92:38600) 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1e18640 1 -- 172.21.15.92:0/1852609422 learned_addr learned my addr 172.21.15.92:0/1852609422 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507044410 0x558507049180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1617640 1 -- 172.21.15.92:0/1852609422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507044410 msgr2=0x558507049180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1617640 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507044410 0x558507049180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1617640 1 -- 172.21.15.92:0/1852609422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 msgr2=0x5585070496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1617640 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1617640 1 -- 172.21.15.92:0/1852609422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558507041110 con 0x558507043af0 2024-09-10T10:41:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cd1617640 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507048c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5585070617a0 tx=0x7f2cc8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d1e6796d9e2939 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.310+0000 7f2cb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/1852609422 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8035040 con 0x558507043af0 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd6618740 1 -- 172.21.15.92:0/1852609422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cbc0b3070 con 0x558507043af0 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/1852609422 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f2cc8003dd0 con 0x558507043af0 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/1852609422 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f2cc80044d0 con 0x558507043af0 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd6618740 10 client.25285 fetch_fsmap learned FSMap version 46 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd6618740 1 -- 172.21.15.92:0/1852609422 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5585070c9a70 con 0x558507043af0 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/1852609422 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cbc0b3070 con 0x558507043af0 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/1852609422 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f2cc805b070 con 0x558507043af0 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd6618740 10 client.25285 fetch_fsmap finished waiting for FSMap version 46 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd6618740 10 client.25285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd6618740 20 client.25285 populate_metadata read hostname 'smithi092' 2024-09-10T10:41:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd6618740 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5585070ca140 0x5585070cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:41:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd6618740 4 client.25285 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:41:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd6618740 1 -- 172.21.15.92:0/1852609422 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558506fafd70 con 0x5585070ca140 2024-09-10T10:41:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.311+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5585070ca140 0x5585070cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:41:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.312+0000 7f2cb4ff9640 10 client.25285 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.312+0000 7f2cd0e16640 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5585070ca140 0x5585070cc530 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4636f4d8eb2f2059 server_cookie=1cad076354cc6c54 in_seq=0 out_seq=0 2024-09-10T10:41:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cb4ff9640 1 -- 172.21.15.92:0/1852609422 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558506fafd70 con 0x5585070ca140 2024-09-10T10:41:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cb4ff9640 10 client.25285 handle_command_reply: tid=0 2024-09-10T10:41:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 client.25285 shutdown 2024-09-10T10:41:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 -- 172.21.15.92:0/1852609422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 msgr2=0x558507048c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507048c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5585070617a0 tx=0x7f2cc8009260 comp rx=0 tx=0).stop 2024-09-10T10:41:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 -- 172.21.15.92:0/1852609422 shutdown_connections 2024-09-10T10:41:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55850704ecb0 0x5585070496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5585070ca140 0x5585070cc530 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558507044410 0x558507049180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 --2- 172.21.15.92:0/1852609422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558507043af0 0x558507048c40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cb4ff9640 0 client.25285 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 -- 172.21.15.92:0/1852609422 >> 172.21.15.92:0/1852609422 conn(0x558507040060 msgr2=0x55850703e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 -- 172.21.15.92:0/1852609422 shutdown_connections 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 1 -- 172.21.15.92:0/1852609422 wait complete. 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.328+0000 7f2cd6618740 20 client.25285 trim_cache size 0 max 16384 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:41:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:41:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:41:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 -- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2cb80a2e20 msgr2=0x7f2cb80a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2cb80a2e20 0x7f2cb80a52e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80096c0 tx=0x7f2cc80058d0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 -- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc101370 msgr2=0x7f2ccc199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc101370 0x7f2ccc199730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00d770 tx=0x7f2cbc00dc30 comp rx=0 tx=0).stop 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 -- 172.21.15.92:0/4137640601 shutdown_connections 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ccc1069e0 0x7f2ccc1a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ccc101370 0x7f2ccc199730 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2cb80a2e20 0x7f2cb80a52e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 --2- 172.21.15.92:0/4137640601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2ccc1009d0 0x7f2ccc1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 -- 172.21.15.92:0/4137640601 >> 172.21.15.92:0/4137640601 conn(0x7f2ccc0fc6f0 msgr2=0x7f2ccc0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 -- 172.21.15.92:0/4137640601 shutdown_connections 2024-09-10T10:41:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:41:57.329+0000 7f2cd387b640 1 -- 172.21.15.92:0/4137640601 wait complete. 2024-09-10T10:41:57.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:57 smithi097 ceph-mon[35213]: pgmap v163: 97 pgs: 97 active+clean; 3.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.3 MiB/s wr, 819 op/s 2024-09-10T10:41:57.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:57 smithi092 ceph-mon[30834]: pgmap v163: 97 pgs: 97 active+clean; 3.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.3 MiB/s wr, 819 op/s 2024-09-10T10:41:58.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:57 smithi121 ceph-mon[35231]: pgmap v163: 97 pgs: 97 active+clean; 3.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.3 MiB/s wr, 819 op/s 2024-09-10T10:41:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 300.0 s, 2251.2 tps, lat 44.444 ms stddev 48.203 2024-09-10T10:41:59.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:41:59 smithi097 ceph-mon[35213]: pgmap v164: 97 pgs: 97 active+clean; 3.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.0 MiB/s wr, 575 op/s 2024-09-10T10:41:59.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:41:59 smithi092 ceph-mon[30834]: pgmap v164: 97 pgs: 97 active+clean; 3.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.0 MiB/s wr, 575 op/s 2024-09-10T10:42:00.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:41:59 smithi121 ceph-mon[35231]: pgmap v164: 97 pgs: 97 active+clean; 3.9 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.0 MiB/s wr, 575 op/s 2024-09-10T10:42:01.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:01 smithi097 ceph-mon[35213]: pgmap v165: 97 pgs: 97 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.9 MiB/s wr, 855 op/s 2024-09-10T10:42:01.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:01 smithi092 ceph-mon[30834]: pgmap v165: 97 pgs: 97 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.9 MiB/s wr, 855 op/s 2024-09-10T10:42:02.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:01 smithi121 ceph-mon[35231]: pgmap v165: 97 pgs: 97 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.9 MiB/s wr, 855 op/s 2024-09-10T10:42:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 305.0 s, 961.8 tps, lat 101.718 ms stddev 146.538 2024-09-10T10:42:03.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:03 smithi097 ceph-mon[35213]: pgmap v166: 97 pgs: 97 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.1 MiB/s wr, 562 op/s 2024-09-10T10:42:03.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:03 smithi092 ceph-mon[30834]: pgmap v166: 97 pgs: 97 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.1 MiB/s wr, 562 op/s 2024-09-10T10:42:04.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:03 smithi121 ceph-mon[35231]: pgmap v166: 97 pgs: 97 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.1 MiB/s wr, 562 op/s 2024-09-10T10:42:05.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:05 smithi097 ceph-mon[35213]: pgmap v167: 97 pgs: 97 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.2 MiB/s wr, 574 op/s 2024-09-10T10:42:05.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:05 smithi092 ceph-mon[30834]: pgmap v167: 97 pgs: 97 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.2 MiB/s wr, 574 op/s 2024-09-10T10:42:06.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:05 smithi121 ceph-mon[35231]: pgmap v167: 97 pgs: 97 active+clean; 3.9 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.2 MiB/s wr, 574 op/s 2024-09-10T10:42:07.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:07 smithi097 ceph-mon[35213]: pgmap v168: 97 pgs: 97 active+clean; 3.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.6 MiB/s wr, 878 op/s 2024-09-10T10:42:07.842 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:07 smithi121 ceph-mon[35231]: pgmap v168: 97 pgs: 97 active+clean; 3.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.6 MiB/s wr, 878 op/s 2024-09-10T10:42:07.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:07 smithi092 ceph-mon[30834]: pgmap v168: 97 pgs: 97 active+clean; 3.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.6 MiB/s wr, 878 op/s 2024-09-10T10:42:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 310.0 s, 273.0 tps, lat 353.859 ms stddev 216.308 2024-09-10T10:42:09.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:09 smithi097 ceph-mon[35213]: pgmap v169: 97 pgs: 97 active+clean; 3.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.5 MiB/s wr, 610 op/s 2024-09-10T10:42:09.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:09 smithi092 ceph-mon[30834]: pgmap v169: 97 pgs: 97 active+clean; 3.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.5 MiB/s wr, 610 op/s 2024-09-10T10:42:10.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:09 smithi121 ceph-mon[35231]: pgmap v169: 97 pgs: 97 active+clean; 3.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.5 MiB/s wr, 610 op/s 2024-09-10T10:42:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.452+0000 7f1e78cae640 1 -- 172.21.15.92:0/3679099945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e741029b0 msgr2=0x7f1e74102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.452+0000 7f1e78cae640 1 --2- 172.21.15.92:0/3679099945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e741029b0 0x7f1e74102d90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009900 tx=0x7f1e6402a410 comp rx=0 tx=0).stop 2024-09-10T10:42:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.452+0000 7f1e78cae640 1 -- 172.21.15.92:0/3679099945 shutdown_connections 2024-09-10T10:42:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.452+0000 7f1e78cae640 1 --2- 172.21.15.92:0/3679099945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e74101a30 0x7f1e7410d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.452+0000 7f1e78cae640 1 --2- 172.21.15.92:0/3679099945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e74101070 0x7f1e741014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.452+0000 7f1e78cae640 1 --2- 172.21.15.92:0/3679099945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e741029b0 0x7f1e74102d90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.452+0000 7f1e78cae640 1 -- 172.21.15.92:0/3679099945 >> 172.21.15.92:0/3679099945 conn(0x7f1e740770f0 msgr2=0x7f1e740fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.452+0000 7f1e78cae640 1 -- 172.21.15.92:0/3679099945 shutdown_connections 2024-09-10T10:42:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.452+0000 7f1e78cae640 1 -- 172.21.15.92:0/3679099945 wait complete. 2024-09-10T10:42:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.453+0000 7f1e78cae640 1 Processor -- start 2024-09-10T10:42:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e78cae640 1 -- start start 2024-09-10T10:42:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e78cae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e74101070 0x7f1e7419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e78cae640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e74101a30 0x7f1e7419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e78cae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e741029b0 0x7f1e7419ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e7259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e74101070 0x7f1e7419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e78cae640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74110f10 con 0x7f1e74101070 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e78cae640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74110d90 con 0x7f1e74101a30 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e78cae640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1e74111090 con 0x7f1e741029b0 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e7259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e74101070 0x7f1e7419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54984/0 (socket says 172.21.15.92:54984) 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e7259c640 1 -- 172.21.15.92:0/86364862 learned_addr learned my addr 172.21.15.92:0/86364862 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e71d9b640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e74101a30 0x7f1e7419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.454+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e741029b0 0x7f1e7419ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e71d9b640 1 -- 172.21.15.92:0/86364862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e741029b0 msgr2=0x7f1e7419ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e71d9b640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e741029b0 0x7f1e7419ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e71d9b640 1 -- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e74101070 msgr2=0x7f1e7419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e71d9b640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e74101070 0x7f1e7419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e71d9b640 1 -- 172.21.15.92:0/86364862 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7419f580 con 0x7f1e74101a30 2024-09-10T10:42:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e7259c640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e74101070 0x7f1e7419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:42:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e71d9b640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e74101a30 0x7f1e7419aad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800e9f0 tx=0x7f1e6800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e637fe640 1 -- 172.21.15.92:0/86364862 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800ccc0 con 0x7f1e74101a30 2024-09-10T10:42:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e637fe640 1 -- 172.21.15.92:0/86364862 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e68010910 con 0x7f1e74101a30 2024-09-10T10:42:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e78cae640 1 -- 172.21.15.92:0/86364862 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7419f870 con 0x7f1e74101a30 2024-09-10T10:42:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e637fe640 1 -- 172.21.15.92:0/86364862 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68018960 con 0x7f1e74101a30 2024-09-10T10:42:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.455+0000 7f1e78cae640 1 -- 172.21.15.92:0/86364862 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e74107920 con 0x7f1e74101a30 2024-09-10T10:42:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.457+0000 7f1e637fe640 1 -- 172.21.15.92:0/86364862 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1e68010ac0 con 0x7f1e74101a30 2024-09-10T10:42:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.458+0000 7f1e7ba49740 1 Processor -- start 2024-09-10T10:42:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.458+0000 7f1e7ba49740 1 -- start start 2024-09-10T10:42:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.458+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad241ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.458+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad242410 0x5563ad24c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.458+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 0x5563ad24f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.458+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5563ad1a62f0 con 0x5563ad24ccb0 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.458+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5563ad14e270 con 0x5563ad242410 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.458+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5563ad1a22b0 con 0x5563ad241af0 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad241ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad241ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:53542/0 (socket says 172.21.15.92:53542) 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 -- 172.21.15.92:0/83428417 learned_addr learned my addr 172.21.15.92:0/83428417 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e71d9b640 1 --2- 172.21.15.92:0/83428417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 0x5563ad24f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e637fe640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f1e5c0a2da0 0x7f1e5c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 -- 172.21.15.92:0/83428417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad242410 msgr2=0x5563ad24c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/83428417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad242410 0x5563ad24c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 -- 172.21.15.92:0/83428417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 msgr2=0x5563ad24f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/83428417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 0x5563ad24f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 -- 172.21.15.92:0/83428417 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ad14d340 con 0x5563ad241af0 2024-09-10T10:42:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e637fe640 1 -- 172.21.15.92:0/86364862 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f1e680cf7d0 con 0x7f1e74101a30 2024-09-10T10:42:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/83428417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad241ed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c011590 tx=0x7f1e6c011a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cf2f0252f1e0148 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f1e5c0a2da0 0x7f1e5c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.459+0000 7f1e60ff9640 1 -- 172.21.15.92:0/83428417 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c017050 con 0x5563ad241af0 2024-09-10T10:42:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e60ff9640 1 -- 172.21.15.92:0/83428417 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6c003d50 con 0x5563ad241af0 2024-09-10T10:42:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e60ff9640 1 -- 172.21.15.92:0/83428417 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00fdc0 con 0x5563ad241af0 2024-09-10T10:42:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e7ba49740 1 -- 172.21.15.92:0/83428417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 msgr2=0x5563ad241ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f1e5c0a2da0 0x7f1e5c0a5260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c01d040 tx=0x7f1e6c01b470 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/83428417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad241ed0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c011590 tx=0x7f1e6c011a50 comp rx=0 tx=0).stop 2024-09-10T10:42:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e7ba49740 1 -- 172.21.15.92:0/83428417 shutdown_connections 2024-09-10T10:42:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/83428417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 0x5563ad24f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/83428417 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad242410 0x5563ad24c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/83428417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad241ed0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.460+0000 7f1e7ba49740 1 -- 172.21.15.92:0/83428417 >> 172.21.15.92:0/83428417 conn(0x5563ad23e060 msgr2=0x5563ad23e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 -- 172.21.15.92:0/83428417 shutdown_connections 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 -- 172.21.15.92:0/83428417 wait complete. 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 -- start start 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 Processor -- start 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 0x5563ad249bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad242410 0x5563ad24a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 0x5563ad24a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5563ad24f880 con 0x5563ad24ccb0 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5563ad12f290 con 0x5563ad241af0 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5563ad24fa00 con 0x5563ad242410 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7ba49740 10 client.0 _ll_register_callbacks cb 0x5563ad160140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 0x5563ad249bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e71d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad242410 0x5563ad24a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e72d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 0x5563ad24a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 0x5563ad249bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:57384/0 (socket says 172.21.15.92:57384) 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.461+0000 7f1e7259c640 1 -- 172.21.15.92:0/2902224009 learned_addr learned my addr 172.21.15.92:0/2902224009 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e71d9b640 1 -- 172.21.15.92:0/2902224009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 msgr2=0x5563ad249bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e71d9b640 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 0x5563ad249bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e71d9b640 1 -- 172.21.15.92:0/2902224009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 msgr2=0x5563ad24a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e71d9b640 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 0x5563ad24a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e71d9b640 1 -- 172.21.15.92:0/2902224009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563aceb9210 con 0x5563ad242410 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e71d9b640 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad242410 0x5563ad24a100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1e680ccf00 tx=0x7f1e6800cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cf3a9dbae5b1d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2902224009 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e680cd3c0 con 0x5563ad242410 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2902224009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e6c003d50 con 0x5563ad242410 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2902224009 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f1e680cfdc0 con 0x5563ad242410 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2902224009 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1e680a4970 con 0x5563ad242410 2024-09-10T10:42:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e7ba49740 10 client.25297 fetch_fsmap learned FSMap version 46 2024-09-10T10:42:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2902224009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5563acf85620 con 0x5563ad242410 2024-09-10T10:42:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.462+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2902224009 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6c003d50 con 0x5563ad242410 2024-09-10T10:42:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.463+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2902224009 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f1e68086030 con 0x5563ad242410 2024-09-10T10:42:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.463+0000 7f1e7ba49740 10 client.25297 fetch_fsmap finished waiting for FSMap version 46 2024-09-10T10:42:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.463+0000 7f1e7ba49740 10 client.25297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:42:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.463+0000 7f1e7ba49740 20 client.25297 populate_metadata read hostname 'smithi092' 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.463+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5563ad25cc20 0x5563ad25f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.463+0000 7f1e7ba49740 4 client.25297 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.463+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2902224009 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563ad1b3a20 con 0x5563ad25cc20 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.463+0000 7f1e7259c640 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5563ad25cc20 0x5563ad25f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.464+0000 7f1e59ffb640 10 client.25297 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.464+0000 7f1e7259c640 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5563ad25cc20 0x5563ad25f010 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=250a4d41fa83c45f server_cookie=adc95f63c8083cb6 in_seq=0 out_seq=0 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2902224009 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563ad1b3a20 con 0x5563ad25cc20 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e59ffb640 10 client.25297 handle_command_reply: tid=0 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 client.25297 shutdown 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2902224009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad242410 msgr2=0x5563ad24a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad242410 0x5563ad24a100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1e680ccf00 tx=0x7f1e6800cf60 comp rx=0 tx=0).stop 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2902224009 shutdown_connections 2024-09-10T10:42:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad24ccb0 0x5563ad24a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad242410 0x5563ad24a100 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5563ad25cc20 0x5563ad25f010 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2902224009 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 0x5563ad249bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e59ffb640 0 client.25297 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2902224009 >> 172.21.15.92:0/2902224009 conn(0x5563ad23e060 msgr2=0x5563ad243d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2902224009 shutdown_connections 2024-09-10T10:42:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.465+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2902224009 wait complete. 2024-09-10T10:42:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.466+0000 7f1e7ba49740 20 client.25297 trim_cache size 0 max 16384 2024-09-10T10:42:10.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.489+0000 7f1e7ba49740 1 Processor -- start 2024-09-10T10:42:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.491+0000 7f1e7ba49740 1 -- start start 2024-09-10T10:42:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.492+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 0x5563ad24a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.492+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 0x5563ad264860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.492+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad24ccb0 0x5563ad264da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.492+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741ab580 con 0x5563ad242410 2024-09-10T10:42:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.492+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741ad150 con 0x5563ad241af0 2024-09-10T10:42:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.492+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741abc50 con 0x5563ad24ccb0 2024-09-10T10:42:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.493+0000 7f1e72d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad24ccb0 0x5563ad264da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.493+0000 7f1e72d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad24ccb0 0x5563ad264da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:53556/0 (socket says 172.21.15.92:53556) 2024-09-10T10:42:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.493+0000 7f1e72d9d640 1 -- 172.21.15.92:0/2883125689 learned_addr learned my addr 172.21.15.92:0/2883125689 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.493+0000 7f1e72d9d640 1 -- 172.21.15.92:0/2883125689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 msgr2=0x5563ad24a470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:42:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.493+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/2883125689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 0x5563ad24a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.493+0000 7f1e72d9d640 1 -- 172.21.15.92:0/2883125689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 msgr2=0x5563ad264860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.493+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/2883125689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 0x5563ad264860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.493+0000 7f1e72d9d640 1 -- 172.21.15.92:0/2883125689 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ad2392d0 con 0x5563ad24ccb0 2024-09-10T10:42:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.494+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/2883125689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad24ccb0 0x5563ad264da0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00f400 tx=0x7f1e6c026000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a74e6bb1fdc9f042 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.496+0000 7f1e5bfff640 1 -- 172.21.15.92:0/2883125689 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00e980 con 0x5563ad24ccb0 2024-09-10T10:42:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.496+0000 7f1e5bfff640 1 -- 172.21.15.92:0/2883125689 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6c00f640 con 0x5563ad24ccb0 2024-09-10T10:42:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.496+0000 7f1e5bfff640 1 -- 172.21.15.92:0/2883125689 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c024660 con 0x5563ad24ccb0 2024-09-10T10:42:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.497+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2883125689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad24ccb0 msgr2=0x5563ad264da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.497+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2883125689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad24ccb0 0x5563ad264da0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00f400 tx=0x7f1e6c026000 comp rx=0 tx=0).stop 2024-09-10T10:42:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.499+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2883125689 shutdown_connections 2024-09-10T10:42:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.499+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2883125689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad24ccb0 0x5563ad264da0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.499+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2883125689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 0x5563ad264860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.499+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2883125689 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad241af0 0x5563ad24a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.499+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2883125689 >> 172.21.15.92:0/2883125689 conn(0x5563ad23e060 msgr2=0x5563ad24bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:10.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.507+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2883125689 shutdown_connections 2024-09-10T10:42:10.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.512+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2883125689 wait complete. 2024-09-10T10:42:10.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.513+0000 7f1e7ba49740 1 -- start start 2024-09-10T10:42:10.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.513+0000 7f1e7ba49740 1 Processor -- start 2024-09-10T10:42:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.513+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad2c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.513+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 0x5563ad254c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.513+0000 7f1e7ba49740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad24ccb0 0x5563ad2551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.513+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741aca80 con 0x5563ad242410 2024-09-10T10:42:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.513+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741ac3b0 con 0x5563ad24ccb0 2024-09-10T10:42:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.513+0000 7f1e7ba49740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1e741a95a0 con 0x5563ad241af0 2024-09-10T10:42:10.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.513+0000 7f1e7ba49740 10 client.0 _ll_register_callbacks cb 0x7f1e6800ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:42:10.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.514+0000 7f1e72d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad24ccb0 0x5563ad2551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.517+0000 7f1e7259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad2c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.517+0000 7f1e71d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 0x5563ad254c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.517+0000 7f1e71d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 0x5563ad254c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55018/0 (socket says 172.21.15.92:55018) 2024-09-10T10:42:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.517+0000 7f1e71d9b640 1 -- 172.21.15.92:0/2358706496 learned_addr learned my addr 172.21.15.92:0/2358706496 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.518+0000 7f1e72d9d640 1 -- 172.21.15.92:0/2358706496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 msgr2=0x5563ad2c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.518+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad2c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.518+0000 7f1e72d9d640 1 -- 172.21.15.92:0/2358706496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 msgr2=0x5563ad254c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.518+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 0x5563ad254c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.518+0000 7f1e72d9d640 1 -- 172.21.15.92:0/2358706496 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ad246ab0 con 0x5563ad24ccb0 2024-09-10T10:42:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.519+0000 7f1e72d9d640 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad24ccb0 0x5563ad2551d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009270 tx=0x7f1e6c00eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fe33f6161208f3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.520+0000 7f1e59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:42:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.520+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2358706496 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c017040 con 0x5563ad24ccb0 2024-09-10T10:42:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.520+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2358706496 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f1e6c00f9f0 con 0x5563ad24ccb0 2024-09-10T10:42:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.521+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2358706496 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e6c00f640 con 0x5563ad24ccb0 2024-09-10T10:42:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.523+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2358706496 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1e6c00fbf0 con 0x5563ad24ccb0 2024-09-10T10:42:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.526+0000 7f1e7ba49740 10 client.25259 fetch_fsmap learned FSMap version 46 2024-09-10T10:42:10.526 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.526+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2358706496 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5563ad2d89f0 con 0x5563ad24ccb0 2024-09-10T10:42:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.529+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2358706496 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6c00f640 con 0x5563ad24ccb0 2024-09-10T10:42:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.529+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2358706496 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f1e6c04a030 con 0x5563ad24ccb0 2024-09-10T10:42:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.531+0000 7f1e7ba49740 10 client.25259 fetch_fsmap finished waiting for FSMap version 46 2024-09-10T10:42:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.531+0000 7f1e7ba49740 10 client.25259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:42:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.531+0000 7f1e7ba49740 20 client.25259 populate_metadata read hostname 'smithi092' 2024-09-10T10:42:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.531+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5563ad2d8e70 0x5563ad2db260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.531+0000 7f1e7ba49740 4 client.25259 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:42:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.531+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2358706496 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5563ad1add70 con 0x5563ad2d8e70 2024-09-10T10:42:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.534+0000 7f1e7259c640 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5563ad2d8e70 0x5563ad2db260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.543+0000 7f1e7259c640 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5563ad2d8e70 0x5563ad2db260 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d604fd16eaf759ab server_cookie=221850dccc68db82 in_seq=0 out_seq=0 2024-09-10T10:42:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.543+0000 7f1e59ffb640 10 client.25259 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.557+0000 7f1e59ffb640 1 -- 172.21.15.92:0/2358706496 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5563ad1add70 con 0x5563ad2d8e70 2024-09-10T10:42:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.557+0000 7f1e59ffb640 10 client.25259 handle_command_reply: tid=0 2024-09-10T10:42:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.557+0000 7f1e7ba49740 1 client.25259 shutdown 2024-09-10T10:42:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.558+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2358706496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad24ccb0 msgr2=0x5563ad2551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.558+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad24ccb0 0x5563ad2551d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009270 tx=0x7f1e6c00eda0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.558+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2358706496 shutdown_connections 2024-09-10T10:42:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.559+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5563ad2d8e70 0x5563ad2db260 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.559+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5563ad24ccb0 0x5563ad2551d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.559+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5563ad242410 0x5563ad254c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.559+0000 7f1e7ba49740 1 --2- 172.21.15.92:0/2358706496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ad241af0 0x5563ad2c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.559+0000 7f1e59ffb640 0 client.25259 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.559+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2358706496 >> 172.21.15.92:0/2358706496 conn(0x5563ad23e060 msgr2=0x5563ad23c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.559+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2358706496 shutdown_connections 2024-09-10T10:42:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.559+0000 7f1e7ba49740 1 -- 172.21.15.92:0/2358706496 wait complete. 2024-09-10T10:42:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.559+0000 7f1e7ba49740 20 client.25259 trim_cache size 0 max 16384 2024-09-10T10:42:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:42:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:42:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:42:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:42:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 -- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f1e5c0a2da0 msgr2=0x7f1e5c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f1e5c0a2da0 0x7f1e5c0a5260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c01d040 tx=0x7f1e6c01b470 comp rx=0 tx=0).stop 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 -- 172.21.15.92:0/86364862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e74101a30 msgr2=0x7f1e7419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e74101a30 0x7f1e7419aad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800e9f0 tx=0x7f1e6800eeb0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 -- 172.21.15.92:0/86364862 shutdown_connections 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e741029b0 0x7f1e7419ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f1e5c0a2da0 0x7f1e5c0a5260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f1e74101a30 0x7f1e7419aad0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 --2- 172.21.15.92:0/86364862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e74101070 0x7f1e7419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 -- 172.21.15.92:0/86364862 >> 172.21.15.92:0/86364862 conn(0x7f1e740770f0 msgr2=0x7f1e740fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 -- 172.21.15.92:0/86364862 shutdown_connections 2024-09-10T10:42:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:10.560+0000 7f1e78cae640 1 -- 172.21.15.92:0/86364862 wait complete. 2024-09-10T10:42:11.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:11 smithi092 ceph-mon[30834]: pgmap v170: 97 pgs: 97 active+clean; 4.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 31 MiB/s wr, 1.65k op/s 2024-09-10T10:42:12.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:11 smithi121 ceph-mon[35231]: pgmap v170: 97 pgs: 97 active+clean; 4.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 31 MiB/s wr, 1.65k op/s 2024-09-10T10:42:12.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:11 smithi097 ceph-mon[35213]: pgmap v170: 97 pgs: 97 active+clean; 4.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 31 MiB/s wr, 1.65k op/s 2024-09-10T10:42:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 315.0 s, 1486.0 tps, lat 71.005 ms stddev 133.163 2024-09-10T10:42:13.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:13 smithi092 ceph-mon[30834]: pgmap v171: 97 pgs: 97 active+clean; 4.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 1.37k op/s 2024-09-10T10:42:14.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:13 smithi121 ceph-mon[35231]: pgmap v171: 97 pgs: 97 active+clean; 4.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 1.37k op/s 2024-09-10T10:42:14.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:13 smithi097 ceph-mon[35213]: pgmap v171: 97 pgs: 97 active+clean; 4.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 1.37k op/s 2024-09-10T10:42:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:15 smithi092 ceph-mon[30834]: pgmap v172: 97 pgs: 97 active+clean; 4.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 MiB/s wr, 1.38k op/s 2024-09-10T10:42:16.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:15 smithi121 ceph-mon[35231]: pgmap v172: 97 pgs: 97 active+clean; 4.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 MiB/s wr, 1.38k op/s 2024-09-10T10:42:16.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:15 smithi097 ceph-mon[35213]: pgmap v172: 97 pgs: 97 active+clean; 4.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 MiB/s wr, 1.38k op/s 2024-09-10T10:42:17.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:17 smithi092 ceph-mon[30834]: pgmap v173: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 32 MiB/s wr, 1.71k op/s 2024-09-10T10:42:18.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:17 smithi121 ceph-mon[35231]: pgmap v173: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 32 MiB/s wr, 1.71k op/s 2024-09-10T10:42:18.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:17 smithi097 ceph-mon[35213]: pgmap v173: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 32 MiB/s wr, 1.71k op/s 2024-09-10T10:42:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 320.0 s, 2519.6 tps, lat 39.693 ms stddev 43.653 2024-09-10T10:42:19.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:19 smithi092 ceph-mon[30834]: pgmap v174: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 1.39k op/s 2024-09-10T10:42:20.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:19 smithi121 ceph-mon[35231]: pgmap v174: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 1.39k op/s 2024-09-10T10:42:20.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:19 smithi097 ceph-mon[35213]: pgmap v174: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 1.39k op/s 2024-09-10T10:42:21.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:21 smithi092 ceph-mon[30834]: pgmap v175: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 1.68k op/s 2024-09-10T10:42:22.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:21 smithi121 ceph-mon[35231]: pgmap v175: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 1.68k op/s 2024-09-10T10:42:22.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:21 smithi097 ceph-mon[35213]: pgmap v175: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 MiB/s wr, 1.68k op/s 2024-09-10T10:42:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 325.0 s, 2626.8 tps, lat 38.012 ms stddev 42.587 2024-09-10T10:42:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 -- 172.21.15.92:0/524270340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 msgr2=0x7f2b00100870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 --2- 172.21.15.92:0/524270340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 0x7f2b00100870 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2af800aa40 tx=0x7f2af802a660 comp rx=0 tx=0).stop 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 -- 172.21.15.92:0/524270340 shutdown_connections 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 --2- 172.21.15.92:0/524270340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b001026f0 0x7f2b0010d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 --2- 172.21.15.92:0/524270340 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b00101d70 0x7f2b001021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 --2- 172.21.15.92:0/524270340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 0x7f2b00100870 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 -- 172.21.15.92:0/524270340 >> 172.21.15.92:0/524270340 conn(0x7f2b000770f0 msgr2=0x7f2b000fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 -- 172.21.15.92:0/524270340 shutdown_connections 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 -- 172.21.15.92:0/524270340 wait complete. 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.676+0000 7f2b06e65640 1 Processor -- start 2024-09-10T10:42:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b06e65640 1 -- start start 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b06e65640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 0x7f2b001961c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b06e65640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b00101d70 0x7f2b00196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b06e65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b001026f0 0x7f2b0019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b06e65640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0010fdd0 con 0x7f2b00100490 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b06e65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0010fc50 con 0x7f2b001026f0 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b06e65640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0010ff50 con 0x7f2b00101d70 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b04c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 0x7f2b001961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b04c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 0x7f2b001961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42880/0 (socket says 172.21.15.92:42880) 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b04c01640 1 -- 172.21.15.92:0/3949050175 learned_addr learned my addr 172.21.15.92:0/3949050175 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b05402640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b001026f0 0x7f2b0019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2afffff640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b00101d70 0x7f2b00196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b04c01640 1 -- 172.21.15.92:0/3949050175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b00101d70 msgr2=0x7f2b00196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b04c01640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b00101d70 0x7f2b00196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b04c01640 1 -- 172.21.15.92:0/3949050175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b001026f0 msgr2=0x7f2b0019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b04c01640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b001026f0 0x7f2b0019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b04c01640 1 -- 172.21.15.92:0/3949050175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0019b1b0 con 0x7f2b00100490 2024-09-10T10:42:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2b04c01640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 0x7f2b001961c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2af800a340 tx=0x7f2af8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.677+0000 7f2afdffb640 1 -- 172.21.15.92:0/3949050175 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af803f070 con 0x7f2b00100490 2024-09-10T10:42:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.678+0000 7f2afdffb640 1 -- 172.21.15.92:0/3949050175 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af8003cd0 con 0x7f2b00100490 2024-09-10T10:42:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.678+0000 7f2b06e65640 1 -- 172.21.15.92:0/3949050175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0019b440 con 0x7f2b00100490 2024-09-10T10:42:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.678+0000 7f2afdffb640 1 -- 172.21.15.92:0/3949050175 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8035030 con 0x7f2b00100490 2024-09-10T10:42:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.678+0000 7f2b06e65640 1 -- 172.21.15.92:0/3949050175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b001a2d30 con 0x7f2b00100490 2024-09-10T10:42:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.681+0000 7f2b09c00740 1 Processor -- start 2024-09-10T10:42:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b09c00740 1 -- start start 2024-09-10T10:42:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2afdffb640 1 -- 172.21.15.92:0/3949050175 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2af8042070 con 0x7f2b00100490 2024-09-10T10:42:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc163770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc1660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b09c00740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55edcc0bd2f0 con 0x55edcc159410 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b09c00740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55edcc065270 con 0x55edcc158af0 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b09c00740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edcc0b92b0 con 0x55edcc163cb0 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b04c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b04c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc163770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42888/0 (socket says 172.21.15.92:42888) 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b04c01640 1 -- 172.21.15.92:0/902336922 learned_addr learned my addr 172.21.15.92:0/902336922 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2afffff640 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc1660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b05402640 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2afffff640 1 -- 172.21.15.92:0/902336922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 msgr2=0x55edcc158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2afffff640 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2afffff640 1 -- 172.21.15.92:0/902336922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 msgr2=0x55edcc163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:23.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2afffff640 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc163770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2afffff640 1 -- 172.21.15.92:0/902336922 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edcc064340 con 0x55edcc163cb0 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b05402640 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2b04c01640 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2afdffb640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2aec0a2da0 0x7f2aec0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.682+0000 7f2afffff640 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc1660a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009b60 tx=0x7f2ae8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df0b01de1b26db18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2b05402640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2aec0a2da0 0x7f2aec0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2afdffb640 1 -- 172.21.15.92:0/3949050175 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f2af80efb20 con 0x7f2b00100490 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2af6ffd640 1 -- 172.21.15.92:0/902336922 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8009e50 con 0x55edcc163cb0 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2af6ffd640 1 -- 172.21.15.92:0/902336922 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae80035f0 con 0x55edcc163cb0 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2af6ffd640 1 -- 172.21.15.92:0/902336922 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8012650 con 0x55edcc163cb0 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2b09c00740 1 -- 172.21.15.92:0/902336922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 msgr2=0x55edcc1660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2b09c00740 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc1660a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009b60 tx=0x7f2ae8010740 comp rx=0 tx=0).stop 2024-09-10T10:42:23.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2b05402640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2aec0a2da0 0x7f2aec0a5260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2af0005fd0 tx=0x7f2af000f040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2b09c00740 1 -- 172.21.15.92:0/902336922 shutdown_connections 2024-09-10T10:42:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2b09c00740 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc1660a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2b09c00740 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2b09c00740 1 --2- 172.21.15.92:0/902336922 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.683+0000 7f2b09c00740 1 -- 172.21.15.92:0/902336922 >> 172.21.15.92:0/902336922 conn(0x55edcc155060 msgr2=0x55edcc155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 -- 172.21.15.92:0/902336922 shutdown_connections 2024-09-10T10:42:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 -- 172.21.15.92:0/902336922 wait complete. 2024-09-10T10:42:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 -- start start 2024-09-10T10:42:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 Processor -- start 2024-09-10T10:42:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc158af0 0x55edcc160b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc159410 0x55edcc161050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55edcc166880 con 0x55edcc158af0 2024-09-10T10:42:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55edcc046290 con 0x55edcc159410 2024-09-10T10:42:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b04c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc158af0 0x55edcc160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.684+0000 7f2b09c00740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edcc166a00 con 0x55edcc163cb0 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b04c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc158af0 0x55edcc160b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42892/0 (socket says 172.21.15.92:42892) 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b04c01640 1 -- 172.21.15.92:0/258194855 learned_addr learned my addr 172.21.15.92:0/258194855 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b09c00740 10 client.0 _ll_register_callbacks cb 0x55edcc077140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b05402640 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2afffff640 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc159410 0x55edcc161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b04c01640 1 -- 172.21.15.92:0/258194855 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 msgr2=0x55edcc161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b04c01640 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b04c01640 1 -- 172.21.15.92:0/258194855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc159410 msgr2=0x55edcc161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b04c01640 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc159410 0x55edcc161050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b04c01640 1 -- 172.21.15.92:0/258194855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edcbdd0210 con 0x55edcc158af0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b05402640 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2b04c01640 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc158af0 0x55edcc160b10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2af80b8510 tx=0x7f2af80efd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ecdcad1965aa9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.685+0000 7f2adffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.686+0000 7f2adffff640 1 -- 172.21.15.92:0/258194855 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8049030 con 0x55edcc158af0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.686+0000 7f2adffff640 1 -- 172.21.15.92:0/258194855 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f2af80ed560 con 0x55edcc158af0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.686+0000 7f2b09c00740 1 -- 172.21.15.92:0/258194855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae80035f0 con 0x55edcc158af0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.686+0000 7f2adffff640 1 -- 172.21.15.92:0/258194855 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f2af80b8350 con 0x55edcc158af0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.686+0000 7f2b09c00740 10 client.15759 fetch_fsmap learned FSMap version 46 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.686+0000 7f2b09c00740 1 -- 172.21.15.92:0/258194855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55edcbe9c620 con 0x55edcc158af0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.687+0000 7f2adffff640 1 -- 172.21.15.92:0/258194855 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae80035f0 con 0x55edcc158af0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.687+0000 7f2adffff640 1 -- 172.21.15.92:0/258194855 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f2af804c060 con 0x55edcc158af0 2024-09-10T10:42:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.687+0000 7f2b09c00740 10 client.15759 fetch_fsmap finished waiting for FSMap version 46 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.687+0000 7f2b09c00740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.687+0000 7f2b09c00740 20 client.15759 populate_metadata read hostname 'smithi092' 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.687+0000 7f2b09c00740 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edcc178220 0x55edcc17a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.687+0000 7f2b09c00740 4 client.15759 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.687+0000 7f2b09c00740 1 -- 172.21.15.92:0/258194855 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edcc0caa20 con 0x55edcc178220 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.687+0000 7f2afffff640 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edcc178220 0x55edcc17a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.688+0000 7f2afffff640 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edcc178220 0x55edcc17a670 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be608edff108bd38 server_cookie=750b073279e0ac66 in_seq=0 out_seq=0 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.688+0000 7f2adffff640 10 client.15759 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.688+0000 7f2adffff640 1 -- 172.21.15.92:0/258194855 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55edcc0caa20 con 0x55edcc178220 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.688+0000 7f2adffff640 10 client.15759 handle_command_reply: tid=0 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.688+0000 7f2b09c00740 1 client.15759 shutdown 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 -- 172.21.15.92:0/258194855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc158af0 msgr2=0x55edcc160b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc158af0 0x55edcc160b10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2af80b8510 tx=0x7f2af80efd20 comp rx=0 tx=0).stop 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 -- 172.21.15.92:0/258194855 shutdown_connections 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edcc178220 0x55edcc17a670 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc159410 0x55edcc161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 --2- 172.21.15.92:0/258194855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc158af0 0x55edcc160b10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 -- 172.21.15.92:0/258194855 >> 172.21.15.92:0/258194855 conn(0x55edcc155060 msgr2=0x55edcc15adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2adffff640 0 client.15759 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 -- 172.21.15.92:0/258194855 shutdown_connections 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 1 -- 172.21.15.92:0/258194855 wait complete. 2024-09-10T10:42:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.689+0000 7f2b09c00740 20 client.15759 trim_cache size 0 max 16384 2024-09-10T10:42:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.712+0000 7f2b09c00740 1 Processor -- start 2024-09-10T10:42:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.712+0000 7f2b09c00740 1 -- start start 2024-09-10T10:42:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.712+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc174c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.712+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc159410 0x55edcc1613c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.712+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc163cb0 0x55edcc17ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.712+0000 7f2b09c00740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b001ab490 con 0x55edcc163cb0 2024-09-10T10:42:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.712+0000 7f2b09c00740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2b001ad060 con 0x55edcc158af0 2024-09-10T10:42:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.712+0000 7f2b09c00740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2b001abb60 con 0x55edcc159410 2024-09-10T10:42:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.715+0000 7f2b04c01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc174c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.715+0000 7f2b04c01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc174c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:60486/0 (socket says 172.21.15.92:60486) 2024-09-10T10:42:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.715+0000 7f2b04c01640 1 -- 172.21.15.92:0/611417015 learned_addr learned my addr 172.21.15.92:0/611417015 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:23.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.715+0000 7f2b05402640 1 --2- 172.21.15.92:0/611417015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc163cb0 0x55edcc17ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.715+0000 7f2b04c01640 1 -- 172.21.15.92:0/611417015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc159410 msgr2=0x55edcc1613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.715+0000 7f2b04c01640 1 --2- 172.21.15.92:0/611417015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc159410 0x55edcc1613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.716+0000 7f2b04c01640 1 -- 172.21.15.92:0/611417015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc163cb0 msgr2=0x55edcc17ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.716+0000 7f2b04c01640 1 --2- 172.21.15.92:0/611417015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc163cb0 0x55edcc17ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.716+0000 7f2b04c01640 1 -- 172.21.15.92:0/611417015 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edcc154e90 con 0x55edcc158af0 2024-09-10T10:42:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.716+0000 7f2b04c01640 1 --2- 172.21.15.92:0/611417015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc174c60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2af80ed8e0 tx=0x7f2af80ba5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ecb9467f3cb757c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.718+0000 7f2af67fc640 1 -- 172.21.15.92:0/611417015 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8049070 con 0x55edcc158af0 2024-09-10T10:42:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.718+0000 7f2af67fc640 1 -- 172.21.15.92:0/611417015 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af80bc7b0 con 0x55edcc158af0 2024-09-10T10:42:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.718+0000 7f2af67fc640 1 -- 172.21.15.92:0/611417015 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af80bba10 con 0x55edcc158af0 2024-09-10T10:42:23.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.719+0000 7f2b09c00740 1 -- 172.21.15.92:0/611417015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 msgr2=0x55edcc174c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:23.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.719+0000 7f2b09c00740 1 --2- 172.21.15.92:0/611417015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc174c60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2af80ed8e0 tx=0x7f2af80ba5c0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.719+0000 7f2b09c00740 1 -- 172.21.15.92:0/611417015 shutdown_connections 2024-09-10T10:42:23.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.719+0000 7f2b09c00740 1 --2- 172.21.15.92:0/611417015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc163cb0 0x55edcc17ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.720+0000 7f2b09c00740 1 --2- 172.21.15.92:0/611417015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc159410 0x55edcc1613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.720+0000 7f2b09c00740 1 --2- 172.21.15.92:0/611417015 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc174c60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.720+0000 7f2b09c00740 1 -- 172.21.15.92:0/611417015 >> 172.21.15.92:0/611417015 conn(0x55edcc155060 msgr2=0x55edcc162b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:23.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.721+0000 7f2b09c00740 1 -- 172.21.15.92:0/611417015 shutdown_connections 2024-09-10T10:42:23.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.722+0000 7f2b09c00740 1 -- 172.21.15.92:0/611417015 wait complete. 2024-09-10T10:42:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.723+0000 7f2b09c00740 1 -- start start 2024-09-10T10:42:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.723+0000 7f2b09c00740 1 Processor -- start 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.727+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.727+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc165470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.727+0000 7f2b09c00740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc16bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.727+0000 7f2b09c00740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b001ac990 con 0x55edcc159410 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.727+0000 7f2b09c00740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2b001ac2c0 con 0x55edcc158af0 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.727+0000 7f2b09c00740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2b001a9490 con 0x55edcc163cb0 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.727+0000 7f2b09c00740 10 client.0 _ll_register_callbacks cb 0x7f2af8005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2b05402640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc16bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2b05402640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc16bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:33780/0 (socket says 172.21.15.92:33780) 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2b05402640 1 -- 172.21.15.92:0/746861534 learned_addr learned my addr 172.21.15.92:0/746861534 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2afffff640 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc165470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2b05402640 1 -- 172.21.15.92:0/746861534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 msgr2=0x55edcc164f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2b05402640 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc164f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2b05402640 1 -- 172.21.15.92:0/746861534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 msgr2=0x55edcc165470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2b05402640 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc165470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2b05402640 1 -- 172.21.15.92:0/746861534 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edcc16c420 con 0x55edcc163cb0 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2b05402640 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc16bd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2af0015ac0 tx=0x7f2af0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=899ede4813ad7185 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.728+0000 7f2adffff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.729+0000 7f2adffff640 1 -- 172.21.15.92:0/746861534 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0029030 con 0x55edcc163cb0 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.729+0000 7f2adffff640 1 -- 172.21.15.92:0/746861534 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f2af001b9e0 con 0x55edcc163cb0 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.729+0000 7f2b09c00740 1 -- 172.21.15.92:0/746861534 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2af80bc7b0 con 0x55edcc163cb0 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.729+0000 7f2adffff640 1 -- 172.21.15.92:0/746861534 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f2af0021040 con 0x55edcc163cb0 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.729+0000 7f2b09c00740 10 client.25312 fetch_fsmap learned FSMap version 46 2024-09-10T10:42:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.729+0000 7f2b09c00740 1 -- 172.21.15.92:0/746861534 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55edcc1678e0 con 0x55edcc163cb0 2024-09-10T10:42:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.730+0000 7f2adffff640 1 -- 172.21.15.92:0/746861534 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af0003e50 con 0x55edcc163cb0 2024-09-10T10:42:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.730+0000 7f2adffff640 1 -- 172.21.15.92:0/746861534 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 46) ==== 8374+0+0 (secure 0 0 0) 0x7f2af0004630 con 0x55edcc163cb0 2024-09-10T10:42:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.730+0000 7f2b09c00740 10 client.25312 fetch_fsmap finished waiting for FSMap version 46 2024-09-10T10:42:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.730+0000 7f2b09c00740 10 client.25312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:42:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.730+0000 7f2b09c00740 20 client.25312 populate_metadata read hostname 'smithi092' 2024-09-10T10:42:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.730+0000 7f2b09c00740 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edcc1dd310 0x55edcc1df730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.730+0000 7f2b09c00740 4 client.25312 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:42:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.730+0000 7f2b09c00740 1 -- 172.21.15.92:0/746861534 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f2af80bc7b0 con 0x55edcc1dd310 2024-09-10T10:42:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.733+0000 7f2b04c01640 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edcc1dd310 0x55edcc1df730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.733+0000 7f2adffff640 10 client.25312 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.733+0000 7f2b04c01640 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edcc1dd310 0x55edcc1df730 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2597c69e0882ed88 server_cookie=7e83f123168aa8c8 in_seq=0 out_seq=0 2024-09-10T10:42:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2adffff640 1 -- 172.21.15.92:0/746861534 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f2af80bc7b0 con 0x55edcc1dd310 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2adffff640 10 client.25312 handle_command_reply: tid=0 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2b09c00740 1 client.25312 shutdown 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2b09c00740 1 -- 172.21.15.92:0/746861534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 msgr2=0x55edcc16bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2b09c00740 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc16bd80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2af0015ac0 tx=0x7f2af0004ab0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2b09c00740 1 -- 172.21.15.92:0/746861534 shutdown_connections 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2b09c00740 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edcc163cb0 0x55edcc16bd80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2b09c00740 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55edcc159410 0x55edcc165470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2b09c00740 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55edcc1dd310 0x55edcc1df730 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2b09c00740 1 --2- 172.21.15.92:0/746861534 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55edcc158af0 0x55edcc164f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2adffff640 0 client.25312 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.748+0000 7f2b09c00740 1 -- 172.21.15.92:0/746861534 >> 172.21.15.92:0/746861534 conn(0x55edcc155060 msgr2=0x55edcc1539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.749+0000 7f2b09c00740 1 -- 172.21.15.92:0/746861534 shutdown_connections 2024-09-10T10:42:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.749+0000 7f2b09c00740 1 -- 172.21.15.92:0/746861534 wait complete. 2024-09-10T10:42:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.749+0000 7f2b09c00740 20 client.25312 trim_cache size 0 max 16384 2024-09-10T10:42:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:42:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:42:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:42:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 -- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2aec0a2da0 msgr2=0x7f2aec0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2aec0a2da0 0x7f2aec0a5260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2af0005fd0 tx=0x7f2af000f040 comp rx=0 tx=0).stop 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 -- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 msgr2=0x7f2b001961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 0x7f2b001961c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2af800a340 tx=0x7f2af8004270 comp rx=0 tx=0).stop 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 -- 172.21.15.92:0/3949050175 shutdown_connections 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2aec0a2da0 0x7f2aec0a5260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b001026f0 0x7f2b0019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b00101d70 0x7f2b00196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 --2- 172.21.15.92:0/3949050175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b00100490 0x7f2b001961c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 -- 172.21.15.92:0/3949050175 >> 172.21.15.92:0/3949050175 conn(0x7f2b000770f0 msgr2=0x7f2b00104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:23.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 -- 172.21.15.92:0/3949050175 shutdown_connections 2024-09-10T10:42:23.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:23.750+0000 7f2b06e65640 1 -- 172.21.15.92:0/3949050175 wait complete. 2024-09-10T10:42:23.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:23 smithi092 ceph-mon[30834]: pgmap v176: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 636 op/s 2024-09-10T10:42:24.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:23 smithi121 ceph-mon[35231]: pgmap v176: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 636 op/s 2024-09-10T10:42:24.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:23 smithi097 ceph-mon[35213]: pgmap v176: 97 pgs: 97 active+clean; 4.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 636 op/s 2024-09-10T10:42:25.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:25 smithi092 ceph-mon[30834]: pgmap v177: 97 pgs: 97 active+clean; 4.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 640 op/s 2024-09-10T10:42:26.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:25 smithi121 ceph-mon[35231]: pgmap v177: 97 pgs: 97 active+clean; 4.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 640 op/s 2024-09-10T10:42:26.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:25 smithi097 ceph-mon[35213]: pgmap v177: 97 pgs: 97 active+clean; 4.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 640 op/s 2024-09-10T10:42:27.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:27 smithi092 ceph-mon[30834]: pgmap v178: 97 pgs: 97 active+clean; 4.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 912 op/s 2024-09-10T10:42:28.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:27 smithi121 ceph-mon[35231]: pgmap v178: 97 pgs: 97 active+clean; 4.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 912 op/s 2024-09-10T10:42:28.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:27 smithi097 ceph-mon[35213]: pgmap v178: 97 pgs: 97 active+clean; 4.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 912 op/s 2024-09-10T10:42:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 330.0 s, 2726.8 tps, lat 36.714 ms stddev 41.611 2024-09-10T10:42:29.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:29 smithi092 ceph-mon[30834]: pgmap v179: 97 pgs: 97 active+clean; 4.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 571 op/s 2024-09-10T10:42:30.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:29 smithi121 ceph-mon[35231]: pgmap v179: 97 pgs: 97 active+clean; 4.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 571 op/s 2024-09-10T10:42:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:29 smithi097 ceph-mon[35213]: pgmap v179: 97 pgs: 97 active+clean; 4.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 571 op/s 2024-09-10T10:42:32.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:31 smithi121 ceph-mon[35231]: pgmap v180: 97 pgs: 97 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 889 op/s 2024-09-10T10:42:32.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:31 smithi097 ceph-mon[35213]: pgmap v180: 97 pgs: 97 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 889 op/s 2024-09-10T10:42:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:31 smithi092 ceph-mon[30834]: pgmap v180: 97 pgs: 97 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 889 op/s 2024-09-10T10:42:33.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:32 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:42:33.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:32 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:42:33.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:32 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:42:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 335.0 s, 3355.6 tps, lat 29.776 ms stddev 32.381 2024-09-10T10:42:34.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:33 smithi121 ceph-mon[35231]: pgmap v181: 97 pgs: 97 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 601 op/s 2024-09-10T10:42:34.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:33 smithi097 ceph-mon[35213]: pgmap v181: 97 pgs: 97 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 601 op/s 2024-09-10T10:42:34.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:33 smithi092 ceph-mon[30834]: pgmap v181: 97 pgs: 97 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 601 op/s 2024-09-10T10:42:36.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:35 smithi121 ceph-mon[35231]: pgmap v182: 97 pgs: 97 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 605 op/s 2024-09-10T10:42:36.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:35 smithi097 ceph-mon[35213]: pgmap v182: 97 pgs: 97 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 605 op/s 2024-09-10T10:42:36.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:35 smithi092 ceph-mon[30834]: pgmap v182: 97 pgs: 97 active+clean; 4.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 605 op/s 2024-09-10T10:42:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.863+0000 7f7f2885e640 1 -- 172.21.15.92:0/3081776801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f24100040 msgr2=0x7f7f24100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.863+0000 7f7f2885e640 1 --2- 172.21.15.92:0/3081776801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f24100040 0x7f7f24100480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009930 tx=0x7f7f1802a420 comp rx=0 tx=0).stop 2024-09-10T10:42:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 -- 172.21.15.92:0/3081776801 shutdown_connections 2024-09-10T10:42:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 --2- 172.21.15.92:0/3081776801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f241009c0 0x7f7f2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 --2- 172.21.15.92:0/3081776801 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f24100040 0x7f7f24100480 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 --2- 172.21.15.92:0/3081776801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f241039d0 0x7f7f24103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 -- 172.21.15.92:0/3081776801 >> 172.21.15.92:0/3081776801 conn(0x7f7f240770f0 msgr2=0x7f7f240fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 -- 172.21.15.92:0/3081776801 shutdown_connections 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 -- 172.21.15.92:0/3081776801 wait complete. 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 Processor -- start 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 -- start start 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f24100040 0x7f7f24198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f241009c0 0x7f7f241988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.864+0000 7f7f2885e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f241039d0 0x7f7f2419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2885e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f24111f70 con 0x7f7f24100040 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2885e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7f24111df0 con 0x7f7f241039d0 2024-09-10T10:42:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2885e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241120f0 con 0x7f7f241009c0 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f24100040 0x7f7f24198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f24100040 0x7f7f24198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42328/0 (socket says 172.21.15.92:42328) 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2259c640 1 -- 172.21.15.92:0/421927993 learned_addr learned my addr 172.21.15.92:0/421927993 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f22d9d640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f241039d0 0x7f7f2419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f241009c0 0x7f7f241988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2259c640 1 -- 172.21.15.92:0/421927993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f241009c0 msgr2=0x7f7f241988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2259c640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f241009c0 0x7f7f241988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2259c640 1 -- 172.21.15.92:0/421927993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f241039d0 msgr2=0x7f7f2419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2259c640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f241039d0 0x7f7f2419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2259c640 1 -- 172.21.15.92:0/421927993 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2419d380 con 0x7f7f24100040 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2259c640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f24100040 0x7f7f24198390 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400e9f0 tx=0x7f7f1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f137fe640 1 -- 172.21.15.92:0/421927993 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400cd80 con 0x7f7f24100040 2024-09-10T10:42:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f137fe640 1 -- 172.21.15.92:0/421927993 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f14010910 con 0x7f7f24100040 2024-09-10T10:42:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2885e640 1 -- 172.21.15.92:0/421927993 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2419d670 con 0x7f7f24100040 2024-09-10T10:42:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f137fe640 1 -- 172.21.15.92:0/421927993 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14018990 con 0x7f7f24100040 2024-09-10T10:42:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.865+0000 7f7f2885e640 1 -- 172.21.15.92:0/421927993 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f241a4f00 con 0x7f7f24100040 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f2b5f9740 1 Processor -- start 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f137fe640 1 -- 172.21.15.92:0/421927993 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7f14010ac0 con 0x7f7f24100040 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f2b5f9740 1 -- start start 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a2ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a3db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5590c19932f0 con 0x5590c1a2e9b0 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5590c193b270 con 0x5590c1a2f2d0 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5590c198f2b0 con 0x5590c1a3e0c0 2024-09-10T10:42:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f22d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a2ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.869+0000 7f7f21d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f22d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a2ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42344/0 (socket says 172.21.15.92:42344) 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f2259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a3db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f22d9d640 1 -- 172.21.15.92:0/2414939969 learned_addr learned my addr 172.21.15.92:0/2414939969 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f21d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:45310/0 (socket says 172.21.15.92:45310) 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f21d9b640 1 -- 172.21.15.92:0/2414939969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 msgr2=0x5590c1a3db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/2414939969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a3db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f21d9b640 1 -- 172.21.15.92:0/2414939969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 msgr2=0x5590c1a2ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/2414939969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a2ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f21d9b640 1 -- 172.21.15.92:0/2414939969 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c193a340 con 0x5590c1a3e0c0 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f137fe640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7f0c0a2da0 0x7f7f0c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/2414939969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a404b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f18005940 tx=0x7f7f18005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f56957f4d87999b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f22d9d640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7f0c0a2da0 0x7f7f0c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f137fe640 1 -- 172.21.15.92:0/421927993 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f7f140cf6d0 con 0x7f7f24100040 2024-09-10T10:42:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f10ff9640 1 -- 172.21.15.92:0/2414939969 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18040070 con 0x5590c1a3e0c0 2024-09-10T10:42:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f10ff9640 1 -- 172.21.15.92:0/2414939969 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f18031870 con 0x5590c1a3e0c0 2024-09-10T10:42:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.870+0000 7f7f10ff9640 1 -- 172.21.15.92:0/2414939969 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18035040 con 0x5590c1a3e0c0 2024-09-10T10:42:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.871+0000 7f7f22d9d640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7f0c0a2da0 0x7f7f0c0a5260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0116b0 tx=0x7f7f1c009500 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.871+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/2414939969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 msgr2=0x5590c1a404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.871+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/2414939969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a404b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f18005940 tx=0x7f7f18005bd0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.871+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/2414939969 shutdown_connections 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.872+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/2414939969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a404b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.872+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/2414939969 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a3db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.872+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/2414939969 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a2ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.872+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/2414939969 >> 172.21.15.92:0/2414939969 conn(0x5590c1a2b060 msgr2=0x5590c1a2b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.872+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/2414939969 shutdown_connections 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.872+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/2414939969 wait complete. 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.873+0000 7f7f2b5f9740 1 -- start start 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.873+0000 7f7f2b5f9740 1 Processor -- start 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.873+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2e9b0 0x5590c1a3b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.873+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2f2d0 0x5590c1a3b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.873+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a3baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5590c1a40c90 con 0x5590c1a2f2d0 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5590c191c290 con 0x5590c1a2e9b0 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5590c1a40e10 con 0x5590c1a3e0c0 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2e9b0 0x5590c1a3b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2e9b0 0x5590c1a3b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:46934/0 (socket says 172.21.15.92:46934) 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2259c640 1 -- 172.21.15.92:0/99321144 learned_addr learned my addr 172.21.15.92:0/99321144 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2f2d0 0x5590c1a3b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2b5f9740 10 client.0 _ll_register_callbacks cb 0x5590c194d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f22d9d640 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a3baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2259c640 1 -- 172.21.15.92:0/99321144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 msgr2=0x5590c1a3baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2259c640 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a3baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2259c640 1 -- 172.21.15.92:0/99321144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2f2d0 msgr2=0x5590c1a3b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2259c640 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2f2d0 0x5590c1a3b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2259c640 1 -- 172.21.15.92:0/99321144 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c16a6210 con 0x5590c1a2e9b0 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f22d9d640 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a3baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:42:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2f2d0 0x5590c1a3b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.874+0000 7f7f2259c640 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2e9b0 0x5590c1a3b020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f140ccef0 tx=0x7f7f14098070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a508a2572101d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f09ffb640 1 -- 172.21.15.92:0/99321144 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f140cfd80 con 0x5590c1a2e9b0 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f09ffb640 1 -- 172.21.15.92:0/99321144 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f7f14018b30 con 0x5590c1a2e9b0 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/99321144 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f18031870 con 0x5590c1a2e9b0 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f09ffb640 1 -- 172.21.15.92:0/99321144 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f7f1409bd10 con 0x5590c1a2e9b0 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f2b5f9740 10 client.25286 fetch_fsmap learned FSMap version 47 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/99321144 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5590c1772620 con 0x5590c1a2e9b0 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f09ffb640 1 -- 172.21.15.92:0/99321144 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f18031870 con 0x5590c1a2e9b0 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f09ffb640 1 -- 172.21.15.92:0/99321144 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 47) ==== 8370+0+0 (secure 0 0 0) 0x7f7f14097a60 con 0x5590c1a2e9b0 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f2b5f9740 10 client.25286 fetch_fsmap finished waiting for FSMap version 47 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f2b5f9740 10 client.25286 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:42:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f2b5f9740 20 client.25286 populate_metadata read hostname 'smithi092' 2024-09-10T10:42:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5590c1a4e080 0x5590c1a50470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f2b5f9740 4 client.25286 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:42:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.875+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/99321144 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590c19a0a20 con 0x5590c1a4e080 2024-09-10T10:42:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.876+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5590c1a4e080 0x5590c1a50470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.876+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5590c1a4e080 0x5590c1a50470 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b34b81c2f73d1078 server_cookie=259f718c77326201 in_seq=0 out_seq=0 2024-09-10T10:42:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.876+0000 7f7f09ffb640 10 client.25286 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.877+0000 7f7f09ffb640 1 -- 172.21.15.92:0/99321144 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590c19a0a20 con 0x5590c1a4e080 2024-09-10T10:42:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.877+0000 7f7f09ffb640 10 client.25286 handle_command_reply: tid=0 2024-09-10T10:42:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 client.25286 shutdown 2024-09-10T10:42:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/99321144 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2e9b0 msgr2=0x5590c1a3b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2e9b0 0x5590c1a3b020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f140ccef0 tx=0x7f7f14098070 comp rx=0 tx=0).stop 2024-09-10T10:42:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/99321144 shutdown_connections 2024-09-10T10:42:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a3baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2f2d0 0x5590c1a3b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5590c1a4e080 0x5590c1a50470 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/99321144 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2e9b0 0x5590c1a3b020 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f09ffb640 0 client.25286 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/99321144 >> 172.21.15.92:0/99321144 conn(0x5590c1a2b060 msgr2=0x5590c1a30d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/99321144 shutdown_connections 2024-09-10T10:42:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/99321144 wait complete. 2024-09-10T10:42:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.878+0000 7f7f2b5f9740 20 client.25286 trim_cache size 0 max 16384 2024-09-10T10:42:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f2b5f9740 1 Processor -- start 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f2b5f9740 1 -- start start 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a2e9b0 0x5590c1a30c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a55d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a3e0c0 0x5590c1a562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241ab460 con 0x5590c1a3e0c0 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241ad000 con 0x5590c1a2f2d0 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241abb30 con 0x5590c1a2e9b0 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f21d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a55d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f22d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a3e0c0 0x5590c1a562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f2259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a2e9b0 0x5590c1a30c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f21d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a55d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:46950/0 (socket says 172.21.15.92:46950) 2024-09-10T10:42:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.896+0000 7f7f21d9b640 1 -- 172.21.15.92:0/504385253 learned_addr learned my addr 172.21.15.92:0/504385253 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f2259c640 1 -- 172.21.15.92:0/504385253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 msgr2=0x5590c1a55d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f2259c640 1 --2- 172.21.15.92:0/504385253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a55d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f2259c640 1 -- 172.21.15.92:0/504385253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a3e0c0 msgr2=0x5590c1a562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f2259c640 1 --2- 172.21.15.92:0/504385253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a3e0c0 0x5590c1a562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f2259c640 1 -- 172.21.15.92:0/504385253 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590c1a40820 con 0x5590c1a2e9b0 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/504385253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a55d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f22d9d640 1 --2- 172.21.15.92:0/504385253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a3e0c0 0x5590c1a562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f2259c640 1 --2- 172.21.15.92:0/504385253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a2e9b0 0x5590c1a30c00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7f1409bca0 tx=0x7f7f14009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434d9f38aceb3b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f0bfff640 1 -- 172.21.15.92:0/504385253 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1409b850 con 0x5590c1a2e9b0 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f0bfff640 1 -- 172.21.15.92:0/504385253 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f140b1050 con 0x5590c1a2e9b0 2024-09-10T10:42:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.897+0000 7f7f0bfff640 1 -- 172.21.15.92:0/504385253 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1409aee0 con 0x5590c1a2e9b0 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/504385253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a2e9b0 msgr2=0x5590c1a30c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/504385253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a2e9b0 0x5590c1a30c00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7f1409bca0 tx=0x7f7f14009700 comp rx=0 tx=0).stop 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/504385253 shutdown_connections 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/504385253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a3e0c0 0x5590c1a562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/504385253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a55d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/504385253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a2e9b0 0x5590c1a30c00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/504385253 >> 172.21.15.92:0/504385253 conn(0x5590c1a2b060 msgr2=0x5590c1a304f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/504385253 shutdown_connections 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/504385253 wait complete. 2024-09-10T10:42:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 -- start start 2024-09-10T10:42:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 Processor -- start 2024-09-10T10:42:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a468e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a37e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a38430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241ac930 con 0x5590c1a2e9b0 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241ac260 con 0x5590c1a2f2d0 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241a94a0 con 0x5590c1a3e0c0 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2b5f9740 10 client.0 _ll_register_callbacks cb 0x7f7f140d5240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42364/0 (socket says 172.21.15.92:42364) 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f2259c640 1 -- 172.21.15.92:0/1676366897 learned_addr learned my addr 172.21.15.92:0/1676366897 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.899+0000 7f7f22d9d640 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a38430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.898+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a37e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.899+0000 7f7f2259c640 1 -- 172.21.15.92:0/1676366897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 msgr2=0x5590c1a38430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.899+0000 7f7f2259c640 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a38430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.899+0000 7f7f2259c640 1 -- 172.21.15.92:0/1676366897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 msgr2=0x5590c1a37e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.899+0000 7f7f2259c640 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a37e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.899+0000 7f7f2259c640 1 -- 172.21.15.92:0/1676366897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590c1a38c30 con 0x5590c1a2e9b0 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.899+0000 7f7f22d9d640 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a38430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.900+0000 7f7f2259c640 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a468e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7f1409ba10 tx=0x7f7f14097f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a21fa4170f5f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.900+0000 7f7f09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.900+0000 7f7f09ffb640 1 -- 172.21.15.92:0/1676366897 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f140b4e60 con 0x5590c1a2e9b0 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.900+0000 7f7f09ffb640 1 -- 172.21.15.92:0/1676366897 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7f7f1409ade0 con 0x5590c1a2e9b0 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.900+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/1676366897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f140b1050 con 0x5590c1a2e9b0 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.900+0000 7f7f09ffb640 1 -- 172.21.15.92:0/1676366897 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f7f1409b850 con 0x5590c1a2e9b0 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.900+0000 7f7f2b5f9740 10 client.15783 fetch_fsmap learned FSMap version 47 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.900+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/1676366897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5590c1ab8e40 con 0x5590c1a2e9b0 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.900+0000 7f7f09ffb640 1 -- 172.21.15.92:0/1676366897 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f140b1050 con 0x5590c1a2e9b0 2024-09-10T10:42:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.901+0000 7f7f09ffb640 1 -- 172.21.15.92:0/1676366897 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 47) ==== 8370+0+0 (secure 0 0 0) 0x7f7f140b4070 con 0x5590c1a2e9b0 2024-09-10T10:42:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.901+0000 7f7f2b5f9740 10 client.15783 fetch_fsmap finished waiting for FSMap version 47 2024-09-10T10:42:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.901+0000 7f7f2b5f9740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:42:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.901+0000 7f7f2b5f9740 20 client.15783 populate_metadata read hostname 'smithi092' 2024-09-10T10:42:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.901+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5590c1ab9270 0x5590c1abb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.901+0000 7f7f2b5f9740 4 client.15783 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:42:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.901+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/1676366897 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5590c199ad70 con 0x5590c1ab9270 2024-09-10T10:42:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.902+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5590c1ab9270 0x5590c1abb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.902+0000 7f7f21d9b640 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5590c1ab9270 0x5590c1abb660 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbfc488d1044d1d server_cookie=5d0664db2976dff8 in_seq=0 out_seq=0 2024-09-10T10:42:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.903+0000 7f7f09ffb640 10 client.15783 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.929+0000 7f7f09ffb640 1 -- 172.21.15.92:0/1676366897 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5590c199ad70 con 0x5590c1ab9270 2024-09-10T10:42:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.929+0000 7f7f09ffb640 10 client.15783 handle_command_reply: tid=0 2024-09-10T10:42:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.930+0000 7f7f2b5f9740 1 client.15783 shutdown 2024-09-10T10:42:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.931+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/1676366897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 msgr2=0x5590c1a468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.931+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a468e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7f1409ba10 tx=0x7f7f14097f10 comp rx=0 tx=0).stop 2024-09-10T10:42:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.932+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/1676366897 shutdown_connections 2024-09-10T10:42:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.932+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5590c1a3e0c0 0x5590c1a38430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.932+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5590c1ab9270 0x5590c1abb660 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.932+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5590c1a2f2d0 0x5590c1a37e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.932+0000 7f7f2b5f9740 1 --2- 172.21.15.92:0/1676366897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5590c1a2e9b0 0x5590c1a468e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.932+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/1676366897 >> 172.21.15.92:0/1676366897 conn(0x5590c1a2b060 msgr2=0x5590c1a2a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.932+0000 7f7f09ffb640 0 client.15783 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.933+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/1676366897 shutdown_connections 2024-09-10T10:42:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.933+0000 7f7f2b5f9740 1 -- 172.21.15.92:0/1676366897 wait complete. 2024-09-10T10:42:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.934+0000 7f7f2b5f9740 20 client.15783 trim_cache size 0 max 16384 2024-09-10T10:42:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:42:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:42:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:42:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:42:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 -- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7f0c0a2da0 msgr2=0x7f7f0c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7f0c0a2da0 0x7f7f0c0a5260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0116b0 tx=0x7f7f1c009500 comp rx=0 tx=0).stop 2024-09-10T10:42:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 -- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f24100040 msgr2=0x7f7f24198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f24100040 0x7f7f24198390 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400e9f0 tx=0x7f7f1400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 -- 172.21.15.92:0/421927993 shutdown_connections 2024-09-10T10:42:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7f0c0a2da0 0x7f7f0c0a5260 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7f241039d0 0x7f7f2419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f241009c0 0x7f7f241988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 --2- 172.21.15.92:0/421927993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f24100040 0x7f7f24198390 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 -- 172.21.15.92:0/421927993 >> 172.21.15.92:0/421927993 conn(0x7f7f240770f0 msgr2=0x7f7f24105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.935+0000 7f7f2885e640 1 -- 172.21.15.92:0/421927993 shutdown_connections 2024-09-10T10:42:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:36.936+0000 7f7f2885e640 1 -- 172.21.15.92:0/421927993 wait complete. 2024-09-10T10:42:38.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:37 smithi121 ceph-mon[35231]: pgmap v183: 97 pgs: 97 active+clean; 4.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 923 op/s 2024-09-10T10:42:38.131 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:37 smithi092 ceph-mon[30834]: pgmap v183: 97 pgs: 97 active+clean; 4.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 923 op/s 2024-09-10T10:42:38.132 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:37 smithi097 ceph-mon[35213]: pgmap v183: 97 pgs: 97 active+clean; 4.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 923 op/s 2024-09-10T10:42:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 340.0 s, 2841.8 tps, lat 35.307 ms stddev 38.732 2024-09-10T10:42:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:39 smithi121 ceph-mon[35231]: pgmap v184: 97 pgs: 97 active+clean; 4.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-09-10T10:42:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:39 smithi097 ceph-mon[35213]: pgmap v184: 97 pgs: 97 active+clean; 4.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-09-10T10:42:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:39 smithi092 ceph-mon[30834]: pgmap v184: 97 pgs: 97 active+clean; 4.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.4 MiB/s wr, 644 op/s 2024-09-10T10:42:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:41 smithi121 ceph-mon[35231]: pgmap v185: 97 pgs: 97 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.4 MiB/s wr, 953 op/s 2024-09-10T10:42:42.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:41 smithi097 ceph-mon[35213]: pgmap v185: 97 pgs: 97 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.4 MiB/s wr, 953 op/s 2024-09-10T10:42:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:41 smithi092 ceph-mon[30834]: pgmap v185: 97 pgs: 97 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.4 MiB/s wr, 953 op/s 2024-09-10T10:42:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 345.0 s, 2545.6 tps, lat 38.967 ms stddev 43.409 2024-09-10T10:42:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:43 smithi121 ceph-mon[35231]: pgmap v186: 97 pgs: 97 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 635 op/s 2024-09-10T10:42:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:43 smithi097 ceph-mon[35213]: pgmap v186: 97 pgs: 97 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 635 op/s 2024-09-10T10:42:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:43 smithi092 ceph-mon[30834]: pgmap v186: 97 pgs: 97 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 635 op/s 2024-09-10T10:42:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:45 smithi121 ceph-mon[35231]: pgmap v187: 97 pgs: 97 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 635 op/s 2024-09-10T10:42:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:45 smithi097 ceph-mon[35213]: pgmap v187: 97 pgs: 97 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 635 op/s 2024-09-10T10:42:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:45 smithi092 ceph-mon[30834]: pgmap v187: 97 pgs: 97 active+clean; 4.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 635 op/s 2024-09-10T10:42:47.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:46 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:42:47.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:46 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:42:47.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:46 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:42:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:47 smithi121 ceph-mon[35231]: pgmap v188: 97 pgs: 97 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.1 MiB/s wr, 916 op/s 2024-09-10T10:42:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:47 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:42:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:47 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:42:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:47 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:42:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:47 smithi097 ceph-mon[35213]: pgmap v188: 97 pgs: 97 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.1 MiB/s wr, 916 op/s 2024-09-10T10:42:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:47 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:42:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:47 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:42:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:47 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:42:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:47 smithi092 ceph-mon[30834]: pgmap v188: 97 pgs: 97 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.1 MiB/s wr, 916 op/s 2024-09-10T10:42:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:47 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:42:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:47 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:42:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:47 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:42:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 350.0 s, 2735.6 tps, lat 36.741 ms stddev 40.501 2024-09-10T10:42:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:49 smithi121 ceph-mon[35231]: pgmap v189: 97 pgs: 97 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 593 op/s 2024-09-10T10:42:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.066+0000 7efe2a60e640 1 -- 172.21.15.92:0/334450800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe241090b0 msgr2=0x7efe24110c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.066+0000 7efe2a60e640 1 --2- 172.21.15.92:0/334450800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe241090b0 0x7efe24110c00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe14009ca0 tx=0x7efe1402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.066+0000 7efe2a60e640 1 -- 172.21.15.92:0/334450800 shutdown_connections 2024-09-10T10:42:50.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.066+0000 7efe2a60e640 1 --2- 172.21.15.92:0/334450800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe241090b0 0x7efe24110c00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.066+0000 7efe2a60e640 1 --2- 172.21.15.92:0/334450800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe24104910 0x7efe24108950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.066+0000 7efe2a60e640 1 --2- 172.21.15.92:0/334450800 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe24103f60 0x7efe24104340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.066+0000 7efe2a60e640 1 -- 172.21.15.92:0/334450800 >> 172.21.15.92:0/334450800 conn(0x7efe240ff9b0 msgr2=0x7efe24101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:50.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.067+0000 7efe2a60e640 1 -- 172.21.15.92:0/334450800 shutdown_connections 2024-09-10T10:42:50.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.067+0000 7efe2a60e640 1 -- 172.21.15.92:0/334450800 wait complete. 2024-09-10T10:42:50.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.068+0000 7efe2a60e640 1 Processor -- start 2024-09-10T10:42:50.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.068+0000 7efe2a60e640 1 -- start start 2024-09-10T10:42:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:49 smithi097 ceph-mon[35213]: pgmap v189: 97 pgs: 97 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 593 op/s 2024-09-10T10:42:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe2a60e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe24103f60 0x7efe24110bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe2a60e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe241090b0 0x7efe2410ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe2a60e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe2410f320 0x7efe241aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe2a60e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe24077080 con 0x7efe241090b0 2024-09-10T10:42:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe2a60e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efe24076f00 con 0x7efe24103f60 2024-09-10T10:42:50.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe2a60e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efe24077200 con 0x7efe2410f320 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe23fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe24103f60 0x7efe24110bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe241090b0 0x7efe2410ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe23fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe24103f60 0x7efe24110bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:36240/0 (socket says 172.21.15.92:36240) 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe23fff640 1 -- 172.21.15.92:0/3681560089 learned_addr learned my addr 172.21.15.92:0/3681560089 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe28bab640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe2410f320 0x7efe241aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe237fe640 1 -- 172.21.15.92:0/3681560089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe2410f320 msgr2=0x7efe241aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe237fe640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe2410f320 0x7efe241aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe237fe640 1 -- 172.21.15.92:0/3681560089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe24103f60 msgr2=0x7efe24110bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe237fe640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe24103f60 0x7efe24110bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe237fe640 1 -- 172.21.15.92:0/3681560089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe241ab1d0 con 0x7efe241090b0 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.069+0000 7efe23fff640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe24103f60 0x7efe24110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:42:50.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.070+0000 7efe237fe640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe241090b0 0x7efe2410ecd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e9c0 tx=0x7efe0c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.070+0000 7efe217fa640 1 -- 172.21.15.92:0/3681560089 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00ccc0 con 0x7efe241090b0 2024-09-10T10:42:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.070+0000 7efe2a60e640 1 -- 172.21.15.92:0/3681560089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe241ab3a0 con 0x7efe241090b0 2024-09-10T10:42:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.070+0000 7efe217fa640 1 -- 172.21.15.92:0/3681560089 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe0c010910 con 0x7efe241090b0 2024-09-10T10:42:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.070+0000 7efe217fa640 1 -- 172.21.15.92:0/3681560089 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0178e0 con 0x7efe241090b0 2024-09-10T10:42:50.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.070+0000 7efe2a60e640 1 -- 172.21.15.92:0/3681560089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe241ab8e0 con 0x7efe241090b0 2024-09-10T10:42:50.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.074+0000 7efe217fa640 1 -- 172.21.15.92:0/3681560089 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7efe0c017a80 con 0x7efe241090b0 2024-09-10T10:42:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.075+0000 7efe217fa640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe100a2ef0 0x7efe100a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.075+0000 7efe23fff640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe100a2ef0 0x7efe100a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.076+0000 7efe217fa640 1 -- 172.21.15.92:0/3681560089 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7efe0c0d0830 con 0x7efe241090b0 2024-09-10T10:42:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.076+0000 7efe2d484740 1 Processor -- start 2024-09-10T10:42:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.076+0000 7efe2d484740 1 -- start start 2024-09-10T10:42:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.076+0000 7efe2d484740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0deed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.076+0000 7efe2d484740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.076+0000 7efe2d484740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 0x56323b0ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.076+0000 7efe2d484740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56323b0432f0 con 0x56323b0deaf0 2024-09-10T10:42:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.076+0000 7efe2d484740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56323afeb270 con 0x56323b0e9cb0 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.076+0000 7efe2d484740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56323b03f2b0 con 0x56323b0df410 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe237fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe237fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:47096/0 (socket says 172.21.15.92:47096) 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe237fe640 1 -- 172.21.15.92:0/2245637457 learned_addr learned my addr 172.21.15.92:0/2245637457 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe23fff640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe100a2ef0 0x7efe100a53b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009e10 tx=0x7efe1c0091c0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe23fff640 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0deed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe28bab640 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 0x56323b0ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe237fe640 1 -- 172.21.15.92:0/2245637457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 msgr2=0x56323b0ec0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe237fe640 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 0x56323b0ec0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe237fe640 1 -- 172.21.15.92:0/2245637457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 msgr2=0x56323b0deed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe237fe640 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0deed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe237fe640 1 -- 172.21.15.92:0/2245637457 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56323afea340 con 0x56323b0df410 2024-09-10T10:42:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe28bab640 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 0x56323b0ec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:42:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.077+0000 7efe237fe640 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e9770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0a54a0 tx=0x7efe0c09c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a547a591f07248ee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.078+0000 7efe1a7fc640 1 -- 172.21.15.92:0/2245637457 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0a1110 con 0x56323b0df410 2024-09-10T10:42:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.078+0000 7efe1a7fc640 1 -- 172.21.15.92:0/2245637457 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe0c010e50 con 0x56323b0df410 2024-09-10T10:42:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.078+0000 7efe1a7fc640 1 -- 172.21.15.92:0/2245637457 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c099560 con 0x56323b0df410 2024-09-10T10:42:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.079+0000 7efe2d484740 1 -- 172.21.15.92:0/2245637457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 msgr2=0x56323b0e9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.079+0000 7efe2d484740 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e9770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0a54a0 tx=0x7efe0c09c6c0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.079+0000 7efe2d484740 1 -- 172.21.15.92:0/2245637457 shutdown_connections 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.079+0000 7efe2d484740 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 0x56323b0ec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.079+0000 7efe2d484740 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e9770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.079+0000 7efe2d484740 1 --2- 172.21.15.92:0/2245637457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0deed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.079+0000 7efe2d484740 1 -- 172.21.15.92:0/2245637457 >> 172.21.15.92:0/2245637457 conn(0x56323b0db060 msgr2=0x56323b0db440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.079+0000 7efe2d484740 1 -- 172.21.15.92:0/2245637457 shutdown_connections 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.079+0000 7efe2d484740 1 -- 172.21.15.92:0/2245637457 wait complete. 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.080+0000 7efe2d484740 1 -- start start 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.080+0000 7efe2d484740 1 Processor -- start 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.080+0000 7efe2d484740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.080+0000 7efe2d484740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0df410 0x56323b0e7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.080+0000 7efe2d484740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0e9cb0 0x56323b0e7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.080+0000 7efe2d484740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56323b0ec8d0 con 0x56323b0deaf0 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.080+0000 7efe2d484740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56323afcc290 con 0x56323b0df410 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.080+0000 7efe2d484740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56323b0eca50 con 0x56323b0e9cb0 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.080+0000 7efe2d484740 10 client.0 _ll_register_callbacks cb 0x56323affd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe237fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0df410 0x56323b0e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe28bab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0e9cb0 0x56323b0e7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe237fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0df410 0x56323b0e7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:36258/0 (socket says 172.21.15.92:36258) 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe28bab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0e9cb0 0x56323b0e7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:47106/0 (socket says 172.21.15.92:47106) 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe237fe640 1 -- 172.21.15.92:0/1971522138 learned_addr learned my addr 172.21.15.92:0/1971522138 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe23fff640 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe237fe640 1 -- 172.21.15.92:0/1971522138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0e9cb0 msgr2=0x56323b0e7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe237fe640 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0e9cb0 0x56323b0e7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe237fe640 1 -- 172.21.15.92:0/1971522138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 msgr2=0x56323b0e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe237fe640 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0e6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe237fe640 1 -- 172.21.15.92:0/1971522138 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56323ad56210 con 0x56323b0df410 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe28bab640 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0e9cb0 0x56323b0e7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe237fe640 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0df410 0x56323b0e7150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe0c09c8c0 tx=0x7efe0c017fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb78b62c365ca01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.081+0000 7efe037fe640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe037fe640 1 -- 172.21.15.92:0/1971522138 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c07f070 con 0x56323b0df410 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe2d484740 1 -- 172.21.15.92:0/1971522138 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe0c010e50 con 0x56323b0df410 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe037fe640 1 -- 172.21.15.92:0/1971522138 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7efe0c0a5540 con 0x56323b0df410 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe037fe640 1 -- 172.21.15.92:0/1971522138 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7efe0c086080 con 0x56323b0df410 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe2d484740 10 client.25298 fetch_fsmap learned FSMap version 47 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe2d484740 1 -- 172.21.15.92:0/1971522138 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x56323ae22620 con 0x56323b0df410 2024-09-10T10:42:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe037fe640 1 -- 172.21.15.92:0/1971522138 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe0c0ce410 con 0x56323b0df410 2024-09-10T10:42:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe037fe640 1 -- 172.21.15.92:0/1971522138 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 47) ==== 8370+0+0 (secure 0 0 0) 0x7efe0c09c240 con 0x56323b0df410 2024-09-10T10:42:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe2d484740 10 client.25298 fetch_fsmap finished waiting for FSMap version 47 2024-09-10T10:42:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe2d484740 10 client.25298 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:42:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe2d484740 20 client.25298 populate_metadata read hostname 'smithi092' 2024-09-10T10:42:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe2d484740 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56323b0f9d70 0x56323b0fc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe2d484740 4 client.25298 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:42:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.082+0000 7efe2d484740 1 -- 172.21.15.92:0/1971522138 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efe0c010e50 con 0x56323b0f9d70 2024-09-10T10:42:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.084+0000 7efe23fff640 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56323b0f9d70 0x56323b0fc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.085+0000 7efe037fe640 10 client.25298 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.085+0000 7efe23fff640 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56323b0f9d70 0x56323b0fc190 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced150f864f3f5f7 server_cookie=370bceacf42d00c5 in_seq=0 out_seq=0 2024-09-10T10:42:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.086+0000 7efe037fe640 1 -- 172.21.15.92:0/1971522138 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7efe0c010e50 con 0x56323b0f9d70 2024-09-10T10:42:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.087+0000 7efe037fe640 10 client.25298 handle_command_reply: tid=0 2024-09-10T10:42:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.087+0000 7efe2d484740 1 client.25298 shutdown 2024-09-10T10:42:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.088+0000 7efe2d484740 1 -- 172.21.15.92:0/1971522138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0df410 msgr2=0x56323b0e7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.088+0000 7efe2d484740 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0df410 0x56323b0e7150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe0c09c8c0 tx=0x7efe0c017fa0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.089+0000 7efe2d484740 1 -- 172.21.15.92:0/1971522138 shutdown_connections 2024-09-10T10:42:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.089+0000 7efe2d484740 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0e9cb0 0x56323b0e7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.089+0000 7efe2d484740 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56323b0f9d70 0x56323b0fc190 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.089+0000 7efe2d484740 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0df410 0x56323b0e7150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.089+0000 7efe037fe640 0 client.25298 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.089+0000 7efe2d484740 1 --2- 172.21.15.92:0/1971522138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.089+0000 7efe2d484740 1 -- 172.21.15.92:0/1971522138 >> 172.21.15.92:0/1971522138 conn(0x56323b0db060 msgr2=0x56323b0e0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.090+0000 7efe2d484740 1 -- 172.21.15.92:0/1971522138 shutdown_connections 2024-09-10T10:42:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.090+0000 7efe2d484740 1 -- 172.21.15.92:0/1971522138 wait complete. 2024-09-10T10:42:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.090+0000 7efe2d484740 20 client.25298 trim_cache size 0 max 16384 2024-09-10T10:42:50.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:49 smithi092 ceph-mon[30834]: pgmap v189: 97 pgs: 97 active+clean; 4.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 593 op/s 2024-09-10T10:42:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.115+0000 7efe2d484740 1 Processor -- start 2024-09-10T10:42:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe2d484740 1 -- start start 2024-09-10T10:42:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe2d484740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0deaf0 0x56323b0e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe2d484740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe2d484740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0e9cb0 0x56323b101a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe2d484740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b3d80 con 0x56323b0e9cb0 2024-09-10T10:42:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe2d484740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b5920 con 0x56323b0deaf0 2024-09-10T10:42:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe2d484740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b4450 con 0x56323b0df410 2024-09-10T10:42:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe28bab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0e9cb0 0x56323b101a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe28bab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0e9cb0 0x56323b101a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46850/0 (socket says 172.21.15.92:46850) 2024-09-10T10:42:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.116+0000 7efe28bab640 1 -- 172.21.15.92:0/4217767254 learned_addr learned my addr 172.21.15.92:0/4217767254 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.120+0000 7efe237fe640 1 --2- 172.21.15.92:0/4217767254 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.122+0000 7efe23fff640 1 --2- 172.21.15.92:0/4217767254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0deaf0 0x56323b0e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.122+0000 7efe237fe640 1 -- 172.21.15.92:0/4217767254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0deaf0 msgr2=0x56323b0e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.122+0000 7efe237fe640 1 --2- 172.21.15.92:0/4217767254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0deaf0 0x56323b0e54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.122+0000 7efe237fe640 1 -- 172.21.15.92:0/4217767254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0e9cb0 msgr2=0x56323b101a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.122+0000 7efe237fe640 1 --2- 172.21.15.92:0/4217767254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0e9cb0 0x56323b101a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.122+0000 7efe237fe640 1 -- 172.21.15.92:0/4217767254 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56323b0e5ba0 con 0x56323b0df410 2024-09-10T10:42:50.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.130+0000 7efe237fe640 1 --2- 172.21.15.92:0/4217767254 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e74c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0a5b90 tx=0x7efe0c09c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e1ca3657be4de70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.132+0000 7efe19ffb640 1 -- 172.21.15.92:0/4217767254 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c09d460 con 0x56323b0df410 2024-09-10T10:42:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.132+0000 7efe19ffb640 1 -- 172.21.15.92:0/4217767254 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe0c010e50 con 0x56323b0df410 2024-09-10T10:42:50.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.132+0000 7efe19ffb640 1 -- 172.21.15.92:0/4217767254 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c07be00 con 0x56323b0df410 2024-09-10T10:42:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.133+0000 7efe2d484740 1 -- 172.21.15.92:0/4217767254 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 msgr2=0x56323b0e74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.133+0000 7efe2d484740 1 --2- 172.21.15.92:0/4217767254 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e74c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0a5b90 tx=0x7efe0c09c6c0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.135+0000 7efe2d484740 1 -- 172.21.15.92:0/4217767254 shutdown_connections 2024-09-10T10:42:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.135+0000 7efe2d484740 1 --2- 172.21.15.92:0/4217767254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0e9cb0 0x56323b101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.135+0000 7efe2d484740 1 --2- 172.21.15.92:0/4217767254 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e74c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.135+0000 7efe2d484740 1 --2- 172.21.15.92:0/4217767254 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0deaf0 0x56323b0e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.135+0000 7efe2d484740 1 -- 172.21.15.92:0/4217767254 >> 172.21.15.92:0/4217767254 conn(0x56323b0db060 msgr2=0x56323b0e8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.136+0000 7efe2d484740 1 -- 172.21.15.92:0/4217767254 shutdown_connections 2024-09-10T10:42:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.136+0000 7efe2d484740 1 -- 172.21.15.92:0/4217767254 wait complete. 2024-09-10T10:42:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.136+0000 7efe2d484740 1 -- start start 2024-09-10T10:42:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.137+0000 7efe2d484740 1 Processor -- start 2024-09-10T10:42:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.137+0000 7efe2d484740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0f2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.137+0000 7efe2d484740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.137+0000 7efe2d484740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 0x56323b0e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.137+0000 7efe2d484740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b5250 con 0x56323b0deaf0 2024-09-10T10:42:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.137+0000 7efe2d484740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b4b80 con 0x56323b0e9cb0 2024-09-10T10:42:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.137+0000 7efe2d484740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efe241b1dc0 con 0x56323b0df410 2024-09-10T10:42:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.137+0000 7efe2d484740 10 client.0 _ll_register_callbacks cb 0x7efe0c09cc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:42:50.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe237fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe23fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe23fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0f2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46862/0 (socket says 172.21.15.92:46862) 2024-09-10T10:42:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe23fff640 1 -- 172.21.15.92:0/4037074393 learned_addr learned my addr 172.21.15.92:0/4037074393 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:42:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe28bab640 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 0x56323b0e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe23fff640 1 -- 172.21.15.92:0/4037074393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 msgr2=0x56323b0e3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe23fff640 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe23fff640 1 -- 172.21.15.92:0/4037074393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 msgr2=0x56323b0e3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:42:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe23fff640 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 0x56323b0e3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.138+0000 7efe23fff640 1 -- 172.21.15.92:0/4037074393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56323b0e4200 con 0x56323b0deaf0 2024-09-10T10:42:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.139+0000 7efe23fff640 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0f2180 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00ec50 tx=0x7efe1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb9020c578a7316 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:42:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.139+0000 7efe037fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:42:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.139+0000 7efe037fe640 1 -- 172.21.15.92:0/4037074393 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1c02f060 con 0x56323b0deaf0 2024-09-10T10:42:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.139+0000 7efe037fe640 1 -- 172.21.15.92:0/4037074393 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7efe1c00f040 con 0x56323b0deaf0 2024-09-10T10:42:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.139+0000 7efe2d484740 1 -- 172.21.15.92:0/4037074393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe0c010e50 con 0x56323b0deaf0 2024-09-10T10:42:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe037fe640 1 -- 172.21.15.92:0/4037074393 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7efe1c01b040 con 0x56323b0deaf0 2024-09-10T10:42:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe2d484740 10 client.15801 fetch_fsmap learned FSMap version 47 2024-09-10T10:42:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe2d484740 1 -- 172.21.15.92:0/4037074393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x56323b175870 con 0x56323b0deaf0 2024-09-10T10:42:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe037fe640 1 -- 172.21.15.92:0/4037074393 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe0c010e50 con 0x56323b0deaf0 2024-09-10T10:42:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe037fe640 1 -- 172.21.15.92:0/4037074393 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 47) ==== 8370+0+0 (secure 0 0 0) 0x7efe1c032020 con 0x56323b0deaf0 2024-09-10T10:42:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe2d484740 10 client.15801 fetch_fsmap finished waiting for FSMap version 47 2024-09-10T10:42:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe2d484740 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:42:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe2d484740 20 client.15801 populate_metadata read hostname 'smithi092' 2024-09-10T10:42:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe2d484740 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56323b175f00 0x56323b178320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:42:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe2d484740 4 client.15801 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:42:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.140+0000 7efe2d484740 1 -- 172.21.15.92:0/4037074393 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56323b050a20 con 0x56323b175f00 2024-09-10T10:42:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.142+0000 7efe237fe640 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56323b175f00 0x56323b178320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:42:50.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.143+0000 7efe237fe640 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56323b175f00 0x56323b178320 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb26facc8b9df1c6 server_cookie=ffd8f1aff866c572 in_seq=0 out_seq=0 2024-09-10T10:42:50.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.143+0000 7efe037fe640 10 client.15801 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.154+0000 7efe037fe640 1 -- 172.21.15.92:0/4037074393 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56323b050a20 con 0x56323b175f00 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.154+0000 7efe037fe640 10 client.15801 handle_command_reply: tid=0 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe2d484740 1 client.15801 shutdown 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe2d484740 1 -- 172.21.15.92:0/4037074393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 msgr2=0x56323b0f2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe2d484740 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0f2180 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00ec50 tx=0x7efe1c0046c0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe2d484740 1 -- 172.21.15.92:0/4037074393 shutdown_connections 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe2d484740 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56323b175f00 0x56323b178320 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe2d484740 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56323b0e9cb0 0x56323b0e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe2d484740 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56323b0df410 0x56323b0e3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe2d484740 1 --2- 172.21.15.92:0/4037074393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56323b0deaf0 0x56323b0f2180 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe2d484740 1 -- 172.21.15.92:0/4037074393 >> 172.21.15.92:0/4037074393 conn(0x56323b0db060 msgr2=0x56323b0e8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.155+0000 7efe037fe640 0 client.15801 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:42:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.156+0000 7efe2d484740 1 -- 172.21.15.92:0/4037074393 shutdown_connections 2024-09-10T10:42:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.157+0000 7efe2d484740 1 -- 172.21.15.92:0/4037074393 wait complete. 2024-09-10T10:42:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.157+0000 7efe2d484740 20 client.15801 trim_cache size 0 max 16384 2024-09-10T10:42:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:42:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:42:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:42:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:42:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 -- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe100a2ef0 msgr2=0x7efe100a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe100a2ef0 0x7efe100a53b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009e10 tx=0x7efe1c0091c0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 -- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe241090b0 msgr2=0x7efe2410ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:42:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe241090b0 0x7efe2410ecd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e9c0 tx=0x7efe0c00ee80 comp rx=0 tx=0).stop 2024-09-10T10:42:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 -- 172.21.15.92:0/3681560089 shutdown_connections 2024-09-10T10:42:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efe2410f320 0x7efe241aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efe241090b0 0x7efe2410ecd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7efe100a2ef0 0x7efe100a53b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 --2- 172.21.15.92:0/3681560089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7efe24103f60 0x7efe24110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:42:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 -- 172.21.15.92:0/3681560089 >> 172.21.15.92:0/3681560089 conn(0x7efe240ff9b0 msgr2=0x7efe24100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:42:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 -- 172.21.15.92:0/3681560089 shutdown_connections 2024-09-10T10:42:50.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:42:50.159+0000 7efe2a60e640 1 -- 172.21.15.92:0/3681560089 wait complete. 2024-09-10T10:42:51.912 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:51 smithi092 ceph-mon[30834]: pgmap v190: 97 pgs: 97 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 876 op/s 2024-09-10T10:42:52.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:51 smithi121 ceph-mon[35231]: pgmap v190: 97 pgs: 97 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 876 op/s 2024-09-10T10:42:52.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:51 smithi097 ceph-mon[35213]: pgmap v190: 97 pgs: 97 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 876 op/s 2024-09-10T10:42:53.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:52 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:42:53.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:52 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:42:53.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:52 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:42:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 355.0 s, 2476.8 tps, lat 40.418 ms stddev 43.624 2024-09-10T10:42:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:53 smithi121 ceph-mon[35231]: pgmap v191: 97 pgs: 97 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 567 op/s 2024-09-10T10:42:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:53 smithi097 ceph-mon[35213]: pgmap v191: 97 pgs: 97 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 567 op/s 2024-09-10T10:42:54.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:53 smithi092 ceph-mon[30834]: pgmap v191: 97 pgs: 97 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 567 op/s 2024-09-10T10:42:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:55 smithi121 ceph-mon[35231]: pgmap v192: 97 pgs: 97 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 573 op/s 2024-09-10T10:42:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:55 smithi097 ceph-mon[35213]: pgmap v192: 97 pgs: 97 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 573 op/s 2024-09-10T10:42:56.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:55 smithi092 ceph-mon[30834]: pgmap v192: 97 pgs: 97 active+clean; 4.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 573 op/s 2024-09-10T10:42:58.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:57 smithi121 ceph-mon[35231]: pgmap v193: 97 pgs: 97 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 17 MiB/s wr, 963 op/s 2024-09-10T10:42:58.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:57 smithi097 ceph-mon[35213]: pgmap v193: 97 pgs: 97 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 17 MiB/s wr, 963 op/s 2024-09-10T10:42:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:57 smithi092 ceph-mon[30834]: pgmap v193: 97 pgs: 97 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 17 MiB/s wr, 963 op/s 2024-09-10T10:42:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 360.0 s, 3031.6 tps, lat 33.013 ms stddev 37.759 2024-09-10T10:43:00.045 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:42:59 smithi121 ceph-mon[35231]: pgmap v194: 97 pgs: 97 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 679 op/s 2024-09-10T10:43:00.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:42:59 smithi097 ceph-mon[35213]: pgmap v194: 97 pgs: 97 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 679 op/s 2024-09-10T10:43:00.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:42:59 smithi092 ceph-mon[30834]: pgmap v194: 97 pgs: 97 active+clean; 4.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 14 MiB/s wr, 679 op/s 2024-09-10T10:43:02.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:01 smithi121 ceph-mon[35231]: pgmap v195: 97 pgs: 97 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 24 MiB/s wr, 988 op/s 2024-09-10T10:43:02.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:01 smithi097 ceph-mon[35213]: pgmap v195: 97 pgs: 97 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 24 MiB/s wr, 988 op/s 2024-09-10T10:43:02.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:01 smithi092 ceph-mon[30834]: pgmap v195: 97 pgs: 97 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 24 MiB/s wr, 988 op/s 2024-09-10T10:43:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 365.0 s, 1480.0 tps, lat 66.269 ms stddev 117.272 2024-09-10T10:43:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.258+0000 7fcc31142640 1 -- 172.21.15.92:0/663274957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c101370 msgr2=0x7fcc2c10d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.258+0000 7fcc31142640 1 --2- 172.21.15.92:0/663274957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c101370 0x7fcc2c10d8a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009cd0 tx=0x7fcc2402a8e0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.258+0000 7fcc31142640 1 -- 172.21.15.92:0/663274957 shutdown_connections 2024-09-10T10:43:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.258+0000 7fcc31142640 1 --2- 172.21.15.92:0/663274957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c101370 0x7fcc2c10d8a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.258+0000 7fcc31142640 1 --2- 172.21.15.92:0/663274957 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2c1009d0 0x7fcc2c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.258+0000 7fcc31142640 1 --2- 172.21.15.92:0/663274957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc2c1069e0 0x7fcc2c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.258+0000 7fcc31142640 1 -- 172.21.15.92:0/663274957 >> 172.21.15.92:0/663274957 conn(0x7fcc2c0fc6b0 msgr2=0x7fcc2c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:03.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.258+0000 7fcc31142640 1 -- 172.21.15.92:0/663274957 shutdown_connections 2024-09-10T10:43:03.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.258+0000 7fcc31142640 1 -- 172.21.15.92:0/663274957 wait complete. 2024-09-10T10:43:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.259+0000 7fcc31142640 1 Processor -- start 2024-09-10T10:43:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.259+0000 7fcc31142640 1 -- start start 2024-09-10T10:43:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.259+0000 7fcc31142640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2c1009d0 0x7fcc2c197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.259+0000 7fcc31142640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc2c101370 0x7fcc2c197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.259+0000 7fcc31142640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c1069e0 0x7fcc2c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.259+0000 7fcc31142640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c110e20 con 0x7fcc2c1069e0 2024-09-10T10:43:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.259+0000 7fcc31142640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c110ca0 con 0x7fcc2c1009d0 2024-09-10T10:43:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.259+0000 7fcc31142640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c110fa0 con 0x7fcc2c101370 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2c1009d0 0x7fcc2c197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2b59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c1069e0 0x7fcc2c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc2c101370 0x7fcc2c197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2c1009d0 0x7fcc2c197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:48480/0 (socket says 172.21.15.92:48480) 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/3838485097 learned_addr learned my addr 172.21.15.92:0/3838485097 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/3838485097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc2c101370 msgr2=0x7fcc2c197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc2c101370 0x7fcc2c197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/3838485097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c1069e0 msgr2=0x7fcc2c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c1069e0 0x7fcc2c19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/3838485097 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c19c200 con 0x7fcc2c1009d0 2024-09-10T10:43:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2c1009d0 0x7fcc2c197210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00e9f0 tx=0x7fcc1c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc13fff640 1 -- 172.21.15.92:0/3838485097 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00cd80 con 0x7fcc2c1009d0 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.260+0000 7fcc31142640 1 -- 172.21.15.92:0/3838485097 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2c19c4f0 con 0x7fcc2c1009d0 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.261+0000 7fcc31142640 1 -- 172.21.15.92:0/3838485097 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2c1a3d80 con 0x7fcc2c1009d0 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.261+0000 7fcc13fff640 1 -- 172.21.15.92:0/3838485097 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc1c005500 con 0x7fcc2c1009d0 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.261+0000 7fcc13fff640 1 -- 172.21.15.92:0/3838485097 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c010690 con 0x7fcc2c1009d0 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.263+0000 7fcc13fff640 1 -- 172.21.15.92:0/3838485097 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fcc1c005020 con 0x7fcc2c1009d0 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.263+0000 7fcc33edb740 1 Processor -- start 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.263+0000 7fcc33edb740 1 -- start start 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.263+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2951ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.263+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf295c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 0x558bf295f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc33edb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558bf28b62f0 con 0x558bf2951af0 2024-09-10T10:43:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc33edb740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558bf285e270 con 0x558bf295ccb0 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc33edb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558bf28b22b0 con 0x558bf2952410 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2b59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2951ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc13fff640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcc140a2da0 0x7fcc140a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2b59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2951ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56338/0 (socket says 172.21.15.92:56338) 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2b59e640 1 -- 172.21.15.92:0/2905776894 learned_addr learned my addr 172.21.15.92:0/2905776894 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/2905776894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 0x558bf295f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/2905776894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf295c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2b59e640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcc140a2da0 0x7fcc140a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc13fff640 1 -- 172.21.15.92:0/3838485097 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fcc1c0cf760 con 0x7fcc2c1009d0 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2a59c640 1 -- 172.21.15.92:0/2905776894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 msgr2=0x558bf295c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/2905776894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf295c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2a59c640 1 -- 172.21.15.92:0/2905776894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 msgr2=0x558bf2951ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/2905776894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2951ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2a59c640 1 -- 172.21.15.92:0/2905776894 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf285d340 con 0x558bf295ccb0 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/2905776894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 0x558bf295f0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009bf0 tx=0x7fcc20011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b36725cda445c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc2b59e640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcc140a2da0 0x7fcc140a5260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009a60 tx=0x7fcc2402a8e0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.264+0000 7fcc117fa640 1 -- 172.21.15.92:0/2905776894 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20004050 con 0x558bf295ccb0 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc117fa640 1 -- 172.21.15.92:0/2905776894 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc20005500 con 0x558bf295ccb0 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc117fa640 1 -- 172.21.15.92:0/2905776894 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc200035f0 con 0x558bf295ccb0 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc33edb740 1 -- 172.21.15.92:0/2905776894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 msgr2=0x558bf295f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc33edb740 1 --2- 172.21.15.92:0/2905776894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 0x558bf295f0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009bf0 tx=0x7fcc20011810 comp rx=0 tx=0).stop 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc33edb740 1 -- 172.21.15.92:0/2905776894 shutdown_connections 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc33edb740 1 --2- 172.21.15.92:0/2905776894 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 0x558bf295f0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc33edb740 1 --2- 172.21.15.92:0/2905776894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf295c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc33edb740 1 --2- 172.21.15.92:0/2905776894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2951ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc33edb740 1 -- 172.21.15.92:0/2905776894 >> 172.21.15.92:0/2905776894 conn(0x558bf294e060 msgr2=0x558bf294e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc33edb740 1 -- 172.21.15.92:0/2905776894 shutdown_connections 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.265+0000 7fcc33edb740 1 -- 172.21.15.92:0/2905776894 wait complete. 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc33edb740 1 -- start start 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc33edb740 1 Processor -- start 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2951af0 0x558bf295fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf2960240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf295ccb0 0x558bf2960780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc33edb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558bf295f880 con 0x558bf295ccb0 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc33edb740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558bf283f290 con 0x558bf2951af0 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc33edb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558bf295fa00 con 0x558bf2952410 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc33edb740 10 client.0 _ll_register_callbacks cb 0x558bf2870140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc2ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2951af0 0x558bf295fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc2b59e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf295ccb0 0x558bf2960780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc2ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2951af0 0x558bf295fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:48494/0 (socket says 172.21.15.92:48494) 2024-09-10T10:43:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/4045157140 learned_addr learned my addr 172.21.15.92:0/4045157140 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf2960240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc2b59e640 1 -- 172.21.15.92:0/4045157140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 msgr2=0x558bf2960240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.266+0000 7fcc2b59e640 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf2960240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc2b59e640 1 -- 172.21.15.92:0/4045157140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2951af0 msgr2=0x558bf295fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc2b59e640 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2951af0 0x558bf295fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc2b59e640 1 -- 172.21.15.92:0/4045157140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf25c9210 con 0x558bf295ccb0 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2951af0 0x558bf295fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc2b59e640 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf295ccb0 0x558bf2960780 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcc2402ae00 tx=0x7fcc240095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533e1a0d5749cc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc0eff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc0eff5640 1 -- 172.21.15.92:0/4045157140 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24004d40 con 0x558bf295ccb0 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc33edb740 1 -- 172.21.15.92:0/4045157140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc20005500 con 0x558bf295ccb0 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc0eff5640 1 -- 172.21.15.92:0/4045157140 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fcc24004510 con 0x558bf295ccb0 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc0eff5640 1 -- 172.21.15.92:0/4045157140 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fcc24059050 con 0x558bf295ccb0 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc33edb740 10 client.15813 fetch_fsmap learned FSMap version 48 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc33edb740 1 -- 172.21.15.92:0/4045157140 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x558bf2695620 con 0x558bf295ccb0 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc0eff5640 1 -- 172.21.15.92:0/4045157140 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc20005500 con 0x558bf295ccb0 2024-09-10T10:43:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.267+0000 7fcc0eff5640 1 -- 172.21.15.92:0/4045157140 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 48) ==== 8362+0+0 (secure 0 0 0) 0x7fcc24030070 con 0x558bf295ccb0 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.268+0000 7fcc33edb740 10 client.15813 fetch_fsmap finished waiting for FSMap version 48 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.268+0000 7fcc33edb740 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.268+0000 7fcc33edb740 20 client.15813 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.268+0000 7fcc33edb740 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558bf296ee00 0x558bf29711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.268+0000 7fcc33edb740 4 client.15813 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.268+0000 7fcc33edb740 1 -- 172.21.15.92:0/4045157140 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bf28c3a20 con 0x558bf296ee00 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.268+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558bf296ee00 0x558bf29711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.268+0000 7fcc0eff5640 10 client.15813 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.268+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558bf296ee00 0x558bf29711f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=822c8811ea829aa0 server_cookie=3b5b2bc84fc301a4 in_seq=0 out_seq=0 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc0eff5640 1 -- 172.21.15.92:0/4045157140 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bf28c3a20 con 0x558bf296ee00 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc0eff5640 10 client.15813 handle_command_reply: tid=0 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 client.15813 shutdown 2024-09-10T10:43:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 -- 172.21.15.92:0/4045157140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf295ccb0 msgr2=0x558bf2960780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf295ccb0 0x558bf2960780 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fcc2402ae00 tx=0x7fcc240095c0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 -- 172.21.15.92:0/4045157140 shutdown_connections 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf295ccb0 0x558bf2960780 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf2960240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558bf296ee00 0x558bf29711f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 --2- 172.21.15.92:0/4045157140 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2951af0 0x558bf295fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc0eff5640 0 client.15813 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 -- 172.21.15.92:0/4045157140 >> 172.21.15.92:0/4045157140 conn(0x558bf294e060 msgr2=0x558bf2953dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 -- 172.21.15.92:0/4045157140 shutdown_connections 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 1 -- 172.21.15.92:0/4045157140 wait complete. 2024-09-10T10:43:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.269+0000 7fcc33edb740 20 client.15813 trim_cache size 0 max 16384 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc33edb740 1 Processor -- start 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc33edb740 1 -- start start 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2953c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf2976b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 0x558bf2977040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc33edb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c1ab440 con 0x558bf2951af0 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc33edb740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c1acf80 con 0x558bf295ccb0 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc33edb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c1abb10 con 0x558bf2952410 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2953c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2953c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56360/0 (socket says 172.21.15.92:56360) 2024-09-10T10:43:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/525795269 learned_addr learned my addr 172.21.15.92:0/525795269 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2b59e640 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 0x558bf2977040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf2976b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/525795269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 msgr2=0x558bf2976b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf2976b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/525795269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 msgr2=0x558bf2977040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 0x558bf2977040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/525795269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf294de90 con 0x558bf2951af0 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.284+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf2976b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.285+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2953c60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c098150 tx=0x7fcc1c06dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77aae8bf0c82c734 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.285+0000 7fcc10ff9640 1 -- 172.21.15.92:0/525795269 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0a00a0 con 0x558bf2951af0 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.285+0000 7fcc10ff9640 1 -- 172.21.15.92:0/525795269 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc1c0a4960 con 0x558bf2951af0 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.285+0000 7fcc10ff9640 1 -- 172.21.15.92:0/525795269 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0a4730 con 0x558bf2951af0 2024-09-10T10:43:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.285+0000 7fcc33edb740 1 -- 172.21.15.92:0/525795269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 msgr2=0x558bf2953c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.285+0000 7fcc33edb740 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2953c60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c098150 tx=0x7fcc1c06dd70 comp rx=0 tx=0).stop 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 -- 172.21.15.92:0/525795269 shutdown_connections 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf295ccb0 0x558bf2977040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf2952410 0x558bf2976b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 --2- 172.21.15.92:0/525795269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2953c60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 -- 172.21.15.92:0/525795269 >> 172.21.15.92:0/525795269 conn(0x558bf294e060 msgr2=0x558bf2953550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 -- 172.21.15.92:0/525795269 shutdown_connections 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 -- 172.21.15.92:0/525795269 wait complete. 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 -- start start 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 Processor -- start 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2965300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2952410 0x558bf2960620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf295ccb0 0x558bf2960b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c1ac8b0 con 0x558bf2951af0 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c1ac1e0 con 0x558bf2952410 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c1a9460 con 0x558bf295ccb0 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc33edb740 10 client.0 _ll_register_callbacks cb 0x7fcc24009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc2ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2965300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.286+0000 7fcc2ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2965300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56364/0 (socket says 172.21.15.92:56364) 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/3905198968 learned_addr learned my addr 172.21.15.92:0/3905198968 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc2b59e640 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf295ccb0 0x558bf2960b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2952410 0x558bf2960620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/3905198968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf295ccb0 msgr2=0x558bf2960b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf295ccb0 0x558bf2960b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/3905198968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2952410 msgr2=0x558bf2960620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2952410 0x558bf2960620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc2ad9d640 1 -- 172.21.15.92:0/3905198968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf2951920 con 0x558bf2951af0 2024-09-10T10:43:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc2ad9d640 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2965300 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c09b9f0 tx=0x7fcc1c09bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8077699f3d933447 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc0eff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:43:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc0eff5640 1 -- 172.21.15.92:0/3905198968 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0a46d0 con 0x558bf2951af0 2024-09-10T10:43:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc0eff5640 1 -- 172.21.15.92:0/3905198968 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8411+0+0 (secure 0 0 0) 0x7fcc1c0046c0 con 0x558bf2951af0 2024-09-10T10:43:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc33edb740 1 -- 172.21.15.92:0/3905198968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc1c0a4960 con 0x558bf2951af0 2024-09-10T10:43:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc0eff5640 1 -- 172.21.15.92:0/3905198968 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fcc1c0984e0 con 0x558bf2951af0 2024-09-10T10:43:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc33edb740 10 client.15819 fetch_fsmap learned FSMap version 48 2024-09-10T10:43:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc33edb740 1 -- 172.21.15.92:0/3905198968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x558bf29d97f0 con 0x558bf2951af0 2024-09-10T10:43:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.287+0000 7fcc0eff5640 1 -- 172.21.15.92:0/3905198968 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc1c0a4960 con 0x558bf2951af0 2024-09-10T10:43:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc0eff5640 1 -- 172.21.15.92:0/3905198968 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 48) ==== 8362+0+0 (secure 0 0 0) 0x7fcc1c09abb0 con 0x558bf2951af0 2024-09-10T10:43:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc33edb740 10 client.15819 fetch_fsmap finished waiting for FSMap version 48 2024-09-10T10:43:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc33edb740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc33edb740 20 client.15819 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc33edb740 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558bf29d9eb0 0x558bf29dc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc33edb740 4 client.15819 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:43:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc33edb740 1 -- 172.21.15.92:0/3905198968 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558bf28bdd70 con 0x558bf29d9eb0 2024-09-10T10:43:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558bf29d9eb0 0x558bf29dc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc0eff5640 10 client.15819 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.288+0000 7fcc2a59c640 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558bf29d9eb0 0x558bf29dc2a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c10f61a22d6b7559 server_cookie=1b978d240708965c in_seq=0 out_seq=0 2024-09-10T10:43:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc0eff5640 1 -- 172.21.15.92:0/3905198968 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558bf28bdd70 con 0x558bf29d9eb0 2024-09-10T10:43:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc0eff5640 10 client.15819 handle_command_reply: tid=0 2024-09-10T10:43:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 client.15819 shutdown 2024-09-10T10:43:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 -- 172.21.15.92:0/3905198968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 msgr2=0x558bf2965300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2965300 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c09b9f0 tx=0x7fcc1c09bdb0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 -- 172.21.15.92:0/3905198968 shutdown_connections 2024-09-10T10:43:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558bf295ccb0 0x558bf2960b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558bf29d9eb0 0x558bf29dc2a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558bf2952410 0x558bf2960620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc0eff5640 0 client.15819 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 --2- 172.21.15.92:0/3905198968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bf2951af0 0x558bf2965300 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 -- 172.21.15.92:0/3905198968 >> 172.21.15.92:0/3905198968 conn(0x558bf294e060 msgr2=0x558bf294c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 -- 172.21.15.92:0/3905198968 shutdown_connections 2024-09-10T10:43:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 1 -- 172.21.15.92:0/3905198968 wait complete. 2024-09-10T10:43:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc33edb740 20 client.15819 trim_cache size 0 max 16384 2024-09-10T10:43:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:43:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:43:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:43:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:43:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc31142640 1 -- 172.21.15.92:0/3838485097 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcc140a2da0 msgr2=0x7fcc140a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc31142640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcc140a2da0 0x7fcc140a5260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009a60 tx=0x7fcc2402a8e0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc31142640 1 -- 172.21.15.92:0/3838485097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2c1009d0 msgr2=0x7fcc2c197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.296+0000 7fcc31142640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2c1009d0 0x7fcc2c197210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00e9f0 tx=0x7fcc1c00edf0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.297+0000 7fcc31142640 1 -- 172.21.15.92:0/3838485097 shutdown_connections 2024-09-10T10:43:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.297+0000 7fcc31142640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c1069e0 0x7fcc2c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.297+0000 7fcc31142640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc2c101370 0x7fcc2c197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.304 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.297+0000 7fcc31142640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcc140a2da0 0x7fcc140a5260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.297+0000 7fcc31142640 1 --2- 172.21.15.92:0/3838485097 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcc2c1009d0 0x7fcc2c197210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:03.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.297+0000 7fcc31142640 1 -- 172.21.15.92:0/3838485097 >> 172.21.15.92:0/3838485097 conn(0x7fcc2c0fc6b0 msgr2=0x7fcc2c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:03.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.297+0000 7fcc31142640 1 -- 172.21.15.92:0/3838485097 shutdown_connections 2024-09-10T10:43:03.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:03.297+0000 7fcc31142640 1 -- 172.21.15.92:0/3838485097 wait complete. 2024-09-10T10:43:04.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:03 smithi121 ceph-mon[35231]: pgmap v196: 97 pgs: 97 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 21 MiB/s wr, 704 op/s 2024-09-10T10:43:04.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:03 smithi097 ceph-mon[35213]: pgmap v196: 97 pgs: 97 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 21 MiB/s wr, 704 op/s 2024-09-10T10:43:04.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:03 smithi092 ceph-mon[30834]: pgmap v196: 97 pgs: 97 active+clean; 4.5 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 21 MiB/s wr, 704 op/s 2024-09-10T10:43:06.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:05 smithi121 ceph-mon[35231]: pgmap v197: 97 pgs: 97 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 838 op/s 2024-09-10T10:43:06.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:05 smithi097 ceph-mon[35213]: pgmap v197: 97 pgs: 97 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 838 op/s 2024-09-10T10:43:06.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:05 smithi092 ceph-mon[30834]: pgmap v197: 97 pgs: 97 active+clean; 4.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 24 MiB/s wr, 838 op/s 2024-09-10T10:43:08.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:07 smithi121 ceph-mon[35231]: pgmap v198: 97 pgs: 97 active+clean; 4.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 MiB/s wr, 1.84k op/s 2024-09-10T10:43:08.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:07 smithi121 ceph-mon[35231]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T10:43:08.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:07 smithi097 ceph-mon[35213]: pgmap v198: 97 pgs: 97 active+clean; 4.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 MiB/s wr, 1.84k op/s 2024-09-10T10:43:08.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:07 smithi097 ceph-mon[35213]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T10:43:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:07 smithi092 ceph-mon[30834]: pgmap v198: 97 pgs: 97 active+clean; 4.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 MiB/s wr, 1.84k op/s 2024-09-10T10:43:08.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:07 smithi092 ceph-mon[30834]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T10:43:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 370.0 s, 1758.0 tps, lat 57.905 ms stddev 127.336 2024-09-10T10:43:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:10 smithi121 ceph-mon[35231]: pgmap v200: 97 pgs: 97 active+clean; 4.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 45 MiB/s wr, 1.74k op/s 2024-09-10T10:43:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:10 smithi097 ceph-mon[35213]: pgmap v200: 97 pgs: 97 active+clean; 4.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 45 MiB/s wr, 1.74k op/s 2024-09-10T10:43:10.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:10 smithi092 ceph-mon[30834]: pgmap v200: 97 pgs: 97 active+clean; 4.8 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 45 MiB/s wr, 1.74k op/s 2024-09-10T10:43:12.621 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:12 smithi097 ceph-mon[35213]: pgmap v201: 97 pgs: 97 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 44 MiB/s wr, 1.84k op/s 2024-09-10T10:43:12.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:12 smithi121 ceph-mon[35231]: pgmap v201: 97 pgs: 97 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 44 MiB/s wr, 1.84k op/s 2024-09-10T10:43:12.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:12 smithi092 ceph-mon[30834]: pgmap v201: 97 pgs: 97 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 44 MiB/s wr, 1.84k op/s 2024-09-10T10:43:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 375.0 s, 2485.0 tps, lat 40.157 ms stddev 43.915 2024-09-10T10:43:14.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:14 smithi121 ceph-mon[35231]: pgmap v202: 97 pgs: 97 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 44 MiB/s wr, 1.84k op/s 2024-09-10T10:43:14.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:14 smithi097 ceph-mon[35213]: pgmap v202: 97 pgs: 97 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 44 MiB/s wr, 1.84k op/s 2024-09-10T10:43:14.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:14 smithi092 ceph-mon[30834]: pgmap v202: 97 pgs: 97 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 44 MiB/s wr, 1.84k op/s 2024-09-10T10:43:15.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:15 smithi121 ceph-mon[35231]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T10:43:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:15 smithi097 ceph-mon[35213]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T10:43:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:15 smithi092 ceph-mon[30834]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T10:43:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.432+0000 7fa54645c640 1 -- 172.21.15.92:0/3168948652 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5401091f0 msgr2=0x7fa540110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.432+0000 7fa54645c640 1 --2- 172.21.15.92:0/3168948652 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5401091f0 0x7fa540110250 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa534009930 tx=0x7fa53402a480 comp rx=0 tx=0).stop 2024-09-10T10:43:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.433+0000 7fa54645c640 1 -- 172.21.15.92:0/3168948652 shutdown_connections 2024-09-10T10:43:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.433+0000 7fa54645c640 1 --2- 172.21.15.92:0/3168948652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa54011b140 0x7fa54011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.433+0000 7fa54645c640 1 --2- 172.21.15.92:0/3168948652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5401095d0 0x7fa540109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.433+0000 7fa54645c640 1 --2- 172.21.15.92:0/3168948652 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa5401091f0 0x7fa540110250 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa534009930 tx=0x7fa53402a480 comp rx=0 tx=0).stop 2024-09-10T10:43:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.433+0000 7fa54645c640 1 -- 172.21.15.92:0/3168948652 >> 172.21.15.92:0/3168948652 conn(0x7fa54006ce00 msgr2=0x7fa54006d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.435+0000 7fa54645c640 1 -- 172.21.15.92:0/3168948652 shutdown_connections 2024-09-10T10:43:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.437+0000 7fa54645c640 1 -- 172.21.15.92:0/3168948652 wait complete. 2024-09-10T10:43:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.438+0000 7fa54645c640 1 Processor -- start 2024-09-10T10:43:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.439+0000 7fa54645c640 1 -- start start 2024-09-10T10:43:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.439+0000 7fa54645c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401095d0 0x7fa54011a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.439+0000 7fa54645c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa54011b140 0x7fa540113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.439+0000 7fa54645c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa540113e40 0x7fa5401142f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.439+0000 7fa54645c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa540120d30 con 0x7fa5401095d0 2024-09-10T10:43:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.439+0000 7fa54645c640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa540120bb0 con 0x7fa540113e40 2024-09-10T10:43:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.439+0000 7fa54645c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa540120eb0 con 0x7fa54011b140 2024-09-10T10:43:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.439+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401095d0 0x7fa54011a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.440+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401095d0 0x7fa54011a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41738/0 (socket says 172.21.15.92:41738) 2024-09-10T10:43:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.440+0000 7fa53ffff640 1 -- 172.21.15.92:0/4085196116 learned_addr learned my addr 172.21.15.92:0/4085196116 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.440+0000 7fa5449f9640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa540113e40 0x7fa5401142f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.440+0000 7fa53f7fe640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa54011b140 0x7fa540113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.440+0000 7fa53ffff640 1 -- 172.21.15.92:0/4085196116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa54011b140 msgr2=0x7fa540113900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.440+0000 7fa53ffff640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa54011b140 0x7fa540113900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.440+0000 7fa53ffff640 1 -- 172.21.15.92:0/4085196116 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa540113e40 msgr2=0x7fa5401142f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.440+0000 7fa53ffff640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa540113e40 0x7fa5401142f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.440+0000 7fa53ffff640 1 -- 172.21.15.92:0/4085196116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5401183f0 con 0x7fa5401095d0 2024-09-10T10:43:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.441+0000 7fa53ffff640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401095d0 0x7fa54011a880 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa53402a9f0 tx=0x7fa534005460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.441+0000 7fa53d7fa640 1 -- 172.21.15.92:0/4085196116 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534040030 con 0x7fa5401095d0 2024-09-10T10:43:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.441+0000 7fa53d7fa640 1 -- 172.21.15.92:0/4085196116 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa53403cb30 con 0x7fa5401095d0 2024-09-10T10:43:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.442+0000 7fa53d7fa640 1 -- 172.21.15.92:0/4085196116 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534031a00 con 0x7fa5401095d0 2024-09-10T10:43:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.442+0000 7fa54645c640 1 -- 172.21.15.92:0/4085196116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa540118680 con 0x7fa5401095d0 2024-09-10T10:43:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.442+0000 7fa54645c640 1 -- 172.21.15.92:0/4085196116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa540118a30 con 0x7fa5401095d0 2024-09-10T10:43:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5491ed740 1 Processor -- start 2024-09-10T10:43:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa53d7fa640 1 -- 172.21.15.92:0/4085196116 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa534043030 con 0x7fa5401095d0 2024-09-10T10:43:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5491ed740 1 -- start start 2024-09-10T10:43:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b8410 0x562f4c6c2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5491ed740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562f4c61c2f0 con 0x562f4c6b7af0 2024-09-10T10:43:16.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5491ed740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562f4c5c4270 con 0x562f4c6b8410 2024-09-10T10:43:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5491ed740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562f4c6182b0 con 0x562f4c6c2cb0 2024-09-10T10:43:16.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5449f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa53f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5449f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6b7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41752/0 (socket says 172.21.15.92:41752) 2024-09-10T10:43:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa5449f9640 1 -- 172.21.15.92:0/3017592892 learned_addr learned my addr 172.21.15.92:0/3017592892 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:16.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.446+0000 7fa53ffff640 1 --2- 172.21.15.92:0/3017592892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b8410 0x562f4c6c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa53f7fe640 1 -- 172.21.15.92:0/3017592892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b8410 msgr2=0x562f4c6c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa53f7fe640 1 --2- 172.21.15.92:0/3017592892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b8410 0x562f4c6c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa53f7fe640 1 -- 172.21.15.92:0/3017592892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 msgr2=0x562f4c6b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa53f7fe640 1 --2- 172.21.15.92:0/3017592892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa53f7fe640 1 -- 172.21.15.92:0/3017592892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4c5c3340 con 0x562f4c6c2cb0 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa53f7fe640 1 --2- 172.21.15.92:0/3017592892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c50a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa540115150 tx=0x7fa538003e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e45a63ce435b286 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa5267fc640 1 -- 172.21.15.92:0/3017592892 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538004b20 con 0x562f4c6c2cb0 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa5267fc640 1 -- 172.21.15.92:0/3017592892 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa538004cc0 con 0x562f4c6c2cb0 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa5267fc640 1 -- 172.21.15.92:0/3017592892 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5380126b0 con 0x562f4c6c2cb0 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.447+0000 7fa53d7fa640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa5280a2da0 0x7fa5280a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa53d7fa640 1 -- 172.21.15.92:0/4085196116 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7fa5340ef730 con 0x7fa5401095d0 2024-09-10T10:43:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5491ed740 1 -- 172.21.15.92:0/3017592892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6c2cb0 msgr2=0x562f4c6c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5491ed740 1 --2- 172.21.15.92:0/3017592892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c50a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa540115150 tx=0x7fa538003e00 comp rx=0 tx=0).stop 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5449f9640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa5280a2da0 0x7fa5280a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5491ed740 1 -- 172.21.15.92:0/3017592892 shutdown_connections 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5491ed740 1 --2- 172.21.15.92:0/3017592892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c50a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5491ed740 1 --2- 172.21.15.92:0/3017592892 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b8410 0x562f4c6c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5491ed740 1 --2- 172.21.15.92:0/3017592892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5491ed740 1 -- 172.21.15.92:0/3017592892 >> 172.21.15.92:0/3017592892 conn(0x562f4c6b4060 msgr2=0x562f4c6b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5491ed740 1 -- 172.21.15.92:0/3017592892 shutdown_connections 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.448+0000 7fa5491ed740 1 -- 172.21.15.92:0/3017592892 wait complete. 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.449+0000 7fa5449f9640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa5280a2da0 0x7fa5280a5260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa530006aa0 tx=0x7fa5300090e0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.449+0000 7fa5491ed740 1 -- start start 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.449+0000 7fa5491ed740 1 Processor -- start 2024-09-10T10:43:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.449+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.449+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 0x562f4c6c0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.449+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa5491ed740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562f4c6c5880 con 0x562f4c6b7af0 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa5491ed740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562f4c5a5290 con 0x562f4c6c2cb0 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6bfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41762/0 (socket says 172.21.15.92:41762) 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53ffff640 1 -- 172.21.15.92:0/1814620906 learned_addr learned my addr 172.21.15.92:0/1814620906 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa5491ed740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562f4c6c5a00 con 0x562f4c6b8410 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53f7fe640 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 0x562f4c6c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa5491ed740 10 client.0 _ll_register_callbacks cb 0x562f4c5d6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa5449f9640 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53f7fe640 1 -- 172.21.15.92:0/1814620906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 msgr2=0x562f4c6c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53f7fe640 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53f7fe640 1 -- 172.21.15.92:0/1814620906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 msgr2=0x562f4c6bfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53f7fe640 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6bfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53f7fe640 1 -- 172.21.15.92:0/1814620906 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4c32f210 con 0x562f4c6b8410 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53ffff640 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6bfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa53f7fe640 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 0x562f4c6c0070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa538000f80 tx=0x7fa538009d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc278585bcc34afd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa51f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1814620906 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538005280 con 0x562f4c6b8410 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1814620906 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7fa538005420 con 0x562f4c6b8410 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.450+0000 7fa5491ed740 1 -- 172.21.15.92:0/1814620906 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa538004cc0 con 0x562f4c6b8410 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1814620906 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa538004830 con 0x562f4c6b8410 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa5491ed740 10 client.25378 fetch_fsmap learned FSMap version 48 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa5491ed740 1 -- 172.21.15.92:0/1814620906 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x562f4c3fb620 con 0x562f4c6b8410 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1814620906 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa538004cc0 con 0x562f4c6b8410 2024-09-10T10:43:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1814620906 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 48) ==== 8362+0+0 (secure 0 0 0) 0x7fa53800f040 con 0x562f4c6b8410 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa5491ed740 10 client.25378 fetch_fsmap finished waiting for FSMap version 48 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa5491ed740 10 client.25378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa5491ed740 20 client.25378 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562f4c6d2b70 0x562f4c6d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa5491ed740 4 client.25378 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.451+0000 7fa5491ed740 1 -- 172.21.15.92:0/1814620906 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f4c629a20 con 0x562f4c6d2b70 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.452+0000 7fa53ffff640 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562f4c6d2b70 0x562f4c6d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.452+0000 7fa53ffff640 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562f4c6d2b70 0x562f4c6d4f60 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9148d16c426fccf server_cookie=603bebb77af272da in_seq=0 out_seq=0 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.452+0000 7fa51f7fe640 10 client.25378 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1814620906 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f4c629a20 con 0x562f4c6d2b70 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa51f7fe640 10 client.25378 handle_command_reply: tid=0 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 client.25378 shutdown 2024-09-10T10:43:16.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 -- 172.21.15.92:0/1814620906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 msgr2=0x562f4c6c0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 0x562f4c6c0070 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa538000f80 tx=0x7fa538009d00 comp rx=0 tx=0).stop 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 -- 172.21.15.92:0/1814620906 shutdown_connections 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562f4c6d2b70 0x562f4c6d4f60 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa51f7fe640 0 client.25378 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 0x562f4c6c0070 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1814620906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b7af0 0x562f4c6bfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 -- 172.21.15.92:0/1814620906 >> 172.21.15.92:0/1814620906 conn(0x562f4c6b4060 msgr2=0x562f4c6b9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 -- 172.21.15.92:0/1814620906 shutdown_connections 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.453+0000 7fa5491ed740 1 -- 172.21.15.92:0/1814620906 wait complete. 2024-09-10T10:43:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.454+0000 7fa5491ed740 20 client.25378 trim_cache size 0 max 16384 2024-09-10T10:43:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.473+0000 7fa5491ed740 1 Processor -- start 2024-09-10T10:43:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.473+0000 7fa5491ed740 1 -- start start 2024-09-10T10:43:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.473+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b7af0 0x562f4c6c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.473+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 0x562f4c6c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.473+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6c2cb0 0x562f4c6da6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.473+0000 7fa5491ed740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401c4fb0 con 0x562f4c6c2cb0 2024-09-10T10:43:16.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.473+0000 7fa5491ed740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401c6af0 con 0x562f4c6b7af0 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.473+0000 7fa5491ed740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401c5680 con 0x562f4c6b8410 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa5449f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6c2cb0 0x562f4c6da6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b7af0 0x562f4c6c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa53f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 0x562f4c6c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa5449f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6c2cb0 0x562f4c6da6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41764/0 (socket says 172.21.15.92:41764) 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa5449f9640 1 -- 172.21.15.92:0/3830938776 learned_addr learned my addr 172.21.15.92:0/3830938776 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa5449f9640 1 -- 172.21.15.92:0/3830938776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 msgr2=0x562f4c6c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa5449f9640 1 --2- 172.21.15.92:0/3830938776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 0x562f4c6c1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa5449f9640 1 -- 172.21.15.92:0/3830938776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b7af0 msgr2=0x562f4c6c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa5449f9640 1 --2- 172.21.15.92:0/3830938776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b7af0 0x562f4c6c03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa5449f9640 1 -- 172.21.15.92:0/3830938776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4c6b8240 con 0x562f4c6c2cb0 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa5449f9640 1 --2- 172.21.15.92:0/3830938776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6c2cb0 0x562f4c6da6f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa530011d60 tx=0x7fa530014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a4d58e38f177e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:16.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa525ffb640 1 -- 172.21.15.92:0/3830938776 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530026030 con 0x562f4c6c2cb0 2024-09-10T10:43:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa525ffb640 1 -- 172.21.15.92:0/3830938776 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa53001b040 con 0x562f4c6c2cb0 2024-09-10T10:43:16.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.474+0000 7fa525ffb640 1 -- 172.21.15.92:0/3830938776 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530022dc0 con 0x562f4c6c2cb0 2024-09-10T10:43:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 -- 172.21.15.92:0/3830938776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6c2cb0 msgr2=0x562f4c6da6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 --2- 172.21.15.92:0/3830938776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6c2cb0 0x562f4c6da6f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa530011d60 tx=0x7fa530014000 comp rx=0 tx=0).stop 2024-09-10T10:43:16.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 -- 172.21.15.92:0/3830938776 shutdown_connections 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 --2- 172.21.15.92:0/3830938776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6c2cb0 0x562f4c6da6f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 --2- 172.21.15.92:0/3830938776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b8410 0x562f4c6c1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 --2- 172.21.15.92:0/3830938776 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6b7af0 0x562f4c6c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 -- 172.21.15.92:0/3830938776 >> 172.21.15.92:0/3830938776 conn(0x562f4c6b4060 msgr2=0x562f4c6c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 -- 172.21.15.92:0/3830938776 shutdown_connections 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 -- 172.21.15.92:0/3830938776 wait complete. 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.475+0000 7fa5491ed740 1 -- start start 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5491ed740 1 Processor -- start 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b7af0 0x562f4c6cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b8410 0x562f4c6cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5491ed740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5491ed740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401c6420 con 0x562f4c6b8410 2024-09-10T10:43:16.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5491ed740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401c5d50 con 0x562f4c6c2cb0 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5491ed740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401c2fb0 con 0x562f4c6b7af0 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5491ed740 10 client.0 _ll_register_callbacks cb 0x7fa530009410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa53f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b8410 0x562f4c6cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa53f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b8410 0x562f4c6cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41772/0 (socket says 172.21.15.92:41772) 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa53f7fe640 1 -- 172.21.15.92:0/1894317357 learned_addr learned my addr 172.21.15.92:0/1894317357 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa53ffff640 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b7af0 0x562f4c6cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5449f9640 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5449f9640 1 -- 172.21.15.92:0/1894317357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b7af0 msgr2=0x562f4c6cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5449f9640 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b7af0 0x562f4c6cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5449f9640 1 -- 172.21.15.92:0/1894317357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b8410 msgr2=0x562f4c6cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5449f9640 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b8410 0x562f4c6cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa5449f9640 1 -- 172.21.15.92:0/1894317357 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4c6c6a60 con 0x562f4c6c2cb0 2024-09-10T10:43:16.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.476+0000 7fa53f7fe640 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b8410 0x562f4c6cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.477+0000 7fa5449f9640 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c6230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa530006a30 tx=0x7fa530014f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4690430db8049961 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.477+0000 7fa51f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.477+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1894317357 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530031070 con 0x562f4c6c2cb0 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.477+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1894317357 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7fa530022820 con 0x562f4c6c2cb0 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.477+0000 7fa5491ed740 1 -- 172.21.15.92:0/1894317357 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa53001b040 con 0x562f4c6c2cb0 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.478+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1894317357 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa530026040 con 0x562f4c6c2cb0 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.478+0000 7fa5491ed740 10 client.25337 fetch_fsmap learned FSMap version 48 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.478+0000 7fa5491ed740 1 -- 172.21.15.92:0/1894317357 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x562f4c73d190 con 0x562f4c6c2cb0 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.478+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1894317357 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa530006d00 con 0x562f4c6c2cb0 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.478+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1894317357 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 48) ==== 8362+0+0 (secure 0 0 0) 0x7fa53002b530 con 0x562f4c6c2cb0 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.478+0000 7fa5491ed740 10 client.25337 fetch_fsmap finished waiting for FSMap version 48 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.478+0000 7fa5491ed740 10 client.25337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:16.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.479+0000 7fa5491ed740 20 client.25337 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.479+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562f4c6d2b70 0x562f4c73f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.479+0000 7fa5491ed740 4 client.25337 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:43:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.479+0000 7fa5491ed740 1 -- 172.21.15.92:0/1894317357 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa53001b040 con 0x562f4c6d2b70 2024-09-10T10:43:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.479+0000 7fa53ffff640 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562f4c6d2b70 0x562f4c73f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.479+0000 7fa51f7fe640 10 client.25337 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:16.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.479+0000 7fa53ffff640 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562f4c6d2b70 0x562f4c73f840 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43534e4c97271345 server_cookie=af7cfaa2ae645bab in_seq=0 out_seq=0 2024-09-10T10:43:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa51f7fe640 1 -- 172.21.15.92:0/1894317357 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa53001b040 con 0x562f4c6d2b70 2024-09-10T10:43:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa51f7fe640 10 client.25337 handle_command_reply: tid=0 2024-09-10T10:43:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa5491ed740 1 client.25337 shutdown 2024-09-10T10:43:16.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa5491ed740 1 -- 172.21.15.92:0/1894317357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 msgr2=0x562f4c6c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c6230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa530006a30 tx=0x7fa530014f60 comp rx=0 tx=0).stop 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa5491ed740 1 -- 172.21.15.92:0/1894317357 shutdown_connections 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562f4c6d2b70 0x562f4c73f840 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562f4c6c2cb0 0x562f4c6c6230 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa51f7fe640 0 client.25337 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f4c6b8410 0x562f4c6cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa5491ed740 1 --2- 172.21.15.92:0/1894317357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562f4c6b7af0 0x562f4c6cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.490+0000 7fa5491ed740 1 -- 172.21.15.92:0/1894317357 >> 172.21.15.92:0/1894317357 conn(0x562f4c6b4060 msgr2=0x562f4c6c1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa5491ed740 1 -- 172.21.15.92:0/1894317357 shutdown_connections 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa5491ed740 1 -- 172.21.15.92:0/1894317357 wait complete. 2024-09-10T10:43:16.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa5491ed740 20 client.25337 trim_cache size 0 max 16384 2024-09-10T10:43:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:43:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:43:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:43:16.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:43:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 -- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa5280a2da0 msgr2=0x7fa5280a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa5280a2da0 0x7fa5280a5260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa530006aa0 tx=0x7fa5300090e0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 -- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401095d0 msgr2=0x7fa54011a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401095d0 0x7fa54011a880 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa53402a9f0 tx=0x7fa534005460 comp rx=0 tx=0).stop 2024-09-10T10:43:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 -- 172.21.15.92:0/4085196116 shutdown_connections 2024-09-10T10:43:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa5280a2da0 0x7fa5280a5260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa540113e40 0x7fa5401142f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa54011b140 0x7fa540113900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 --2- 172.21.15.92:0/4085196116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5401095d0 0x7fa54011a880 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.491+0000 7fa54645c640 1 -- 172.21.15.92:0/4085196116 >> 172.21.15.92:0/4085196116 conn(0x7fa54006ce00 msgr2=0x7fa540071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.492+0000 7fa54645c640 1 -- 172.21.15.92:0/4085196116 shutdown_connections 2024-09-10T10:43:16.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:16.492+0000 7fa54645c640 1 -- 172.21.15.92:0/4085196116 wait complete. 2024-09-10T10:43:16.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:16 smithi121 ceph-mon[35231]: pgmap v204: 97 pgs: 97 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 599 op/s 2024-09-10T10:43:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:16 smithi097 ceph-mon[35213]: pgmap v204: 97 pgs: 97 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 599 op/s 2024-09-10T10:43:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:16 smithi092 ceph-mon[30834]: pgmap v204: 97 pgs: 97 active+clean; 4.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 13 MiB/s wr, 599 op/s 2024-09-10T10:43:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 380.0 s, 2882.0 tps, lat 34.852 ms stddev 40.792 2024-09-10T10:43:18.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:18 smithi121 ceph-mon[35231]: pgmap v205: 97 pgs: 97 active+clean; 4.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 MiB/s wr, 824 op/s 2024-09-10T10:43:18.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:18 smithi097 ceph-mon[35213]: pgmap v205: 97 pgs: 97 active+clean; 4.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 MiB/s wr, 824 op/s 2024-09-10T10:43:18.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:18 smithi092 ceph-mon[30834]: pgmap v205: 97 pgs: 97 active+clean; 4.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 18 MiB/s wr, 824 op/s 2024-09-10T10:43:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:20 smithi121 ceph-mon[35231]: pgmap v206: 97 pgs: 97 active+clean; 4.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 808 op/s 2024-09-10T10:43:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:20 smithi097 ceph-mon[35213]: pgmap v206: 97 pgs: 97 active+clean; 4.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 808 op/s 2024-09-10T10:43:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:20 smithi092 ceph-mon[30834]: pgmap v206: 97 pgs: 97 active+clean; 4.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 808 op/s 2024-09-10T10:43:22.662 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:22 smithi092 ceph-mon[30834]: pgmap v207: 97 pgs: 97 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 MiB/s wr, 2.04k op/s 2024-09-10T10:43:22.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:22 smithi121 ceph-mon[35231]: pgmap v207: 97 pgs: 97 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 MiB/s wr, 2.04k op/s 2024-09-10T10:43:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:22 smithi097 ceph-mon[35213]: pgmap v207: 97 pgs: 97 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 MiB/s wr, 2.04k op/s 2024-09-10T10:43:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 385.0 s, 2956.2 tps, lat 33.819 ms stddev 58.405 2024-09-10T10:43:24.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:24 smithi121 ceph-mon[35231]: pgmap v208: 97 pgs: 97 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 MiB/s wr, 2.04k op/s 2024-09-10T10:43:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:24 smithi097 ceph-mon[35213]: pgmap v208: 97 pgs: 97 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 MiB/s wr, 2.04k op/s 2024-09-10T10:43:24.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:24 smithi092 ceph-mon[30834]: pgmap v208: 97 pgs: 97 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 MiB/s wr, 2.04k op/s 2024-09-10T10:43:26.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:26 smithi121 ceph-mon[35231]: pgmap v209: 97 pgs: 97 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 2.02k op/s 2024-09-10T10:43:26.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:26 smithi097 ceph-mon[35213]: pgmap v209: 97 pgs: 97 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 2.02k op/s 2024-09-10T10:43:26.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:26 smithi092 ceph-mon[30834]: pgmap v209: 97 pgs: 97 active+clean; 4.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 2.02k op/s 2024-09-10T10:43:27.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:27 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:43:27.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:27 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:43:27.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:27 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:43:28.154 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 390.0 s, 1973.0 tps, lat 30.738 ms stddev 37.771 2024-09-10T10:43:28.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:28 smithi121 ceph-mon[35231]: pgmap v210: 97 pgs: 97 active+clean; 4.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 32 MiB/s wr, 2.04k op/s 2024-09-10T10:43:28.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:28 smithi097 ceph-mon[35213]: pgmap v210: 97 pgs: 97 active+clean; 4.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 32 MiB/s wr, 2.04k op/s 2024-09-10T10:43:28.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:28 smithi092 ceph-mon[30834]: pgmap v210: 97 pgs: 97 active+clean; 4.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 32 MiB/s wr, 2.04k op/s 2024-09-10T10:43:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.588+0000 7f33ba40e640 1 -- 172.21.15.92:0/1921969014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 msgr2=0x7f33b410e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.588+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1921969014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 0x7f33b410e5a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009ca0 tx=0x7f33ac02a950 comp rx=0 tx=0).stop 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.588+0000 7f33ba40e640 1 -- 172.21.15.92:0/1921969014 shutdown_connections 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.588+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1921969014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 0x7f33b410e5a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.588+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1921969014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33b4103680 0x7f33b410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.588+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1921969014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33b4102d60 0x7f33b4103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.588+0000 7f33ba40e640 1 -- 172.21.15.92:0/1921969014 >> 172.21.15.92:0/1921969014 conn(0x7f33b40fc6b0 msgr2=0x7f33b40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.589+0000 7f33ba40e640 1 -- 172.21.15.92:0/1921969014 shutdown_connections 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.589+0000 7f33ba40e640 1 -- 172.21.15.92:0/1921969014 wait complete. 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.589+0000 7f33ba40e640 1 Processor -- start 2024-09-10T10:43:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.589+0000 7f33ba40e640 1 -- start start 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33ba40e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33b4102d60 0x7f33b41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33ba40e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33b4103680 0x7f33b4198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33ba40e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 0x7f33b419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33ba40e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4111f00 con 0x7f33b410c130 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33ba40e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4111d80 con 0x7f33b4102d60 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33ba40e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33b4112080 con 0x7f33b4103680 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b89ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 0x7f33b419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b89ab640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 0x7f33b419cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44588/0 (socket says 172.21.15.92:44588) 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b89ab640 1 -- 172.21.15.92:0/1156867469 learned_addr learned my addr 172.21.15.92:0/1156867469 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b3fff640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33b4102d60 0x7f33b41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b37fe640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33b4103680 0x7f33b4198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b89ab640 1 -- 172.21.15.92:0/1156867469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33b4103680 msgr2=0x7f33b4198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b89ab640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33b4103680 0x7f33b4198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b89ab640 1 -- 172.21.15.92:0/1156867469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33b4102d60 msgr2=0x7f33b41982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b89ab640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33b4102d60 0x7f33b41982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b89ab640 1 -- 172.21.15.92:0/1156867469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b419d2e0 con 0x7f33b410c130 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b37fe640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33b4103680 0x7f33b4198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b3fff640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33b4102d60 0x7f33b41982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b89ab640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 0x7f33b419cbb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f33ac02ae70 tx=0x7f33ac02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b17fa640 1 -- 172.21.15.92:0/1156867469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac034040 con 0x7f33b410c130 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33ba40e640 1 -- 172.21.15.92:0/1156867469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b419d570 con 0x7f33b410c130 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.590+0000 7f33b17fa640 1 -- 172.21.15.92:0/1156867469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ac030920 con 0x7f33b410c130 2024-09-10T10:43:29.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.591+0000 7f33ba40e640 1 -- 172.21.15.92:0/1156867469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b41a4e60 con 0x7f33b410c130 2024-09-10T10:43:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.591+0000 7f33b17fa640 1 -- 172.21.15.92:0/1156867469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac045480 con 0x7f33b410c130 2024-09-10T10:43:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.593+0000 7f33b17fa640 1 -- 172.21.15.92:0/1156867469 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f33ac037020 con 0x7f33b410c130 2024-09-10T10:43:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33bd285740 1 Processor -- start 2024-09-10T10:43:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33bd285740 1 -- start start 2024-09-10T10:43:29.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33bd285740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba3af0 0x55d291ba3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33bd285740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 0x55d291bae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33bd285740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291bb10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33bd285740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d291b082f0 con 0x55d291baecb0 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33bd285740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d291ab0270 con 0x55d291ba4410 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33bd285740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d291b042b0 con 0x55d291ba3af0 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291bb10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291bb10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44590/0 (socket says 172.21.15.92:44590) 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b37fe640 1 -- 172.21.15.92:0/3916766941 learned_addr learned my addr 172.21.15.92:0/3916766941 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b37fe640 1 --2- 172.21.15.92:0/3916766941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba3af0 0x55d291ba3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b3fff640 1 --2- 172.21.15.92:0/3916766941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 0x55d291bae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b17fa640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f339c0a2da0 0x7f339c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b37fe640 1 -- 172.21.15.92:0/3916766941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba3af0 msgr2=0x55d291ba3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b37fe640 1 --2- 172.21.15.92:0/3916766941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba3af0 0x55d291ba3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b37fe640 1 -- 172.21.15.92:0/3916766941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 msgr2=0x55d291bae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b37fe640 1 --2- 172.21.15.92:0/3916766941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 0x55d291bae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b37fe640 1 -- 172.21.15.92:0/3916766941 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d291aaf340 con 0x55d291baecb0 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.594+0000 7f33b89ab640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f339c0a2da0 0x7f339c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.595+0000 7f33b37fe640 1 --2- 172.21.15.92:0/3916766941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291bb10a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f33a800df90 tx=0x7f33a800d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a04de29433bd88 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.595+0000 7f33b17fa640 1 -- 172.21.15.92:0/1156867469 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7f33ac0f02c0 con 0x7f33b410c130 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.595+0000 7f339a7fc640 1 -- 172.21.15.92:0/3916766941 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8005220 con 0x55d291baecb0 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.595+0000 7f339a7fc640 1 -- 172.21.15.92:0/3916766941 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33a8004c80 con 0x55d291baecb0 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.595+0000 7f339a7fc640 1 -- 172.21.15.92:0/3916766941 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a80128f0 con 0x55d291baecb0 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.595+0000 7f33bd285740 1 -- 172.21.15.92:0/3916766941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 msgr2=0x55d291bb10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.595+0000 7f33b89ab640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f339c0a2da0 0x7f339c0a5260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0bc8c0 tx=0x7f33ac04e000 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:29.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.595+0000 7f33bd285740 1 --2- 172.21.15.92:0/3916766941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291bb10a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f33a800df90 tx=0x7f33a800d5c0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 -- 172.21.15.92:0/3916766941 shutdown_connections 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 --2- 172.21.15.92:0/3916766941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291bb10a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 --2- 172.21.15.92:0/3916766941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 0x55d291bae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 --2- 172.21.15.92:0/3916766941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba3af0 0x55d291ba3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 -- 172.21.15.92:0/3916766941 >> 172.21.15.92:0/3916766941 conn(0x55d291ba0060 msgr2=0x55d291ba0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 -- 172.21.15.92:0/3916766941 shutdown_connections 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 -- 172.21.15.92:0/3916766941 wait complete. 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 -- start start 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 Processor -- start 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba3af0 0x55d291babbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba4410 0x55d291bac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291baecb0 0x55d291bac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d291bb1880 con 0x55d291ba3af0 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d291a91290 con 0x55d291baecb0 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d291bb1a00 con 0x55d291ba4410 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.596+0000 7f33bd285740 10 client.0 _ll_register_callbacks cb 0x55d291ac2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba3af0 0x55d291babbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba3af0 0x55d291babbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44604/0 (socket says 172.21.15.92:44604) 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 -- 172.21.15.92:0/2898879231 learned_addr learned my addr 172.21.15.92:0/2898879231 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291baecb0 0x55d291bac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b3fff640 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba4410 0x55d291bac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 -- 172.21.15.92:0/2898879231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba4410 msgr2=0x55d291bac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba4410 0x55d291bac0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 -- 172.21.15.92:0/2898879231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291baecb0 msgr2=0x55d291bac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:29.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291baecb0 0x55d291bac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 -- 172.21.15.92:0/2898879231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29181b210 con 0x55d291ba3af0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33b37fe640 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba3af0 0x55d291babbb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f33a80058d0 tx=0x7f33a8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e39b96c06c5a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33937fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33937fe640 1 -- 172.21.15.92:0/2898879231 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8004ad0 con 0x55d291ba3af0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33937fe640 1 -- 172.21.15.92:0/2898879231 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7f33a8005000 con 0x55d291ba3af0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33bd285740 1 -- 172.21.15.92:0/2898879231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33a8004c80 con 0x55d291ba3af0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33937fe640 1 -- 172.21.15.92:0/2898879231 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f33a8031050 con 0x55d291ba3af0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33bd285740 10 client.15846 fetch_fsmap learned FSMap version 49 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.597+0000 7f33bd285740 1 -- 172.21.15.92:0/2898879231 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d2918e7620 con 0x55d291ba3af0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33937fe640 1 -- 172.21.15.92:0/2898879231 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33a8004c80 con 0x55d291ba3af0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33937fe640 1 -- 172.21.15.92:0/2898879231 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 49) ==== 8366+0+0 (secure 0 0 0) 0x7f33a802a060 con 0x55d291ba3af0 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33bd285740 10 client.15846 fetch_fsmap finished waiting for FSMap version 49 2024-09-10T10:43:29.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33bd285740 10 client.15846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33bd285740 20 client.15846 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33bd285740 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d291bbec50 0x55d291bc1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33bd285740 4 client.15846 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33bd285740 1 -- 172.21.15.92:0/2898879231 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d291b15a20 con 0x55d291bbec50 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33b3fff640 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d291bbec50 0x55d291bc1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33937fe640 10 client.15846 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.598+0000 7f33b3fff640 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d291bbec50 0x55d291bc1040 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b9e4c221cb91e76 server_cookie=1af762c7630f017b in_seq=0 out_seq=0 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33937fe640 1 -- 172.21.15.92:0/2898879231 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d291b15a20 con 0x55d291bbec50 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33937fe640 10 client.15846 handle_command_reply: tid=0 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 client.15846 shutdown 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 -- 172.21.15.92:0/2898879231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba3af0 msgr2=0x55d291babbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:29.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba3af0 0x55d291babbb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f33a80058d0 tx=0x7f33a8001e50 comp rx=0 tx=0).stop 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 -- 172.21.15.92:0/2898879231 shutdown_connections 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d291bbec50 0x55d291bc1040 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291baecb0 0x55d291bac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba4410 0x55d291bac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 --2- 172.21.15.92:0/2898879231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba3af0 0x55d291babbb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33937fe640 0 client.15846 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 -- 172.21.15.92:0/2898879231 >> 172.21.15.92:0/2898879231 conn(0x55d291ba0060 msgr2=0x55d291ba5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 -- 172.21.15.92:0/2898879231 shutdown_connections 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.599+0000 7f33bd285740 1 -- 172.21.15.92:0/2898879231 wait complete. 2024-09-10T10:43:29.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.600+0000 7f33bd285740 20 client.15846 trim_cache size 0 max 16384 2024-09-10T10:43:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33bd285740 1 Processor -- start 2024-09-10T10:43:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33bd285740 1 -- start start 2024-09-10T10:43:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33bd285740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba3af0 0x55d291bac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33bd285740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba4410 0x55d291bc67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33bd285740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291baecb0 0x55d291bc6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33bd285740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41ad5a0 con 0x55d291ba4410 2024-09-10T10:43:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33bd285740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41af110 con 0x55d291ba3af0 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33bd285740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41adc70 con 0x55d291baecb0 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba4410 0x55d291bc67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33b3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba4410 0x55d291bc67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44612/0 (socket says 172.21.15.92:44612) 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33b3fff640 1 -- 172.21.15.92:0/633035479 learned_addr learned my addr 172.21.15.92:0/633035479 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33b37fe640 1 --2- 172.21.15.92:0/633035479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba3af0 0x55d291bac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.614+0000 7f33b3fff640 1 -- 172.21.15.92:0/633035479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291baecb0 msgr2=0x55d291bc6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f33b3fff640 1 --2- 172.21.15.92:0/633035479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291baecb0 0x55d291bc6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f33b3fff640 1 -- 172.21.15.92:0/633035479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba3af0 msgr2=0x55d291bac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f33b3fff640 1 --2- 172.21.15.92:0/633035479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba3af0 0x55d291bac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f33b3fff640 1 -- 172.21.15.92:0/633035479 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d291ba0ba0 con 0x55d291ba4410 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f33b37fe640 1 --2- 172.21.15.92:0/633035479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba3af0 0x55d291bac460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:43:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f33b3fff640 1 --2- 172.21.15.92:0/633035479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba4410 0x55d291bc67d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f33a400b370 tx=0x7f33a4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eedf585f56e552d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f3399ffb640 1 -- 172.21.15.92:0/633035479 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a40142d0 con 0x55d291ba4410 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f3399ffb640 1 -- 172.21.15.92:0/633035479 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33a4005050 con 0x55d291ba4410 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f3399ffb640 1 -- 172.21.15.92:0/633035479 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4004ca0 con 0x55d291ba4410 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f33bd285740 1 -- 172.21.15.92:0/633035479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba4410 msgr2=0x55d291bc67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.615+0000 7f33bd285740 1 --2- 172.21.15.92:0/633035479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba4410 0x55d291bc67d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f33a400b370 tx=0x7f33a4005850 comp rx=0 tx=0).stop 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 -- 172.21.15.92:0/633035479 shutdown_connections 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 --2- 172.21.15.92:0/633035479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291baecb0 0x55d291bc6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 --2- 172.21.15.92:0/633035479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291ba4410 0x55d291bc67d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 --2- 172.21.15.92:0/633035479 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba3af0 0x55d291bac460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 -- 172.21.15.92:0/633035479 >> 172.21.15.92:0/633035479 conn(0x55d291ba0060 msgr2=0x55d291badc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 -- 172.21.15.92:0/633035479 shutdown_connections 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 -- 172.21.15.92:0/633035479 wait complete. 2024-09-10T10:43:29.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 -- start start 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 Processor -- start 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba3af0 0x55d291bb6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 0x55d291bb74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291ba8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41aea40 con 0x55d291baecb0 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41ae370 con 0x55d291ba4410 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33b41ab5a0 con 0x55d291ba3af0 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33bd285740 10 client.0 _ll_register_callbacks cb 0x7f33a8014470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291ba8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291ba8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44620/0 (socket says 172.21.15.92:44620) 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.616+0000 7f33b37fe640 1 -- 172.21.15.92:0/2824106080 learned_addr learned my addr 172.21.15.92:0/2824106080 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33b3fff640 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 0x55d291bb74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33b37fe640 1 -- 172.21.15.92:0/2824106080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba3af0 msgr2=0x55d291bb6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33b37fe640 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba3af0 0x55d291bb6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33b37fe640 1 -- 172.21.15.92:0/2824106080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 msgr2=0x55d291bb74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33b37fe640 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 0x55d291bb74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33b37fe640 1 -- 172.21.15.92:0/2824106080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d291ba8c70 con 0x55d291baecb0 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33b3fff640 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 0x55d291bb74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33b37fe640 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291ba8440 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f33a800db40 tx=0x7f33a8005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b18f520faa918c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33937fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33937fe640 1 -- 172.21.15.92:0/2824106080 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a803a060 con 0x55d291baecb0 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33937fe640 1 -- 172.21.15.92:0/2824106080 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7f33a800d5c0 con 0x55d291baecb0 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33bd285740 1 -- 172.21.15.92:0/2824106080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33a4005050 con 0x55d291baecb0 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33937fe640 1 -- 172.21.15.92:0/2824106080 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f33a80048d0 con 0x55d291baecb0 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33bd285740 10 client.15852 fetch_fsmap learned FSMap version 49 2024-09-10T10:43:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33bd285740 1 -- 172.21.15.92:0/2824106080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d291c29260 con 0x55d291baecb0 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.617+0000 7f33937fe640 1 -- 172.21.15.92:0/2824106080 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33a4005050 con 0x55d291baecb0 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.618+0000 7f33937fe640 1 -- 172.21.15.92:0/2824106080 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 49) ==== 8366+0+0 (secure 0 0 0) 0x7f33a802a040 con 0x55d291baecb0 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.618+0000 7f33bd285740 10 client.15852 fetch_fsmap finished waiting for FSMap version 49 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.618+0000 7f33bd285740 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.618+0000 7f33bd285740 20 client.15852 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.618+0000 7f33bd285740 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d291c29980 0x55d291c2bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.618+0000 7f33bd285740 4 client.15852 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.618+0000 7f33bd285740 1 -- 172.21.15.92:0/2824106080 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d291b0fd70 con 0x55d291c29980 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.618+0000 7f33b3fff640 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d291c29980 0x55d291c2bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.619+0000 7f33b3fff640 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d291c29980 0x55d291c2bd70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d28f27741e94a8c server_cookie=36957b76456450c in_seq=0 out_seq=0 2024-09-10T10:43:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.619+0000 7f33937fe640 10 client.15852 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.634+0000 7f33937fe640 1 -- 172.21.15.92:0/2824106080 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d291b0fd70 con 0x55d291c29980 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.634+0000 7f33937fe640 10 client.15852 handle_command_reply: tid=0 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.634+0000 7f33bd285740 1 client.15852 shutdown 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 -- 172.21.15.92:0/2824106080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 msgr2=0x55d291ba8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291ba8440 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f33a800db40 tx=0x7f33a8005f60 comp rx=0 tx=0).stop 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 -- 172.21.15.92:0/2824106080 shutdown_connections 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d291baecb0 0x55d291ba8440 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d291c29980 0x55d291c2bd70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d291ba4410 0x55d291bb74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 --2- 172.21.15.92:0/2824106080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d291ba3af0 0x55d291bb6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33937fe640 0 client.15852 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 -- 172.21.15.92:0/2824106080 >> 172.21.15.92:0/2824106080 conn(0x55d291ba0060 msgr2=0x55d291ba5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 -- 172.21.15.92:0/2824106080 shutdown_connections 2024-09-10T10:43:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 1 -- 172.21.15.92:0/2824106080 wait complete. 2024-09-10T10:43:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33bd285740 20 client.15852 trim_cache size 0 max 16384 2024-09-10T10:43:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:43:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:43:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:43:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:43:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33ba40e640 1 -- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f339c0a2da0 msgr2=0x7f339c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f339c0a2da0 0x7f339c0a5260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0bc8c0 tx=0x7f33ac04e000 comp rx=0 tx=0).stop 2024-09-10T10:43:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33ba40e640 1 -- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 msgr2=0x7f33b419cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.635+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 0x7f33b419cbb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f33ac02ae70 tx=0x7f33ac02f5d0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.636+0000 7f33ba40e640 1 -- 172.21.15.92:0/1156867469 shutdown_connections 2024-09-10T10:43:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.636+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33b410c130 0x7f33b419cbb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.636+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33b4103680 0x7f33b4198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.636+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f339c0a2da0 0x7f339c0a5260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.636+0000 7f33ba40e640 1 --2- 172.21.15.92:0/1156867469 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f33b4102d60 0x7f33b41982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.636+0000 7f33ba40e640 1 -- 172.21.15.92:0/1156867469 >> 172.21.15.92:0/1156867469 conn(0x7f33b40fc6b0 msgr2=0x7f33b40fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.636+0000 7f33ba40e640 1 -- 172.21.15.92:0/1156867469 shutdown_connections 2024-09-10T10:43:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:29.636+0000 7f33ba40e640 1 -- 172.21.15.92:0/1156867469 wait complete. 2024-09-10T10:43:29.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:29 smithi121 ceph-mon[35231]: pgmap v211: 97 pgs: 97 active+clean; 4.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 26 MiB/s wr, 1.76k op/s 2024-09-10T10:43:29.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:29 smithi097 ceph-mon[35213]: pgmap v211: 97 pgs: 97 active+clean; 4.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 26 MiB/s wr, 1.76k op/s 2024-09-10T10:43:29.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:29 smithi092 ceph-mon[30834]: pgmap v211: 97 pgs: 97 active+clean; 4.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 26 MiB/s wr, 1.76k op/s 2024-09-10T10:43:31.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:31 smithi092 ceph-mon[30834]: pgmap v212: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 28 MiB/s wr, 1.85k op/s 2024-09-10T10:43:32.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:31 smithi121 ceph-mon[35231]: pgmap v212: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 28 MiB/s wr, 1.85k op/s 2024-09-10T10:43:32.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:31 smithi097 ceph-mon[35213]: pgmap v212: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 28 MiB/s wr, 1.85k op/s 2024-09-10T10:43:33.157 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 395.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-10T10:43:33.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:33 smithi092 ceph-mon[30834]: pgmap v213: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.5 MiB/s wr, 428 op/s 2024-09-10T10:43:34.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:33 smithi121 ceph-mon[35231]: pgmap v213: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.5 MiB/s wr, 428 op/s 2024-09-10T10:43:34.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:33 smithi097 ceph-mon[35213]: pgmap v213: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.5 MiB/s wr, 428 op/s 2024-09-10T10:43:35.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:35 smithi092 ceph-mon[30834]: pgmap v214: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.5 MiB/s wr, 428 op/s 2024-09-10T10:43:36.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:35 smithi121 ceph-mon[35231]: pgmap v214: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.5 MiB/s wr, 428 op/s 2024-09-10T10:43:36.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:35 smithi097 ceph-mon[35213]: pgmap v214: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 7.5 MiB/s wr, 428 op/s 2024-09-10T10:43:37.842 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:37 smithi121 ceph-mon[35231]: pgmap v215: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 17 MiB/s wr, 1.34k op/s 2024-09-10T10:43:37.842 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:37 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:43:37.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:37 smithi092 ceph-mon[30834]: pgmap v215: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 17 MiB/s wr, 1.34k op/s 2024-09-10T10:43:37.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:37 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:43:38.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:37 smithi097 ceph-mon[35213]: pgmap v215: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 17 MiB/s wr, 1.34k op/s 2024-09-10T10:43:38.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:37 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:43:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 400.0 s, 1558.8 tps, lat 153.369 ms stddev 1005.163 2024-09-10T10:43:39.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:39 smithi092 ceph-mon[30834]: pgmap v216: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 995 op/s 2024-09-10T10:43:40.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:39 smithi121 ceph-mon[35231]: pgmap v216: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 995 op/s 2024-09-10T10:43:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:39 smithi097 ceph-mon[35213]: pgmap v216: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 11 MiB/s wr, 995 op/s 2024-09-10T10:43:41.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:41 smithi092 ceph-mon[30834]: pgmap v217: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2024-09-10T10:43:42.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:41 smithi121 ceph-mon[35231]: pgmap v217: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2024-09-10T10:43:42.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:41 smithi097 ceph-mon[35213]: pgmap v217: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2024-09-10T10:43:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.757+0000 7f1117778640 1 -- 172.21.15.92:0/3727158241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11101010f0 msgr2=0x7f1110101530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.757+0000 7f1117778640 1 --2- 172.21.15.92:0/3727158241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11101010f0 0x7f1110101530 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1100009900 tx=0x7f110002a410 comp rx=0 tx=0).stop 2024-09-10T10:43:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.757+0000 7f1117778640 1 -- 172.21.15.92:0/3727158241 shutdown_connections 2024-09-10T10:43:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.757+0000 7f1117778640 1 --2- 172.21.15.92:0/3727158241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1110101a70 0x7f111010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.757+0000 7f1117778640 1 --2- 172.21.15.92:0/3727158241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11101010f0 0x7f1110101530 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.757+0000 7f1117778640 1 --2- 172.21.15.92:0/3727158241 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11101028d0 0x7f1110102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.757+0000 7f1117778640 1 -- 172.21.15.92:0/3727158241 >> 172.21.15.92:0/3727158241 conn(0x7f11100770f0 msgr2=0x7f11100fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.758+0000 7f1117778640 1 -- 172.21.15.92:0/3727158241 shutdown_connections 2024-09-10T10:43:42.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.758+0000 7f1117778640 1 -- 172.21.15.92:0/3727158241 wait complete. 2024-09-10T10:43:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.759+0000 7f1117778640 1 Processor -- start 2024-09-10T10:43:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.759+0000 7f1117778640 1 -- start start 2024-09-10T10:43:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.760+0000 7f1117778640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11101010f0 0x7f111019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.760+0000 7f1117778640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1110101a70 0x7f111019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.760+0000 7f1117778640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11101028d0 0x7f111019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.760+0000 7f1115514640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11101010f0 0x7f111019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.760+0000 7f1115514640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11101010f0 0x7f111019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40526/0 (socket says 172.21.15.92:40526) 2024-09-10T10:43:42.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1115514640 1 -- 172.21.15.92:0/2782843178 learned_addr learned my addr 172.21.15.92:0/2782843178 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1114d13640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1110101a70 0x7f111019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1115d15640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11101028d0 0x7f111019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11101141c0 con 0x7f11101010f0 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1110114040 con 0x7f11101028d0 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1110114340 con 0x7f1110101a70 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1115d15640 1 -- 172.21.15.92:0/2782843178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1110101a70 msgr2=0x7f111019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1115d15640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1110101a70 0x7f111019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1115d15640 1 -- 172.21.15.92:0/2782843178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11101010f0 msgr2=0x7f111019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1115d15640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11101010f0 0x7f111019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1115d15640 1 -- 172.21.15.92:0/2782843178 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111019f4d0 con 0x7f11101028d0 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.761+0000 7f1114d13640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1110101a70 0x7f111019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:43:42.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.762+0000 7f1115d15640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11101028d0 0x7f111019eda0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1108009fd0 tx=0x7f110800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.762+0000 7f11067fc640 1 -- 172.21.15.92:0/2782843178 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110800ce20 con 0x7f11101028d0 2024-09-10T10:43:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.762+0000 7f11067fc640 1 -- 172.21.15.92:0/2782843178 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1108005020 con 0x7f11101028d0 2024-09-10T10:43:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.762+0000 7f11067fc640 1 -- 172.21.15.92:0/2782843178 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1108010720 con 0x7f11101028d0 2024-09-10T10:43:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.762+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111019f7c0 con 0x7f11101028d0 2024-09-10T10:43:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.762+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11101a7050 con 0x7f11101028d0 2024-09-10T10:43:42.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.765+0000 7f111a5f1740 1 Processor -- start 2024-09-10T10:43:42.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.765+0000 7f11067fc640 1 -- 172.21.15.92:0/2782843178 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1108005540 con 0x7f11101028d0 2024-09-10T10:43:42.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f111a5f1740 1 -- start start 2024-09-10T10:43:42.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831f300 0x559e8831f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831fc20 0x559e88329f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8832a4c0 0x559e8832c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f111a5f1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559e8827b2f0 con 0x559e8831fc20 2024-09-10T10:43:42.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f111a5f1740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559e88223270 con 0x559e8831f300 2024-09-10T10:43:42.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f111a5f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559e882772b0 con 0x559e8832a4c0 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f1114d13640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831f300 0x559e8831f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f1115514640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831fc20 0x559e88329f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f1114d13640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831f300 0x559e8831f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:49940/0 (socket says 172.21.15.92:49940) 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.766+0000 7f1114d13640 1 -- 172.21.15.92:0/3247151713 learned_addr learned my addr 172.21.15.92:0/3247151713 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f1114d13640 1 --2- 172.21.15.92:0/3247151713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8832a4c0 0x559e8832c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f1115514640 1 -- 172.21.15.92:0/3247151713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8832a4c0 msgr2=0x559e8832c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f1115514640 1 --2- 172.21.15.92:0/3247151713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8832a4c0 0x559e8832c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f1115514640 1 -- 172.21.15.92:0/3247151713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831f300 msgr2=0x559e8831f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f1115514640 1 --2- 172.21.15.92:0/3247151713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831f300 0x559e8831f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f1115514640 1 -- 172.21.15.92:0/3247151713 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e88222340 con 0x559e8831fc20 2024-09-10T10:43:42.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f11067fc640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f10fc0a2ea0 0x7f10fc0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f1114d13640 1 --2- 172.21.15.92:0/3247151713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8832a4c0 0x559e8832c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:43:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f1115514640 1 --2- 172.21.15.92:0/3247151713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831fc20 0x559e88329f80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f110c00bc90 tx=0x7f110c00b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a69d7a6cbf32805 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f1114d13640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f10fc0a2ea0 0x7f10fc0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f11067fc640 1 -- 172.21.15.92:0/2782843178 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7f11080cfaf0 con 0x7f11101028d0 2024-09-10T10:43:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f10fb7fe640 1 -- 172.21.15.92:0/3247151713 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c004250 con 0x559e8831fc20 2024-09-10T10:43:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.767+0000 7f10fb7fe640 1 -- 172.21.15.92:0/3247151713 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f110c01a070 con 0x559e8831fc20 2024-09-10T10:43:42.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.768+0000 7f10fb7fe640 1 -- 172.21.15.92:0/3247151713 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c015660 con 0x559e8831fc20 2024-09-10T10:43:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.768+0000 7f111a5f1740 1 -- 172.21.15.92:0/3247151713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831fc20 msgr2=0x559e88329f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.768+0000 7f111a5f1740 1 --2- 172.21.15.92:0/3247151713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831fc20 0x559e88329f80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f110c00bc90 tx=0x7f110c00b500 comp rx=0 tx=0).stop 2024-09-10T10:43:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.769+0000 7f1114d13640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f10fc0a2ea0 0x7f10fc0a5360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x559e8831cbf0 tx=0x7f1100005730 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.769+0000 7f111a5f1740 1 -- 172.21.15.92:0/3247151713 shutdown_connections 2024-09-10T10:43:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.769+0000 7f111a5f1740 1 --2- 172.21.15.92:0/3247151713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8832a4c0 0x559e8832c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.769+0000 7f111a5f1740 1 --2- 172.21.15.92:0/3247151713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831fc20 0x559e88329f80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.769+0000 7f111a5f1740 1 --2- 172.21.15.92:0/3247151713 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831f300 0x559e8831f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.769+0000 7f111a5f1740 1 -- 172.21.15.92:0/3247151713 >> 172.21.15.92:0/3247151713 conn(0x559e8831b870 msgr2=0x559e8831bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.770+0000 7f111a5f1740 1 -- 172.21.15.92:0/3247151713 shutdown_connections 2024-09-10T10:43:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.770+0000 7f111a5f1740 1 -- 172.21.15.92:0/3247151713 wait complete. 2024-09-10T10:43:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.770+0000 7f111a5f1740 1 -- start start 2024-09-10T10:43:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.770+0000 7f111a5f1740 1 Processor -- start 2024-09-10T10:43:42.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.771+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831f300 0x559e883272b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.771+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831fc20 0x559e883277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.771+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 0x559e88327d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.771+0000 7f111a5f1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559e8832d0e0 con 0x559e8832a4c0 2024-09-10T10:43:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.771+0000 7f111a5f1740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x559e88204290 con 0x559e8831fc20 2024-09-10T10:43:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.771+0000 7f111a5f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559e8832d260 con 0x559e8831f300 2024-09-10T10:43:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.771+0000 7f111a5f1740 10 client.0 _ll_register_callbacks cb 0x559e88235140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.771+0000 7f1115514640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831f300 0x559e883272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f1115514640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831f300 0x559e883272b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:45280/0 (socket says 172.21.15.92:45280) 2024-09-10T10:43:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f1115514640 1 -- 172.21.15.92:0/12585379 learned_addr learned my addr 172.21.15.92:0/12585379 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f1114d13640 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831fc20 0x559e883277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f1115514640 1 -- 172.21.15.92:0/12585379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831fc20 msgr2=0x559e883277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f1115514640 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831fc20 0x559e883277f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f1115514640 1 -- 172.21.15.92:0/12585379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 msgr2=0x559e88327d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f1115514640 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 0x559e88327d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f1115514640 1 -- 172.21.15.92:0/12585379 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e87f8e210 con 0x559e8831f300 2024-09-10T10:43:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f1115514640 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831f300 0x559e883272b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f110c003e30 tx=0x7f110c003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa0aaf1f1eb63792 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f10f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f10f8ff9640 1 -- 172.21.15.92:0/12585379 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c005270 con 0x559e8831f300 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f111a5f1740 1 -- 172.21.15.92:0/12585379 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f110c01a070 con 0x559e8831f300 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.772+0000 7f10f8ff9640 1 -- 172.21.15.92:0/12585379 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7f110c005410 con 0x559e8831f300 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f10f8ff9640 1 -- 172.21.15.92:0/12585379 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f110c005610 con 0x559e8831f300 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f111a5f1740 10 client.25399 fetch_fsmap learned FSMap version 50 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f111a5f1740 1 -- 172.21.15.92:0/12585379 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559e8805a620 con 0x559e8831f300 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f10f8ff9640 1 -- 172.21.15.92:0/12585379 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f110c01a070 con 0x559e8831f300 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f10f8ff9640 1 -- 172.21.15.92:0/12585379 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f110c032670 con 0x559e8831f300 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f111a5f1740 10 client.25399 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f111a5f1740 10 client.25399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:42.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f111a5f1740 20 client.25399 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:42.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f111a5f1740 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559e8834b700 0x559e8834db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f111a5f1740 4 client.25399 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:43:42.782 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.773+0000 7f111a5f1740 1 -- 172.21.15.92:0/12585379 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e88288a20 con 0x559e8834b700 2024-09-10T10:43:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.775+0000 7f1114d13640 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559e8834b700 0x559e8834db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.775+0000 7f1114d13640 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559e8834b700 0x559e8834db90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faa2cf07430481e5 server_cookie=b1fb0b866979ec22 in_seq=0 out_seq=0 2024-09-10T10:43:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.775+0000 7f10f8ff9640 10 client.25399 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.776+0000 7f10f8ff9640 1 -- 172.21.15.92:0/12585379 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e88288a20 con 0x559e8834b700 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.776+0000 7f10f8ff9640 10 client.25399 handle_command_reply: tid=0 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.776+0000 7f111a5f1740 1 client.25399 shutdown 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f111a5f1740 1 -- 172.21.15.92:0/12585379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831f300 msgr2=0x559e883272b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f111a5f1740 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831f300 0x559e883272b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f110c003e30 tx=0x7f110c003820 comp rx=0 tx=0).stop 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f111a5f1740 1 -- 172.21.15.92:0/12585379 shutdown_connections 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f111a5f1740 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 0x559e88327d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f111a5f1740 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559e8834b700 0x559e8834db90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f111a5f1740 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8831fc20 0x559e883277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f111a5f1740 1 --2- 172.21.15.92:0/12585379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831f300 0x559e883272b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f111a5f1740 1 -- 172.21.15.92:0/12585379 >> 172.21.15.92:0/12585379 conn(0x559e8831b870 msgr2=0x559e883215d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f10f8ff9640 0 client.25399 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.777+0000 7f111a5f1740 1 -- 172.21.15.92:0/12585379 shutdown_connections 2024-09-10T10:43:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.778+0000 7f111a5f1740 1 -- 172.21.15.92:0/12585379 wait complete. 2024-09-10T10:43:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.778+0000 7f111a5f1740 20 client.25399 trim_cache size 0 max 16384 2024-09-10T10:43:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f111a5f1740 1 Processor -- start 2024-09-10T10:43:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f111a5f1740 1 -- start start 2024-09-10T10:43:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831f300 0x559e883120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 0x559e883534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8832a4c0 0x559e883539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f111a5f1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f111006fee0 con 0x559e8831f300 2024-09-10T10:43:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f111a5f1740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1110071ab0 con 0x559e8832a4c0 2024-09-10T10:43:42.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f111a5f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11100705b0 con 0x559e8831fc20 2024-09-10T10:43:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1115514640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831f300 0x559e883120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1115514640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831f300 0x559e883120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40566/0 (socket says 172.21.15.92:40566) 2024-09-10T10:43:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1114d13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 0x559e883534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1115514640 1 -- 172.21.15.92:0/1189262936 learned_addr learned my addr 172.21.15.92:0/1189262936 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1115d15640 1 --2- 172.21.15.92:0/1189262936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8832a4c0 0x559e883539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1115514640 1 -- 172.21.15.92:0/1189262936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 msgr2=0x559e883534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1115514640 1 --2- 172.21.15.92:0/1189262936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 0x559e883534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1115514640 1 -- 172.21.15.92:0/1189262936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8832a4c0 msgr2=0x559e883539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:42.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1115514640 1 --2- 172.21.15.92:0/1189262936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8832a4c0 0x559e883539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.799+0000 7f1115514640 1 -- 172.21.15.92:0/1189262936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e8831b6a0 con 0x559e8831f300 2024-09-10T10:43:42.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.800+0000 7f1115514640 1 --2- 172.21.15.92:0/1189262936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831f300 0x559e883120b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f110c006010 tx=0x7f110c00b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58a12c5c187d8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:42.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.800+0000 7f10faffd640 1 -- 172.21.15.92:0/1189262936 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c003c20 con 0x559e8831f300 2024-09-10T10:43:42.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.800+0000 7f10faffd640 1 -- 172.21.15.92:0/1189262936 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f110c01a040 con 0x559e8831f300 2024-09-10T10:43:42.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.800+0000 7f10faffd640 1 -- 172.21.15.92:0/1189262936 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c005000 con 0x559e8831f300 2024-09-10T10:43:42.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.802+0000 7f111a5f1740 1 -- 172.21.15.92:0/1189262936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831f300 msgr2=0x559e883120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:42.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.802+0000 7f111a5f1740 1 --2- 172.21.15.92:0/1189262936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831f300 0x559e883120b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f110c006010 tx=0x7f110c00b500 comp rx=0 tx=0).stop 2024-09-10T10:43:42.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.803+0000 7f111a5f1740 1 -- 172.21.15.92:0/1189262936 shutdown_connections 2024-09-10T10:43:42.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.803+0000 7f111a5f1740 1 --2- 172.21.15.92:0/1189262936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e8832a4c0 0x559e883539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.803+0000 7f111a5f1740 1 --2- 172.21.15.92:0/1189262936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 0x559e883534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.803+0000 7f111a5f1740 1 --2- 172.21.15.92:0/1189262936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8831f300 0x559e883120b0 secure :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f110c006010 tx=0x7f110c00b500 comp rx=0 tx=0).stop 2024-09-10T10:43:42.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.803+0000 7f111a5f1740 1 -- 172.21.15.92:0/1189262936 >> 172.21.15.92:0/1189262936 conn(0x559e8831b870 msgr2=0x559e883119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:42.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.816+0000 7f111a5f1740 1 -- 172.21.15.92:0/1189262936 shutdown_connections 2024-09-10T10:43:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.821+0000 7f111a5f1740 1 -- 172.21.15.92:0/1189262936 wait complete. 2024-09-10T10:43:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.821+0000 7f111a5f1740 1 -- start start 2024-09-10T10:43:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.821+0000 7f111a5f1740 1 Processor -- start 2024-09-10T10:43:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.826+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 0x559e88324d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.826+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 0x559e88332550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.826+0000 7f111a5f1740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e88332a90 0x559e883237d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.826+0000 7f111a5f1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11100713e0 con 0x559e8832a4c0 2024-09-10T10:43:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.826+0000 7f111a5f1740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1110070d10 con 0x559e88332a90 2024-09-10T10:43:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.826+0000 7f111a5f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f111006df00 con 0x559e8831fc20 2024-09-10T10:43:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.826+0000 7f111a5f1740 10 client.0 _ll_register_callbacks cb 0x7f110c00bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:42.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.827+0000 7f1114d13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 0x559e88332550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.827+0000 7f1114d13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 0x559e88332550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40578/0 (socket says 172.21.15.92:40578) 2024-09-10T10:43:42.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.827+0000 7f1114d13640 1 -- 172.21.15.92:0/804958387 learned_addr learned my addr 172.21.15.92:0/804958387 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:42.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.828+0000 7f1115d15640 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e88332a90 0x559e883237d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.828+0000 7f1115514640 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 0x559e88324d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.829+0000 7f1115d15640 1 -- 172.21.15.92:0/804958387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 msgr2=0x559e88324d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.829+0000 7f1115d15640 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 0x559e88324d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.829+0000 7f1115d15640 1 -- 172.21.15.92:0/804958387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 msgr2=0x559e88332550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.829+0000 7f1115d15640 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 0x559e88332550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.829+0000 7f1115d15640 1 -- 172.21.15.92:0/804958387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e88333070 con 0x559e88332a90 2024-09-10T10:43:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.829+0000 7f1115d15640 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e88332a90 0x559e883237d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11080cd220 tx=0x7f110809c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24089a6ad181ca8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.829+0000 7f10f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:43:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.830+0000 7f10f8ff9640 1 -- 172.21.15.92:0/804958387 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11080b4070 con 0x559e88332a90 2024-09-10T10:43:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.830+0000 7f10f8ff9640 1 -- 172.21.15.92:0/804958387 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7f110809c250 con 0x559e88332a90 2024-09-10T10:43:42.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.830+0000 7f111a5f1740 1 -- 172.21.15.92:0/804958387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f110c01a040 con 0x559e88332a90 2024-09-10T10:43:42.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.831+0000 7f10f8ff9640 1 -- 172.21.15.92:0/804958387 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f110807f050 con 0x559e88332a90 2024-09-10T10:43:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.831+0000 7f111a5f1740 10 client.25370 fetch_fsmap learned FSMap version 50 2024-09-10T10:43:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.831+0000 7f111a5f1740 1 -- 172.21.15.92:0/804958387 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559e88312f40 con 0x559e88332a90 2024-09-10T10:43:42.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.835+0000 7f10f8ff9640 1 -- 172.21.15.92:0/804958387 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f110c01a040 con 0x559e88332a90 2024-09-10T10:43:42.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.836+0000 7f10f8ff9640 1 -- 172.21.15.92:0/804958387 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f11080a47d0 con 0x559e88332a90 2024-09-10T10:43:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.837+0000 7f111a5f1740 10 client.25370 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:43:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.837+0000 7f111a5f1740 10 client.25370 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.837+0000 7f111a5f1740 20 client.25370 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.837+0000 7f111a5f1740 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559e88313660 0x559e88315a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.837+0000 7f111a5f1740 4 client.25370 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:43:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.837+0000 7f111a5f1740 1 -- 172.21.15.92:0/804958387 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559e88282d70 con 0x559e88313660 2024-09-10T10:43:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.837+0000 7f1115514640 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559e88313660 0x559e88315a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.839+0000 7f1115514640 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559e88313660 0x559e88315a50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5e680760861527a server_cookie=400b044ea664b27b in_seq=0 out_seq=0 2024-09-10T10:43:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.839+0000 7f10f8ff9640 10 client.25370 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f10f8ff9640 1 -- 172.21.15.92:0/804958387 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559e88282d70 con 0x559e88313660 2024-09-10T10:43:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f10f8ff9640 10 client.25370 handle_command_reply: tid=0 2024-09-10T10:43:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f111a5f1740 1 client.25370 shutdown 2024-09-10T10:43:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f111a5f1740 1 -- 172.21.15.92:0/804958387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e88332a90 msgr2=0x559e883237d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f111a5f1740 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e88332a90 0x559e883237d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11080cd220 tx=0x7f110809c6f0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f111a5f1740 1 -- 172.21.15.92:0/804958387 shutdown_connections 2024-09-10T10:43:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f111a5f1740 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559e88313660 0x559e88315a50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f111a5f1740 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x559e88332a90 0x559e883237d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f111a5f1740 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559e8832a4c0 0x559e88332550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f10f8ff9640 0 client.25370 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f111a5f1740 1 --2- 172.21.15.92:0/804958387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e8831fc20 0x559e88324d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.854+0000 7f111a5f1740 1 -- 172.21.15.92:0/804958387 >> 172.21.15.92:0/804958387 conn(0x559e8831b870 msgr2=0x559e883121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f111a5f1740 1 -- 172.21.15.92:0/804958387 shutdown_connections 2024-09-10T10:43:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f111a5f1740 1 -- 172.21.15.92:0/804958387 wait complete. 2024-09-10T10:43:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f111a5f1740 20 client.25370 trim_cache size 0 max 16384 2024-09-10T10:43:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:43:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:43:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:43:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:43:42.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f10fc0a2ea0 msgr2=0x7f10fc0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:42.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f10fc0a2ea0 0x7f10fc0a5360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x559e8831cbf0 tx=0x7f1100005730 comp rx=0 tx=0).stop 2024-09-10T10:43:42.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11101028d0 msgr2=0x7f111019eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:42.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11101028d0 0x7f111019eda0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1108009fd0 tx=0x7f110800ef10 comp rx=0 tx=0).stop 2024-09-10T10:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 shutdown_connections 2024-09-10T10:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f10fc0a2ea0 0x7f10fc0a5360 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11101028d0 0x7f111019eda0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1110101a70 0x7f111019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 --2- 172.21.15.92:0/2782843178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11101010f0 0x7f111019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 >> 172.21.15.92:0/2782843178 conn(0x7f11100770f0 msgr2=0x7f1110104880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.855+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 shutdown_connections 2024-09-10T10:43:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:42.856+0000 7f1117778640 1 -- 172.21.15.92:0/2782843178 wait complete. 2024-09-10T10:43:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 405.0 s, 2621.6 tps, lat 38.405 ms stddev 41.300 2024-09-10T10:43:43.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:43 smithi092 ceph-mon[30834]: pgmap v218: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 1.22k op/s 2024-09-10T10:43:43.871 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:43 smithi097 ceph-mon[35213]: pgmap v218: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 1.22k op/s 2024-09-10T10:43:44.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:43 smithi121 ceph-mon[35231]: pgmap v218: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 1.22k op/s 2024-09-10T10:43:45.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:45 smithi092 ceph-mon[30834]: pgmap v219: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 1.22k op/s 2024-09-10T10:43:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:45 smithi121 ceph-mon[35231]: pgmap v219: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 1.22k op/s 2024-09-10T10:43:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:45 smithi097 ceph-mon[35213]: pgmap v219: 97 pgs: 97 active+clean; 4.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 1.22k op/s 2024-09-10T10:43:47.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:47 smithi092 ceph-mon[30834]: pgmap v220: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 18 MiB/s wr, 1.52k op/s 2024-09-10T10:43:47.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:47 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:43:48.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:47 smithi121 ceph-mon[35231]: pgmap v220: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 18 MiB/s wr, 1.52k op/s 2024-09-10T10:43:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:47 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:43:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:47 smithi097 ceph-mon[35213]: pgmap v220: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 18 MiB/s wr, 1.52k op/s 2024-09-10T10:43:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:47 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:43:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 410.0 s, 2775.0 tps, lat 35.881 ms stddev 50.007 2024-09-10T10:43:48.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:48 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:43:48.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:48 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:43:48.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:48 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:43:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:48 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:43:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:48 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:43:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:48 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:43:49.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:48 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:43:49.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:48 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:43:49.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:48 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:43:50.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:49 smithi121 ceph-mon[35231]: pgmap v221: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 603 op/s 2024-09-10T10:43:50.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:49 smithi097 ceph-mon[35213]: pgmap v221: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 603 op/s 2024-09-10T10:43:50.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:49 smithi092 ceph-mon[30834]: pgmap v221: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 603 op/s 2024-09-10T10:43:52.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:51 smithi121 ceph-mon[35231]: pgmap v222: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 896 op/s 2024-09-10T10:43:52.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:51 smithi097 ceph-mon[35213]: pgmap v222: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 896 op/s 2024-09-10T10:43:52.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:51 smithi092 ceph-mon[30834]: pgmap v222: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 896 op/s 2024-09-10T10:43:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 415.0 s, 2826.8 tps, lat 35.303 ms stddev 41.400 2024-09-10T10:43:54.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:53 smithi121 ceph-mon[35231]: pgmap v223: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 593 op/s 2024-09-10T10:43:54.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:53 smithi097 ceph-mon[35213]: pgmap v223: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 593 op/s 2024-09-10T10:43:54.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:53 smithi092 ceph-mon[30834]: pgmap v223: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 593 op/s 2024-09-10T10:43:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.990+0000 7fc3b0453640 1 -- 172.21.15.92:0/1823680820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 msgr2=0x7fc3a81030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.990+0000 7fc3b0453640 1 --2- 172.21.15.92:0/1823680820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 0x7fc3a81030e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009900 tx=0x7fc3a402a4d0 comp rx=0 tx=0).stop 2024-09-10T10:43:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.990+0000 7fc3b0453640 1 -- 172.21.15.92:0/1823680820 shutdown_connections 2024-09-10T10:43:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.990+0000 7fc3b0453640 1 --2- 172.21.15.92:0/1823680820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3a810c0d0 0x7fc3a810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.990+0000 7fc3b0453640 1 --2- 172.21.15.92:0/1823680820 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3a8103620 0x7fc3a810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.990+0000 7fc3b0453640 1 --2- 172.21.15.92:0/1823680820 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 0x7fc3a81030e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.990+0000 7fc3b0453640 1 -- 172.21.15.92:0/1823680820 >> 172.21.15.92:0/1823680820 conn(0x7fc3a8077990 msgr2=0x7fc3a80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.990+0000 7fc3b0453640 1 -- 172.21.15.92:0/1823680820 shutdown_connections 2024-09-10T10:43:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.990+0000 7fc3b0453640 1 -- 172.21.15.92:0/1823680820 wait complete. 2024-09-10T10:43:55.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.991+0000 7fc3b0453640 1 Processor -- start 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.991+0000 7fc3b0453640 1 -- start start 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.991+0000 7fc3b0453640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 0x7fc3a819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.991+0000 7fc3b0453640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3a8103620 0x7fc3a819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.991+0000 7fc3b0453640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3a810c0d0 0x7fc3a819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3b0453640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8101a80 con 0x7fc3a8103620 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3b0453640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8101900 con 0x7fc3a810c0d0 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3b0453640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8101c00 con 0x7fc3a8102d00 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae1ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 0x7fc3a819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae1ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 0x7fc3a819a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:56686/0 (socket says 172.21.15.92:56686) 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/2288770364 learned_addr learned my addr 172.21.15.92:0/2288770364 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:55.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3a8103620 0x7fc3a819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae9f0640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3a810c0d0 0x7fc3a819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/2288770364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3a810c0d0 msgr2=0x7fc3a819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3a810c0d0 0x7fc3a819ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3a8103620 msgr2=0x7fc3a819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3a8103620 0x7fc3a819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/2288770364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a819f6c0 con 0x7fc3a8102d00 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 0x7fc3a819a6d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4005ab0 tx=0x7fc3a40042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc39f7fe640 1 -- 172.21.15.92:0/2288770364 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a403f030 con 0x7fc3a8102d00 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc39f7fe640 1 -- 172.21.15.92:0/2288770364 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a4003ce0 con 0x7fc3a8102d00 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3b0453640 1 -- 172.21.15.92:0/2288770364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a819f950 con 0x7fc3a8102d00 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc39f7fe640 1 -- 172.21.15.92:0/2288770364 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4035070 con 0x7fc3a8102d00 2024-09-10T10:43:55.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.992+0000 7fc3b0453640 1 -- 172.21.15.92:0/2288770364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a81a7240 con 0x7fc3a8102d00 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.995+0000 7fc39f7fe640 1 -- 172.21.15.92:0/2288770364 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc3a4042030 con 0x7fc3a8102d00 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.995+0000 7fc3b31ea740 1 Processor -- start 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.995+0000 7fc3b31ea740 1 -- start start 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51baf0 0x55973e51bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51c410 0x55973e526770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 0x55973e5290a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3b31ea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55973e4802f0 con 0x55973e51baf0 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3b31ea740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55973e428270 con 0x55973e51c410 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3b31ea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55973e47c2b0 con 0x55973e526cb0 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ae9f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51baf0 0x55973e51bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:55.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ae1ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51c410 0x55973e526770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ae9f0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51baf0 0x55973e51bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36180/0 (socket says 172.21.15.92:36180) 2024-09-10T10:43:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ae9f0640 1 -- 172.21.15.92:0/189153027 learned_addr learned my addr 172.21.15.92:0/189153027 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/189153027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 0x55973e5290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:55.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/189153027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 msgr2=0x55973e5290a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/189153027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 0x55973e5290a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/189153027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51baf0 msgr2=0x55973e51bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/189153027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51baf0 0x55973e51bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/189153027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55973e427340 con 0x55973e51c410 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.996+0000 7fc39f7fe640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc3940a2da0 0x7fc3940a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.997+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/189153027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51c410 0x55973e526770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40ed0c0 tx=0x7fc3a40f5c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a9347ed8c9955d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.997+0000 7fc39cbfe640 1 -- 172.21.15.92:0/189153027 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4049030 con 0x55973e51c410 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.997+0000 7fc39cbfe640 1 -- 172.21.15.92:0/189153027 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a40bbf40 con 0x55973e51c410 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.997+0000 7fc39cbfe640 1 -- 172.21.15.92:0/189153027 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40bbd10 con 0x55973e51c410 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.997+0000 7fc3ae9f0640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc3940a2da0 0x7fc3940a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.997+0000 7fc39f7fe640 1 -- 172.21.15.92:0/2288770364 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7fc3a40ef990 con 0x7fc3a8102d00 2024-09-10T10:43:55.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:55.998+0000 7fc3ae9f0640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc3940a2da0 0x7fc3940a5260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009420 tx=0x7fc3a000d040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.000+0000 7fc3b31ea740 1 -- 172.21.15.92:0/189153027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51c410 msgr2=0x55973e526770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.000+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/189153027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51c410 0x55973e526770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40ed0c0 tx=0x7fc3a40f5c20 comp rx=0 tx=0).stop 2024-09-10T10:43:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.000+0000 7fc3b31ea740 1 -- 172.21.15.92:0/189153027 shutdown_connections 2024-09-10T10:43:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.000+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/189153027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 0x55973e5290a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.000+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/189153027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51c410 0x55973e526770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.000+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/189153027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51baf0 0x55973e51bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.000+0000 7fc3b31ea740 1 -- 172.21.15.92:0/189153027 >> 172.21.15.92:0/189153027 conn(0x55973e518060 msgr2=0x55973e518440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.000+0000 7fc3b31ea740 1 -- 172.21.15.92:0/189153027 shutdown_connections 2024-09-10T10:43:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.000+0000 7fc3b31ea740 1 -- 172.21.15.92:0/189153027 wait complete. 2024-09-10T10:43:56.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3b31ea740 1 -- start start 2024-09-10T10:43:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3b31ea740 1 Processor -- start 2024-09-10T10:43:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51baf0 0x55973e523c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e524180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e526cb0 0x55973e5246c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3b31ea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55973e529640 con 0x55973e51c410 2024-09-10T10:43:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3b31ea740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55973e409290 con 0x55973e526cb0 2024-09-10T10:43:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3b31ea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55973e5297c0 con 0x55973e51baf0 2024-09-10T10:43:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3b31ea740 10 client.0 _ll_register_callbacks cb 0x55973e43a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3ad9ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e524180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3ad9ee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e524180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36188/0 (socket says 172.21.15.92:36188) 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3ad9ee640 1 -- 172.21.15.92:0/1237854653 learned_addr learned my addr 172.21.15.92:0/1237854653 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3ae9f0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e526cb0 0x55973e5246c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.001+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51baf0 0x55973e523c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3ad9ee640 1 -- 172.21.15.92:0/1237854653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51baf0 msgr2=0x55973e523c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51baf0 0x55973e523c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3ad9ee640 1 -- 172.21.15.92:0/1237854653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e526cb0 msgr2=0x55973e5246c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e526cb0 0x55973e5246c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3ad9ee640 1 -- 172.21.15.92:0/1237854653 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55973e193210 con 0x55973e51c410 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3ae9f0640 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e526cb0 0x55973e5246c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:43:56.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e524180 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc398011570 tx=0x7fc398011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2608962365479f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc391ffb640 1 -- 172.21.15.92:0/1237854653 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398013670 con 0x55973e51c410 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1237854653 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3a40bbf40 con 0x55973e51c410 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc391ffb640 1 -- 172.21.15.92:0/1237854653 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7fc398013810 con 0x55973e51c410 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc391ffb640 1 -- 172.21.15.92:0/1237854653 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fc398013a50 con 0x55973e51c410 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3b31ea740 10 client.15876 fetch_fsmap learned FSMap version 50 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1237854653 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55973e25f620 con 0x55973e51c410 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.002+0000 7fc391ffb640 1 -- 172.21.15.92:0/1237854653 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a40bbf40 con 0x55973e51c410 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc391ffb640 1 -- 172.21.15.92:0/1237854653 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7fc39801d400 con 0x55973e51c410 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc3b31ea740 10 client.15876 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc3b31ea740 10 client.15876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc3b31ea740 20 client.15876 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55973e536a40 0x55973e538e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc3b31ea740 4 client.15876 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1237854653 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55973e48da20 con 0x55973e536a40 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55973e536a40 0x55973e538e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc391ffb640 10 client.15876 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.003+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55973e536a40 0x55973e538e30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13dabfa72d4e314a server_cookie=fd34f6accb8daadf in_seq=0 out_seq=0 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc391ffb640 1 -- 172.21.15.92:0/1237854653 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55973e48da20 con 0x55973e536a40 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc391ffb640 10 client.15876 handle_command_reply: tid=0 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 client.15876 shutdown 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1237854653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 msgr2=0x55973e524180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e524180 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc398011570 tx=0x7fc398011a30 comp rx=0 tx=0).stop 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1237854653 shutdown_connections 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55973e536a40 0x55973e538e30 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e526cb0 0x55973e5246c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc391ffb640 0 client.15876 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e524180 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1237854653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51baf0 0x55973e523c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1237854653 >> 172.21.15.92:0/1237854653 conn(0x55973e518060 msgr2=0x55973e51ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1237854653 shutdown_connections 2024-09-10T10:43:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1237854653 wait complete. 2024-09-10T10:43:56.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.004+0000 7fc3b31ea740 20 client.15876 trim_cache size 0 max 16384 2024-09-10T10:43:56.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.025+0000 7fc3b31ea740 1 Processor -- start 2024-09-10T10:43:56.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.025+0000 7fc3b31ea740 1 -- start start 2024-09-10T10:43:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.025+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e51e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.025+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51c410 0x55973e5244f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.025+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e526cb0 0x55973e53e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.025+0000 7fc3b31ea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81af8e0 con 0x55973e526cb0 2024-09-10T10:43:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.025+0000 7fc3ae1ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e51e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.025+0000 7fc3ae1ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e51e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:52984/0 (socket says 172.21.15.92:52984) 2024-09-10T10:43:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/1286401794 learned_addr learned my addr 172.21.15.92:0/1286401794 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:56.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51c410 0x55973e5244f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ae9f0640 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e526cb0 0x55973e53e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1286401794 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81b14b0 con 0x55973e51baf0 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1286401794 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81affb0 con 0x55973e51c410 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/1286401794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51c410 msgr2=0x55973e5244f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51c410 0x55973e5244f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/1286401794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e526cb0 msgr2=0x55973e53e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e526cb0 0x55973e53e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/1286401794 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55973e5391a0 con 0x55973e51baf0 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51c410 0x55973e5244f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ae9f0640 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e526cb0 0x55973e53e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e51e5b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4006010 tx=0x7fc3a4009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de6047f20ca95831 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc393fff640 1 -- 172.21.15.92:0/1286401794 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4049040 con 0x55973e51baf0 2024-09-10T10:43:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc393fff640 1 -- 172.21.15.92:0/1286401794 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a40c0240 con 0x55973e51baf0 2024-09-10T10:43:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.026+0000 7fc393fff640 1 -- 172.21.15.92:0/1286401794 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40bb8a0 con 0x55973e51baf0 2024-09-10T10:43:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.028+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1286401794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 msgr2=0x55973e51e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.028+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e51e5b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4006010 tx=0x7fc3a4009560 comp rx=0 tx=0).stop 2024-09-10T10:43:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.028+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1286401794 shutdown_connections 2024-09-10T10:43:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.028+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e526cb0 0x55973e53e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.028+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e51c410 0x55973e5244f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.028+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/1286401794 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e51e5b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.028+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1286401794 >> 172.21.15.92:0/1286401794 conn(0x55973e518060 msgr2=0x55973e525cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.029+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1286401794 shutdown_connections 2024-09-10T10:43:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.029+0000 7fc3b31ea740 1 -- 172.21.15.92:0/1286401794 wait complete. 2024-09-10T10:43:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.030+0000 7fc3b31ea740 1 -- start start 2024-09-10T10:43:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.030+0000 7fc3b31ea740 1 Processor -- start 2024-09-10T10:43:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.030+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e52ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.030+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e52f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.030+0000 7fc3b31ea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 0x55973e520490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ae1ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e52ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ae1ef640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e52ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:52986/0 (socket says 172.21.15.92:52986) 2024-09-10T10:43:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ae1ef640 1 -- 172.21.15.92:0/439739322 learned_addr learned my addr 172.21.15.92:0/439739322 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:43:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81b0de0 con 0x55973e51c410 2024-09-10T10:43:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81b0710 con 0x55973e51baf0 2024-09-10T10:43:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81ad8e0 con 0x55973e526cb0 2024-09-10T10:43:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e52f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3b31ea740 10 client.0 _ll_register_callbacks cb 0x7fc398009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:43:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ae9f0640 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 0x55973e520490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ad9ee640 1 -- 172.21.15.92:0/439739322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 msgr2=0x55973e520490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 0x55973e520490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ad9ee640 1 -- 172.21.15.92:0/439739322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 msgr2=0x55973e52ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:43:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e52ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ad9ee640 1 -- 172.21.15.92:0/439739322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55973e520c90 con 0x55973e51c410 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ae9f0640 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 0x55973e520490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e52ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc3ad9ee640 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e52f1b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc398009fd0 tx=0x7fc398009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efaf48c1fb0609c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.031+0000 7fc391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc391ffb640 1 -- 172.21.15.92:0/439739322 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398033060 con 0x55973e51c410 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc391ffb640 1 -- 172.21.15.92:0/439739322 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8455+0+0 (secure 0 0 0) 0x7fc398013670 con 0x55973e51c410 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3a40c0240 con 0x55973e51c410 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc391ffb640 1 -- 172.21.15.92:0/439739322 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fc39801de60 con 0x55973e51c410 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3b31ea740 10 client.15882 fetch_fsmap learned FSMap version 50 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55973e5a9a10 con 0x55973e51c410 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc391ffb640 1 -- 172.21.15.92:0/439739322 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a40c0240 con 0x55973e51c410 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc391ffb640 1 -- 172.21.15.92:0/439739322 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7fc398013cf0 con 0x55973e51c410 2024-09-10T10:43:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3b31ea740 10 client.15882 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:43:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3b31ea740 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:43:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3b31ea740 20 client.15882 populate_metadata read hostname 'smithi092' 2024-09-10T10:43:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55973e5aa130 0x55973e5ac550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:43:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3b31ea740 4 client.15882 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:43:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55973e487d70 con 0x55973e5aa130 2024-09-10T10:43:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.032+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55973e5aa130 0x55973e5ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:43:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.033+0000 7fc391ffb640 10 client.15882 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.033+0000 7fc3ae1ef640 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55973e5aa130 0x55973e5ac550 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=226b35084f2112ea server_cookie=80919bf6ace8882d in_seq=0 out_seq=0 2024-09-10T10:43:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc391ffb640 1 -- 172.21.15.92:0/439739322 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55973e487d70 con 0x55973e5aa130 2024-09-10T10:43:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc391ffb640 10 client.15882 handle_command_reply: tid=0 2024-09-10T10:43:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 client.15882 shutdown 2024-09-10T10:43:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 msgr2=0x55973e52f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:56.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e52f1b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc398009fd0 tx=0x7fc398009ea0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 shutdown_connections 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55973e526cb0 0x55973e520490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55973e51c410 0x55973e52f1b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55973e5aa130 0x55973e5ac550 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 --2- 172.21.15.92:0/439739322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55973e51baf0 0x55973e52ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 >> 172.21.15.92:0/439739322 conn(0x55973e518060 msgr2=0x55973e5169a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc391ffb640 0 client.15882 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 shutdown_connections 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 1 -- 172.21.15.92:0/439739322 wait complete. 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.043+0000 7fc3b31ea740 20 client.15882 trim_cache size 0 max 16384 2024-09-10T10:43:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:43:56.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:43:56.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:43:56.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:43:56.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.046+0000 7fc3b0453640 1 -- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc3940a2da0 msgr2=0x7fc3940a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:56.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.046+0000 7fc3b0453640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc3940a2da0 0x7fc3940a5260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009420 tx=0x7fc3a000d040 comp rx=0 tx=0).stop 2024-09-10T10:43:56.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 -- 172.21.15.92:0/2288770364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 msgr2=0x7fc3a819a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:43:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 0x7fc3a819a6d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4005ab0 tx=0x7fc3a40042f0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 -- 172.21.15.92:0/2288770364 shutdown_connections 2024-09-10T10:43:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc3940a2da0 0x7fc3940a5260 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc3a810c0d0 0x7fc3a819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3a8103620 0x7fc3a819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 --2- 172.21.15.92:0/2288770364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3a8102d00 0x7fc3a819a6d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:43:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 -- 172.21.15.92:0/2288770364 >> 172.21.15.92:0/2288770364 conn(0x7fc3a8077990 msgr2=0x7fc3a80fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:43:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 -- 172.21.15.92:0/2288770364 shutdown_connections 2024-09-10T10:43:56.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:43:56.047+0000 7fc3b0453640 1 -- 172.21.15.92:0/2288770364 wait complete. 2024-09-10T10:43:56.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:55 smithi121 ceph-mon[35231]: pgmap v224: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 593 op/s 2024-09-10T10:43:56.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:55 smithi097 ceph-mon[35213]: pgmap v224: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 593 op/s 2024-09-10T10:43:56.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:55 smithi092 ceph-mon[30834]: pgmap v224: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 593 op/s 2024-09-10T10:43:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 420.0 s, 3025.0 tps, lat 32.999 ms stddev 36.485 2024-09-10T10:43:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:57 smithi121 ceph-mon[35231]: pgmap v225: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 885 op/s 2024-09-10T10:43:58.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:57 smithi097 ceph-mon[35213]: pgmap v225: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 885 op/s 2024-09-10T10:43:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:57 smithi092 ceph-mon[30834]: pgmap v225: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 885 op/s 2024-09-10T10:44:00.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:43:59 smithi121 ceph-mon[35231]: pgmap v226: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.3 MiB/s wr, 584 op/s 2024-09-10T10:44:00.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:43:59 smithi097 ceph-mon[35213]: pgmap v226: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.3 MiB/s wr, 584 op/s 2024-09-10T10:44:00.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:43:59 smithi092 ceph-mon[30834]: pgmap v226: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.3 MiB/s wr, 584 op/s 2024-09-10T10:44:02.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:01 smithi121 ceph-mon[35231]: pgmap v227: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 11 MiB/s wr, 884 op/s 2024-09-10T10:44:02.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:01 smithi097 ceph-mon[35213]: pgmap v227: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 11 MiB/s wr, 884 op/s 2024-09-10T10:44:02.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:01 smithi092 ceph-mon[30834]: pgmap v227: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 11 MiB/s wr, 884 op/s 2024-09-10T10:44:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 425.0 s, 1534.8 tps, lat 61.604 ms stddev 117.835 2024-09-10T10:44:04.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:03 smithi121 ceph-mon[35231]: pgmap v228: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 591 op/s 2024-09-10T10:44:04.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:03 smithi097 ceph-mon[35213]: pgmap v228: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 591 op/s 2024-09-10T10:44:04.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:03 smithi092 ceph-mon[30834]: pgmap v228: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 591 op/s 2024-09-10T10:44:06.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:05 smithi121 ceph-mon[35231]: pgmap v229: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 591 op/s 2024-09-10T10:44:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:05 smithi097 ceph-mon[35213]: pgmap v229: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 591 op/s 2024-09-10T10:44:06.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:05 smithi092 ceph-mon[30834]: pgmap v229: 97 pgs: 97 active+clean; 4.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 591 op/s 2024-09-10T10:44:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 430.0 s, 1382.2 tps, lat 76.263 ms stddev 187.543 2024-09-10T10:44:08.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:07 smithi121 ceph-mon[35231]: pgmap v230: 97 pgs: 97 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 1.34k op/s 2024-09-10T10:44:08.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:07 smithi121 ceph-mon[35231]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T10:44:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:07 smithi097 ceph-mon[35213]: pgmap v230: 97 pgs: 97 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 1.34k op/s 2024-09-10T10:44:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:07 smithi097 ceph-mon[35213]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T10:44:08.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:07 smithi092 ceph-mon[30834]: pgmap v230: 97 pgs: 97 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 1.34k op/s 2024-09-10T10:44:08.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:07 smithi092 ceph-mon[30834]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T10:44:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.181+0000 7faae2526640 1 -- 172.21.15.92:0/3383501871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faadc1067b0 msgr2=0x7faadc106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.181+0000 7faae2526640 1 --2- 172.21.15.92:0/3383501871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faadc1067b0 0x7faadc106b90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faacc01a910 tx=0x7faacc03b470 comp rx=0 tx=0).stop 2024-09-10T10:44:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.182+0000 7faae2526640 1 -- 172.21.15.92:0/3383501871 shutdown_connections 2024-09-10T10:44:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.182+0000 7faae2526640 1 --2- 172.21.15.92:0/3383501871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faadc112ac0 0x7faadc114eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.182+0000 7faae2526640 1 --2- 172.21.15.92:0/3383501871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faadc1070d0 0x7faadc112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.182+0000 7faae2526640 1 --2- 172.21.15.92:0/3383501871 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faadc1067b0 0x7faadc106b90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.182+0000 7faae2526640 1 -- 172.21.15.92:0/3383501871 >> 172.21.15.92:0/3383501871 conn(0x7faadc075e20 msgr2=0x7faadc076230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:09.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.184+0000 7faae2526640 1 -- 172.21.15.92:0/3383501871 shutdown_connections 2024-09-10T10:44:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.185+0000 7faae2526640 1 -- 172.21.15.92:0/3383501871 wait complete. 2024-09-10T10:44:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.185+0000 7faae2526640 1 Processor -- start 2024-09-10T10:44:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.185+0000 7faae2526640 1 -- start start 2024-09-10T10:44:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.186+0000 7faae2526640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faadc1067b0 0x7faadc070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.186+0000 7faae2526640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faadc1070d0 0x7faadc0709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.186+0000 7faae2526640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faadc112ac0 0x7faadc105660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.186+0000 7faae2526640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faadc10a840 con 0x7faadc1070d0 2024-09-10T10:44:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.186+0000 7faae2526640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faadc10a6c0 con 0x7faadc1067b0 2024-09-10T10:44:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.186+0000 7faae2526640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faadc10a9c0 con 0x7faadc112ac0 2024-09-10T10:44:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.186+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faadc112ac0 0x7faadc105660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.186+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faadc112ac0 0x7faadc105660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:33744/0 (socket says 172.21.15.92:33744) 2024-09-10T10:44:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.186+0000 7faae0ac3640 1 -- 172.21.15.92:0/3974607447 learned_addr learned my addr 172.21.15.92:0/3974607447 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.187+0000 7faadb7fe640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faadc1070d0 0x7faadc0709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.187+0000 7faadbfff640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faadc1067b0 0x7faadc070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.188+0000 7faadb7fe640 1 -- 172.21.15.92:0/3974607447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faadc112ac0 msgr2=0x7faadc105660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.188+0000 7faadb7fe640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faadc112ac0 0x7faadc105660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.188+0000 7faadb7fe640 1 -- 172.21.15.92:0/3974607447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faadc1067b0 msgr2=0x7faadc070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.188+0000 7faadb7fe640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faadc1067b0 0x7faadc070470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.188+0000 7faadb7fe640 1 -- 172.21.15.92:0/3974607447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faadc105ba0 con 0x7faadc1070d0 2024-09-10T10:44:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.189+0000 7faadb7fe640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faadc1070d0 0x7faadc0709b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faad0009fd0 tx=0x7faad000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.190+0000 7faad97fa640 1 -- 172.21.15.92:0/3974607447 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0015020 con 0x7faadc1070d0 2024-09-10T10:44:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.190+0000 7faae2526640 1 -- 172.21.15.92:0/3974607447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faadc105e90 con 0x7faadc1070d0 2024-09-10T10:44:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.190+0000 7faad97fa640 1 -- 172.21.15.92:0/3974607447 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad0011d10 con 0x7faadc1070d0 2024-09-10T10:44:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.190+0000 7faae2526640 1 -- 172.21.15.92:0/3974607447 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faadc1063b0 con 0x7faadc1070d0 2024-09-10T10:44:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.190+0000 7faad97fa640 1 -- 172.21.15.92:0/3974607447 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad001a400 con 0x7faadc1070d0 2024-09-10T10:44:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.194+0000 7faad97fa640 1 -- 172.21.15.92:0/3974607447 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7faad0018020 con 0x7faadc1070d0 2024-09-10T10:44:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.195+0000 7faae52b8740 1 Processor -- start 2024-09-10T10:44:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.195+0000 7faae52b8740 1 -- start start 2024-09-10T10:44:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.195+0000 7faae52b8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x56279523ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faad97fa640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faac40a2e70 0x7faac40a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x56279523ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x56279523ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:33746/0 (socket says 172.21.15.92:33746) 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faad97fa640 1 -- 172.21.15.92:0/3974607447 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8499+0+0 (secure 0 0 0) 0x7faad00cec20 con 0x7faadc1070d0 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faae52b8740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 0x562795247770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faae0ac3640 1 -- 172.21.15.92:0/1182928419 learned_addr learned my addr 172.21.15.92:0/1182928419 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faadb7fe640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faac40a2e70 0x7faac40a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faae52b8740 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562795247cb0 0x56279524a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faae52b8740 1 -- 172.21.15.92:0/1182928419 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5627951a12f0 con 0x562795247cb0 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faae52b8740 1 -- 172.21.15.92:0/1182928419 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562795149270 con 0x56279523d410 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faae52b8740 1 -- 172.21.15.92:0/1182928419 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56279519d2b0 con 0x56279523caf0 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.196+0000 7faadbfff640 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 0x562795247770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562795247cb0 0x56279524a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faae0ac3640 1 -- 172.21.15.92:0/1182928419 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 msgr2=0x562795247770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 0x562795247770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faae0ac3640 1 -- 172.21.15.92:0/1182928419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562795247cb0 msgr2=0x56279524a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562795247cb0 0x56279524a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faae0ac3640 1 -- 172.21.15.92:0/1182928419 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562795148340 con 0x56279523caf0 2024-09-10T10:44:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faadb7fe640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faac40a2e70 0x7faac40a5330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faad00a3940 tx=0x7faad0004700 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x56279523ced0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faad4012650 tx=0x7faad40096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a079f614cc305139 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faac27fc640 1 -- 172.21.15.92:0/1182928419 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4018420 con 0x56279523caf0 2024-09-10T10:44:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faac27fc640 1 -- 172.21.15.92:0/1182928419 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad4018aa0 con 0x56279523caf0 2024-09-10T10:44:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.197+0000 7faac27fc640 1 -- 172.21.15.92:0/1182928419 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4017830 con 0x56279523caf0 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.198+0000 7faae52b8740 1 -- 172.21.15.92:0/1182928419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 msgr2=0x56279523ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.198+0000 7faae52b8740 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x56279523ced0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faad4012650 tx=0x7faad40096c0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.198+0000 7faae52b8740 1 -- 172.21.15.92:0/1182928419 shutdown_connections 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.198+0000 7faae52b8740 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562795247cb0 0x56279524a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.198+0000 7faae52b8740 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 0x562795247770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.198+0000 7faae52b8740 1 --2- 172.21.15.92:0/1182928419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x56279523ced0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.198+0000 7faae52b8740 1 -- 172.21.15.92:0/1182928419 >> 172.21.15.92:0/1182928419 conn(0x562795239060 msgr2=0x562795239440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.198+0000 7faae52b8740 1 -- 172.21.15.92:0/1182928419 shutdown_connections 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.198+0000 7faae52b8740 1 -- 172.21.15.92:0/1182928419 wait complete. 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.199+0000 7faae52b8740 1 -- start start 2024-09-10T10:44:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.199+0000 7faae52b8740 1 Processor -- start 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.199+0000 7faae52b8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x562795244b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.199+0000 7faae52b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523d410 0x5627952450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.199+0000 7faae52b8740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 0x5627952455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.199+0000 7faae52b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56279524a880 con 0x56279523d410 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.199+0000 7faae52b8740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56279512a290 con 0x562795247cb0 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.199+0000 7faae52b8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56279524aa00 con 0x56279523caf0 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.199+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x562795244b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x562795244b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:33758/0 (socket says 172.21.15.92:33758) 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae0ac3640 1 -- 172.21.15.92:0/1323071224 learned_addr learned my addr 172.21.15.92:0/1323071224 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae52b8740 10 client.0 _ll_register_callbacks cb 0x56279515b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faadbfff640 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523d410 0x5627952450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 0x5627952455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae0ac3640 1 -- 172.21.15.92:0/1323071224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 msgr2=0x5627952455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 0x5627952455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae0ac3640 1 -- 172.21.15.92:0/1323071224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523d410 msgr2=0x5627952450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523d410 0x5627952450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae0ac3640 1 -- 172.21.15.92:0/1323071224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562794eb4210 con 0x56279523caf0 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faadbfff640 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523d410 0x5627952450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x562795244b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faad4009b80 tx=0x7faad4004a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=908f65f72aa33e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faabb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faabb7fe640 1 -- 172.21.15.92:0/1323071224 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad40177d0 con 0x56279523caf0 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faae52b8740 1 -- 172.21.15.92:0/1323071224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faad4018aa0 con 0x56279523caf0 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.200+0000 7faabb7fe640 1 -- 172.21.15.92:0/1323071224 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8499+0+0 (secure 0 0 0) 0x7faad4017970 con 0x56279523caf0 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faabb7fe640 1 -- 172.21.15.92:0/1323071224 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7faad4017b70 con 0x56279523caf0 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faae52b8740 10 client.25432 fetch_fsmap learned FSMap version 50 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faae52b8740 1 -- 172.21.15.92:0/1323071224 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x562794f80620 con 0x56279523caf0 2024-09-10T10:44:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faabb7fe640 1 -- 172.21.15.92:0/1323071224 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad4018aa0 con 0x56279523caf0 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faabb7fe640 1 -- 172.21.15.92:0/1323071224 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7faad4015050 con 0x56279523caf0 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faae52b8740 10 client.25432 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faae52b8740 10 client.25432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faae52b8740 20 client.25432 populate_metadata read hostname 'smithi092' 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faae52b8740 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562795257b40 0x562795259f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faae52b8740 4 client.25432 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faae52b8740 1 -- 172.21.15.92:0/1323071224 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627951aea20 con 0x562795257b40 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.201+0000 7faadbfff640 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562795257b40 0x562795259f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.202+0000 7faabb7fe640 10 client.25432 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.202+0000 7faadbfff640 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562795257b40 0x562795259f30 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5e99e25e17894e5 server_cookie=b114e1ab5f86c0e8 in_seq=0 out_seq=0 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.202+0000 7faabb7fe640 1 -- 172.21.15.92:0/1323071224 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627951aea20 con 0x562795257b40 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.202+0000 7faabb7fe640 10 client.25432 handle_command_reply: tid=0 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.202+0000 7faae52b8740 1 client.25432 shutdown 2024-09-10T10:44:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 -- 172.21.15.92:0/1323071224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 msgr2=0x562795244b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x562795244b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faad4009b80 tx=0x7faad4004a80 comp rx=0 tx=0).stop 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 -- 172.21.15.92:0/1323071224 shutdown_connections 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562795257b40 0x562795259f30 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 0x5627952455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523d410 0x5627952450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 --2- 172.21.15.92:0/1323071224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523caf0 0x562795244b60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faabb7fe640 0 client.25432 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 -- 172.21.15.92:0/1323071224 >> 172.21.15.92:0/1323071224 conn(0x562795239060 msgr2=0x56279523ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 -- 172.21.15.92:0/1323071224 shutdown_connections 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 1 -- 172.21.15.92:0/1323071224 wait complete. 2024-09-10T10:44:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.203+0000 7faae52b8740 20 client.25432 trim_cache size 0 max 16384 2024-09-10T10:44:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae52b8740 1 Processor -- start 2024-09-10T10:44:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae52b8740 1 -- start start 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae52b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x562795245410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae52b8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523d410 0x56279525f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae52b8740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 0x56279525fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae52b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faadc1b3e60 con 0x56279523caf0 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae52b8740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faadc1b5a30 con 0x562795247cb0 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae52b8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faadc1b4530 con 0x56279523d410 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x562795245410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x562795245410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34836/0 (socket says 172.21.15.92:34836) 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faae0ac3640 1 -- 172.21.15.92:0/1973585735 learned_addr learned my addr 172.21.15.92:0/1973585735 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.224+0000 7faadbfff640 1 --2- 172.21.15.92:0/1973585735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523d410 0x56279525f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1973585735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 0x56279525fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faae0ac3640 1 -- 172.21.15.92:0/1973585735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523d410 msgr2=0x56279525f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1973585735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523d410 0x56279525f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faae0ac3640 1 -- 172.21.15.92:0/1973585735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 msgr2=0x56279525fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1973585735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 0x56279525fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faae0ac3640 1 -- 172.21.15.92:0/1973585735 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56279523d240 con 0x56279523caf0 2024-09-10T10:44:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faae0ac3640 1 --2- 172.21.15.92:0/1973585735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x562795245410 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faad4009720 tx=0x7faad4009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366518d074ec98dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faac1ffb640 1 -- 172.21.15.92:0/1973585735 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad402f550 con 0x56279523caf0 2024-09-10T10:44:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faac1ffb640 1 -- 172.21.15.92:0/1973585735 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad403b070 con 0x56279523caf0 2024-09-10T10:44:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.225+0000 7faac1ffb640 1 -- 172.21.15.92:0/1973585735 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4017ed0 con 0x56279523caf0 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 -- 172.21.15.92:0/1973585735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 msgr2=0x562795245410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 --2- 172.21.15.92:0/1973585735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x562795245410 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faad4009720 tx=0x7faad4009dc0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 -- 172.21.15.92:0/1973585735 shutdown_connections 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 --2- 172.21.15.92:0/1973585735 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562795247cb0 0x56279525fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 --2- 172.21.15.92:0/1973585735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56279523d410 0x56279525f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 --2- 172.21.15.92:0/1973585735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x562795245410 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 -- 172.21.15.92:0/1973585735 >> 172.21.15.92:0/1973585735 conn(0x562795239060 msgr2=0x562795246be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 -- 172.21.15.92:0/1973585735 shutdown_connections 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 -- 172.21.15.92:0/1973585735 wait complete. 2024-09-10T10:44:09.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.226+0000 7faae52b8740 1 -- start start 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae52b8740 1 Processor -- start 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae52b8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x5627952ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae52b8740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 0x5627952bad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae52b8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562795247cb0 0x56279524b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x5627952ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae52b8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faadc1b5360 con 0x56279523caf0 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae0ac3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x5627952ba7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34848/0 (socket says 172.21.15.92:34848) 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7faadc1b4c90 con 0x56279523d410 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae0ac3640 1 -- 172.21.15.92:0/3426786805 learned_addr learned my addr 172.21.15.92:0/3426786805 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faadc1b1e60 con 0x562795247cb0 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae52b8740 10 client.0 _ll_register_callbacks cb 0x7faacc01a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faadbfff640 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 0x5627952bad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae0ac3640 1 -- 172.21.15.92:0/3426786805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562795247cb0 msgr2=0x56279524b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae0ac3640 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562795247cb0 0x56279524b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae0ac3640 1 -- 172.21.15.92:0/3426786805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 msgr2=0x5627952bad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae0ac3640 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 0x5627952bad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faae0ac3640 1 -- 172.21.15.92:0/3426786805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56279524ba20 con 0x56279523caf0 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.227+0000 7faadbfff640 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 0x5627952bad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faae0ac3640 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x5627952ba7d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faad4012650 tx=0x7faad4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf82bf21c39c7776 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faabb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faabb7fe640 1 -- 172.21.15.92:0/3426786805 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4003a30 con 0x56279523caf0 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faabb7fe640 1 -- 172.21.15.92:0/3426786805 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8499+0+0 (secure 0 0 0) 0x7faad4003bd0 con 0x56279523caf0 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faad403b070 con 0x56279523caf0 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faabb7fe640 1 -- 172.21.15.92:0/3426786805 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7faad4003dd0 con 0x56279523caf0 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faae52b8740 10 client.15897 fetch_fsmap learned FSMap version 50 2024-09-10T10:44:09.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5627952c1fe0 con 0x56279523caf0 2024-09-10T10:44:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faabb7fe640 1 -- 172.21.15.92:0/3426786805 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad403b070 con 0x56279523caf0 2024-09-10T10:44:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faabb7fe640 1 -- 172.21.15.92:0/3426786805 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7faad4015040 con 0x56279523caf0 2024-09-10T10:44:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faae52b8740 10 client.15897 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:44:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faae52b8740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:44:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.228+0000 7faae52b8740 20 client.15897 populate_metadata read hostname 'smithi092' 2024-09-10T10:44:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.229+0000 7faae52b8740 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5627952c25f0 0x5627952c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.229+0000 7faae52b8740 4 client.15897 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:44:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.229+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5627951a8d70 con 0x5627952c25f0 2024-09-10T10:44:09.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.229+0000 7faadbfff640 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5627952c25f0 0x5627952c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:09.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.229+0000 7faabb7fe640 10 client.15897 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:09.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.230+0000 7faadbfff640 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5627952c25f0 0x5627952c49e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=270cbec44f4e1c02 server_cookie=cc977bfca83f6ed6 in_seq=0 out_seq=0 2024-09-10T10:44:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faabb7fe640 1 -- 172.21.15.92:0/3426786805 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5627951a8d70 con 0x5627952c25f0 2024-09-10T10:44:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faabb7fe640 10 client.15897 handle_command_reply: tid=0 2024-09-10T10:44:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faae52b8740 1 client.15897 shutdown 2024-09-10T10:44:09.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 msgr2=0x5627952ba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:09.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faae52b8740 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x5627952ba7d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faad4012650 tx=0x7faad4009b50 comp rx=0 tx=0).stop 2024-09-10T10:44:09.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 shutdown_connections 2024-09-10T10:44:09.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faae52b8740 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562795247cb0 0x56279524b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faae52b8740 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5627952c25f0 0x5627952c49e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faae52b8740 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56279523d410 0x5627952bad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.239+0000 7faae52b8740 1 --2- 172.21.15.92:0/3426786805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56279523caf0 0x5627952ba7d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.240+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 >> 172.21.15.92:0/3426786805 conn(0x562795239060 msgr2=0x5627952463c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:09.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.240+0000 7faabb7fe640 0 client.15897 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:09.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.240+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 shutdown_connections 2024-09-10T10:44:09.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.240+0000 7faae52b8740 1 -- 172.21.15.92:0/3426786805 wait complete. 2024-09-10T10:44:09.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.240+0000 7faae52b8740 20 client.15897 trim_cache size 0 max 16384 2024-09-10T10:44:09.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:44:09.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:44:09.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:44:09.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:44:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 -- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faac40a2e70 msgr2=0x7faac40a5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faac40a2e70 0x7faac40a5330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faad00a3940 tx=0x7faad0004700 comp rx=0 tx=0).stop 2024-09-10T10:44:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 -- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faadc1070d0 msgr2=0x7faadc0709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faadc1070d0 0x7faadc0709b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faad0009fd0 tx=0x7faad000b870 comp rx=0 tx=0).stop 2024-09-10T10:44:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 -- 172.21.15.92:0/3974607447 shutdown_connections 2024-09-10T10:44:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faadc112ac0 0x7faadc105660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faadc1070d0 0x7faadc0709b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7faac40a2e70 0x7faac40a5330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 --2- 172.21.15.92:0/3974607447 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7faadc1067b0 0x7faadc070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 -- 172.21.15.92:0/3974607447 >> 172.21.15.92:0/3974607447 conn(0x7faadc075e20 msgr2=0x7faadc110310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 -- 172.21.15.92:0/3974607447 shutdown_connections 2024-09-10T10:44:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:09.241+0000 7faae2526640 1 -- 172.21.15.92:0/3974607447 wait complete. 2024-09-10T10:44:10.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:09 smithi121 ceph-mon[35231]: pgmap v232: 97 pgs: 97 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 1.26k op/s 2024-09-10T10:44:10.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:09 smithi097 ceph-mon[35213]: pgmap v232: 97 pgs: 97 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 1.26k op/s 2024-09-10T10:44:10.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:09 smithi092 ceph-mon[30834]: pgmap v232: 97 pgs: 97 active+clean; 5.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 1.26k op/s 2024-09-10T10:44:12.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:11 smithi121 ceph-mon[35231]: pgmap v233: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 MiB/s wr, 1.68k op/s 2024-09-10T10:44:12.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:11 smithi097 ceph-mon[35213]: pgmap v233: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 MiB/s wr, 1.68k op/s 2024-09-10T10:44:12.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:11 smithi092 ceph-mon[30834]: pgmap v233: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 MiB/s wr, 1.68k op/s 2024-09-10T10:44:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 435.0 s, 2809.6 tps, lat 35.808 ms stddev 43.019 2024-09-10T10:44:14.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:13 smithi121 ceph-mon[35231]: pgmap v234: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 MiB/s wr, 1.68k op/s 2024-09-10T10:44:14.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:13 smithi097 ceph-mon[35213]: pgmap v234: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 MiB/s wr, 1.68k op/s 2024-09-10T10:44:14.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:13 smithi092 ceph-mon[30834]: pgmap v234: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 39 MiB/s wr, 1.68k op/s 2024-09-10T10:44:15.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:15 smithi121 ceph-mon[35231]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T10:44:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:15 smithi097 ceph-mon[35213]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T10:44:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:15 smithi092 ceph-mon[30834]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T10:44:16.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:16 smithi121 ceph-mon[35231]: pgmap v236: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 18 MiB/s wr, 969 op/s 2024-09-10T10:44:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:16 smithi097 ceph-mon[35213]: pgmap v236: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 18 MiB/s wr, 969 op/s 2024-09-10T10:44:16.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:16 smithi092 ceph-mon[30834]: pgmap v236: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 18 MiB/s wr, 969 op/s 2024-09-10T10:44:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 440.0 s, 2330.0 tps, lat 42.807 ms stddev 51.621 2024-09-10T10:44:18.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:18 smithi121 ceph-mon[35231]: pgmap v237: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 19 MiB/s wr, 1.16k op/s 2024-09-10T10:44:18.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:18 smithi097 ceph-mon[35213]: pgmap v237: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 19 MiB/s wr, 1.16k op/s 2024-09-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:18 smithi092 ceph-mon[30834]: pgmap v237: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 19 MiB/s wr, 1.16k op/s 2024-09-10T10:44:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:20 smithi121 ceph-mon[35231]: pgmap v238: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 1.11k op/s 2024-09-10T10:44:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:20 smithi097 ceph-mon[35213]: pgmap v238: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 1.11k op/s 2024-09-10T10:44:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:20 smithi092 ceph-mon[30834]: pgmap v238: 97 pgs: 97 active+clean; 4.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 1.11k op/s 2024-09-10T10:44:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.352+0000 7f9c04f4b640 1 -- 172.21.15.92:0/3145720804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 msgr2=0x7f9c00103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.352+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/3145720804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 0x7f9c00103080 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009900 tx=0x7f9bf002a410 comp rx=0 tx=0).stop 2024-09-10T10:44:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.353+0000 7f9c04f4b640 1 -- 172.21.15.92:0/3145720804 shutdown_connections 2024-09-10T10:44:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.353+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/3145720804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c0010c0d0 0x7f9c0010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.353+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/3145720804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c001035c0 0x7f9c0010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.353+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/3145720804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 0x7f9c00103080 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.353+0000 7f9c04f4b640 1 -- 172.21.15.92:0/3145720804 >> 172.21.15.92:0/3145720804 conn(0x7f9c000fc6b0 msgr2=0x7f9c000fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.353+0000 7f9c04f4b640 1 -- 172.21.15.92:0/3145720804 shutdown_connections 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.353+0000 7f9c04f4b640 1 -- 172.21.15.92:0/3145720804 wait complete. 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9c04f4b640 1 Processor -- start 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9c04f4b640 1 -- start start 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9c04f4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 0x7f9c00198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9c04f4b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c001035c0 0x7f9c00198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9c04f4b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c0010c0d0 0x7f9c0019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9c04f4b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00111ed0 con 0x7f9c00102ca0 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9c04f4b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00111d50 con 0x7f9c001035c0 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9c04f4b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00112050 con 0x7f9c0010c0d0 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9bfe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 0x7f9c00198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9bfe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 0x7f9c00198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45114/0 (socket says 172.21.15.92:45114) 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9bfe59c640 1 -- 172.21.15.92:0/2953268910 learned_addr learned my addr 172.21.15.92:0/2953268910 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c0010c0d0 0x7f9c0019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.354+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c001035c0 0x7f9c00198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bfed9d640 1 -- 172.21.15.92:0/2953268910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c001035c0 msgr2=0x7f9c00198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c001035c0 0x7f9c00198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bfed9d640 1 -- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 msgr2=0x7f9c00198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 0x7f9c00198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bfed9d640 1 -- 172.21.15.92:0/2953268910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0019d320 con 0x7f9c0010c0d0 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 0x7f9c00198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c0010c0d0 0x7f9c0019cbf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009fd0 tx=0x7f9bf800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bef7fe640 1 -- 172.21.15.92:0/2953268910 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf800ce20 con 0x7f9c0010c0d0 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bef7fe640 1 -- 172.21.15.92:0/2953268910 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bf8005020 con 0x7f9c0010c0d0 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9bef7fe640 1 -- 172.21.15.92:0/2953268910 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8010720 con 0x7f9c0010c0d0 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9c04f4b640 1 -- 172.21.15.92:0/2953268910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0019d610 con 0x7f9c0010c0d0 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.355+0000 7f9c04f4b640 1 -- 172.21.15.92:0/2953268910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c001a4ea0 con 0x7f9c0010c0d0 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.357+0000 7f9bef7fe640 1 -- 172.21.15.92:0/2953268910 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9bf8005540 con 0x7f9c0010c0d0 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.358+0000 7f9bef7fe640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9be80a2e20 0x7f9be80a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.358+0000 7f9bef7fe640 1 -- 172.21.15.92:0/2953268910 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7f9bf80cf990 con 0x7f9c0010c0d0 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.358+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9be80a2e20 0x7f9be80a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.358+0000 7f9c07922740 1 Processor -- start 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9c07922740 1 -- start start 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9c07922740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691d99b0 0x5594691d9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9c07922740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x5594691ed370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9c07922740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691e0730 0x5594691ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9c07922740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55946913e2f0 con 0x5594691e0730 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9c07922740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5594690e6270 con 0x5594691d99b0 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9c07922740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55946913a2b0 con 0x5594691da2d0 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9bfe59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691d99b0 0x5594691d9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9bfe59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691d99b0 0x5594691d9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35772/0 (socket says 172.21.15.92:35772) 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9bfe59c640 1 -- 172.21.15.92:0/2917745579 learned_addr learned my addr 172.21.15.92:0/2917745579 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.359+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/2917745579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x5594691ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.360+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/2917745579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691e0730 0x5594691ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.360+0000 7f9bfdd9b640 1 -- 172.21.15.92:0/2917745579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691d99b0 msgr2=0x5594691d9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.360+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/2917745579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691d99b0 0x5594691d9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.360+0000 7f9bfdd9b640 1 -- 172.21.15.92:0/2917745579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691e0730 msgr2=0x5594691ef8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.360+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/2917745579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691e0730 0x5594691ef8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.360+0000 7f9bfdd9b640 1 -- 172.21.15.92:0/2917745579 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594690e5340 con 0x5594691da2d0 2024-09-10T10:44:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.360+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/2917745579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x5594691ed370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c000697f0 tx=0x7f9bf4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18265d829cf129a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.360+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9be80a2e20 0x7f9be80a52e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00096c0 tx=0x7f9bf0005a20 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.361+0000 7f9becff9640 1 -- 172.21.15.92:0/2917745579 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4009d70 con 0x5594691da2d0 2024-09-10T10:44:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.361+0000 7f9becff9640 1 -- 172.21.15.92:0/2917745579 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bf4005020 con 0x5594691da2d0 2024-09-10T10:44:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.361+0000 7f9becff9640 1 -- 172.21.15.92:0/2917745579 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4004bc0 con 0x5594691da2d0 2024-09-10T10:44:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.362+0000 7f9c07922740 1 -- 172.21.15.92:0/2917745579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 msgr2=0x5594691ed370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.362+0000 7f9c07922740 1 --2- 172.21.15.92:0/2917745579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x5594691ed370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c000697f0 tx=0x7f9bf4011810 comp rx=0 tx=0).stop 2024-09-10T10:44:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 -- 172.21.15.92:0/2917745579 shutdown_connections 2024-09-10T10:44:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 --2- 172.21.15.92:0/2917745579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691e0730 0x5594691ef8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 --2- 172.21.15.92:0/2917745579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x5594691ed370 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 --2- 172.21.15.92:0/2917745579 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691d99b0 0x5594691d9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 -- 172.21.15.92:0/2917745579 >> 172.21.15.92:0/2917745579 conn(0x5594691d6060 msgr2=0x5594691d6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 -- 172.21.15.92:0/2917745579 shutdown_connections 2024-09-10T10:44:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 -- 172.21.15.92:0/2917745579 wait complete. 2024-09-10T10:44:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 -- start start 2024-09-10T10:44:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 Processor -- start 2024-09-10T10:44:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 0x5594691e9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691da2d0 0x5594691e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691ef680 0x5594691e5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594691e4e00 con 0x5594691ef680 2024-09-10T10:44:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.363+0000 7f9c07922740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5594690c7290 con 0x5594691da2d0 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfdd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691da2d0 0x5594691e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9c07922740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5594691e4f80 con 0x5594691d99b0 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfdd9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691da2d0 0x5594691e9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35780/0 (socket says 172.21.15.92:35780) 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfdd9b640 1 -- 172.21.15.92:0/2177959709 learned_addr learned my addr 172.21.15.92:0/2177959709 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9c07922740 10 client.0 _ll_register_callbacks cb 0x5594690f8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691ef680 0x5594691e5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 0x5594691e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfdd9b640 1 -- 172.21.15.92:0/2177959709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 msgr2=0x5594691e9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 0x5594691e9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfdd9b640 1 -- 172.21.15.92:0/2177959709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691ef680 msgr2=0x5594691e5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691ef680 0x5594691e5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfdd9b640 1 -- 172.21.15.92:0/2177959709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559468e51210 con 0x5594691da2d0 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691da2d0 0x5594691e9e50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4000c00 tx=0x7f9bf4009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f64bd94e05a348 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9be5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9be5ffb640 1 -- 172.21.15.92:0/2177959709 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4029020 con 0x5594691da2d0 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9c07922740 1 -- 172.21.15.92:0/2177959709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bf4005020 con 0x5594691da2d0 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.364+0000 7f9be5ffb640 1 -- 172.21.15.92:0/2177959709 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7f9bf4004c10 con 0x5594691da2d0 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9be5ffb640 1 -- 172.21.15.92:0/2177959709 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9bf4034050 con 0x5594691da2d0 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9c07922740 10 client.25409 fetch_fsmap learned FSMap version 50 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9c07922740 1 -- 172.21.15.92:0/2177959709 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559468f1d620 con 0x5594691da2d0 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9be5ffb640 1 -- 172.21.15.92:0/2177959709 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bf4005020 con 0x5594691da2d0 2024-09-10T10:44:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9be5ffb640 1 -- 172.21.15.92:0/2177959709 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f9bf40194e0 con 0x5594691da2d0 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9c07922740 10 client.25409 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9c07922740 10 client.25409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9c07922740 20 client.25409 populate_metadata read hostname 'smithi092' 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9c07922740 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559469205fe0 0x5594692083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9c07922740 4 client.25409 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9c07922740 1 -- 172.21.15.92:0/2177959709 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55946914ba20 con 0x559469205fe0 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.365+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559469205fe0 0x5594692083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.366+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559469205fe0 0x5594692083d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3412cfa4adb3341 server_cookie=362d1210b949baa in_seq=0 out_seq=0 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.366+0000 7f9be5ffb640 10 client.25409 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.366+0000 7f9be5ffb640 1 -- 172.21.15.92:0/2177959709 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55946914ba20 con 0x559469205fe0 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.366+0000 7f9be5ffb640 10 client.25409 handle_command_reply: tid=0 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.366+0000 7f9c07922740 1 client.25409 shutdown 2024-09-10T10:44:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 -- 172.21.15.92:0/2177959709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691da2d0 msgr2=0x5594691e9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691da2d0 0x5594691e9e50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4000c00 tx=0x7f9bf4009850 comp rx=0 tx=0).stop 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 -- 172.21.15.92:0/2177959709 shutdown_connections 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691ef680 0x5594691e5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559469205fe0 0x5594692083d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691da2d0 0x5594691e9e50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 --2- 172.21.15.92:0/2177959709 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 0x5594691e9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 -- 172.21.15.92:0/2177959709 >> 172.21.15.92:0/2177959709 conn(0x5594691d6060 msgr2=0x5594691dbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9be5ffb640 0 client.25409 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 -- 172.21.15.92:0/2177959709 shutdown_connections 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 1 -- 172.21.15.92:0/2177959709 wait complete. 2024-09-10T10:44:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.367+0000 7f9c07922740 20 client.25409 trim_cache size 0 max 16384 2024-09-10T10:44:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.386+0000 7f9c07922740 1 Processor -- start 2024-09-10T10:44:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.386+0000 7f9c07922740 1 -- start start 2024-09-10T10:44:22.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9c07922740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 0x5594691e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9c07922740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691da2d0 0x5594691e1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9c07922740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x5594691e2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9c07922740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001ab530 con 0x5594691da2d0 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9c07922740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001ad100 con 0x5594691ef680 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9c07922740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001abc00 con 0x5594691d99b0 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691da2d0 0x5594691e1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x5594691e2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691da2d0 0x5594691e1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45140/0 (socket says 172.21.15.92:45140) 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfed9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x5594691e2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35788/0 (socket says 172.21.15.92:35788) 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfdd9b640 1 -- 172.21.15.92:0/767743778 learned_addr learned my addr 172.21.15.92:0/767743778 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/767743778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 0x5594691e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfed9d640 1 -- 172.21.15.92:0/767743778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 msgr2=0x5594691e9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/767743778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 0x5594691e9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfed9d640 1 -- 172.21.15.92:0/767743778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691da2d0 msgr2=0x5594691e1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/767743778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691da2d0 0x5594691e1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfed9d640 1 -- 172.21.15.92:0/767743778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594691e9510 con 0x5594691ef680 2024-09-10T10:44:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.387+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/767743778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 0x5594691e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:44:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.388+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/767743778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x5594691e2070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80cd0c0 tx=0x7f9bf80058b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=661881540d45d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.388+0000 7f9be7fff640 1 -- 172.21.15.92:0/767743778 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80051d0 con 0x5594691ef680 2024-09-10T10:44:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.388+0000 7f9be7fff640 1 -- 172.21.15.92:0/767743778 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bf80cd340 con 0x5594691ef680 2024-09-10T10:44:22.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.388+0000 7f9be7fff640 1 -- 172.21.15.92:0/767743778 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80a4670 con 0x5594691ef680 2024-09-10T10:44:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 -- 172.21.15.92:0/767743778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 msgr2=0x5594691e2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 --2- 172.21.15.92:0/767743778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x5594691e2070 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80cd0c0 tx=0x7f9bf80058b0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 -- 172.21.15.92:0/767743778 shutdown_connections 2024-09-10T10:44:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 --2- 172.21.15.92:0/767743778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x5594691e2070 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 --2- 172.21.15.92:0/767743778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691da2d0 0x5594691e1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 --2- 172.21.15.92:0/767743778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691d99b0 0x5594691e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 -- 172.21.15.92:0/767743778 >> 172.21.15.92:0/767743778 conn(0x5594691d6060 msgr2=0x5594691e9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:22.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 -- 172.21.15.92:0/767743778 shutdown_connections 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 -- 172.21.15.92:0/767743778 wait complete. 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.389+0000 7f9c07922740 1 -- start start 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9c07922740 1 Processor -- start 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9c07922740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691d99b0 0x559469219b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9c07922740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x55946921a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9c07922740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x559469216900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9bfe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691d99b0 0x559469219b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9bfe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691d99b0 0x559469219b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45142/0 (socket says 172.21.15.92:45142) 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9bfe59c640 1 -- 172.21.15.92:0/963872949 learned_addr learned my addr 172.21.15.92:0/963872949 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001aca30 con 0x5594691d99b0 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001ac360 con 0x5594691ef680 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9c001a9530 con 0x5594691da2d0 2024-09-10T10:44:22.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x559469216900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x55946921a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9c07922740 10 client.0 _ll_register_callbacks cb 0x7f9bf4009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9bfed9d640 1 -- 172.21.15.92:0/963872949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 msgr2=0x55946921a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x55946921a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9bfed9d640 1 -- 172.21.15.92:0/963872949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691d99b0 msgr2=0x559469219b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.390+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691d99b0 0x559469219b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9bfed9d640 1 -- 172.21.15.92:0/963872949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559469217040 con 0x5594691ef680 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9bfdd9b640 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x55946921a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691d99b0 0x559469219b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bf80cd340 con 0x5594691ef680 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9bfed9d640 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x559469216900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80bc100 tx=0x7f9bf809bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3301b4cb1e02db4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9be5ffb640 10 client.25415 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9be5ffb640 1 -- 172.21.15.92:0/963872949 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf807e030 con 0x5594691ef680 2024-09-10T10:44:22.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9be5ffb640 1 -- 172.21.15.92:0/963872949 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7f9bf809a190 con 0x5594691ef680 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9be5ffb640 1 -- 172.21.15.92:0/963872949 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9bf809c300 con 0x5594691ef680 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9c07922740 10 client.25415 fetch_fsmap learned FSMap version 50 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({fsmap=50}) -- 0x5594692712f0 con 0x5594691ef680 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9be5ffb640 1 -- 172.21.15.92:0/963872949 <== mon.2 v2:172.21.15.97:3300/0 4 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f9bf8085020 con 0x5594691ef680 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9c07922740 10 client.25415 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9c07922740 10 client.25415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9c07922740 20 client.25415 populate_metadata read hostname 'smithi092' 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.391+0000 7f9c07922740 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559469271850 0x559469273c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.392+0000 7f9c07922740 4 client.25415 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.392+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559469145d70 con 0x559469271850 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.392+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559469271850 0x559469273c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.392+0000 7f9bfe59c640 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559469271850 0x559469273c40 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfcde3234cc1a4b2 server_cookie=8ae475470e0f9589 in_seq=0 out_seq=0 2024-09-10T10:44:22.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.392+0000 7f9be5ffb640 10 client.25415 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.401+0000 7f9be5ffb640 1 -- 172.21.15.92:0/963872949 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559469145d70 con 0x559469271850 2024-09-10T10:44:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.401+0000 7f9be5ffb640 10 client.25415 handle_command_reply: tid=0 2024-09-10T10:44:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.401+0000 7f9c07922740 1 client.25415 shutdown 2024-09-10T10:44:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 msgr2=0x559469216900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x559469216900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80bc100 tx=0x7f9bf809bd30 comp rx=0 tx=0).stop 2024-09-10T10:44:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 shutdown_connections 2024-09-10T10:44:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x559469271850 0x559469273c40 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9be5ffb640 0 client.25415 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5594691ef680 0x559469216900 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5594691da2d0 0x55946921a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 --2- 172.21.15.92:0/963872949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594691d99b0 0x559469219b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 >> 172.21.15.92:0/963872949 conn(0x5594691d6060 msgr2=0x5594691ee5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 shutdown_connections 2024-09-10T10:44:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 1 -- 172.21.15.92:0/963872949 wait complete. 2024-09-10T10:44:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.402+0000 7f9c07922740 20 client.25415 trim_cache size 0 max 16384 2024-09-10T10:44:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:44:22.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:44:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:44:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:44:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.415+0000 7f9c04f4b640 1 -- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9be80a2e20 msgr2=0x7f9be80a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.415+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9be80a2e20 0x7f9be80a52e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9bf00096c0 tx=0x7f9bf0005a20 comp rx=0 tx=0).stop 2024-09-10T10:44:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.415+0000 7f9c04f4b640 1 -- 172.21.15.92:0/2953268910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c0010c0d0 msgr2=0x7f9c0019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:22.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.415+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c0010c0d0 0x7f9c0019cbf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009fd0 tx=0x7f9bf800ef10 comp rx=0 tx=0).stop 2024-09-10T10:44:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.419+0000 7f9c04f4b640 1 -- 172.21.15.92:0/2953268910 shutdown_connections 2024-09-10T10:44:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.419+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9c0010c0d0 0x7f9c0019cbf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.419+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9be80a2e20 0x7f9be80a52e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.419+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9c001035c0 0x7f9c00198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.419+0000 7f9c04f4b640 1 --2- 172.21.15.92:0/2953268910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c00102ca0 0x7f9c00198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:22.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.419+0000 7f9c04f4b640 1 -- 172.21.15.92:0/2953268910 >> 172.21.15.92:0/2953268910 conn(0x7f9c000fc6b0 msgr2=0x7f9c000fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:22.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.423+0000 7f9c04f4b640 1 -- 172.21.15.92:0/2953268910 shutdown_connections 2024-09-10T10:44:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:22.427+0000 7f9c04f4b640 1 -- 172.21.15.92:0/2953268910 wait complete. 2024-09-10T10:44:22.662 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:22 smithi092 ceph-mon[30834]: pgmap v239: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.2 MiB/s wr, 701 op/s 2024-09-10T10:44:22.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:22 smithi121 ceph-mon[35231]: pgmap v239: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.2 MiB/s wr, 701 op/s 2024-09-10T10:44:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:22 smithi097 ceph-mon[35213]: pgmap v239: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.2 MiB/s wr, 701 op/s 2024-09-10T10:44:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 445.0 s, 2295.0 tps, lat 43.501 ms stddev 48.077 2024-09-10T10:44:24.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:24 smithi121 ceph-mon[35231]: pgmap v240: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.2 MiB/s wr, 701 op/s 2024-09-10T10:44:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:24 smithi097 ceph-mon[35213]: pgmap v240: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.2 MiB/s wr, 701 op/s 2024-09-10T10:44:24.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:24 smithi092 ceph-mon[30834]: pgmap v240: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.2 MiB/s wr, 701 op/s 2024-09-10T10:44:26.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:26 smithi121 ceph-mon[35231]: pgmap v241: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 691 op/s 2024-09-10T10:44:26.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:26 smithi097 ceph-mon[35213]: pgmap v241: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 691 op/s 2024-09-10T10:44:26.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:26 smithi092 ceph-mon[30834]: pgmap v241: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 691 op/s 2024-09-10T10:44:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 450.0 s, 2027.6 tps, lat 49.151 ms stddev 54.678 2024-09-10T10:44:28.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:28 smithi121 ceph-mon[35231]: pgmap v242: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 958 op/s 2024-09-10T10:44:28.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:28 smithi097 ceph-mon[35213]: pgmap v242: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 958 op/s 2024-09-10T10:44:28.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:28 smithi092 ceph-mon[30834]: pgmap v242: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 10 MiB/s wr, 958 op/s 2024-09-10T10:44:30.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:30 smithi121 ceph-mon[35231]: pgmap v243: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.4 MiB/s wr, 678 op/s 2024-09-10T10:44:30.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:30 smithi097 ceph-mon[35213]: pgmap v243: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.4 MiB/s wr, 678 op/s 2024-09-10T10:44:30.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:30 smithi092 ceph-mon[30834]: pgmap v243: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.4 MiB/s wr, 678 op/s 2024-09-10T10:44:32.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:32 smithi121 ceph-mon[35231]: pgmap v244: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 10 MiB/s wr, 961 op/s 2024-09-10T10:44:32.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:32 smithi097 ceph-mon[35213]: pgmap v244: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 10 MiB/s wr, 961 op/s 2024-09-10T10:44:32.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:32 smithi092 ceph-mon[30834]: pgmap v244: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 10 MiB/s wr, 961 op/s 2024-09-10T10:44:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 455.0 s, 2518.8 tps, lat 39.890 ms stddev 43.449 2024-09-10T10:44:34.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:34 smithi121 ceph-mon[35231]: pgmap v245: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 657 op/s 2024-09-10T10:44:34.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:34 smithi097 ceph-mon[35213]: pgmap v245: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 657 op/s 2024-09-10T10:44:34.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:34 smithi092 ceph-mon[30834]: pgmap v245: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 657 op/s 2024-09-10T10:44:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.575+0000 7fe19cd7f640 1 -- 172.21.15.92:0/2990581558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe198101af0 msgr2=0x7fe19810d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.575+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/2990581558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe198101af0 0x7fe19810d9a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe190009cd0 tx=0x7fe19002ea20 comp rx=0 tx=0).stop 2024-09-10T10:44:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.575+0000 7fe19cd7f640 1 -- 172.21.15.92:0/2990581558 shutdown_connections 2024-09-10T10:44:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.575+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/2990581558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe198101af0 0x7fe19810d9a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.575+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/2990581558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe198101130 0x7fe1981015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.575+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/2990581558 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe1981028f0 0x7fe198102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.575+0000 7fe19cd7f640 1 -- 172.21.15.92:0/2990581558 >> 172.21.15.92:0/2990581558 conn(0x7fe1980770f0 msgr2=0x7fe1980fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.575+0000 7fe19cd7f640 1 -- 172.21.15.92:0/2990581558 shutdown_connections 2024-09-10T10:44:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.575+0000 7fe19cd7f640 1 -- 172.21.15.92:0/2990581558 wait complete. 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.576+0000 7fe19cd7f640 1 Processor -- start 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.576+0000 7fe19cd7f640 1 -- start start 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.576+0000 7fe19cd7f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe198101130 0x7fe1981a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe19cd7f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe198101af0 0x7fe1981a4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe19cd7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1981028f0 0x7fe19819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe19cd7f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981186d0 con 0x7fe1981028f0 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe19cd7f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe198118550 con 0x7fe198101af0 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe19cd7f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe198118850 con 0x7fe198101130 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe196d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1981028f0 0x7fe19819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe196d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1981028f0 0x7fe19819e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36086/0 (socket says 172.21.15.92:36086) 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe196d9d640 1 -- 172.21.15.92:0/845844845 learned_addr learned my addr 172.21.15.92:0/845844845 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe19659c640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe198101130 0x7fe1981a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe195d9b640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe198101af0 0x7fe1981a4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe196d9d640 1 -- 172.21.15.92:0/845844845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe198101130 msgr2=0x7fe1981a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe196d9d640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe198101130 0x7fe1981a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe196d9d640 1 -- 172.21.15.92:0/845844845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe198101af0 msgr2=0x7fe1981a4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe196d9d640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe198101af0 0x7fe1981a4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe196d9d640 1 -- 172.21.15.92:0/845844845 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19819f170 con 0x7fe1981028f0 2024-09-10T10:44:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.577+0000 7fe196d9d640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1981028f0 0x7fe19819e9f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe1900098d0 tx=0x7fe190003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.578+0000 7fe1877fe640 1 -- 172.21.15.92:0/845844845 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190040030 con 0x7fe1981028f0 2024-09-10T10:44:35.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.578+0000 7fe19cd7f640 1 -- 172.21.15.92:0/845844845 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19819f400 con 0x7fe1981028f0 2024-09-10T10:44:35.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.578+0000 7fe19cd7f640 1 -- 172.21.15.92:0/845844845 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1981ab700 con 0x7fe1981028f0 2024-09-10T10:44:35.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.578+0000 7fe1877fe640 1 -- 172.21.15.92:0/845844845 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe190033b20 con 0x7fe1981028f0 2024-09-10T10:44:35.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.578+0000 7fe1877fe640 1 -- 172.21.15.92:0/845844845 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190037050 con 0x7fe1981028f0 2024-09-10T10:44:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.580+0000 7fe1877fe640 1 -- 172.21.15.92:0/845844845 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe190043030 con 0x7fe1981028f0 2024-09-10T10:44:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.581+0000 7fe19fbf5740 1 Processor -- start 2024-09-10T10:44:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.581+0000 7fe19fbf5740 1 -- start start 2024-09-10T10:44:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.582+0000 7fe1877fe640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe1800a2ea0 0x7fe1800a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.582+0000 7fe1877fe640 1 -- 172.21.15.92:0/845844845 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7fe1900ef6b0 con 0x7fe1981028f0 2024-09-10T10:44:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.582+0000 7fe195d9b640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe1800a2ea0 0x7fe1800a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.582+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037365af0 0x556037365ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.582+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037366410 0x556037370770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.582+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 0x5560373730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.582+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5560372ca2f0 con 0x556037370cb0 2024-09-10T10:44:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.582+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556037272270 con 0x556037366410 2024-09-10T10:44:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.582+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5560372c62b0 con 0x556037365af0 2024-09-10T10:44:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.583+0000 7fe195d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037366410 0x556037370770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.583+0000 7fe195d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037366410 0x556037370770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:44262/0 (socket says 172.21.15.92:44262) 2024-09-10T10:44:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.583+0000 7fe195d9b640 1 -- 172.21.15.92:0/1883356487 learned_addr learned my addr 172.21.15.92:0/1883356487 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.583+0000 7fe196d9d640 1 --2- 172.21.15.92:0/1883356487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 0x5560373730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.584+0000 7fe195d9b640 1 -- 172.21.15.92:0/1883356487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037365af0 msgr2=0x556037365ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:44:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.584+0000 7fe195d9b640 1 --2- 172.21.15.92:0/1883356487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037365af0 0x556037365ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.584+0000 7fe195d9b640 1 -- 172.21.15.92:0/1883356487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 msgr2=0x5560373730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.584+0000 7fe195d9b640 1 --2- 172.21.15.92:0/1883356487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 0x5560373730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.584+0000 7fe195d9b640 1 -- 172.21.15.92:0/1883356487 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556037271340 con 0x556037366410 2024-09-10T10:44:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.584+0000 7fe196d9d640 1 --2- 172.21.15.92:0/1883356487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 0x5560373730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:44:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.584+0000 7fe195d9b640 1 --2- 172.21.15.92:0/1883356487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037366410 0x556037370770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe188015840 tx=0x7fe188015d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c508996c5cc4ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.584+0000 7fe195d9b640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe1800a2ea0 0x7fe1800a5360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe188017750 tx=0x7fe18800f000 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.585+0000 7fe184ff9640 1 -- 172.21.15.92:0/1883356487 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188027070 con 0x556037366410 2024-09-10T10:44:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.585+0000 7fe184ff9640 1 -- 172.21.15.92:0/1883356487 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe188018c00 con 0x556037366410 2024-09-10T10:44:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.585+0000 7fe184ff9640 1 -- 172.21.15.92:0/1883356487 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188022b70 con 0x556037366410 2024-09-10T10:44:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.586+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1883356487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037366410 msgr2=0x556037370770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.586+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/1883356487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037366410 0x556037370770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe188015840 tx=0x7fe188015d00 comp rx=0 tx=0).stop 2024-09-10T10:44:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.586+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1883356487 shutdown_connections 2024-09-10T10:44:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.586+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/1883356487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 0x5560373730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.586+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/1883356487 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037366410 0x556037370770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.586+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/1883356487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037365af0 0x556037365ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.586+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1883356487 >> 172.21.15.92:0/1883356487 conn(0x556037362060 msgr2=0x556037362440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.587+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1883356487 shutdown_connections 2024-09-10T10:44:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.587+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1883356487 wait complete. 2024-09-10T10:44:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.587+0000 7fe19fbf5740 1 -- start start 2024-09-10T10:44:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19fbf5740 1 Processor -- start 2024-09-10T10:44:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x55603736dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 0x55603736e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037370cb0 0x55603736e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556037373880 con 0x556037366410 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x556037253290 con 0x556037365af0 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556037373a00 con 0x556037370cb0 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19fbf5740 10 client.0 _ll_register_callbacks cb 0x556037284140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x55603736dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x55603736dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:44274/0 (socket says 172.21.15.92:44274) 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19659c640 1 -- 172.21.15.92:0/3461072964 learned_addr learned my addr 172.21.15.92:0/3461072964 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe196d9d640 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037370cb0 0x55603736e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe195d9b640 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 0x55603736e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19659c640 1 -- 172.21.15.92:0/3461072964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037370cb0 msgr2=0x55603736e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19659c640 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037370cb0 0x55603736e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19659c640 1 -- 172.21.15.92:0/3461072964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 msgr2=0x55603736e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19659c640 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 0x55603736e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe19659c640 1 -- 172.21.15.92:0/3461072964 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556036fdd210 con 0x556037365af0 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.588+0000 7fe196d9d640 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037370cb0 0x55603736e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.589+0000 7fe17dffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.589+0000 7fe19659c640 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x55603736dc50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e480 tx=0x7fe18c00e940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8300b175b904be62 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.589+0000 7fe17dffb640 1 -- 172.21.15.92:0/3461072964 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c017070 con 0x556037365af0 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.589+0000 7fe17dffb640 1 -- 172.21.15.92:0/3461072964 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7fe18c00f040 con 0x556037365af0 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.589+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3461072964 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe188018c00 con 0x556037365af0 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.589+0000 7fe17dffb640 1 -- 172.21.15.92:0/3461072964 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe18c023050 con 0x556037365af0 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.589+0000 7fe19fbf5740 10 client.25424 fetch_fsmap learned FSMap version 50 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.589+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3461072964 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5560370a9620 con 0x556037365af0 2024-09-10T10:44:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.589+0000 7fe17dffb640 1 -- 172.21.15.92:0/3461072964 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe188018c00 con 0x556037365af0 2024-09-10T10:44:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe17dffb640 1 -- 172.21.15.92:0/3461072964 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7fe18c012770 con 0x556037365af0 2024-09-10T10:44:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe19fbf5740 10 client.25424 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:44:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe19fbf5740 10 client.25424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:44:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe19fbf5740 20 client.25424 populate_metadata read hostname 'smithi092' 2024-09-10T10:44:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556037380cc0 0x5560373830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe19fbf5740 4 client.25424 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:44:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3461072964 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560372d7a20 con 0x556037380cc0 2024-09-10T10:44:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe195d9b640 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556037380cc0 0x5560373830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe195d9b640 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556037380cc0 0x5560373830f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff9cb5b6944d043b server_cookie=2ba9a04bec0fea0e in_seq=0 out_seq=0 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.590+0000 7fe17dffb640 10 client.25424 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe17dffb640 1 -- 172.21.15.92:0/3461072964 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560372d7a20 con 0x556037380cc0 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe17dffb640 10 client.25424 handle_command_reply: tid=0 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 client.25424 shutdown 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3461072964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 msgr2=0x55603736dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x55603736dc50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e480 tx=0x7fe18c00e940 comp rx=0 tx=0).stop 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3461072964 shutdown_connections 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037370cb0 0x55603736e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 0x55603736e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x556037380cc0 0x5560373830f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3461072964 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x55603736dc50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3461072964 >> 172.21.15.92:0/3461072964 conn(0x556037362060 msgr2=0x556037367dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe17dffb640 0 client.25424 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3461072964 shutdown_connections 2024-09-10T10:44:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.591+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3461072964 wait complete. 2024-09-10T10:44:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.592+0000 7fe19fbf5740 20 client.25424 trim_cache size 0 max 16384 2024-09-10T10:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.612+0000 7fe19fbf5740 1 Processor -- start 2024-09-10T10:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.612+0000 7fe19fbf5740 1 -- start start 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.612+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037365af0 0x5560373685b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.612+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 0x556037368fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.612+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037370cb0 0x55603736e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.612+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981b3de0 con 0x556037366410 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.612+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981b59b0 con 0x556037370cb0 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.612+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981b44b0 con 0x556037365af0 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe195d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 0x556037368fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe196d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037370cb0 0x55603736e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe195d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 0x556037368fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36122/0 (socket says 172.21.15.92:36122) 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe195d9b640 1 -- 172.21.15.92:0/1652829707 learned_addr learned my addr 172.21.15.92:0/1652829707 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe19659c640 1 --2- 172.21.15.92:0/1652829707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037365af0 0x5560373685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe196d9d640 1 -- 172.21.15.92:0/1652829707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037365af0 msgr2=0x5560373685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe196d9d640 1 --2- 172.21.15.92:0/1652829707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037365af0 0x5560373685b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe196d9d640 1 -- 172.21.15.92:0/1652829707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 msgr2=0x556037368fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe196d9d640 1 --2- 172.21.15.92:0/1652829707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 0x556037368fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.613+0000 7fe196d9d640 1 -- 172.21.15.92:0/1652829707 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556037365920 con 0x556037370cb0 2024-09-10T10:44:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.614+0000 7fe196d9d640 1 --2- 172.21.15.92:0/1652829707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037370cb0 0x55603736e500 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe1900ecde0 tx=0x7fe1900123e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56cb3004904f8e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.614+0000 7fe17ffff640 1 -- 172.21.15.92:0/1652829707 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1900d2070 con 0x556037370cb0 2024-09-10T10:44:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.614+0000 7fe17ffff640 1 -- 172.21.15.92:0/1652829707 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1900c4820 con 0x556037370cb0 2024-09-10T10:44:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.614+0000 7fe17ffff640 1 -- 172.21.15.92:0/1652829707 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19004a050 con 0x556037370cb0 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.615+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1652829707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037370cb0 msgr2=0x55603736e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.615+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/1652829707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037370cb0 0x55603736e500 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe1900ecde0 tx=0x7fe1900123e0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.615+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1652829707 shutdown_connections 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.615+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/1652829707 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037370cb0 0x55603736e500 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.615+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/1652829707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037366410 0x556037368fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.615+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/1652829707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037365af0 0x5560373685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.615+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1652829707 >> 172.21.15.92:0/1652829707 conn(0x556037362060 msgr2=0x55603736fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.616+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1652829707 shutdown_connections 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.616+0000 7fe19fbf5740 1 -- 172.21.15.92:0/1652829707 wait complete. 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.616+0000 7fe19fbf5740 1 -- start start 2024-09-10T10:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.616+0000 7fe19fbf5740 1 Processor -- start 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.616+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x556037378c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.616+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037366410 0x5560373791d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.616+0000 7fe19fbf5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 0x556037375c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981b52e0 con 0x556037370cb0 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981b4c10 con 0x556037365af0 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe19fbf5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1981b1de0 con 0x556037366410 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe19fbf5740 10 client.0 _ll_register_callbacks cb 0x7fe18c009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe19659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x556037378c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe195d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037366410 0x5560373791d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe195d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037366410 0x5560373791d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:51256/0 (socket says 172.21.15.92:51256) 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe195d9b640 1 -- 172.21.15.92:0/3400503251 learned_addr learned my addr 172.21.15.92:0/3400503251 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe196d9d640 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 0x556037375c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe195d9b640 1 -- 172.21.15.92:0/3400503251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 msgr2=0x556037378c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe195d9b640 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x556037378c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe195d9b640 1 -- 172.21.15.92:0/3400503251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 msgr2=0x556037375c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe195d9b640 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 0x556037375c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe195d9b640 1 -- 172.21.15.92:0/3400503251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603736ea40 con 0x556037366410 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe19659c640 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x556037378c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe195d9b640 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037366410 0x5560373791d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1880094a0 tx=0x7fe188009830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65adf124e6af1297 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe17dffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe17dffb640 1 -- 172.21.15.92:0/3400503251 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188027040 con 0x556037366410 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe17dffb640 1 -- 172.21.15.92:0/3400503251 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7fe188018ac0 con 0x556037366410 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.617+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3400503251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1900c4820 con 0x556037366410 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe17dffb640 1 -- 172.21.15.92:0/3400503251 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe188009b70 con 0x556037366410 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe19fbf5740 10 client.25465 fetch_fsmap learned FSMap version 50 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3400503251 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5560373ec110 con 0x556037366410 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe17dffb640 1 -- 172.21.15.92:0/3400503251 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1900c4820 con 0x556037366410 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe17dffb640 1 -- 172.21.15.92:0/3400503251 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7fe188004250 con 0x556037366410 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe19fbf5740 10 client.25465 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:44:35.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe19fbf5740 10 client.25465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:44:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe19fbf5740 20 client.25465 populate_metadata read hostname 'smithi092' 2024-09-10T10:44:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5560373ec660 0x5560373eea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe19fbf5740 4 client.25465 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:44:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3400503251 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5560372d1d70 con 0x5560373ec660 2024-09-10T10:44:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.618+0000 7fe19659c640 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5560373ec660 0x5560373eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.619+0000 7fe17dffb640 10 client.25465 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:35.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.619+0000 7fe19659c640 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5560373ec660 0x5560373eea80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f1c7a9c7121977 server_cookie=92857cf3a9891ab9 in_seq=0 out_seq=0 2024-09-10T10:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe17dffb640 1 -- 172.21.15.92:0/3400503251 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5560372d1d70 con 0x5560373ec660 2024-09-10T10:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe17dffb640 10 client.25465 handle_command_reply: tid=0 2024-09-10T10:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 client.25465 shutdown 2024-09-10T10:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3400503251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037366410 msgr2=0x5560373791d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037366410 0x5560373791d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe1880094a0 tx=0x7fe188009830 comp rx=0 tx=0).stop 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3400503251 shutdown_connections 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556037370cb0 0x556037375c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556037366410 0x5560373791d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5560373ec660 0x5560373eea80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 --2- 172.21.15.92:0/3400503251 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x556037365af0 0x556037378c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe17dffb640 0 client.25465 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3400503251 >> 172.21.15.92:0/3400503251 conn(0x556037362060 msgr2=0x5560373609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3400503251 shutdown_connections 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 1 -- 172.21.15.92:0/3400503251 wait complete. 2024-09-10T10:44:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.626+0000 7fe19fbf5740 20 client.25465 trim_cache size 0 max 16384 2024-09-10T10:44:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:44:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:44:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:44:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:44:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 -- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe1800a2ea0 msgr2=0x7fe1800a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe1800a2ea0 0x7fe1800a5360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe188017750 tx=0x7fe18800f000 comp rx=0 tx=0).stop 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 -- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1981028f0 msgr2=0x7fe19819e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1981028f0 0x7fe19819e9f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe1900098d0 tx=0x7fe190003f10 comp rx=0 tx=0).stop 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 -- 172.21.15.92:0/845844845 shutdown_connections 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1981028f0 0x7fe19819e9f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe1800a2ea0 0x7fe1800a5360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe198101af0 0x7fe1981a4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 --2- 172.21.15.92:0/845844845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe198101130 0x7fe1981a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 -- 172.21.15.92:0/845844845 >> 172.21.15.92:0/845844845 conn(0x7fe1980770f0 msgr2=0x7fe1980fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 -- 172.21.15.92:0/845844845 shutdown_connections 2024-09-10T10:44:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:35.627+0000 7fe19cd7f640 1 -- 172.21.15.92:0/845844845 wait complete. 2024-09-10T10:44:36.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:36 smithi121 ceph-mon[35231]: pgmap v246: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 657 op/s 2024-09-10T10:44:36.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:36 smithi097 ceph-mon[35213]: pgmap v246: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 657 op/s 2024-09-10T10:44:36.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:36 smithi092 ceph-mon[30834]: pgmap v246: 97 pgs: 97 active+clean; 4.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.5 MiB/s wr, 657 op/s 2024-09-10T10:44:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 460.0 s, 1713.8 tps, lat 58.130 ms stddev 70.475 2024-09-10T10:44:38.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:38 smithi121 ceph-mon[35231]: pgmap v247: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.5 MiB/s wr, 944 op/s 2024-09-10T10:44:38.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:38 smithi097 ceph-mon[35213]: pgmap v247: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.5 MiB/s wr, 944 op/s 2024-09-10T10:44:38.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:38 smithi092 ceph-mon[30834]: pgmap v247: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.5 MiB/s wr, 944 op/s 2024-09-10T10:44:40.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:40 smithi121 ceph-mon[35231]: pgmap v248: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 571 op/s 2024-09-10T10:44:40.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:40 smithi097 ceph-mon[35213]: pgmap v248: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 571 op/s 2024-09-10T10:44:40.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:40 smithi092 ceph-mon[30834]: pgmap v248: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.0 MiB/s wr, 571 op/s 2024-09-10T10:44:42.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:42 smithi121 ceph-mon[35231]: pgmap v249: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 877 op/s 2024-09-10T10:44:42.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:42 smithi097 ceph-mon[35213]: pgmap v249: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 877 op/s 2024-09-10T10:44:42.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:42 smithi092 ceph-mon[30834]: pgmap v249: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 877 op/s 2024-09-10T10:44:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 465.0 s, 2474.2 tps, lat 40.670 ms stddev 45.302 2024-09-10T10:44:44.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:44 smithi121 ceph-mon[35231]: pgmap v250: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 594 op/s 2024-09-10T10:44:44.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:44 smithi097 ceph-mon[35213]: pgmap v250: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 594 op/s 2024-09-10T10:44:44.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:44 smithi092 ceph-mon[30834]: pgmap v250: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 594 op/s 2024-09-10T10:44:45.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:45 smithi121 ceph-mon[35231]: pgmap v251: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 594 op/s 2024-09-10T10:44:45.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:45 smithi097 ceph-mon[35213]: pgmap v251: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 594 op/s 2024-09-10T10:44:45.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:45 smithi092 ceph-mon[30834]: pgmap v251: 97 pgs: 97 active+clean; 4.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.8 MiB/s wr, 594 op/s 2024-09-10T10:44:47.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:47 smithi092 ceph-mon[30834]: pgmap v252: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.7 MiB/s wr, 886 op/s 2024-09-10T10:44:48.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:47 smithi121 ceph-mon[35231]: pgmap v252: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.7 MiB/s wr, 886 op/s 2024-09-10T10:44:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:47 smithi097 ceph-mon[35213]: pgmap v252: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.7 MiB/s wr, 886 op/s 2024-09-10T10:44:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 470.0 s, 2773.0 tps, lat 35.621 ms stddev 41.716 2024-09-10T10:44:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.750+0000 7f7690f03640 1 -- 172.21.15.92:0/4112471328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768c101ae0 msgr2=0x7f768c101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.750+0000 7f7690f03640 1 --2- 172.21.15.92:0/4112471328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768c101ae0 0x7f768c101f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7674009900 tx=0x7f767402a400 comp rx=0 tx=0).stop 2024-09-10T10:44:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.750+0000 7f7690f03640 1 -- 172.21.15.92:0/4112471328 shutdown_connections 2024-09-10T10:44:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.750+0000 7f7690f03640 1 --2- 172.21.15.92:0/4112471328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f768c102480 0x7f768c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.750+0000 7f7690f03640 1 --2- 172.21.15.92:0/4112471328 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768c101ae0 0x7f768c101f40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.750+0000 7f7690f03640 1 --2- 172.21.15.92:0/4112471328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f768c107b80 0x7f768c107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.750+0000 7f7690f03640 1 -- 172.21.15.92:0/4112471328 >> 172.21.15.92:0/4112471328 conn(0x7f768c0fd7e0 msgr2=0x7f768c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.750+0000 7f7690f03640 1 -- 172.21.15.92:0/4112471328 shutdown_connections 2024-09-10T10:44:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.750+0000 7f7690f03640 1 -- 172.21.15.92:0/4112471328 wait complete. 2024-09-10T10:44:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.751+0000 7f7690f03640 1 Processor -- start 2024-09-10T10:44:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.751+0000 7f7690f03640 1 -- start start 2024-09-10T10:44:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.751+0000 7f7690f03640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f768c101ae0 0x7f768c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.751+0000 7f7690f03640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f768c102480 0x7f768c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.751+0000 7f7690f03640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768c107b80 0x7f768c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.751+0000 7f7690f03640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f768c111ef0 con 0x7f768c102480 2024-09-10T10:44:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.751+0000 7f7690f03640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f768c111d70 con 0x7f768c107b80 2024-09-10T10:44:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.751+0000 7f7690f03640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f768c112070 con 0x7f768c101ae0 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f768c101ae0 0x7f768c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768c107b80 0x7f768c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f7683fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f768c102480 0x7f768c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768c107b80 0x7f768c19cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35334/0 (socket says 172.21.15.92:35334) 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768ad9d640 1 -- 172.21.15.92:0/3316703043 learned_addr learned my addr 172.21.15.92:0/3316703043 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768a59c640 1 -- 172.21.15.92:0/3316703043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768c107b80 msgr2=0x7f768c19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768a59c640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768c107b80 0x7f768c19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768a59c640 1 -- 172.21.15.92:0/3316703043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f768c102480 msgr2=0x7f768c198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768a59c640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f768c102480 0x7f768c198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768a59c640 1 -- 172.21.15.92:0/3316703043 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768c19d2b0 con 0x7f768c101ae0 2024-09-10T10:44:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.752+0000 7f768a59c640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f768c101ae0 0x7f768c1982c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f767c005fd0 tx=0x7f767c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.753+0000 7f76837fe640 1 -- 172.21.15.92:0/3316703043 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c009c30 con 0x7f768c101ae0 2024-09-10T10:44:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.753+0000 7f7690f03640 1 -- 172.21.15.92:0/3316703043 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768c19d5a0 con 0x7f768c101ae0 2024-09-10T10:44:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.753+0000 7f7690f03640 1 -- 172.21.15.92:0/3316703043 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768c074420 con 0x7f768c101ae0 2024-09-10T10:44:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.753+0000 7f76837fe640 1 -- 172.21.15.92:0/3316703043 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f767c009dd0 con 0x7f768c101ae0 2024-09-10T10:44:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.753+0000 7f76837fe640 1 -- 172.21.15.92:0/3316703043 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c010460 con 0x7f768c101ae0 2024-09-10T10:44:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.755+0000 7f76837fe640 1 -- 172.21.15.92:0/3316703043 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f767c0035f0 con 0x7f768c101ae0 2024-09-10T10:44:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.757+0000 7f76837fe640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f766c0a2e20 0x7f766c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.757+0000 7f76837fe640 1 -- 172.21.15.92:0/3316703043 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7f767c0ced00 con 0x7f768c101ae0 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.757+0000 7f7693c99740 1 Processor -- start 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f7693c99740 1 -- start start 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f7683fff640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f766c0a2e20 0x7f766c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f7693c99740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf72ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f7693c99740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f7693c99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 0x5647fcf800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f7693c99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5647fced72f0 con 0x5647fcf7dcb0 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f7693c99740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5647fce7f270 con 0x5647fcf73410 2024-09-10T10:44:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f7693c99740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5647fced32b0 con 0x5647fcf72af0 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f768a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf72ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f768a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf72ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34928/0 (socket says 172.21.15.92:34928) 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f768a59c640 1 -- 172.21.15.92:0/858906271 learned_addr learned my addr 172.21.15.92:0/858906271 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.758+0000 7f7683fff640 1 --2- 172.21.15.92:0/858906271 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f768ad9d640 1 --2- 172.21.15.92:0/858906271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 0x5647fcf800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f768a59c640 1 -- 172.21.15.92:0/858906271 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 msgr2=0x5647fcf7d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f768a59c640 1 --2- 172.21.15.92:0/858906271 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f768a59c640 1 -- 172.21.15.92:0/858906271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 msgr2=0x5647fcf800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f768a59c640 1 --2- 172.21.15.92:0/858906271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 0x5647fcf800a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f768a59c640 1 -- 172.21.15.92:0/858906271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647fce7e340 con 0x5647fcf72af0 2024-09-10T10:44:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f7683fff640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f766c0a2e20 0x7f766c0a52e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7674009230 tx=0x7f76740043d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f768a59c640 1 --2- 172.21.15.92:0/858906271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf72ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f767c097660 tx=0x7f767c005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44dd6f0e37d79148 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f7680ff9640 1 -- 172.21.15.92:0/858906271 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c0cc6b0 con 0x5647fcf72af0 2024-09-10T10:44:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f7680ff9640 1 -- 172.21.15.92:0/858906271 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f767c097870 con 0x5647fcf72af0 2024-09-10T10:44:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.759+0000 7f7680ff9640 1 -- 172.21.15.92:0/858906271 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c0bb2d0 con 0x5647fcf72af0 2024-09-10T10:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.760+0000 7f7693c99740 1 -- 172.21.15.92:0/858906271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 msgr2=0x5647fcf72ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.760+0000 7f7693c99740 1 --2- 172.21.15.92:0/858906271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf72ed0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f767c097660 tx=0x7f767c005dc0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.761+0000 7f7693c99740 1 -- 172.21.15.92:0/858906271 shutdown_connections 2024-09-10T10:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.761+0000 7f7693c99740 1 --2- 172.21.15.92:0/858906271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 0x5647fcf800a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.761+0000 7f7693c99740 1 --2- 172.21.15.92:0/858906271 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.761+0000 7f7693c99740 1 --2- 172.21.15.92:0/858906271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf72ed0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.761+0000 7f7693c99740 1 -- 172.21.15.92:0/858906271 >> 172.21.15.92:0/858906271 conn(0x5647fcf6f060 msgr2=0x5647fcf6f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.761+0000 7f7693c99740 1 -- 172.21.15.92:0/858906271 shutdown_connections 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.761+0000 7f7693c99740 1 -- 172.21.15.92:0/858906271 wait complete. 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7693c99740 1 -- start start 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7693c99740 1 Processor -- start 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7693c99740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf7abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7693c99740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7693c99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 0x5647fcf7b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7693c99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5647fcf80880 con 0x5647fcf7dcb0 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7693c99740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5647fce60290 con 0x5647fcf73410 2024-09-10T10:44:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7693c99740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5647fcf80a00 con 0x5647fcf72af0 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7693c99740 10 client.0 _ll_register_callbacks cb 0x5647fce91140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7683fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f768ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 0x5647fcf7b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7683fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35352/0 (socket says 172.21.15.92:35352) 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7683fff640 1 -- 172.21.15.92:0/644695416 learned_addr learned my addr 172.21.15.92:0/644695416 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f768a59c640 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf7abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7683fff640 1 -- 172.21.15.92:0/644695416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 msgr2=0x5647fcf7abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7683fff640 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf7abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7683fff640 1 -- 172.21.15.92:0/644695416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 msgr2=0x5647fcf7b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7683fff640 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 0x5647fcf7b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.762+0000 7f7683fff640 1 -- 172.21.15.92:0/644695416 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647fcbea210 con 0x5647fcf73410 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7683fff640 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7b0f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7674033000 tx=0x7f767402a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29d7ee5797625a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7679ffb640 1 -- 172.21.15.92:0/644695416 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767404f020 con 0x5647fcf73410 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7679ffb640 1 -- 172.21.15.92:0/644695416 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7f7674031950 con 0x5647fcf73410 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7693c99740 1 -- 172.21.15.92:0/644695416 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f767c097870 con 0x5647fcf73410 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7679ffb640 1 -- 172.21.15.92:0/644695416 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f767405a050 con 0x5647fcf73410 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7693c99740 10 client.25442 fetch_fsmap learned FSMap version 50 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7693c99740 1 -- 172.21.15.92:0/644695416 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5647fccb6620 con 0x5647fcf73410 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7679ffb640 1 -- 172.21.15.92:0/644695416 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7674031b50 con 0x5647fcf73410 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7679ffb640 1 -- 172.21.15.92:0/644695416 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f7674046040 con 0x5647fcf73410 2024-09-10T10:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7693c99740 10 client.25442 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7693c99740 10 client.25442 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7693c99740 20 client.25442 populate_metadata read hostname 'smithi092' 2024-09-10T10:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7693c99740 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5647fcf96550 0x5647fcf98940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7693c99740 4 client.25442 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.763+0000 7f7693c99740 1 -- 172.21.15.92:0/644695416 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f767c097870 con 0x5647fcf96550 2024-09-10T10:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.764+0000 7f768a59c640 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5647fcf96550 0x5647fcf98940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.764+0000 7f7679ffb640 10 client.25442 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.764+0000 7f768a59c640 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5647fcf96550 0x5647fcf98940 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c70684db5de1d4f1 server_cookie=c6643fc725a0a083 in_seq=0 out_seq=0 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.765+0000 7f7679ffb640 1 -- 172.21.15.92:0/644695416 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f767c097870 con 0x5647fcf96550 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.765+0000 7f7679ffb640 10 client.25442 handle_command_reply: tid=0 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.765+0000 7f7693c99740 1 client.25442 shutdown 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 -- 172.21.15.92:0/644695416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 msgr2=0x5647fcf7b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7b0f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7674033000 tx=0x7f767402a400 comp rx=0 tx=0).stop 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 -- 172.21.15.92:0/644695416 shutdown_connections 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf7dcb0 0x5647fcf7b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5647fcf96550 0x5647fcf98940 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf7b0f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 --2- 172.21.15.92:0/644695416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf72af0 0x5647fcf7abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7679ffb640 0 client.25442 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 -- 172.21.15.92:0/644695416 >> 172.21.15.92:0/644695416 conn(0x5647fcf6f060 msgr2=0x5647fcf74d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 -- 172.21.15.92:0/644695416 shutdown_connections 2024-09-10T10:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 1 -- 172.21.15.92:0/644695416 wait complete. 2024-09-10T10:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.766+0000 7f7693c99740 20 client.25442 trim_cache size 0 max 16384 2024-09-10T10:44:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.784+0000 7f7693c99740 1 Processor -- start 2024-09-10T10:44:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.784+0000 7f7693c99740 1 -- start start 2024-09-10T10:44:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f7693c99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 0x5647fcf9e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f7693c99740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf9e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f7693c99740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 0x5647fcf77df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f7693c99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f767000e660 con 0x5647fcf72af0 2024-09-10T10:44:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f7693c99740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7670010230 con 0x5647fcf73410 2024-09-10T10:44:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f7683fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf9e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f7693c99740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f767000ed30 con 0x5647fcf7dcb0 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f768ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 0x5647fcf77df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f7683fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf9e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35364/0 (socket says 172.21.15.92:35364) 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f7683fff640 1 -- 172.21.15.92:0/4178716424 learned_addr learned my addr 172.21.15.92:0/4178716424 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.785+0000 7f768ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 0x5647fcf77df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34952/0 (socket says 172.21.15.92:34952) 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.786+0000 7f7683fff640 1 -- 172.21.15.92:0/4178716424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 msgr2=0x5647fcf77df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.786+0000 7f7683fff640 1 --2- 172.21.15.92:0/4178716424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 0x5647fcf77df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.786+0000 7f7683fff640 1 -- 172.21.15.92:0/4178716424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 msgr2=0x5647fcf9e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.786+0000 7f7683fff640 1 --2- 172.21.15.92:0/4178716424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 0x5647fcf9e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.786+0000 7f7683fff640 1 -- 172.21.15.92:0/4178716424 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647fcf6ee90 con 0x5647fcf73410 2024-09-10T10:44:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.786+0000 7f7683fff640 1 --2- 172.21.15.92:0/4178716424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf9e740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7674009850 tx=0x7f7674009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ee60be8a699144b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.786+0000 7f767bfff640 1 -- 172.21.15.92:0/4178716424 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767404f040 con 0x5647fcf73410 2024-09-10T10:44:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.786+0000 7f767bfff640 1 -- 172.21.15.92:0/4178716424 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76740560f0 con 0x5647fcf73410 2024-09-10T10:44:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.786+0000 7f767bfff640 1 -- 172.21.15.92:0/4178716424 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674005560 con 0x5647fcf73410 2024-09-10T10:44:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 -- 172.21.15.92:0/4178716424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 msgr2=0x5647fcf9e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 --2- 172.21.15.92:0/4178716424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf9e740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7674009850 tx=0x7f7674009260 comp rx=0 tx=0).stop 2024-09-10T10:44:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 -- 172.21.15.92:0/4178716424 shutdown_connections 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 --2- 172.21.15.92:0/4178716424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 0x5647fcf77df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 --2- 172.21.15.92:0/4178716424 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf9e740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 --2- 172.21.15.92:0/4178716424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 0x5647fcf9e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 -- 172.21.15.92:0/4178716424 >> 172.21.15.92:0/4178716424 conn(0x5647fcf6f060 msgr2=0x5647fcf7cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 -- 172.21.15.92:0/4178716424 shutdown_connections 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 -- 172.21.15.92:0/4178716424 wait complete. 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.787+0000 7f7693c99740 1 -- start start 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7693c99740 1 Processor -- start 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7693c99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 0x5647fcf8a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7693c99740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf8ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7693c99740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 0x5647fcf8b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7693c99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f767000fb60 con 0x5647fcf72af0 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7693c99740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f767000f490 con 0x5647fcf73410 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7693c99740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f767000c660 con 0x5647fcf7dcb0 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 0x5647fcf8a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 0x5647fcf8a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55314/0 (socket says 172.21.15.92:55314) 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768a59c640 1 -- 172.21.15.92:0/1398830299 learned_addr learned my addr 172.21.15.92:0/1398830299 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7693c99740 10 client.0 _ll_register_callbacks cb 0x7f76740036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7683fff640 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf8ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768ad9d640 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 0x5647fcf8b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768a59c640 1 -- 172.21.15.92:0/1398830299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 msgr2=0x5647fcf8b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768a59c640 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 0x5647fcf8b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768a59c640 1 -- 172.21.15.92:0/1398830299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 msgr2=0x5647fcf8ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768a59c640 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf8ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768a59c640 1 -- 172.21.15.92:0/1398830299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647fd000470 con 0x5647fcf72af0 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7683fff640 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf8ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f768a59c640 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 0x5647fcf8a5d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f767c09b040 tx=0x7f767c00d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5312a48b0d980cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.788+0000 7f7679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7679ffb640 1 -- 172.21.15.92:0/1398830299 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c0b8020 con 0x5647fcf72af0 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7679ffb640 1 -- 172.21.15.92:0/1398830299 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7f767c0cc6b0 con 0x5647fcf72af0 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7693c99740 1 -- 172.21.15.92:0/1398830299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76740560f0 con 0x5647fcf72af0 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7679ffb640 1 -- 172.21.15.92:0/1398830299 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f767c097870 con 0x5647fcf72af0 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7693c99740 10 client.15945 fetch_fsmap learned FSMap version 50 2024-09-10T10:44:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7693c99740 1 -- 172.21.15.92:0/1398830299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5647fd001740 con 0x5647fcf72af0 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7679ffb640 1 -- 172.21.15.92:0/1398830299 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76740560f0 con 0x5647fcf72af0 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7679ffb640 1 -- 172.21.15.92:0/1398830299 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f767c0ccb80 con 0x5647fcf72af0 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7693c99740 10 client.15945 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7693c99740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7693c99740 20 client.15945 populate_metadata read hostname 'smithi092' 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7693c99740 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5647fd001a80 0x5647fd003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7693c99740 4 client.15945 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7693c99740 1 -- 172.21.15.92:0/1398830299 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5647fcee4a20 con 0x5647fd001a80 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.789+0000 7f7683fff640 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5647fd001a80 0x5647fd003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.790+0000 7f7683fff640 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5647fd001a80 0x5647fd003e70 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edb3b427ab260fe0 server_cookie=f69302f901081609 in_seq=0 out_seq=0 2024-09-10T10:44:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.790+0000 7f7679ffb640 10 client.15945 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7679ffb640 1 -- 172.21.15.92:0/1398830299 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5647fcee4a20 con 0x5647fd001a80 2024-09-10T10:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7679ffb640 10 client.15945 handle_command_reply: tid=0 2024-09-10T10:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7693c99740 1 client.15945 shutdown 2024-09-10T10:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7693c99740 1 -- 172.21.15.92:0/1398830299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 msgr2=0x5647fcf8a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7693c99740 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 0x5647fcf8a5d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f767c09b040 tx=0x7f767c00d8d0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7693c99740 1 -- 172.21.15.92:0/1398830299 shutdown_connections 2024-09-10T10:44:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7693c99740 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647fcf7dcb0 0x5647fcf8b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7693c99740 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5647fd001a80 0x5647fd003e70 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7693c99740 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5647fcf73410 0x5647fcf8ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7693c99740 1 --2- 172.21.15.92:0/1398830299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647fcf72af0 0x5647fcf8a5d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.799+0000 7f7693c99740 1 -- 172.21.15.92:0/1398830299 >> 172.21.15.92:0/1398830299 conn(0x5647fcf6f060 msgr2=0x5647fcf6d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.800+0000 7f7679ffb640 0 client.15945 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:44:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.800+0000 7f7693c99740 1 -- 172.21.15.92:0/1398830299 shutdown_connections 2024-09-10T10:44:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.800+0000 7f7693c99740 1 -- 172.21.15.92:0/1398830299 wait complete. 2024-09-10T10:44:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.800+0000 7f7693c99740 20 client.15945 trim_cache size 0 max 16384 2024-09-10T10:44:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:44:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:44:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:44:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:44:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 -- 172.21.15.92:0/3316703043 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f766c0a2e20 msgr2=0x7f766c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f766c0a2e20 0x7f766c0a52e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7674009230 tx=0x7f76740043d0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 -- 172.21.15.92:0/3316703043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f768c101ae0 msgr2=0x7f768c1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:44:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f768c101ae0 0x7f768c1982c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f767c005fd0 tx=0x7f767c00dde0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 -- 172.21.15.92:0/3316703043 shutdown_connections 2024-09-10T10:44:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f766c0a2e20 0x7f766c0a52e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f768c107b80 0x7f768c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f768c102480 0x7f768c198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 --2- 172.21.15.92:0/3316703043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f768c101ae0 0x7f768c1982c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:44:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 -- 172.21.15.92:0/3316703043 >> 172.21.15.92:0/3316703043 conn(0x7f768c0fd7e0 msgr2=0x7f768c0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:44:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 -- 172.21.15.92:0/3316703043 shutdown_connections 2024-09-10T10:44:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:44:48.801+0000 7f7690f03640 1 -- 172.21.15.92:0/3316703043 wait complete. 2024-09-10T10:44:48.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:48 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:44:49.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:48 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:44:49.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:48 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:44:49.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:49 smithi092 ceph-mon[30834]: pgmap v253: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 598 op/s 2024-09-10T10:44:49.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:49 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:44:49.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:49 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:44:49.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:49 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:44:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:49 smithi121 ceph-mon[35231]: pgmap v253: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 598 op/s 2024-09-10T10:44:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:49 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:44:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:49 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:44:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:49 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:44:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:49 smithi097 ceph-mon[35213]: pgmap v253: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 598 op/s 2024-09-10T10:44:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:49 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:44:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:49 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:44:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:49 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:44:52.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:51 smithi121 ceph-mon[35231]: pgmap v254: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.8 MiB/s wr, 888 op/s 2024-09-10T10:44:52.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:51 smithi097 ceph-mon[35213]: pgmap v254: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.8 MiB/s wr, 888 op/s 2024-09-10T10:44:52.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:51 smithi092 ceph-mon[30834]: pgmap v254: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.8 MiB/s wr, 888 op/s 2024-09-10T10:44:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 475.0 s, 2342.2 tps, lat 43.239 ms stddev 50.245 2024-09-10T10:44:53.912 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:53 smithi092 ceph-mon[30834]: pgmap v255: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 582 op/s 2024-09-10T10:44:54.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:53 smithi121 ceph-mon[35231]: pgmap v255: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 582 op/s 2024-09-10T10:44:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:53 smithi097 ceph-mon[35213]: pgmap v255: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 582 op/s 2024-09-10T10:44:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:55 smithi121 ceph-mon[35231]: pgmap v256: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 582 op/s 2024-09-10T10:44:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:55 smithi097 ceph-mon[35213]: pgmap v256: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 582 op/s 2024-09-10T10:44:56.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:55 smithi092 ceph-mon[30834]: pgmap v256: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 582 op/s 2024-09-10T10:44:58.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:57 smithi121 ceph-mon[35231]: pgmap v257: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.6 MiB/s wr, 861 op/s 2024-09-10T10:44:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:57 smithi097 ceph-mon[35213]: pgmap v257: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.6 MiB/s wr, 861 op/s 2024-09-10T10:44:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:57 smithi092 ceph-mon[30834]: pgmap v257: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.6 MiB/s wr, 861 op/s 2024-09-10T10:44:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 480.0 s, 1872.8 tps, lat 53.049 ms stddev 60.628 2024-09-10T10:45:00.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:44:59 smithi121 ceph-mon[35231]: pgmap v258: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.7 MiB/s wr, 569 op/s 2024-09-10T10:45:00.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:44:59 smithi097 ceph-mon[35213]: pgmap v258: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.7 MiB/s wr, 569 op/s 2024-09-10T10:45:00.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:44:59 smithi092 ceph-mon[30834]: pgmap v258: 97 pgs: 97 active+clean; 4.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.7 MiB/s wr, 569 op/s 2024-09-10T10:45:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.900+0000 7fe92a9c6640 1 -- 172.21.15.92:0/2914095633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe924103660 msgr2=0x7fe92410bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.900+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/2914095633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe924103660 0x7fe92410bb40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe918009860 tx=0x7fe91802a3d0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.900+0000 7fe92a9c6640 1 -- 172.21.15.92:0/2914095633 shutdown_connections 2024-09-10T10:45:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.900+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/2914095633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe92410c110 0x7fe92410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.900+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/2914095633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe924103660 0x7fe92410bb40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.900+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/2914095633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe924102d40 0x7fe924103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.900+0000 7fe92a9c6640 1 -- 172.21.15.92:0/2914095633 >> 172.21.15.92:0/2914095633 conn(0x7fe9240fc6b0 msgr2=0x7fe9240fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.900+0000 7fe92a9c6640 1 -- 172.21.15.92:0/2914095633 shutdown_connections 2024-09-10T10:45:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.900+0000 7fe92a9c6640 1 -- 172.21.15.92:0/2914095633 wait complete. 2024-09-10T10:45:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe92a9c6640 1 Processor -- start 2024-09-10T10:45:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe92a9c6640 1 -- start start 2024-09-10T10:45:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe92a9c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe924102d40 0x7fe924198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe92a9c6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe924103660 0x7fe924198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe92a9c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe92410c110 0x7fe92419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe92a9c6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe924111ef0 con 0x7fe92410c110 2024-09-10T10:45:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe92a9c6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe924111d70 con 0x7fe924102d40 2024-09-10T10:45:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe92a9c6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe924112070 con 0x7fe924103660 2024-09-10T10:45:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe928f63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe92410c110 0x7fe92419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe923fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe924102d40 0x7fe924198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe928f63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe92410c110 0x7fe92419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37640/0 (socket says 172.21.15.92:37640) 2024-09-10T10:45:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe923fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe924102d40 0x7fe924198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:37940/0 (socket says 172.21.15.92:37940) 2024-09-10T10:45:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe928f63640 1 -- 172.21.15.92:0/887529951 learned_addr learned my addr 172.21.15.92:0/887529951 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.901+0000 7fe9237fe640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe924103660 0x7fe924198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe928f63640 1 -- 172.21.15.92:0/887529951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe924103660 msgr2=0x7fe924198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe928f63640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe924103660 0x7fe924198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe928f63640 1 -- 172.21.15.92:0/887529951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe924102d40 msgr2=0x7fe924198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe928f63640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe924102d40 0x7fe924198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe928f63640 1 -- 172.21.15.92:0/887529951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92419d330 con 0x7fe92410c110 2024-09-10T10:45:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe923fff640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe924102d40 0x7fe924198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe9237fe640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe924103660 0x7fe924198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe928f63640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe92410c110 0x7fe92419cc00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009fd0 tx=0x7fe91c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe9217fa640 1 -- 172.21.15.92:0/887529951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c004b20 con 0x7fe92410c110 2024-09-10T10:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe9217fa640 1 -- 172.21.15.92:0/887529951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe91c003e50 con 0x7fe92410c110 2024-09-10T10:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe92a9c6640 1 -- 172.21.15.92:0/887529951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92419d620 con 0x7fe92410c110 2024-09-10T10:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe9217fa640 1 -- 172.21.15.92:0/887529951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00b630 con 0x7fe92410c110 2024-09-10T10:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.902+0000 7fe92a9c6640 1 -- 172.21.15.92:0/887529951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9241a4eb0 con 0x7fe92410c110 2024-09-10T10:45:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.904+0000 7fe9217fa640 1 -- 172.21.15.92:0/887529951 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe91c01d020 con 0x7fe92410c110 2024-09-10T10:45:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe92d837740 1 Processor -- start 2024-09-10T10:45:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe92d837740 1 -- start start 2024-09-10T10:45:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe92d837740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343d5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe92d837740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 0x5586343e0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe92d837740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe92d837740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55863433a2f0 con 0x5586343d5af0 2024-09-10T10:45:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe92d837740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5586342e2270 con 0x5586343d6410 2024-09-10T10:45:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe92d837740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5586343362b0 con 0x5586343e0cb0 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe9237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343d5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe9237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343d5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37648/0 (socket says 172.21.15.92:37648) 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe9237fe640 1 -- 172.21.15.92:0/3612297833 learned_addr learned my addr 172.21.15.92:0/3612297833 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe923fff640 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 0x5586343e0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe9217fa640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe90c0a2da0 0x7fe90c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.905+0000 7fe9237fe640 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe9217fa640 1 -- 172.21.15.92:0/887529951 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7fe91c0cf3c0 con 0x7fe92410c110 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe928f63640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe90c0a2da0 0x7fe90c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe9237fe640 1 -- 172.21.15.92:0/3612297833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 msgr2=0x5586343e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe9237fe640 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe9237fe640 1 -- 172.21.15.92:0/3612297833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 msgr2=0x5586343e0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe9237fe640 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 0x5586343e0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe9237fe640 1 -- 172.21.15.92:0/3612297833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586342e1340 con 0x5586343d5af0 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe923fff640 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 0x5586343e0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe9237fe640 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343d5ed0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe918005b60 tx=0x7fe918005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64700af25dfeaf38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe928f63640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe90c0a2da0 0x7fe90c0a5260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00cd00 tx=0x7fe91c086040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe90a7fc640 1 -- 172.21.15.92:0/3612297833 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918030690 con 0x5586343d5af0 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe90a7fc640 1 -- 172.21.15.92:0/3612297833 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe918030830 con 0x5586343d5af0 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.906+0000 7fe90a7fc640 1 -- 172.21.15.92:0/3612297833 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918004dc0 con 0x5586343d5af0 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.907+0000 7fe92d837740 1 -- 172.21.15.92:0/3612297833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 msgr2=0x5586343d5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.907+0000 7fe92d837740 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343d5ed0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe918005b60 tx=0x7fe918005a90 comp rx=0 tx=0).stop 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.907+0000 7fe92d837740 1 -- 172.21.15.92:0/3612297833 shutdown_connections 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.907+0000 7fe92d837740 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.907+0000 7fe92d837740 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 0x5586343e0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.907+0000 7fe92d837740 1 --2- 172.21.15.92:0/3612297833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343d5ed0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.907+0000 7fe92d837740 1 -- 172.21.15.92:0/3612297833 >> 172.21.15.92:0/3612297833 conn(0x5586343d2060 msgr2=0x5586343d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.908+0000 7fe92d837740 1 -- 172.21.15.92:0/3612297833 shutdown_connections 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.908+0000 7fe92d837740 1 -- 172.21.15.92:0/3612297833 wait complete. 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.908+0000 7fe92d837740 1 -- start start 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.908+0000 7fe92d837740 1 Processor -- start 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.908+0000 7fe92d837740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343ddb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe92d837740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 0x5586343de070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe92d837740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe92d837740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5586343e3880 con 0x5586343d5af0 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe92d837740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5586342c3290 con 0x5586343d6410 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe92d837740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5586343e3a00 con 0x5586343e0cb0 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343ddb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343ddb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37662/0 (socket says 172.21.15.92:37662) 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe92d837740 10 client.0 _ll_register_callbacks cb 0x5586342f4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 -- 172.21.15.92:0/3605943033 learned_addr learned my addr 172.21.15.92:0/3605943033 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe923fff640 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 0x5586343de070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 -- 172.21.15.92:0/3605943033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 msgr2=0x5586343de5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343de5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 -- 172.21.15.92:0/3605943033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 msgr2=0x5586343de070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 0x5586343de070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 -- 172.21.15.92:0/3605943033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863404d210 con 0x5586343d5af0 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9237fe640 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343ddb30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe918006010 tx=0x7fe9180309e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7695a7525be3573b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9037fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9037fe640 1 -- 172.21.15.92:0/3605943033 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe918055060 con 0x5586343d5af0 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe9037fe640 1 -- 172.21.15.92:0/3605943033 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7fe918005450 con 0x5586343d5af0 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.909+0000 7fe92d837740 1 -- 172.21.15.92:0/3605943033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe918030830 con 0x5586343d5af0 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe9037fe640 1 -- 172.21.15.92:0/3605943033 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe918004e70 con 0x5586343d5af0 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe92d837740 10 client.15957 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe92d837740 1 -- 172.21.15.92:0/3605943033 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558634119620 con 0x5586343d5af0 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe9037fe640 1 -- 172.21.15.92:0/3605943033 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe918030830 con 0x5586343d5af0 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe9037fe640 1 -- 172.21.15.92:0/3605943033 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7fe91803c4b0 con 0x5586343d5af0 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe92d837740 10 client.15957 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe92d837740 10 client.15957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe92d837740 20 client.15957 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe92d837740 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5586343f0a20 0x5586343f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe92d837740 4 client.15957 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe92d837740 1 -- 172.21.15.92:0/3605943033 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558634347a20 con 0x5586343f0a20 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.910+0000 7fe923fff640 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5586343f0a20 0x5586343f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.911+0000 7fe9037fe640 10 client.15957 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.911+0000 7fe923fff640 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5586343f0a20 0x5586343f2e10 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5e361476e847cee server_cookie=7ddfd2196b37913b in_seq=0 out_seq=0 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.911+0000 7fe9037fe640 1 -- 172.21.15.92:0/3605943033 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558634347a20 con 0x5586343f0a20 2024-09-10T10:45:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.911+0000 7fe9037fe640 10 client.15957 handle_command_reply: tid=0 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.911+0000 7fe92d837740 1 client.15957 shutdown 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 -- 172.21.15.92:0/3605943033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 msgr2=0x5586343ddb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343ddb30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe918006010 tx=0x7fe9180309e0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 -- 172.21.15.92:0/3605943033 shutdown_connections 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343de5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5586343f0a20 0x5586343f2e10 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d6410 0x5586343de070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 --2- 172.21.15.92:0/3605943033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d5af0 0x5586343ddb30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe9037fe640 0 client.15957 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 -- 172.21.15.92:0/3605943033 >> 172.21.15.92:0/3605943033 conn(0x5586343d2060 msgr2=0x5586343d7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 -- 172.21.15.92:0/3605943033 shutdown_connections 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 1 -- 172.21.15.92:0/3605943033 wait complete. 2024-09-10T10:45:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.912+0000 7fe92d837740 20 client.15957 trim_cache size 0 max 16384 2024-09-10T10:45:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.928+0000 7fe92d837740 1 Processor -- start 2024-09-10T10:45:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.928+0000 7fe92d837740 1 -- start start 2024-09-10T10:45:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe92d837740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d5af0 0x5586343de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe92d837740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343dad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe92d837740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343db2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe92d837740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241ad690 con 0x5586343d6410 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe92d837740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241af260 con 0x5586343d5af0 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe92d837740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241add60 con 0x5586343e0cb0 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe923fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343dad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe923fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343dad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37674/0 (socket says 172.21.15.92:37674) 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe923fff640 1 -- 172.21.15.92:0/1622831258 learned_addr learned my addr 172.21.15.92:0/1622831258 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe9237fe640 1 --2- 172.21.15.92:0/1622831258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d5af0 0x5586343de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe9237fe640 1 --2- 172.21.15.92:0/1622831258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343db2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe923fff640 1 -- 172.21.15.92:0/1622831258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 msgr2=0x5586343db2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe923fff640 1 --2- 172.21.15.92:0/1622831258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343db2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe923fff640 1 -- 172.21.15.92:0/1622831258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d5af0 msgr2=0x5586343de3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe923fff640 1 --2- 172.21.15.92:0/1622831258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d5af0 0x5586343de3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe923fff640 1 -- 172.21.15.92:0/1622831258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586343d1e90 con 0x5586343d6410 2024-09-10T10:45:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.929+0000 7fe923fff640 1 --2- 172.21.15.92:0/1622831258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343dad70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5586343dd3a0 tx=0x7fe914011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1709ecc6bd089fcf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe909ffb640 1 -- 172.21.15.92:0/1622831258 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91400fab0 con 0x5586343d6410 2024-09-10T10:45:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe909ffb640 1 -- 172.21.15.92:0/1622831258 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe91400fc50 con 0x5586343d6410 2024-09-10T10:45:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe909ffb640 1 -- 172.21.15.92:0/1622831258 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914026600 con 0x5586343d6410 2024-09-10T10:45:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe92d837740 1 -- 172.21.15.92:0/1622831258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 msgr2=0x5586343dad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe92d837740 1 --2- 172.21.15.92:0/1622831258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343dad70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x5586343dd3a0 tx=0x7fe914011d80 comp rx=0 tx=0).stop 2024-09-10T10:45:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe92d837740 1 -- 172.21.15.92:0/1622831258 shutdown_connections 2024-09-10T10:45:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe92d837740 1 --2- 172.21.15.92:0/1622831258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343e0cb0 0x5586343db2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe92d837740 1 --2- 172.21.15.92:0/1622831258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343dad70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe92d837740 1 --2- 172.21.15.92:0/1622831258 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343d5af0 0x5586343de3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.930+0000 7fe92d837740 1 -- 172.21.15.92:0/1622831258 >> 172.21.15.92:0/1622831258 conn(0x5586343d2060 msgr2=0x5586343dfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 -- 172.21.15.92:0/1622831258 shutdown_connections 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 -- 172.21.15.92:0/1622831258 wait complete. 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 -- start start 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 Processor -- start 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343d5af0 0x5586343f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343e0cb0 0x5586343f2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241aeb90 con 0x5586343d6410 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241ae4c0 con 0x5586343e0cb0 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9241ab690 con 0x5586343d5af0 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe92d837740 10 client.0 _ll_register_callbacks cb 0x7fe914009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:01.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe923fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe923fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343f22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37688/0 (socket says 172.21.15.92:37688) 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe9237fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343d5af0 0x5586343f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.931+0000 7fe923fff640 1 -- 172.21.15.92:0/2175847346 learned_addr learned my addr 172.21.15.92:0/2175847346 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe9237fe640 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343e0cb0 0x5586343f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe923fff640 1 -- 172.21.15.92:0/2175847346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343d5af0 msgr2=0x5586343f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe923fff640 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343d5af0 0x5586343f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe923fff640 1 -- 172.21.15.92:0/2175847346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343e0cb0 msgr2=0x5586343f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe923fff640 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343e0cb0 0x5586343f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe923fff640 1 -- 172.21.15.92:0/2175847346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863445e960 con 0x5586343d6410 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe923fff640 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343f22c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe9140105c0 tx=0x7fe91401ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71b467922f5b71c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe9037fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:45:01.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe9037fe640 1 -- 172.21.15.92:0/2175847346 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91401e620 con 0x5586343d6410 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe9037fe640 1 -- 172.21.15.92:0/2175847346 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8455+0+0 (secure 0 0 0) 0x7fe91401e7c0 con 0x5586343d6410 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe92d837740 1 -- 172.21.15.92:0/2175847346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe91400fc50 con 0x5586343d6410 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe9037fe640 1 -- 172.21.15.92:0/2175847346 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe91400fe00 con 0x5586343d6410 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe92d837740 10 client.15963 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe92d837740 1 -- 172.21.15.92:0/2175847346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55863445fc60 con 0x5586343d6410 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.932+0000 7fe9037fe640 1 -- 172.21.15.92:0/2175847346 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe91400fc50 con 0x5586343d6410 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe9037fe640 1 -- 172.21.15.92:0/2175847346 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7fe91402f020 con 0x5586343d6410 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe92d837740 10 client.15963 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe92d837740 10 client.15963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe92d837740 20 client.15963 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe92d837740 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558634460410 0x558634462830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe92d837740 4 client.15963 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe92d837740 1 -- 172.21.15.92:0/2175847346 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558634341d70 con 0x558634460410 2024-09-10T10:45:01.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe9237fe640 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558634460410 0x558634462830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe9037fe640 10 client.15963 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.933+0000 7fe9237fe640 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558634460410 0x558634462830 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4517b2f0196bd6d8 server_cookie=e5046742f420df6b in_seq=0 out_seq=0 2024-09-10T10:45:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.944+0000 7fe9037fe640 1 -- 172.21.15.92:0/2175847346 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558634341d70 con 0x558634460410 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.944+0000 7fe9037fe640 10 client.15963 handle_command_reply: tid=0 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.944+0000 7fe92d837740 1 client.15963 shutdown 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 -- 172.21.15.92:0/2175847346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 msgr2=0x5586343f22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343f22c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe9140105c0 tx=0x7fe91401ebd0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 -- 172.21.15.92:0/2175847346 shutdown_connections 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558634460410 0x558634462830 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe9037fe640 0 client.15963 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5586343e0cb0 0x5586343f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5586343d6410 0x5586343f22c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 --2- 172.21.15.92:0/2175847346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586343d5af0 0x5586343f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 -- 172.21.15.92:0/2175847346 >> 172.21.15.92:0/2175847346 conn(0x5586343d2060 msgr2=0x5586343ebcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 -- 172.21.15.92:0/2175847346 shutdown_connections 2024-09-10T10:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 1 -- 172.21.15.92:0/2175847346 wait complete. 2024-09-10T10:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92d837740 20 client.15963 trim_cache size 0 max 16384 2024-09-10T10:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92a9c6640 1 -- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe90c0a2da0 msgr2=0x7fe90c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe90c0a2da0 0x7fe90c0a5260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00cd00 tx=0x7fe91c086040 comp rx=0 tx=0).stop 2024-09-10T10:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92a9c6640 1 -- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe92410c110 msgr2=0x7fe92419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.945+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe92410c110 0x7fe92419cc00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009fd0 tx=0x7fe91c00c800 comp rx=0 tx=0).stop 2024-09-10T10:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.946+0000 7fe92a9c6640 1 -- 172.21.15.92:0/887529951 shutdown_connections 2024-09-10T10:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.946+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe92410c110 0x7fe92419cc00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.946+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe924103660 0x7fe924198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.946+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe90c0a2da0 0x7fe90c0a5260 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.946+0000 7fe92a9c6640 1 --2- 172.21.15.92:0/887529951 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe924102d40 0x7fe924198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.946+0000 7fe92a9c6640 1 -- 172.21.15.92:0/887529951 >> 172.21.15.92:0/887529951 conn(0x7fe9240fc6b0 msgr2=0x7fe9240fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.946+0000 7fe92a9c6640 1 -- 172.21.15.92:0/887529951 shutdown_connections 2024-09-10T10:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:01.946+0000 7fe92a9c6640 1 -- 172.21.15.92:0/887529951 wait complete. 2024-09-10T10:45:02.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:01 smithi121 ceph-mon[35231]: pgmap v259: 97 pgs: 97 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 834 op/s 2024-09-10T10:45:02.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:01 smithi097 ceph-mon[35213]: pgmap v259: 97 pgs: 97 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 834 op/s 2024-09-10T10:45:02.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:01 smithi092 ceph-mon[30834]: pgmap v259: 97 pgs: 97 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.2 MiB/s wr, 834 op/s 2024-09-10T10:45:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 485.0 s, 1201.5 tps, lat 74.589 ms stddev 131.587 2024-09-10T10:45:04.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:03 smithi121 ceph-mon[35231]: pgmap v260: 97 pgs: 97 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-09-10T10:45:04.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:03 smithi097 ceph-mon[35213]: pgmap v260: 97 pgs: 97 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-09-10T10:45:04.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:03 smithi092 ceph-mon[30834]: pgmap v260: 97 pgs: 97 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-09-10T10:45:06.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:05 smithi121 ceph-mon[35231]: pgmap v261: 97 pgs: 97 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-09-10T10:45:06.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:05 smithi097 ceph-mon[35213]: pgmap v261: 97 pgs: 97 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-09-10T10:45:06.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:05 smithi092 ceph-mon[30834]: pgmap v261: 97 pgs: 97 active+clean; 4.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.1 MiB/s wr, 544 op/s 2024-09-10T10:45:08.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:07 smithi121 ceph-mon[35231]: pgmap v262: 97 pgs: 97 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 32 MiB/s wr, 1.77k op/s 2024-09-10T10:45:08.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:07 smithi121 ceph-mon[35231]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T10:45:08.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:07 smithi097 ceph-mon[35213]: pgmap v262: 97 pgs: 97 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 32 MiB/s wr, 1.77k op/s 2024-09-10T10:45:08.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:07 smithi097 ceph-mon[35213]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T10:45:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:07 smithi092 ceph-mon[30834]: pgmap v262: 97 pgs: 97 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 32 MiB/s wr, 1.77k op/s 2024-09-10T10:45:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:07 smithi092 ceph-mon[30834]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T10:45:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 490.0 s, 1640.3 tps, lat 67.322 ms stddev 151.698 2024-09-10T10:45:10.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:09 smithi121 ceph-mon[35231]: pgmap v264: 97 pgs: 97 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.79k op/s 2024-09-10T10:45:10.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:09 smithi097 ceph-mon[35213]: pgmap v264: 97 pgs: 97 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.79k op/s 2024-09-10T10:45:10.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:09 smithi092 ceph-mon[30834]: pgmap v264: 97 pgs: 97 active+clean; 5.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.79k op/s 2024-09-10T10:45:12.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:11 smithi121 ceph-mon[35231]: pgmap v265: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 1.83k op/s 2024-09-10T10:45:12.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:11 smithi097 ceph-mon[35213]: pgmap v265: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 1.83k op/s 2024-09-10T10:45:12.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:11 smithi092 ceph-mon[30834]: pgmap v265: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 1.83k op/s 2024-09-10T10:45:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 495.0 s, 1863.2 tps, lat 53.721 ms stddev 59.944 2024-09-10T10:45:14.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:13 smithi121 ceph-mon[35231]: pgmap v266: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 1.83k op/s 2024-09-10T10:45:14.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:13 smithi097 ceph-mon[35213]: pgmap v266: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 1.83k op/s 2024-09-10T10:45:14.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:13 smithi092 ceph-mon[30834]: pgmap v266: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 1.83k op/s 2024-09-10T10:45:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.070+0000 7fbb76e65640 1 -- 172.21.15.92:0/1332145181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 msgr2=0x7fbb70100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.070+0000 7fbb76e65640 1 --2- 172.21.15.92:0/1332145181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 0x7fbb70100e30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009900 tx=0x7fbb5c02a410 comp rx=0 tx=0).stop 2024-09-10T10:45:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.070+0000 7fbb76e65640 1 -- 172.21.15.92:0/1332145181 shutdown_connections 2024-09-10T10:45:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.070+0000 7fbb76e65640 1 --2- 172.21.15.92:0/1332145181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb70101370 0x7fbb7010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.070+0000 7fbb76e65640 1 --2- 172.21.15.92:0/1332145181 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 0x7fbb70100e30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.070+0000 7fbb76e65640 1 --2- 172.21.15.92:0/1332145181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb701069e0 0x7fbb70106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.070+0000 7fbb76e65640 1 -- 172.21.15.92:0/1332145181 >> 172.21.15.92:0/1332145181 conn(0x7fbb700fc6f0 msgr2=0x7fbb700feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.070+0000 7fbb76e65640 1 -- 172.21.15.92:0/1332145181 shutdown_connections 2024-09-10T10:45:15.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.070+0000 7fbb76e65640 1 -- 172.21.15.92:0/1332145181 wait complete. 2024-09-10T10:45:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.071+0000 7fbb76e65640 1 Processor -- start 2024-09-10T10:45:15.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.071+0000 7fbb76e65640 1 -- start start 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.071+0000 7fbb76e65640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 0x7fbb701972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.071+0000 7fbb76e65640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb70101370 0x7fbb701977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.071+0000 7fbb76e65640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb701069e0 0x7fbb7019bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.071+0000 7fbb76e65640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70110e30 con 0x7fbb70101370 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.071+0000 7fbb76e65640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70110cb0 con 0x7fbb701009d0 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb74c01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 0x7fbb701972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb76e65640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70110fb0 con 0x7fbb701069e0 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb6ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb70101370 0x7fbb701977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb74c01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 0x7fbb701972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:40932/0 (socket says 172.21.15.92:40932) 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb74c01640 1 -- 172.21.15.92:0/2504897785 learned_addr learned my addr 172.21.15.92:0/2504897785 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb74c01640 1 -- 172.21.15.92:0/2504897785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb701069e0 msgr2=0x7fbb7019bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb74c01640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb701069e0 0x7fbb7019bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb74c01640 1 -- 172.21.15.92:0/2504897785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb70101370 msgr2=0x7fbb701977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb74c01640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb70101370 0x7fbb701977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.072+0000 7fbb74c01640 1 -- 172.21.15.92:0/2504897785 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7019c290 con 0x7fbb701009d0 2024-09-10T10:45:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.073+0000 7fbb74c01640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 0x7fbb701972a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400bf40 tx=0x7fbb6400dd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.073+0000 7fbb6dffb640 1 -- 172.21.15.92:0/2504897785 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6401b030 con 0x7fbb701009d0 2024-09-10T10:45:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.073+0000 7fbb6dffb640 1 -- 172.21.15.92:0/2504897785 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb64014b80 con 0x7fbb701009d0 2024-09-10T10:45:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.073+0000 7fbb76e65640 1 -- 172.21.15.92:0/2504897785 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7019c580 con 0x7fbb701009d0 2024-09-10T10:45:15.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.073+0000 7fbb76e65640 1 -- 172.21.15.92:0/2504897785 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7006a2a0 con 0x7fbb701009d0 2024-09-10T10:45:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.074+0000 7fbb6dffb640 1 -- 172.21.15.92:0/2504897785 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64009820 con 0x7fbb701009d0 2024-09-10T10:45:15.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.076+0000 7fbb6dffb640 1 -- 172.21.15.92:0/2504897785 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fbb640099c0 con 0x7fbb701009d0 2024-09-10T10:45:15.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.077+0000 7fbb79c03740 1 Processor -- start 2024-09-10T10:45:15.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.077+0000 7fbb79c03740 1 -- start start 2024-09-10T10:45:15.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.077+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 0x560ba2cc1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.077+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2ccc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.077+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2ccf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.077+0000 7fbb79c03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ba2c262f0 con 0x560ba2ccccb0 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.077+0000 7fbb79c03740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560ba2bce270 con 0x560ba2cc2410 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.077+0000 7fbb79c03740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560ba2c222b0 con 0x560ba2cc1af0 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb74c01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2ccc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb75402640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 0x560ba2cc1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb74c01640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2ccc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:40934/0 (socket says 172.21.15.92:40934) 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb74c01640 1 -- 172.21.15.92:0/3299301986 learned_addr learned my addr 172.21.15.92:0/3299301986 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb6ffff640 1 --2- 172.21.15.92:0/3299301986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2ccf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb74c01640 1 -- 172.21.15.92:0/3299301986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 msgr2=0x560ba2cc1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb74c01640 1 --2- 172.21.15.92:0/3299301986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 0x560ba2cc1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb74c01640 1 -- 172.21.15.92:0/3299301986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 msgr2=0x560ba2ccf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:15.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb74c01640 1 --2- 172.21.15.92:0/3299301986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2ccf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb74c01640 1 -- 172.21.15.92:0/3299301986 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba2bcd340 con 0x560ba2cc2410 2024-09-10T10:45:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb6ffff640 1 --2- 172.21.15.92:0/3299301986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2ccf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:45:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb6dffb640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fbb600a2ea0 0x7fbb600a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb74c01640 1 --2- 172.21.15.92:0/3299301986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2ccc770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbb640d08b0 tx=0x7fbb640d6f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e766e46f0aa69495 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb75402640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fbb600a2ea0 0x7fbb600a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb5affd640 1 -- 172.21.15.92:0/3299301986 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6409ca30 con 0x560ba2cc2410 2024-09-10T10:45:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb6dffb640 1 -- 172.21.15.92:0/2504897785 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7fbb640d3240 con 0x7fbb701009d0 2024-09-10T10:45:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb5affd640 1 -- 172.21.15.92:0/3299301986 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb640575c0 con 0x560ba2cc2410 2024-09-10T10:45:15.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.078+0000 7fbb5affd640 1 -- 172.21.15.92:0/3299301986 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64079d10 con 0x560ba2cc2410 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.080+0000 7fbb79c03740 1 -- 172.21.15.92:0/3299301986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 msgr2=0x560ba2ccc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.080+0000 7fbb79c03740 1 --2- 172.21.15.92:0/3299301986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2ccc770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbb640d08b0 tx=0x7fbb640d6f90 comp rx=0 tx=0).stop 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.081+0000 7fbb75402640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fbb600a2ea0 0x7fbb600a5360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009270 tx=0x7fbb68009200 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.081+0000 7fbb79c03740 1 -- 172.21.15.92:0/3299301986 shutdown_connections 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.081+0000 7fbb79c03740 1 --2- 172.21.15.92:0/3299301986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2ccf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.081+0000 7fbb79c03740 1 --2- 172.21.15.92:0/3299301986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2ccc770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.081+0000 7fbb79c03740 1 --2- 172.21.15.92:0/3299301986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 0x560ba2cc1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.081+0000 7fbb79c03740 1 -- 172.21.15.92:0/3299301986 >> 172.21.15.92:0/3299301986 conn(0x560ba2cbe060 msgr2=0x560ba2cbe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.081+0000 7fbb79c03740 1 -- 172.21.15.92:0/3299301986 shutdown_connections 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.081+0000 7fbb79c03740 1 -- 172.21.15.92:0/3299301986 wait complete. 2024-09-10T10:45:15.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb79c03740 1 -- start start 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb79c03740 1 Processor -- start 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 0x560ba2cc9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2cca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2cca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb79c03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ba2ccf880 con 0x560ba2ccccb0 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb79c03740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x560ba2baf290 con 0x560ba2cc2410 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb6ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2cca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb79c03740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560ba2ccfa00 con 0x560ba2cc1af0 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb75402640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2cca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb6ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2cca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:40944/0 (socket says 172.21.15.92:40944) 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb6ffff640 1 -- 172.21.15.92:0/226345698 learned_addr learned my addr 172.21.15.92:0/226345698 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb74c01640 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 0x560ba2cc9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.082+0000 7fbb79c03740 10 client.0 _ll_register_callbacks cb 0x560ba2be0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.083+0000 7fbb6ffff640 1 -- 172.21.15.92:0/226345698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 msgr2=0x560ba2cc9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.083+0000 7fbb6ffff640 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 0x560ba2cc9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.083+0000 7fbb6ffff640 1 -- 172.21.15.92:0/226345698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 msgr2=0x560ba2cca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.083+0000 7fbb6ffff640 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2cca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.083+0000 7fbb6ffff640 1 -- 172.21.15.92:0/226345698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ba2939210 con 0x560ba2cc2410 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.083+0000 7fbb75402640 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2cca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.083+0000 7fbb6ffff640 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2cca020 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbb700fea20 tx=0x7fbb5c0052f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ff0fe008dca041 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.083+0000 7fbb4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb4ffff640 1 -- 172.21.15.92:0/226345698 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c035030 con 0x560ba2cc2410 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb4ffff640 1 -- 172.21.15.92:0/226345698 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7fbb5c0048c0 con 0x560ba2cc2410 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb79c03740 1 -- 172.21.15.92:0/226345698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb640575c0 con 0x560ba2cc2410 2024-09-10T10:45:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb4ffff640 1 -- 172.21.15.92:0/226345698 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbb5c005d50 con 0x560ba2cc2410 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb79c03740 10 client.25478 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb79c03740 1 -- 172.21.15.92:0/226345698 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x560ba2a05620 con 0x560ba2cc2410 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb4ffff640 1 -- 172.21.15.92:0/226345698 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb640575c0 con 0x560ba2cc2410 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb4ffff640 1 -- 172.21.15.92:0/226345698 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7fbb5c003b50 con 0x560ba2cc2410 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb79c03740 10 client.25478 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb79c03740 10 client.25478 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb79c03740 20 client.25478 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.084+0000 7fbb79c03740 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x560ba2ce53e0 0x560ba2ce77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.085+0000 7fbb79c03740 4 client.25478 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.085+0000 7fbb79c03740 1 -- 172.21.15.92:0/226345698 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ba2c33a20 con 0x560ba2ce53e0 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.085+0000 7fbb74c01640 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x560ba2ce53e0 0x560ba2ce77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.085+0000 7fbb74c01640 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x560ba2ce53e0 0x560ba2ce77d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=526c75b8d3990d9f server_cookie=47ffb177a7bac37e in_seq=0 out_seq=0 2024-09-10T10:45:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.085+0000 7fbb4ffff640 10 client.25478 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb4ffff640 1 -- 172.21.15.92:0/226345698 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ba2c33a20 con 0x560ba2ce53e0 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb4ffff640 10 client.25478 handle_command_reply: tid=0 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 client.25478 shutdown 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 -- 172.21.15.92:0/226345698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 msgr2=0x560ba2cca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2cca020 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbb700fea20 tx=0x7fbb5c0052f0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 -- 172.21.15.92:0/226345698 shutdown_connections 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2ccccb0 0x560ba2cca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x560ba2ce53e0 0x560ba2ce77d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2cc2410 0x560ba2cca020 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 --2- 172.21.15.92:0/226345698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc1af0 0x560ba2cc9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb4ffff640 0 client.25478 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 -- 172.21.15.92:0/226345698 >> 172.21.15.92:0/226345698 conn(0x560ba2cbe060 msgr2=0x560ba2cc3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 -- 172.21.15.92:0/226345698 shutdown_connections 2024-09-10T10:45:15.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 1 -- 172.21.15.92:0/226345698 wait complete. 2024-09-10T10:45:15.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.086+0000 7fbb79c03740 20 client.25478 trim_cache size 0 max 16384 2024-09-10T10:45:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb79c03740 1 Processor -- start 2024-09-10T10:45:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb79c03740 1 -- start start 2024-09-10T10:45:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2ced130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 0x560ba2ced670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cbc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb79c03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5400e660 con 0x560ba2cc1af0 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb79c03740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54010230 con 0x560ba2ccccb0 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb79c03740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5400ed30 con 0x560ba2cc2410 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb74c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2ced130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb74c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2ced130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54756/0 (socket says 172.21.15.92:54756) 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb74c01640 1 -- 172.21.15.92:0/3336199706 learned_addr learned my addr 172.21.15.92:0/3336199706 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.108+0000 7fbb75402640 1 --2- 172.21.15.92:0/3336199706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cbc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.109+0000 7fbb6ffff640 1 --2- 172.21.15.92:0/3336199706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 0x560ba2ced670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.109+0000 7fbb74c01640 1 -- 172.21.15.92:0/3336199706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 msgr2=0x560ba2ced670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.109+0000 7fbb74c01640 1 --2- 172.21.15.92:0/3336199706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 0x560ba2ced670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.109+0000 7fbb74c01640 1 -- 172.21.15.92:0/3336199706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 msgr2=0x560ba2cbc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.109+0000 7fbb74c01640 1 --2- 172.21.15.92:0/3336199706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cbc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.109+0000 7fbb74c01640 1 -- 172.21.15.92:0/3336199706 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ba2cbde90 con 0x560ba2cc1af0 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.109+0000 7fbb74c01640 1 --2- 172.21.15.92:0/3336199706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2ced130 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb64005c60 tx=0x7fbb64005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b5bcfa90403cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.110+0000 7fbb5a7fc640 1 -- 172.21.15.92:0/3336199706 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64018070 con 0x560ba2cc1af0 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.110+0000 7fbb5a7fc640 1 -- 172.21.15.92:0/3336199706 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb640a0e90 con 0x560ba2cc1af0 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.110+0000 7fbb5a7fc640 1 -- 172.21.15.92:0/3336199706 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64079f10 con 0x560ba2cc1af0 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 -- 172.21.15.92:0/3336199706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 msgr2=0x560ba2ced130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 --2- 172.21.15.92:0/3336199706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2ced130 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb64005c60 tx=0x7fbb64005bf0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 -- 172.21.15.92:0/3336199706 shutdown_connections 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 --2- 172.21.15.92:0/3336199706 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cbc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 --2- 172.21.15.92:0/3336199706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 0x560ba2ced670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 --2- 172.21.15.92:0/3336199706 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2ced130 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 -- 172.21.15.92:0/3336199706 >> 172.21.15.92:0/3336199706 conn(0x560ba2cbe060 msgr2=0x560ba2cc8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:15.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 -- 172.21.15.92:0/3336199706 shutdown_connections 2024-09-10T10:45:15.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 -- 172.21.15.92:0/3336199706 wait complete. 2024-09-10T10:45:15.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 -- start start 2024-09-10T10:45:15.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.111+0000 7fbb79c03740 1 Processor -- start 2024-09-10T10:45:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2cddd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 0x560ba2ccdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb79c03740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb79c03740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5400fb60 con 0x560ba2cc1af0 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb79c03740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5400f490 con 0x560ba2ccccb0 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb79c03740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5400c660 con 0x560ba2cc2410 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb75402640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb74c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2cddd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb75402640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cce070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:40956/0 (socket says 172.21.15.92:40956) 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb74c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2cddd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54770/0 (socket says 172.21.15.92:54770) 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb75402640 1 -- 172.21.15.92:0/912734880 learned_addr learned my addr 172.21.15.92:0/912734880 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.112+0000 7fbb79c03740 10 client.0 _ll_register_callbacks cb 0x7fbb680093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.113+0000 7fbb6ffff640 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 0x560ba2ccdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.113+0000 7fbb75402640 1 -- 172.21.15.92:0/912734880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 msgr2=0x560ba2ccdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.113+0000 7fbb75402640 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 0x560ba2ccdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.113+0000 7fbb75402640 1 -- 172.21.15.92:0/912734880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 msgr2=0x560ba2cddd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.113+0000 7fbb75402640 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2cddd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.113+0000 7fbb75402640 1 -- 172.21.15.92:0/912734880 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ba2cce8c0 con 0x560ba2ccccb0 2024-09-10T10:45:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.113+0000 7fbb75402640 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cce070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb68004590 tx=0x7fbb68004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4fda4717c7b5a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.113+0000 7fbb4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:45:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.114+0000 7fbb4ffff640 1 -- 172.21.15.92:0/912734880 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6800fd10 con 0x560ba2ccccb0 2024-09-10T10:45:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.114+0000 7fbb4ffff640 1 -- 172.21.15.92:0/912734880 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7fbb6801e400 con 0x560ba2ccccb0 2024-09-10T10:45:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.114+0000 7fbb79c03740 1 -- 172.21.15.92:0/912734880 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb640a0e90 con 0x560ba2ccccb0 2024-09-10T10:45:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb4ffff640 1 -- 172.21.15.92:0/912734880 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbb6801e600 con 0x560ba2ccccb0 2024-09-10T10:45:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb79c03740 10 client.25484 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb79c03740 1 -- 172.21.15.92:0/912734880 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x560ba2d501c0 con 0x560ba2ccccb0 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb4ffff640 1 -- 172.21.15.92:0/912734880 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb640a0e90 con 0x560ba2ccccb0 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb4ffff640 1 -- 172.21.15.92:0/912734880 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7fbb6801a070 con 0x560ba2ccccb0 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb79c03740 10 client.25484 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb79c03740 10 client.25484 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb79c03740 20 client.25484 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb79c03740 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x560ba2d508a0 0x560ba2d52cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb79c03740 4 client.25484 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb79c03740 1 -- 172.21.15.92:0/912734880 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560ba2c2dd70 con 0x560ba2d508a0 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.115+0000 7fbb74c01640 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x560ba2d508a0 0x560ba2d52cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.116+0000 7fbb4ffff640 10 client.25484 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:15.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.116+0000 7fbb74c01640 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x560ba2d508a0 0x560ba2d52cc0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0fed7b2120d3232 server_cookie=f73ca7db0171660b in_seq=0 out_seq=0 2024-09-10T10:45:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb4ffff640 1 -- 172.21.15.92:0/912734880 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560ba2c2dd70 con 0x560ba2d508a0 2024-09-10T10:45:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb4ffff640 10 client.25484 handle_command_reply: tid=0 2024-09-10T10:45:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 client.25484 shutdown 2024-09-10T10:45:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 -- 172.21.15.92:0/912734880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 msgr2=0x560ba2cce070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cce070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb68004590 tx=0x7fbb68004a40 comp rx=0 tx=0).stop 2024-09-10T10:45:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 -- 172.21.15.92:0/912734880 shutdown_connections 2024-09-10T10:45:15.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x560ba2d508a0 0x560ba2d52cc0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x560ba2ccccb0 0x560ba2cce070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb4ffff640 0 client.25484 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560ba2cc2410 0x560ba2ccdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 --2- 172.21.15.92:0/912734880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ba2cc1af0 0x560ba2cddd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 -- 172.21.15.92:0/912734880 >> 172.21.15.92:0/912734880 conn(0x560ba2cbe060 msgr2=0x560ba2cbc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 -- 172.21.15.92:0/912734880 shutdown_connections 2024-09-10T10:45:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 1 -- 172.21.15.92:0/912734880 wait complete. 2024-09-10T10:45:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.125+0000 7fbb79c03740 20 client.25484 trim_cache size 0 max 16384 2024-09-10T10:45:15.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:45:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:45:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:45:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:45:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 -- 172.21.15.92:0/2504897785 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fbb600a2ea0 msgr2=0x7fbb600a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fbb600a2ea0 0x7fbb600a5360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009270 tx=0x7fbb68009200 comp rx=0 tx=0).stop 2024-09-10T10:45:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 -- 172.21.15.92:0/2504897785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 msgr2=0x7fbb701972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 0x7fbb701972a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400bf40 tx=0x7fbb6400dd60 comp rx=0 tx=0).stop 2024-09-10T10:45:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 -- 172.21.15.92:0/2504897785 shutdown_connections 2024-09-10T10:45:15.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb701069e0 0x7fbb7019bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb70101370 0x7fbb701977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fbb600a2ea0 0x7fbb600a5360 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 --2- 172.21.15.92:0/2504897785 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fbb701009d0 0x7fbb701972a0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbb6400bf40 tx=0x7fbb6400dd60 comp rx=0 tx=0).stop 2024-09-10T10:45:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.126+0000 7fbb76e65640 1 -- 172.21.15.92:0/2504897785 >> 172.21.15.92:0/2504897785 conn(0x7fbb700fc6f0 msgr2=0x7fbb700fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.127+0000 7fbb76e65640 1 -- 172.21.15.92:0/2504897785 shutdown_connections 2024-09-10T10:45:15.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:15.127+0000 7fbb76e65640 1 -- 172.21.15.92:0/2504897785 wait complete. 2024-09-10T10:45:15.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:15 smithi121 ceph-mon[35231]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T10:45:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:15 smithi097 ceph-mon[35213]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T10:45:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:15 smithi092 ceph-mon[30834]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T10:45:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:16 smithi121 ceph-mon[35231]: pgmap v268: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.0 MiB/s wr, 446 op/s 2024-09-10T10:45:16.822 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:16 smithi097 ceph-mon[35213]: pgmap v268: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.0 MiB/s wr, 446 op/s 2024-09-10T10:45:16.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:16 smithi092 ceph-mon[30834]: pgmap v268: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.0 MiB/s wr, 446 op/s 2024-09-10T10:45:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 500.0 s, 2552.2 tps, lat 39.322 ms stddev 46.858 2024-09-10T10:45:18.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:18 smithi121 ceph-mon[35231]: pgmap v269: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.4 MiB/s wr, 685 op/s 2024-09-10T10:45:18.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:18 smithi097 ceph-mon[35213]: pgmap v269: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.4 MiB/s wr, 685 op/s 2024-09-10T10:45:18.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:18 smithi092 ceph-mon[30834]: pgmap v269: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.4 MiB/s wr, 685 op/s 2024-09-10T10:45:20.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:20 smithi121 ceph-mon[35231]: pgmap v270: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.4 MiB/s wr, 679 op/s 2024-09-10T10:45:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:20 smithi097 ceph-mon[35213]: pgmap v270: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.4 MiB/s wr, 679 op/s 2024-09-10T10:45:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:20 smithi092 ceph-mon[30834]: pgmap v270: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.4 MiB/s wr, 679 op/s 2024-09-10T10:45:22.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:22 smithi121 ceph-mon[35231]: pgmap v271: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T10:45:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:22 smithi097 ceph-mon[35213]: pgmap v271: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T10:45:22.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:22 smithi092 ceph-mon[30834]: pgmap v271: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T10:45:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 505.0 s, 2490.0 tps, lat 39.914 ms stddev 44.316 2024-09-10T10:45:24.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:24 smithi121 ceph-mon[35231]: pgmap v272: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T10:45:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:24 smithi097 ceph-mon[35213]: pgmap v272: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T10:45:24.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:24 smithi092 ceph-mon[30834]: pgmap v272: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-10T10:45:26.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:26 smithi121 ceph-mon[35231]: pgmap v273: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.4 MiB/s wr, 665 op/s 2024-09-10T10:45:26.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:26 smithi097 ceph-mon[35213]: pgmap v273: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.4 MiB/s wr, 665 op/s 2024-09-10T10:45:26.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:26 smithi092 ceph-mon[30834]: pgmap v273: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.4 MiB/s wr, 665 op/s 2024-09-10T10:45:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 510.0 s, 2374.6 tps, lat 42.423 ms stddev 48.120 2024-09-10T10:45:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.265+0000 7f9fd7fff640 1 -- 172.21.15.92:0/97805271 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80319b0 con 0x7f9fe010d4b0 2024-09-10T10:45:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.266+0000 7f9fe79d6640 1 -- 172.21.15.92:0/97805271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe010d4b0 msgr2=0x7f9fe0115000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.266+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/97805271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe010d4b0 0x7f9fe0115000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009900 tx=0x7f9fd802a3f0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.266+0000 7f9fe79d6640 1 -- 172.21.15.92:0/97805271 shutdown_connections 2024-09-10T10:45:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.266+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/97805271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe010d4b0 0x7f9fe0115000 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.266+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/97805271 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe0108d10 0x7f9fe010cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.266+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/97805271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe0108360 0x7f9fe0108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.266+0000 7f9fe79d6640 1 -- 172.21.15.92:0/97805271 >> 172.21.15.92:0/97805271 conn(0x7f9fe0077ad0 msgr2=0x7f9fe0079ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.266+0000 7f9fe79d6640 1 -- 172.21.15.92:0/97805271 shutdown_connections 2024-09-10T10:45:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.266+0000 7f9fe79d6640 1 -- 172.21.15.92:0/97805271 wait complete. 2024-09-10T10:45:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe79d6640 1 Processor -- start 2024-09-10T10:45:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe79d6640 1 -- start start 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe79d6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe0108360 0x7f9fe01a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe79d6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe010d4b0 0x7f9fe01a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe79d6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe019e700 0x7f9fe019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe79d6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0118530 con 0x7f9fe010d4b0 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe79d6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01183b0 con 0x7f9fe0108360 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe79d6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01186b0 con 0x7f9fe019e700 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5772640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe0108360 0x7f9fe01a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5772640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe0108360 0x7f9fe01a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:53730/0 (socket says 172.21.15.92:53730) 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5772640 1 -- 172.21.15.92:0/3854984192 learned_addr learned my addr 172.21.15.92:0/3854984192 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe4f71640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe010d4b0 0x7f9fe01a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5f73640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe019e700 0x7f9fe019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5772640 1 -- 172.21.15.92:0/3854984192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe019e700 msgr2=0x7f9fe019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5772640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe019e700 0x7f9fe019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5772640 1 -- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe010d4b0 msgr2=0x7f9fe01a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5772640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe010d4b0 0x7f9fe01a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5772640 1 -- 172.21.15.92:0/3854984192 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe019f300 con 0x7f9fe0108360 2024-09-10T10:45:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.267+0000 7f9fe5f73640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe019e700 0x7f9fe019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.268+0000 7f9fe5772640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe0108360 0x7f9fe01a4640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000d950 tx=0x7f9fd000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.268+0000 7f9fd67fc640 1 -- 172.21.15.92:0/3854984192 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0017070 con 0x7f9fe0108360 2024-09-10T10:45:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.268+0000 7f9fd67fc640 1 -- 172.21.15.92:0/3854984192 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd0009c30 con 0x7f9fe0108360 2024-09-10T10:45:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.268+0000 7f9fd67fc640 1 -- 172.21.15.92:0/3854984192 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000f6b0 con 0x7f9fe0108360 2024-09-10T10:45:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.268+0000 7f9fe79d6640 1 -- 172.21.15.92:0/3854984192 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe01ab3e0 con 0x7f9fe0108360 2024-09-10T10:45:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.268+0000 7f9fe79d6640 1 -- 172.21.15.92:0/3854984192 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe01ab790 con 0x7f9fe0108360 2024-09-10T10:45:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.272+0000 7f9fea84a740 1 Processor -- start 2024-09-10T10:45:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.272+0000 7f9fea84a740 1 -- start start 2024-09-10T10:45:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.272+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb037faf0 0x55deb037fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.272+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb038a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.272+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb038d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.274 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.272+0000 7f9fea84a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55deb02e42f0 con 0x55deb0380410 2024-09-10T10:45:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.272+0000 7f9fea84a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55deb028c270 con 0x55deb038acb0 2024-09-10T10:45:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.272+0000 7f9fea84a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55deb02e02b0 con 0x55deb037faf0 2024-09-10T10:45:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.273+0000 7f9fe5f73640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb037faf0 0x55deb037fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.273+0000 7f9fe5f73640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb037faf0 0x55deb037fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:59728/0 (socket says 172.21.15.92:59728) 2024-09-10T10:45:28.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.273+0000 7f9fe5f73640 1 -- 172.21.15.92:0/245798950 learned_addr learned my addr 172.21.15.92:0/245798950 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.273+0000 7f9fe4f71640 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb038d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.274+0000 7f9fd67fc640 1 -- 172.21.15.92:0/3854984192 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9fd00109d0 con 0x7f9fe0108360 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.274+0000 7f9fe5772640 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb038a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.274+0000 7f9fe4f71640 1 -- 172.21.15.92:0/245798950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb037faf0 msgr2=0x55deb037fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.274+0000 7f9fe4f71640 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb037faf0 0x55deb037fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.274+0000 7f9fe4f71640 1 -- 172.21.15.92:0/245798950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 msgr2=0x55deb038a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.274+0000 7f9fe4f71640 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb038a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.274+0000 7f9fe4f71640 1 -- 172.21.15.92:0/245798950 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb028b340 con 0x55deb038acb0 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.274+0000 7f9fe5f73640 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb037faf0 0x55deb037fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:28.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.274+0000 7f9fe5772640 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb038a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:45:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.275+0000 7f9fe4f71640 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb038d0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9fe019ff50 tx=0x7f9fdc00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bc569da8c3dd3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.275+0000 7f9fcb7fe640 1 -- 172.21.15.92:0/245798950 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc003b70 con 0x55deb038acb0 2024-09-10T10:45:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.275+0000 7f9fd67fc640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a2ea0 0x7f9fcc0a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.275+0000 7f9fd67fc640 1 -- 172.21.15.92:0/3854984192 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7f9fd00cef50 con 0x7f9fe0108360 2024-09-10T10:45:28.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.275+0000 7f9fcb7fe640 1 -- 172.21.15.92:0/245798950 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fdc003d10 con 0x55deb038acb0 2024-09-10T10:45:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fcb7fe640 1 -- 172.21.15.92:0/245798950 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc010ac0 con 0x55deb038acb0 2024-09-10T10:45:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fe5f73640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a2ea0 0x7f9fcc0a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fea84a740 1 -- 172.21.15.92:0/245798950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 msgr2=0x55deb038d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fea84a740 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb038d0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9fe019ff50 tx=0x7f9fdc00f790 comp rx=0 tx=0).stop 2024-09-10T10:45:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fea84a740 1 -- 172.21.15.92:0/245798950 shutdown_connections 2024-09-10T10:45:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fea84a740 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb038d0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fea84a740 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb038a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fea84a740 1 --2- 172.21.15.92:0/245798950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb037faf0 0x55deb037fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fea84a740 1 -- 172.21.15.92:0/245798950 >> 172.21.15.92:0/245798950 conn(0x55deb037c060 msgr2=0x55deb037c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fea84a740 1 -- 172.21.15.92:0/245798950 shutdown_connections 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.276+0000 7f9fe5f73640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a2ea0 0x7f9fcc0a5360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80096c0 tx=0x7f9fd80046c0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.277+0000 7f9fea84a740 1 -- 172.21.15.92:0/245798950 wait complete. 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.277+0000 7f9fea84a740 1 -- start start 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.277+0000 7f9fea84a740 1 Processor -- start 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb0387a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb0387f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb038acb0 0x55deb03884c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fea84a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55deb039e8e0 con 0x55deb0380410 2024-09-10T10:45:28.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fea84a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55deb026d290 con 0x55deb037faf0 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fea84a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55deb039ea60 con 0x55deb038acb0 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fea84a740 10 client.0 _ll_register_callbacks cb 0x55deb029e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe4f71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb0387f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe5772640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb0387a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe4f71640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb0387f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40152/0 (socket says 172.21.15.92:40152) 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe5f73640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb038acb0 0x55deb03884c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe4f71640 1 -- 172.21.15.92:0/1762957915 learned_addr learned my addr 172.21.15.92:0/1762957915 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe5772640 1 -- 172.21.15.92:0/1762957915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb038acb0 msgr2=0x55deb03884c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe5772640 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb038acb0 0x55deb03884c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe5772640 1 -- 172.21.15.92:0/1762957915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 msgr2=0x55deb0387f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe5772640 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb0387f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe5772640 1 -- 172.21.15.92:0/1762957915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deafff7210 con 0x55deb037faf0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fe5772640 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb0387a40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00cc680 tx=0x7f9fd0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339b403d5cc0c283 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.278+0000 7f9fc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/1762957915 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0020070 con 0x55deb037faf0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/1762957915 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7f9fd009a950 con 0x55deb037faf0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fea84a740 1 -- 172.21.15.92:0/1762957915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fdc003d10 con 0x55deb037faf0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/1762957915 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9fd00ccb00 con 0x55deb037faf0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fea84a740 10 client.25493 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fea84a740 1 -- 172.21.15.92:0/1762957915 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55deb00c3620 con 0x55deb037faf0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/1762957915 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fdc003d10 con 0x55deb037faf0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/1762957915 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f9fd00b4250 con 0x55deb037faf0 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fea84a740 10 client.25493 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:28.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fea84a740 10 client.25493 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fea84a740 20 client.25493 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55deb03ac000 0x55deb03ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fea84a740 4 client.25493 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.279+0000 7f9fea84a740 1 -- 172.21.15.92:0/1762957915 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55deb02f1a20 con 0x55deb03ac000 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.280+0000 7f9fe4f71640 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55deb03ac000 0x55deb03ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.280+0000 7f9fc8ff9640 10 client.25493 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.280+0000 7f9fe4f71640 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55deb03ac000 0x55deb03ae470 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33b148182923d742 server_cookie=f07f7c55c17dbbb0 in_seq=0 out_seq=0 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/1762957915 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55deb02f1a20 con 0x55deb03ac000 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fc8ff9640 10 client.25493 handle_command_reply: tid=0 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fea84a740 1 client.25493 shutdown 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fea84a740 1 -- 172.21.15.92:0/1762957915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 msgr2=0x55deb0387a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:28.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb0387a40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00cc680 tx=0x7f9fd0005f90 comp rx=0 tx=0).stop 2024-09-10T10:45:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fea84a740 1 -- 172.21.15.92:0/1762957915 shutdown_connections 2024-09-10T10:45:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb038acb0 0x55deb03884c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb0380410 0x55deb0387f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55deb03ac000 0x55deb03ae470 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1762957915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb0387a40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fea84a740 1 -- 172.21.15.92:0/1762957915 >> 172.21.15.92:0/1762957915 conn(0x55deb037c060 msgr2=0x55deb0381dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.281+0000 7f9fc8ff9640 0 client.25493 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:28.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.282+0000 7f9fea84a740 1 -- 172.21.15.92:0/1762957915 shutdown_connections 2024-09-10T10:45:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.282+0000 7f9fea84a740 1 -- 172.21.15.92:0/1762957915 wait complete. 2024-09-10T10:45:28.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.284+0000 7f9fea84a740 20 client.25493 trim_cache size 0 max 16384 2024-09-10T10:45:28.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fea84a740 1 Processor -- start 2024-09-10T10:45:28.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fea84a740 1 -- start start 2024-09-10T10:45:28.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb03b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 0x55deb03b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb038acb0 0x55deb037a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fea84a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0082d60 con 0x55deb038acb0 2024-09-10T10:45:28.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fea84a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01ad0a0 con 0x55deb037faf0 2024-09-10T10:45:28.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fea84a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01abba0 con 0x55deb0380410 2024-09-10T10:45:28.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fe5772640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb03b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fe5f73640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb038acb0 0x55deb037a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fe5772640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb03b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:53750/0 (socket says 172.21.15.92:53750) 2024-09-10T10:45:28.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.305+0000 7f9fe5772640 1 -- 172.21.15.92:0/1817258805 learned_addr learned my addr 172.21.15.92:0/1817258805 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:28.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.306+0000 7f9fe5772640 1 -- 172.21.15.92:0/1817258805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 msgr2=0x55deb03b42c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:45:28.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.306+0000 7f9fe5772640 1 --2- 172.21.15.92:0/1817258805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 0x55deb03b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.306+0000 7f9fe5772640 1 -- 172.21.15.92:0/1817258805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb038acb0 msgr2=0x55deb037a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:28.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.306+0000 7f9fe5772640 1 --2- 172.21.15.92:0/1817258805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb038acb0 0x55deb037a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.306+0000 7f9fe5772640 1 -- 172.21.15.92:0/1817258805 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb0380240 con 0x55deb037faf0 2024-09-10T10:45:28.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.306+0000 7f9fe5772640 1 --2- 172.21.15.92:0/1817258805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb03b3d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009610 tx=0x7f9fd0005bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8c32356a3813b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:28.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.306+0000 7f9fcaffd640 1 -- 172.21.15.92:0/1817258805 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0014020 con 0x55deb037faf0 2024-09-10T10:45:28.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.306+0000 7f9fcaffd640 1 -- 172.21.15.92:0/1817258805 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd009b500 con 0x55deb037faf0 2024-09-10T10:45:28.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.306+0000 7f9fcaffd640 1 -- 172.21.15.92:0/1817258805 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00cc900 con 0x55deb037faf0 2024-09-10T10:45:28.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.307+0000 7f9fea84a740 1 -- 172.21.15.92:0/1817258805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 msgr2=0x55deb03b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.307+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1817258805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb03b3d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009610 tx=0x7f9fd0005bb0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.307+0000 7f9fea84a740 1 -- 172.21.15.92:0/1817258805 shutdown_connections 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.307+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1817258805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb038acb0 0x55deb037a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.307+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1817258805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 0x55deb03b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.307+0000 7f9fea84a740 1 --2- 172.21.15.92:0/1817258805 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb037faf0 0x55deb03b3d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.307+0000 7f9fea84a740 1 -- 172.21.15.92:0/1817258805 >> 172.21.15.92:0/1817258805 conn(0x55deb037c060 msgr2=0x55deb0386b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.307+0000 7f9fea84a740 1 -- 172.21.15.92:0/1817258805 shutdown_connections 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.307+0000 7f9fea84a740 1 -- 172.21.15.92:0/1817258805 wait complete. 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.308+0000 7f9fea84a740 1 -- start start 2024-09-10T10:45:28.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.308+0000 7f9fea84a740 1 Processor -- start 2024-09-10T10:45:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.308+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb037faf0 0x55deb03a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.308+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 0x55deb03a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.308+0000 7f9fea84a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb0384ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.308+0000 7f9fea84a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01ac9d0 con 0x55deb037faf0 2024-09-10T10:45:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.308+0000 7f9fea84a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe01ac300 con 0x55deb038acb0 2024-09-10T10:45:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.308+0000 7f9fea84a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0108740 con 0x55deb0380410 2024-09-10T10:45:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.308+0000 7f9fea84a740 10 client.0 _ll_register_callbacks cb 0x7f9fd0097870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5772640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb037faf0 0x55deb03a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5772640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb037faf0 0x55deb03a3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40158/0 (socket says 172.21.15.92:40158) 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5772640 1 -- 172.21.15.92:0/2760185539 learned_addr learned my addr 172.21.15.92:0/2760185539 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5f73640 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb0384ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe4f71640 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 0x55deb03a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5f73640 1 -- 172.21.15.92:0/2760185539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 msgr2=0x55deb03a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5f73640 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 0x55deb03a42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5f73640 1 -- 172.21.15.92:0/2760185539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb037faf0 msgr2=0x55deb03a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5f73640 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb037faf0 0x55deb03a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5f73640 1 -- 172.21.15.92:0/2760185539 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deb03851e0 con 0x55deb038acb0 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe4f71640 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 0x55deb03a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fe5f73640 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb0384ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8004650 tx=0x7f9fd8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf988c7e723a600 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/2760185539 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8035040 con 0x55deb038acb0 2024-09-10T10:45:28.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/2760185539 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7f9fd8031c90 con 0x55deb038acb0 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.309+0000 7f9fea84a740 1 -- 172.21.15.92:0/2760185539 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fd009b500 con 0x55deb038acb0 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/2760185539 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9fd803d450 con 0x55deb038acb0 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fea84a740 10 client.25499 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fea84a740 1 -- 172.21.15.92:0/2760185539 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55deb038bcf0 con 0x55deb038acb0 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/2760185539 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fd009b500 con 0x55deb038acb0 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/2760185539 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f9fd8044040 con 0x55deb038acb0 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fea84a740 10 client.25499 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fea84a740 10 client.25499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fea84a740 20 client.25499 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fea84a740 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55deb0416d50 0x55deb0419140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fea84a740 4 client.25499 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fea84a740 1 -- 172.21.15.92:0/2760185539 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55deb02ebd70 con 0x55deb0416d50 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.310+0000 7f9fe5772640 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55deb0416d50 0x55deb0419140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:28.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.311+0000 7f9fc8ff9640 10 client.25499 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:28.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.311+0000 7f9fe5772640 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55deb0416d50 0x55deb0419140 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9baf1e951d47c2f4 server_cookie=6ebf1bd8ce7fd192 in_seq=0 out_seq=0 2024-09-10T10:45:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.319+0000 7f9fc8ff9640 1 -- 172.21.15.92:0/2760185539 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55deb02ebd70 con 0x55deb0416d50 2024-09-10T10:45:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.319+0000 7f9fc8ff9640 10 client.25499 handle_command_reply: tid=0 2024-09-10T10:45:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 client.25499 shutdown 2024-09-10T10:45:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 -- 172.21.15.92:0/2760185539 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 msgr2=0x55deb0384ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:28.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb0384ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8004650 tx=0x7f9fd8009260 comp rx=0 tx=0).stop 2024-09-10T10:45:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 -- 172.21.15.92:0/2760185539 shutdown_connections 2024-09-10T10:45:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55deb0416d50 0x55deb0419140 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55deb038acb0 0x55deb0384ca0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55deb0380410 0x55deb03a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 --2- 172.21.15.92:0/2760185539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55deb037faf0 0x55deb03a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 -- 172.21.15.92:0/2760185539 >> 172.21.15.92:0/2760185539 conn(0x55deb037c060 msgr2=0x55deb037a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fc8ff9640 0 client.25499 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:28.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 -- 172.21.15.92:0/2760185539 shutdown_connections 2024-09-10T10:45:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 1 -- 172.21.15.92:0/2760185539 wait complete. 2024-09-10T10:45:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.320+0000 7f9fea84a740 20 client.25499 trim_cache size 0 max 16384 2024-09-10T10:45:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:45:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:45:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:45:28.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:45:28.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 -- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a2ea0 msgr2=0x7f9fcc0a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:28.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a2ea0 0x7f9fcc0a5360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9fd80096c0 tx=0x7f9fd80046c0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 -- 172.21.15.92:0/3854984192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe0108360 msgr2=0x7f9fe01a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:28.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe0108360 0x7f9fe01a4640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000d950 tx=0x7f9fd000de10 comp rx=0 tx=0).stop 2024-09-10T10:45:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 -- 172.21.15.92:0/3854984192 shutdown_connections 2024-09-10T10:45:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fe019e700 0x7f9fe019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fe010d4b0 0x7f9fe01a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9fcc0a2ea0 0x7f9fcc0a5360 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 --2- 172.21.15.92:0/3854984192 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9fe0108360 0x7f9fe01a4640 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 -- 172.21.15.92:0/3854984192 >> 172.21.15.92:0/3854984192 conn(0x7f9fe0077ad0 msgr2=0x7f9fe00785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 -- 172.21.15.92:0/3854984192 shutdown_connections 2024-09-10T10:45:28.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:28.321+0000 7f9fe79d6640 1 -- 172.21.15.92:0/3854984192 wait complete. 2024-09-10T10:45:28.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:28 smithi121 ceph-mon[35231]: pgmap v274: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 MiB/s wr, 876 op/s 2024-09-10T10:45:28.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:28 smithi097 ceph-mon[35213]: pgmap v274: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 MiB/s wr, 876 op/s 2024-09-10T10:45:28.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:28 smithi092 ceph-mon[30834]: pgmap v274: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.7 MiB/s wr, 876 op/s 2024-09-10T10:45:30.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:30 smithi121 ceph-mon[35231]: pgmap v275: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 608 op/s 2024-09-10T10:45:30.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:30 smithi097 ceph-mon[35213]: pgmap v275: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 608 op/s 2024-09-10T10:45:30.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:30 smithi092 ceph-mon[30834]: pgmap v275: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 608 op/s 2024-09-10T10:45:32.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:32 smithi121 ceph-mon[35231]: pgmap v276: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 893 op/s 2024-09-10T10:45:32.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:32 smithi097 ceph-mon[35213]: pgmap v276: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 893 op/s 2024-09-10T10:45:32.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:32 smithi092 ceph-mon[30834]: pgmap v276: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 893 op/s 2024-09-10T10:45:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 515.0 s, 2708.6 tps, lat 36.419 ms stddev 39.728 2024-09-10T10:45:34.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:34 smithi121 ceph-mon[35231]: pgmap v277: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 598 op/s 2024-09-10T10:45:34.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:34 smithi097 ceph-mon[35213]: pgmap v277: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 598 op/s 2024-09-10T10:45:34.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:34 smithi092 ceph-mon[30834]: pgmap v277: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 598 op/s 2024-09-10T10:45:36.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:36 smithi121 ceph-mon[35231]: pgmap v278: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 598 op/s 2024-09-10T10:45:36.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:36 smithi097 ceph-mon[35213]: pgmap v278: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 598 op/s 2024-09-10T10:45:36.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:36 smithi092 ceph-mon[30834]: pgmap v278: 97 pgs: 97 active+clean; 4.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 598 op/s 2024-09-10T10:45:37.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:37 smithi121 ceph-mon[35231]: pgmap v279: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.9 MiB/s wr, 896 op/s 2024-09-10T10:45:37.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:37 smithi097 ceph-mon[35213]: pgmap v279: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.9 MiB/s wr, 896 op/s 2024-09-10T10:45:37.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:37 smithi092 ceph-mon[30834]: pgmap v279: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.9 MiB/s wr, 896 op/s 2024-09-10T10:45:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 520.0 s, 1784.4 tps, lat 56.475 ms stddev 59.549 2024-09-10T10:45:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:39 smithi121 ceph-mon[35231]: pgmap v280: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 582 op/s 2024-09-10T10:45:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:39 smithi097 ceph-mon[35213]: pgmap v280: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 582 op/s 2024-09-10T10:45:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:39 smithi092 ceph-mon[30834]: pgmap v280: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.7 MiB/s wr, 582 op/s 2024-09-10T10:45:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.451+0000 7f9d16178640 1 -- 172.21.15.92:0/1083925502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1010c0d0 msgr2=0x7f9d1010e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.451+0000 7f9d16178640 1 --2- 172.21.15.92:0/1083925502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1010c0d0 0x7f9d1010e570 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009ca0 tx=0x7f9d0802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.451+0000 7f9d16178640 1 -- 172.21.15.92:0/1083925502 shutdown_connections 2024-09-10T10:45:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.451+0000 7f9d16178640 1 --2- 172.21.15.92:0/1083925502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d1010c0d0 0x7f9d1010e570 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.451+0000 7f9d16178640 1 --2- 172.21.15.92:0/1083925502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d101035c0 0x7f9d1010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.451+0000 7f9d16178640 1 --2- 172.21.15.92:0/1083925502 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d10102ca0 0x7f9d10103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.451+0000 7f9d16178640 1 -- 172.21.15.92:0/1083925502 >> 172.21.15.92:0/1083925502 conn(0x7f9d100fc6b0 msgr2=0x7f9d100fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.452+0000 7f9d16178640 1 -- 172.21.15.92:0/1083925502 shutdown_connections 2024-09-10T10:45:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.452+0000 7f9d16178640 1 -- 172.21.15.92:0/1083925502 wait complete. 2024-09-10T10:45:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d16178640 1 Processor -- start 2024-09-10T10:45:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d16178640 1 -- start start 2024-09-10T10:45:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d16178640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d10102ca0 0x7f9d101008f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d16178640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d101035c0 0x7f9d10100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d16178640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d1010c0d0 0x7f9d10101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d16178640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10111eb0 con 0x7f9d101035c0 2024-09-10T10:45:41.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d16178640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10111d30 con 0x7f9d1010c0d0 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d16178640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10112030 con 0x7f9d10102ca0 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d101035c0 0x7f9d10100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d101035c0 0x7f9d10100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57174/0 (socket says 172.21.15.92:57174) 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d0ffff640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d1010c0d0 0x7f9d10101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d0effd640 1 -- 172.21.15.92:0/1852128611 learned_addr learned my addr 172.21.15.92:0/1852128611 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.453+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d10102ca0 0x7f9d101008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0ffff640 1 -- 172.21.15.92:0/1852128611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d10102ca0 msgr2=0x7f9d101008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0ffff640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d10102ca0 0x7f9d101008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0ffff640 1 -- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d101035c0 msgr2=0x7f9d10100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0ffff640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d101035c0 0x7f9d10100e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0ffff640 1 -- 172.21.15.92:0/1852128611 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d101a6620 con 0x7f9d1010c0d0 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d10102ca0 0x7f9d101008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:41.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0effd640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d101035c0 0x7f9d10100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0ffff640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d1010c0d0 0x7f9d10101370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009bf0 tx=0x7f9d080319d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0cff9640 1 -- 172.21.15.92:0/1852128611 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0802faa0 con 0x7f9d1010c0d0 2024-09-10T10:45:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0cff9640 1 -- 172.21.15.92:0/1852128611 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0802fc40 con 0x7f9d1010c0d0 2024-09-10T10:45:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d16178640 1 -- 172.21.15.92:0/1852128611 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d101a68b0 con 0x7f9d1010c0d0 2024-09-10T10:45:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d0cff9640 1 -- 172.21.15.92:0/1852128611 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d080466e0 con 0x7f9d1010c0d0 2024-09-10T10:45:41.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.454+0000 7f9d16178640 1 -- 172.21.15.92:0/1852128611 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d101a6e00 con 0x7f9d1010c0d0 2024-09-10T10:45:41.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.458+0000 7f9d18fef740 1 Processor -- start 2024-09-10T10:45:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.458+0000 7f9d0cff9640 1 -- 172.21.15.92:0/1852128611 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9d08046940 con 0x7f9d1010c0d0 2024-09-10T10:45:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d18fef740 1 -- start start 2024-09-10T10:45:41.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 0x56256aa396e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39c20 0x56256aa43f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa444c0 0x56256aa468b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d18fef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56256a9952f0 con 0x56256aa444c0 2024-09-10T10:45:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d18fef740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56256a93d270 con 0x56256aa39c20 2024-09-10T10:45:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d18fef740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56256a9912b0 con 0x56256aa39300 2024-09-10T10:45:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa444c0 0x56256aa468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39c20 0x56256aa43f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa444c0 0x56256aa468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57182/0 (socket says 172.21.15.92:57182) 2024-09-10T10:45:41.463 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0effd640 1 -- 172.21.15.92:0/3439994587 learned_addr learned my addr 172.21.15.92:0/3439994587 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0effd640 1 --2- 172.21.15.92:0/3439994587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 0x56256aa396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0cff9640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9cf80a2da0 0x7f9cf80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0effd640 1 -- 172.21.15.92:0/3439994587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 msgr2=0x56256aa396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0effd640 1 --2- 172.21.15.92:0/3439994587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 0x56256aa396e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0effd640 1 -- 172.21.15.92:0/3439994587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39c20 msgr2=0x56256aa43f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0effd640 1 --2- 172.21.15.92:0/3439994587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39c20 0x56256aa43f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.464 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0effd640 1 -- 172.21.15.92:0/3439994587 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56256a93c340 con 0x56256aa444c0 2024-09-10T10:45:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.459+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/3439994587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39c20 0x56256aa43f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.460+0000 7f9d0ffff640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9cf80a2da0 0x7f9cf80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.460+0000 7f9d0effd640 1 --2- 172.21.15.92:0/3439994587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa444c0 0x56256aa468b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9d04011be0 tx=0x7f9d04009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e84ff7021292b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.460+0000 7f9d0cff9640 1 -- 172.21.15.92:0/1852128611 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7f9d080f0560 con 0x7f9d1010c0d0 2024-09-10T10:45:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.460+0000 7f9cf5ffb640 1 -- 172.21.15.92:0/3439994587 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0400fc50 con 0x56256aa444c0 2024-09-10T10:45:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.460+0000 7f9cf5ffb640 1 -- 172.21.15.92:0/3439994587 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0400fdf0 con 0x56256aa444c0 2024-09-10T10:45:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.460+0000 7f9cf5ffb640 1 -- 172.21.15.92:0/3439994587 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04004e30 con 0x56256aa444c0 2024-09-10T10:45:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.461+0000 7f9d18fef740 1 -- 172.21.15.92:0/3439994587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa444c0 msgr2=0x56256aa468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.461+0000 7f9d0ffff640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9cf80a2da0 0x7f9cf80a5260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9d080ee2f0 tx=0x7f9d0802a8c0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.461+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3439994587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa444c0 0x56256aa468b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9d04011be0 tx=0x7f9d04009550 comp rx=0 tx=0).stop 2024-09-10T10:45:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.461+0000 7f9d18fef740 1 -- 172.21.15.92:0/3439994587 shutdown_connections 2024-09-10T10:45:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.461+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3439994587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa444c0 0x56256aa468b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.461+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3439994587 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39c20 0x56256aa43f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.461+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3439994587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 0x56256aa396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.461+0000 7f9d18fef740 1 -- 172.21.15.92:0/3439994587 >> 172.21.15.92:0/3439994587 conn(0x56256aa35870 msgr2=0x56256aa35c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.461+0000 7f9d18fef740 1 -- 172.21.15.92:0/3439994587 shutdown_connections 2024-09-10T10:45:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.462+0000 7f9d18fef740 1 -- 172.21.15.92:0/3439994587 wait complete. 2024-09-10T10:45:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.462+0000 7f9d18fef740 1 -- start start 2024-09-10T10:45:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.462+0000 7f9d18fef740 1 Processor -- start 2024-09-10T10:45:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.462+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 0x56256aa413a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.462+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.462+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 0x56256aa41e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.462+0000 7f9d18fef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56256aa47090 con 0x56256aa39c20 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.462+0000 7f9d18fef740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56256a91e290 con 0x56256aa444c0 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.462+0000 7f9d18fef740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56256aa47210 con 0x56256aa39300 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d18fef740 10 client.0 _ll_register_callbacks cb 0x56256a94f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 0x56256aa413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57196/0 (socket says 172.21.15.92:57196) 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0f7fe640 1 -- 172.21.15.92:0/2608038760 learned_addr learned my addr 172.21.15.92:0/2608038760 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0effd640 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 0x56256aa41e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0effd640 1 -- 172.21.15.92:0/2608038760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 msgr2=0x56256aa41e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0effd640 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 0x56256aa41e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0effd640 1 -- 172.21.15.92:0/2608038760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 msgr2=0x56256aa418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0effd640 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0effd640 1 -- 172.21.15.92:0/2608038760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56256a6a8210 con 0x56256aa39300 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d0effd640 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 0x56256aa413a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009250 tx=0x7f9d04004b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bde0290a97d4f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9ceeffd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9ceeffd640 1 -- 172.21.15.92:0/2608038760 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04004050 con 0x56256aa39300 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9d18fef740 1 -- 172.21.15.92:0/2608038760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d0400fdf0 con 0x56256aa39300 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9ceeffd640 1 -- 172.21.15.92:0/2608038760 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7f9d040041f0 con 0x56256aa39300 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.463+0000 7f9ceeffd640 1 -- 172.21.15.92:0/2608038760 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9d04032050 con 0x56256aa39300 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9d18fef740 10 client.25543 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9d18fef740 1 -- 172.21.15.92:0/2608038760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56256a774620 con 0x56256aa39300 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9ceeffd640 1 -- 172.21.15.92:0/2608038760 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0400fdf0 con 0x56256aa39300 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9ceeffd640 1 -- 172.21.15.92:0/2608038760 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f9d04003730 con 0x56256aa39300 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9d18fef740 10 client.25543 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9d18fef740 10 client.25543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9d18fef740 20 client.25543 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9d18fef740 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56256aa543b0 0x56256aa567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9d18fef740 4 client.25543 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9d18fef740 1 -- 172.21.15.92:0/2608038760 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56256a9a2a20 con 0x56256aa543b0 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.464+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56256aa543b0 0x56256aa567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.465+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56256aa543b0 0x56256aa567a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a75e64bdaefcf8a server_cookie=944cd6b63017d7eb in_seq=0 out_seq=0 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.465+0000 7f9ceeffd640 10 client.25543 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.466+0000 7f9ceeffd640 1 -- 172.21.15.92:0/2608038760 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56256a9a2a20 con 0x56256aa543b0 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.466+0000 7f9ceeffd640 10 client.25543 handle_command_reply: tid=0 2024-09-10T10:45:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.466+0000 7f9d18fef740 1 client.25543 shutdown 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 -- 172.21.15.92:0/2608038760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 msgr2=0x56256aa413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 0x56256aa413a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009250 tx=0x7f9d04004b10 comp rx=0 tx=0).stop 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 -- 172.21.15.92:0/2608038760 shutdown_connections 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56256aa543b0 0x56256aa567a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 0x56256aa41e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9ceeffd640 0 client.25543 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 --2- 172.21.15.92:0/2608038760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39300 0x56256aa413a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 -- 172.21.15.92:0/2608038760 >> 172.21.15.92:0/2608038760 conn(0x56256aa35870 msgr2=0x56256aa3b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 -- 172.21.15.92:0/2608038760 shutdown_connections 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 1 -- 172.21.15.92:0/2608038760 wait complete. 2024-09-10T10:45:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.467+0000 7f9d18fef740 20 client.25543 trim_cache size 0 max 16384 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d18fef740 1 Processor -- start 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d18fef740 1 -- start start 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39300 0x56256aa43310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa5bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa444c0 0x56256aa5c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d18fef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101ab450 con 0x56256aa39c20 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d18fef740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101ad020 con 0x56256aa39300 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d18fef740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101abb20 con 0x56256aa444c0 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39300 0x56256aa43310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa444c0 0x56256aa5c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39300 0x56256aa43310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35992/0 (socket says 172.21.15.92:35992) 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d0effd640 1 -- 172.21.15.92:0/1935713961 learned_addr learned my addr 172.21.15.92:0/1935713961 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.486+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/1935713961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa5bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.487+0000 7f9d0f7fe640 1 -- 172.21.15.92:0/1935713961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa444c0 msgr2=0x56256aa5c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.487+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/1935713961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa444c0 0x56256aa5c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.487+0000 7f9d0f7fe640 1 -- 172.21.15.92:0/1935713961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39300 msgr2=0x56256aa43310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.487+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/1935713961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39300 0x56256aa43310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.487+0000 7f9d0f7fe640 1 -- 172.21.15.92:0/1935713961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56256aa3c150 con 0x56256aa39c20 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.487+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/1935713961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa5bd70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x56256aa56ce0 tx=0x7f9d00005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4869d5ab16ef954e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.487+0000 7f9cf57fa640 1 -- 172.21.15.92:0/1935713961 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000fc80 con 0x56256aa39c20 2024-09-10T10:45:41.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.487+0000 7f9cf57fa640 1 -- 172.21.15.92:0/1935713961 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0000fe20 con 0x56256aa39c20 2024-09-10T10:45:41.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.487+0000 7f9cf57fa640 1 -- 172.21.15.92:0/1935713961 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00010430 con 0x56256aa39c20 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 -- 172.21.15.92:0/1935713961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 msgr2=0x56256aa5bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 --2- 172.21.15.92:0/1935713961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa5bd70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x56256aa56ce0 tx=0x7f9d00005f90 comp rx=0 tx=0).stop 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 -- 172.21.15.92:0/1935713961 shutdown_connections 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 --2- 172.21.15.92:0/1935713961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa444c0 0x56256aa5c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 --2- 172.21.15.92:0/1935713961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39c20 0x56256aa5bd70 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 --2- 172.21.15.92:0/1935713961 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa39300 0x56256aa43310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 -- 172.21.15.92:0/1935713961 >> 172.21.15.92:0/1935713961 conn(0x56256aa35870 msgr2=0x56256aa42c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 -- 172.21.15.92:0/1935713961 shutdown_connections 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 -- 172.21.15.92:0/1935713961 wait complete. 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.488+0000 7f9d18fef740 1 -- start start 2024-09-10T10:45:41.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d18fef740 1 Processor -- start 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39300 0x56256aa4c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39c20 0x56256aa4cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d18fef740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 0x56256aa47dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d18fef740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101ac950 con 0x56256aa39300 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d18fef740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101ac280 con 0x56256aa444c0 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d18fef740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101a9490 con 0x56256aa39c20 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d18fef740 10 client.0 _ll_register_callbacks cb 0x7f9d00009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39300 0x56256aa4c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39300 0x56256aa4c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57212/0 (socket says 172.21.15.92:57212) 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 -- 172.21.15.92:0/3436735070 learned_addr learned my addr 172.21.15.92:0/3436735070 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 0x56256aa47dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39c20 0x56256aa4cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 -- 172.21.15.92:0/3436735070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39c20 msgr2=0x56256aa4cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39c20 0x56256aa4cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 -- 172.21.15.92:0/3436735070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 msgr2=0x56256aa47dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 0x56256aa47dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 -- 172.21.15.92:0/3436735070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56256aa48600 con 0x56256aa39300 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9d0effd640 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39300 0x56256aa4c860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9d04003b00 tx=0x7f9d04000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee65bc4cf8fcb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.489+0000 7f9ceeffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9ceeffd640 1 -- 172.21.15.92:0/3436735070 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04003800 con 0x56256aa39300 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9ceeffd640 1 -- 172.21.15.92:0/3436735070 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7f9d04011020 con 0x56256aa39300 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d18fef740 1 -- 172.21.15.92:0/3436735070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d0000fe20 con 0x56256aa39300 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9ceeffd640 1 -- 172.21.15.92:0/3436735070 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9d04011220 con 0x56256aa39300 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d18fef740 10 client.16011 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d18fef740 1 -- 172.21.15.92:0/3436735070 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56256aabe9e0 con 0x56256aa39300 2024-09-10T10:45:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9ceeffd640 1 -- 172.21.15.92:0/3436735070 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0000fe20 con 0x56256aa39300 2024-09-10T10:45:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9ceeffd640 1 -- 172.21.15.92:0/3436735070 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f9d04004f00 con 0x56256aa39300 2024-09-10T10:45:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d18fef740 10 client.16011 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d18fef740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d18fef740 20 client.16011 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56256aabf100 0x56256aac1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d18fef740 4 client.16011 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:45:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d18fef740 1 -- 172.21.15.92:0/3436735070 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56256a99cd70 con 0x56256aabf100 2024-09-10T10:45:41.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.490+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56256aabf100 0x56256aac1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.491+0000 7f9d0f7fe640 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56256aabf100 0x56256aac1540 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92a8a4fb312e8388 server_cookie=cd206c8762ec1891 in_seq=0 out_seq=0 2024-09-10T10:45:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.492+0000 7f9ceeffd640 10 client.16011 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9ceeffd640 1 -- 172.21.15.92:0/3436735070 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56256a99cd70 con 0x56256aabf100 2024-09-10T10:45:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9ceeffd640 10 client.16011 handle_command_reply: tid=0 2024-09-10T10:45:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 client.16011 shutdown 2024-09-10T10:45:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 -- 172.21.15.92:0/3436735070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39300 msgr2=0x56256aa4c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39300 0x56256aa4c860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9d04003b00 tx=0x7f9d04000bc0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 -- 172.21.15.92:0/3436735070 shutdown_connections 2024-09-10T10:45:41.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56256aabf100 0x56256aac1540 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56256aa444c0 0x56256aa47dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56256aa39c20 0x56256aa4cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 --2- 172.21.15.92:0/3436735070 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56256aa39300 0x56256aa4c860 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9ceeffd640 0 client.16011 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 -- 172.21.15.92:0/3436735070 >> 172.21.15.92:0/3436735070 conn(0x56256aa35870 msgr2=0x56256aa3f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 -- 172.21.15.92:0/3436735070 shutdown_connections 2024-09-10T10:45:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 1 -- 172.21.15.92:0/3436735070 wait complete. 2024-09-10T10:45:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.500+0000 7f9d18fef740 20 client.16011 trim_cache size 0 max 16384 2024-09-10T10:45:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:45:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:45:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:45:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 -- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9cf80a2da0 msgr2=0x7f9cf80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9cf80a2da0 0x7f9cf80a5260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9d080ee2f0 tx=0x7f9d0802a8c0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 -- 172.21.15.92:0/1852128611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d1010c0d0 msgr2=0x7f9d10101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d1010c0d0 0x7f9d10101370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009bf0 tx=0x7f9d080319d0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 -- 172.21.15.92:0/1852128611 shutdown_connections 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9cf80a2da0 0x7f9cf80a5260 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9d1010c0d0 0x7f9d10101370 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d101035c0 0x7f9d10100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 --2- 172.21.15.92:0/1852128611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d10102ca0 0x7f9d101008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 -- 172.21.15.92:0/1852128611 >> 172.21.15.92:0/1852128611 conn(0x7f9d100fc6b0 msgr2=0x7f9d1010d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 -- 172.21.15.92:0/1852128611 shutdown_connections 2024-09-10T10:45:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:41.503+0000 7f9d16178640 1 -- 172.21.15.92:0/1852128611 wait complete. 2024-09-10T10:45:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:41 smithi121 ceph-mon[35231]: pgmap v281: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.7 MiB/s wr, 892 op/s 2024-09-10T10:45:42.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:41 smithi097 ceph-mon[35213]: pgmap v281: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.7 MiB/s wr, 892 op/s 2024-09-10T10:45:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:41 smithi092 ceph-mon[30834]: pgmap v281: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.7 MiB/s wr, 892 op/s 2024-09-10T10:45:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 525.0 s, 2540.0 tps, lat 39.367 ms stddev 45.052 2024-09-10T10:45:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:43 smithi121 ceph-mon[35231]: pgmap v282: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 606 op/s 2024-09-10T10:45:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:43 smithi097 ceph-mon[35213]: pgmap v282: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 606 op/s 2024-09-10T10:45:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:43 smithi092 ceph-mon[30834]: pgmap v282: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 606 op/s 2024-09-10T10:45:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:45 smithi121 ceph-mon[35231]: pgmap v283: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 606 op/s 2024-09-10T10:45:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:45 smithi097 ceph-mon[35213]: pgmap v283: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 606 op/s 2024-09-10T10:45:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:45 smithi092 ceph-mon[30834]: pgmap v283: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 606 op/s 2024-09-10T10:45:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:47 smithi121 ceph-mon[35231]: pgmap v284: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 888 op/s 2024-09-10T10:45:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:47 smithi097 ceph-mon[35213]: pgmap v284: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 888 op/s 2024-09-10T10:45:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:47 smithi092 ceph-mon[30834]: pgmap v284: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 888 op/s 2024-09-10T10:45:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 530.0 s, 1577.6 tps, lat 62.539 ms stddev 73.134 2024-09-10T10:45:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:49 smithi121 ceph-mon[35231]: pgmap v285: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 591 op/s 2024-09-10T10:45:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:49 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:45:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:49 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:45:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:49 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:45:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:49 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:45:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:49 smithi097 ceph-mon[35213]: pgmap v285: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 591 op/s 2024-09-10T10:45:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:49 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:45:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:49 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:45:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:49 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:45:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:49 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:45:50.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:49 smithi092 ceph-mon[30834]: pgmap v285: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 591 op/s 2024-09-10T10:45:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:49 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:45:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:49 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:45:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:49 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:45:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:49 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:45:52.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:51 smithi121 ceph-mon[35231]: pgmap v286: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 MiB/s wr, 843 op/s 2024-09-10T10:45:52.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:51 smithi097 ceph-mon[35213]: pgmap v286: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 MiB/s wr, 843 op/s 2024-09-10T10:45:52.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:51 smithi092 ceph-mon[30834]: pgmap v286: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 MiB/s wr, 843 op/s 2024-09-10T10:45:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 535.0 s, 1735.2 tps, lat 58.359 ms stddev 62.964 2024-09-10T10:45:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:53 smithi121 ceph-mon[35231]: pgmap v287: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.9 MiB/s wr, 533 op/s 2024-09-10T10:45:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:53 smithi097 ceph-mon[35213]: pgmap v287: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.9 MiB/s wr, 533 op/s 2024-09-10T10:45:54.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:53 smithi092 ceph-mon[30834]: pgmap v287: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.9 MiB/s wr, 533 op/s 2024-09-10T10:45:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.616+0000 7f53909e8640 1 -- 172.21.15.92:0/1062093253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c1069e0 msgr2=0x7f538c106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.616+0000 7f53909e8640 1 --2- 172.21.15.92:0/1062093253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c1069e0 0x7f538c106dc0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f537c009930 tx=0x7f537c02a420 comp rx=0 tx=0).stop 2024-09-10T10:45:54.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.616+0000 7f53909e8640 1 -- 172.21.15.92:0/1062093253 shutdown_connections 2024-09-10T10:45:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.616+0000 7f53909e8640 1 --2- 172.21.15.92:0/1062093253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f538c101370 0x7f538c10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.616+0000 7f53909e8640 1 --2- 172.21.15.92:0/1062093253 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f538c1009d0 0x7f538c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.616+0000 7f53909e8640 1 --2- 172.21.15.92:0/1062093253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c1069e0 0x7f538c106dc0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.616+0000 7f53909e8640 1 -- 172.21.15.92:0/1062093253 >> 172.21.15.92:0/1062093253 conn(0x7f538c0fc6b0 msgr2=0x7f538c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.616+0000 7f53909e8640 1 -- 172.21.15.92:0/1062093253 shutdown_connections 2024-09-10T10:45:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.616+0000 7f53909e8640 1 -- 172.21.15.92:0/1062093253 wait complete. 2024-09-10T10:45:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f53909e8640 1 Processor -- start 2024-09-10T10:45:54.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f53909e8640 1 -- start start 2024-09-10T10:45:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f53909e8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f538c1009d0 0x7f538c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f53909e8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c101370 0x7f538c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f53909e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f538c1069e0 0x7f538c1a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f53909e8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f538c110e30 con 0x7f538c101370 2024-09-10T10:45:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f53909e8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f538c110cb0 con 0x7f538c1009d0 2024-09-10T10:45:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f53909e8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f538c110fb0 con 0x7f538c1069e0 2024-09-10T10:45:54.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f5383fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c101370 0x7f538c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f5383fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c101370 0x7f538c199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44302/0 (socket says 172.21.15.92:44302) 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f5383fff640 1 -- 172.21.15.92:0/1742396842 learned_addr learned my addr 172.21.15.92:0/1742396842 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f538a59c640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f538c1009d0 0x7f538c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.617+0000 7f538ad9d640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f538c1069e0 0x7f538c1a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f5383fff640 1 -- 172.21.15.92:0/1742396842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f538c1069e0 msgr2=0x7f538c1a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f5383fff640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f538c1069e0 0x7f538c1a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f5383fff640 1 -- 172.21.15.92:0/1742396842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f538c1009d0 msgr2=0x7f538c199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f5383fff640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f538c1009d0 0x7f538c199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f5383fff640 1 -- 172.21.15.92:0/1742396842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c1a47c0 con 0x7f538c101370 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f5383fff640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c101370 0x7f538c199740 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f537400e9f0 tx=0x7f537400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f53837fe640 1 -- 172.21.15.92:0/1742396842 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537400cd80 con 0x7f538c101370 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f53909e8640 1 -- 172.21.15.92:0/1742396842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538c1a4990 con 0x7f538c101370 2024-09-10T10:45:54.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f53837fe640 1 -- 172.21.15.92:0/1742396842 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5374010910 con 0x7f538c101370 2024-09-10T10:45:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f53837fe640 1 -- 172.21.15.92:0/1742396842 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374018990 con 0x7f538c101370 2024-09-10T10:45:54.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.618+0000 7f53909e8640 1 -- 172.21.15.92:0/1742396842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538c1a4eb0 con 0x7f538c101370 2024-09-10T10:45:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.620+0000 7f53837fe640 1 -- 172.21.15.92:0/1742396842 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5374010ac0 con 0x7f538c101370 2024-09-10T10:45:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.620+0000 7f5393862740 1 Processor -- start 2024-09-10T10:45:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f5393862740 1 -- start start 2024-09-10T10:45:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f5393862740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05d6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f5393862740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05e1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f5393862740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f5393862740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55faf053b2f0 con 0x55faf05d6af0 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f5393862740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55faf04e3270 con 0x55faf05d7410 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f5393862740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55faf05372b0 con 0x55faf05e1cb0 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05d6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f538a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05e1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05d6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44306/0 (socket says 172.21.15.92:44306) 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f538ad9d640 1 -- 172.21.15.92:0/872853026 learned_addr learned my addr 172.21.15.92:0/872853026 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f5383fff640 1 --2- 172.21.15.92:0/872853026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f53837fe640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f53780a2da0 0x7f53780a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f538a59c640 1 -- 172.21.15.92:0/872853026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 msgr2=0x55faf05e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:54.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.621+0000 7f538a59c640 1 --2- 172.21.15.92:0/872853026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f538a59c640 1 -- 172.21.15.92:0/872853026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 msgr2=0x55faf05d6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f538a59c640 1 --2- 172.21.15.92:0/872853026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05d6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f538a59c640 1 -- 172.21.15.92:0/872853026 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faf04e2340 con 0x55faf05d7410 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f538ad9d640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f53780a2da0 0x7f53780a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f53837fe640 1 -- 172.21.15.92:0/1742396842 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7f53740cf700 con 0x7f538c101370 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f538a59c640 1 --2- 172.21.15.92:0/872853026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05e1770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f537c02a940 tx=0x7f537c005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1976dd182f7fce5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f538ad9d640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f53780a2da0 0x7f53780a5260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5384010610 tx=0x7f5384004a40 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f5380ff9640 1 -- 172.21.15.92:0/872853026 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c035040 con 0x55faf05d7410 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f5380ff9640 1 -- 172.21.15.92:0/872853026 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f537c005520 con 0x55faf05d7410 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.622+0000 7f5380ff9640 1 -- 172.21.15.92:0/872853026 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c0035f0 con 0x55faf05d7410 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 -- 172.21.15.92:0/872853026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 msgr2=0x55faf05e1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 --2- 172.21.15.92:0/872853026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05e1770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f537c02a940 tx=0x7f537c005de0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 -- 172.21.15.92:0/872853026 shutdown_connections 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 --2- 172.21.15.92:0/872853026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 --2- 172.21.15.92:0/872853026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05e1770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 --2- 172.21.15.92:0/872853026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05d6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 -- 172.21.15.92:0/872853026 >> 172.21.15.92:0/872853026 conn(0x55faf05d3060 msgr2=0x55faf05d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 -- 172.21.15.92:0/872853026 shutdown_connections 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 -- 172.21.15.92:0/872853026 wait complete. 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 -- start start 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 Processor -- start 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05dec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05df170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55faf05e4880 con 0x55faf05d6af0 2024-09-10T10:45:54.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55faf04c4290 con 0x55faf05d7410 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55faf05e4a00 con 0x55faf05e1cb0 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.623+0000 7f5393862740 10 client.0 _ll_register_callbacks cb 0x55faf04f5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05dec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f5383fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05df170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05dec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44312/0 (socket says 172.21.15.92:44312) 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538a59c640 1 -- 172.21.15.92:0/2712997360 learned_addr learned my addr 172.21.15.92:0/2712997360 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538ad9d640 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538a59c640 1 -- 172.21.15.92:0/2712997360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 msgr2=0x55faf05df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538a59c640 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05df6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538a59c640 1 -- 172.21.15.92:0/2712997360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 msgr2=0x55faf05df170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538a59c640 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05df170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538a59c640 1 -- 172.21.15.92:0/2712997360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faf024e210 con 0x55faf05d6af0 2024-09-10T10:45:54.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f5383fff640 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05df170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f538a59c640 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05dec30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f537c0048f0 tx=0x7f537c004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4d62f77206a51f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f5371ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f5371ffb640 1 -- 172.21.15.92:0/2712997360 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c035050 con 0x55faf05d6af0 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f5393862740 1 -- 172.21.15.92:0/2712997360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f537c005520 con 0x55faf05d6af0 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f5371ffb640 1 -- 172.21.15.92:0/2712997360 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7f537c004390 con 0x55faf05d6af0 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f5371ffb640 1 -- 172.21.15.92:0/2712997360 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f537c009520 con 0x55faf05d6af0 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f5393862740 10 client.16023 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.624+0000 7f5393862740 1 -- 172.21.15.92:0/2712997360 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55faf031a620 con 0x55faf05d6af0 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5371ffb640 1 -- 172.21.15.92:0/2712997360 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f537c005520 con 0x55faf05d6af0 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5371ffb640 1 -- 172.21.15.92:0/2712997360 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f537c031a20 con 0x55faf05d6af0 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5393862740 10 client.16023 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5393862740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:54.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5393862740 20 client.16023 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5393862740 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55faf05f1b20 0x55faf05f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5393862740 4 client.16023 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5393862740 1 -- 172.21.15.92:0/2712997360 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55faf0548a20 con 0x55faf05f1b20 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5383fff640 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55faf05f1b20 0x55faf05f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5383fff640 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55faf05f1b20 0x55faf05f3f10 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e74560305a4a1d3c server_cookie=4cd893db0a4523ba in_seq=0 out_seq=0 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.625+0000 7f5371ffb640 10 client.16023 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5371ffb640 1 -- 172.21.15.92:0/2712997360 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55faf0548a20 con 0x55faf05f1b20 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5371ffb640 10 client.16023 handle_command_reply: tid=0 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 client.16023 shutdown 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 -- 172.21.15.92:0/2712997360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 msgr2=0x55faf05dec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05dec30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f537c0048f0 tx=0x7f537c004920 comp rx=0 tx=0).stop 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 -- 172.21.15.92:0/2712997360 shutdown_connections 2024-09-10T10:45:54.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55faf05f1b20 0x55faf05f3f10 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d7410 0x55faf05df170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 --2- 172.21.15.92:0/2712997360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05dec30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5371ffb640 0 client.16023 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 -- 172.21.15.92:0/2712997360 >> 172.21.15.92:0/2712997360 conn(0x55faf05d3060 msgr2=0x55faf05d8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 -- 172.21.15.92:0/2712997360 shutdown_connections 2024-09-10T10:45:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 1 -- 172.21.15.92:0/2712997360 wait complete. 2024-09-10T10:45:54.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.626+0000 7f5393862740 20 client.16023 trim_cache size 0 max 16384 2024-09-10T10:45:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.646+0000 7f5393862740 1 Processor -- start 2024-09-10T10:45:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.646+0000 7f5393862740 1 -- start start 2024-09-10T10:45:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.646+0000 7f5393862740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05df4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.646+0000 7f5393862740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05d7410 0x55faf05e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.646+0000 7f5393862740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05e1cb0 0x55faf05f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.646+0000 7f5393862740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1ad6f0 con 0x55faf05d6af0 2024-09-10T10:45:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.646+0000 7f5393862740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1af2c0 con 0x55faf05e1cb0 2024-09-10T10:45:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.646+0000 7f5393862740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1addc0 con 0x55faf05d7410 2024-09-10T10:45:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.647+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05e1cb0 0x55faf05f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.647+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05e1cb0 0x55faf05f6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:33440/0 (socket says 172.21.15.92:33440) 2024-09-10T10:45:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.647+0000 7f538ad9d640 1 -- 172.21.15.92:0/2159114435 learned_addr learned my addr 172.21.15.92:0/2159114435 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.653+0000 7f538a59c640 1 --2- 172.21.15.92:0/2159114435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05df4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.654+0000 7f538ad9d640 1 -- 172.21.15.92:0/2159114435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05d7410 msgr2=0x55faf05e0ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:45:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.654+0000 7f538ad9d640 1 --2- 172.21.15.92:0/2159114435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05d7410 0x55faf05e0ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.654+0000 7f538ad9d640 1 -- 172.21.15.92:0/2159114435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 msgr2=0x55faf05df4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.654+0000 7f538ad9d640 1 --2- 172.21.15.92:0/2159114435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05df4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.654+0000 7f538ad9d640 1 -- 172.21.15.92:0/2159114435 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faf05ee660 con 0x55faf05e1cb0 2024-09-10T10:45:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.656+0000 7f538ad9d640 1 --2- 172.21.15.92:0/2159114435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05e1cb0 0x55faf05f6f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f538400f8f0 tx=0x7f5384013030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940b9655b949da43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.659+0000 7f5373fff640 1 -- 172.21.15.92:0/2159114435 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384004b20 con 0x55faf05e1cb0 2024-09-10T10:45:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.659+0000 7f5373fff640 1 -- 172.21.15.92:0/2159114435 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5384004cc0 con 0x55faf05e1cb0 2024-09-10T10:45:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.660+0000 7f5393862740 1 -- 172.21.15.92:0/2159114435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05e1cb0 msgr2=0x55faf05f6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.660+0000 7f5393862740 1 --2- 172.21.15.92:0/2159114435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05e1cb0 0x55faf05f6f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f538400f8f0 tx=0x7f5384013030 comp rx=0 tx=0).stop 2024-09-10T10:45:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.662+0000 7f5393862740 1 -- 172.21.15.92:0/2159114435 shutdown_connections 2024-09-10T10:45:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.662+0000 7f5393862740 1 --2- 172.21.15.92:0/2159114435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05e1cb0 0x55faf05f6f30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.662+0000 7f5393862740 1 --2- 172.21.15.92:0/2159114435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05d7410 0x55faf05e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.662+0000 7f5393862740 1 --2- 172.21.15.92:0/2159114435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d6af0 0x55faf05df4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.662+0000 7f5393862740 1 -- 172.21.15.92:0/2159114435 >> 172.21.15.92:0/2159114435 conn(0x55faf05d3060 msgr2=0x55faf05e0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.662+0000 7f5393862740 1 -- 172.21.15.92:0/2159114435 shutdown_connections 2024-09-10T10:45:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.662+0000 7f5393862740 1 -- 172.21.15.92:0/2159114435 wait complete. 2024-09-10T10:45:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5393862740 1 -- start start 2024-09-10T10:45:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5393862740 1 Processor -- start 2024-09-10T10:45:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5393862740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d6af0 0x55faf05f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5393862740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d7410 0x55faf05f7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5393862740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05f4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5393862740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1aebf0 con 0x55faf05d7410 2024-09-10T10:45:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5393862740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1ae520 con 0x55faf05d6af0 2024-09-10T10:45:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5393862740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1ab6f0 con 0x55faf05e1cb0 2024-09-10T10:45:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5393862740 10 client.0 _ll_register_callbacks cb 0x7f5384009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:45:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f5383fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d7410 0x55faf05f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f538a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d6af0 0x55faf05f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f538a59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d6af0 0x55faf05f72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:33444/0 (socket says 172.21.15.92:33444) 2024-09-10T10:45:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.663+0000 7f538a59c640 1 -- 172.21.15.92:0/2249072865 learned_addr learned my addr 172.21.15.92:0/2249072865 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:45:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.664+0000 7f538a59c640 1 -- 172.21.15.92:0/2249072865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 msgr2=0x55faf05f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.664+0000 7f538a59c640 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.664+0000 7f538a59c640 1 -- 172.21.15.92:0/2249072865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d7410 msgr2=0x55faf05f7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:45:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.664+0000 7f538a59c640 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d7410 0x55faf05f7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.664+0000 7f538a59c640 1 -- 172.21.15.92:0/2249072865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faf05f5080 con 0x55faf05d6af0 2024-09-10T10:45:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.664+0000 7f5383fff640 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d7410 0x55faf05f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:45:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.664+0000 7f538a59c640 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d6af0 0x55faf05f72c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f537c0096c0 tx=0x7f537c031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=279f4673751823d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.664+0000 7f5371ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.664+0000 7f5371ffb640 1 -- 172.21.15.92:0/2249072865 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c035070 con 0x55faf05d6af0 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.665+0000 7f5393862740 1 -- 172.21.15.92:0/2249072865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5384004cc0 con 0x55faf05d6af0 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.665+0000 7f5371ffb640 1 -- 172.21.15.92:0/2249072865 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8455+0+0 (secure 0 0 0) 0x7f537c003c90 con 0x55faf05d6af0 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.665+0000 7f5371ffb640 1 -- 172.21.15.92:0/2249072865 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f537c0315b0 con 0x55faf05d6af0 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.665+0000 7f5393862740 10 client.25535 fetch_fsmap learned FSMap version 50 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.665+0000 7f5393862740 1 -- 172.21.15.92:0/2249072865 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55faf065c0d0 con 0x55faf05d6af0 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.665+0000 7f5371ffb640 1 -- 172.21.15.92:0/2249072865 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5384004cc0 con 0x55faf05d6af0 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.666+0000 7f5371ffb640 1 -- 172.21.15.92:0/2249072865 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 50) ==== 8374+0+0 (secure 0 0 0) 0x7f537c04eba0 con 0x55faf05d6af0 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.666+0000 7f5393862740 10 client.25535 fetch_fsmap finished waiting for FSMap version 50 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.666+0000 7f5393862740 10 client.25535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:45:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.666+0000 7f5393862740 20 client.25535 populate_metadata read hostname 'smithi092' 2024-09-10T10:45:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.666+0000 7f5393862740 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55faf065c730 0x55faf065eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:45:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.666+0000 7f5393862740 4 client.25535 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:45:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.666+0000 7f5393862740 1 -- 172.21.15.92:0/2249072865 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55faf0542d70 con 0x55faf065c730 2024-09-10T10:45:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.666+0000 7f5383fff640 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55faf065c730 0x55faf065eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:45:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.667+0000 7f5371ffb640 10 client.25535 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.667+0000 7f5383fff640 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55faf065c730 0x55faf065eb70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9005485f55922961 server_cookie=b3f9869e3606cb1e in_seq=0 out_seq=0 2024-09-10T10:45:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.684+0000 7f5371ffb640 1 -- 172.21.15.92:0/2249072865 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55faf0542d70 con 0x55faf065c730 2024-09-10T10:45:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.684+0000 7f5371ffb640 10 client.25535 handle_command_reply: tid=0 2024-09-10T10:45:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.684+0000 7f5393862740 1 client.25535 shutdown 2024-09-10T10:45:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 -- 172.21.15.92:0/2249072865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d6af0 msgr2=0x55faf05f72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d6af0 0x55faf05f72c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f537c0096c0 tx=0x7f537c031400 comp rx=0 tx=0).stop 2024-09-10T10:45:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 -- 172.21.15.92:0/2249072865 shutdown_connections 2024-09-10T10:45:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55faf05e1cb0 0x55faf05f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55faf05d7410 0x55faf05f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55faf065c730 0x55faf065eb70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 --2- 172.21.15.92:0/2249072865 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55faf05d6af0 0x55faf05f72c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5371ffb640 0 client.25535 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:45:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 -- 172.21.15.92:0/2249072865 >> 172.21.15.92:0/2249072865 conn(0x55faf05d3060 msgr2=0x55faf05ed4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 -- 172.21.15.92:0/2249072865 shutdown_connections 2024-09-10T10:45:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 1 -- 172.21.15.92:0/2249072865 wait complete. 2024-09-10T10:45:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f5393862740 20 client.25535 trim_cache size 0 max 16384 2024-09-10T10:45:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:45:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:45:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:45:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:45:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 -- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f53780a2da0 msgr2=0x7f53780a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f53780a2da0 0x7f53780a5260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5384010610 tx=0x7f5384004a40 comp rx=0 tx=0).stop 2024-09-10T10:45:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 -- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c101370 msgr2=0x7f538c199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:45:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c101370 0x7f538c199740 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f537400e9f0 tx=0x7f537400eeb0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 -- 172.21.15.92:0/1742396842 shutdown_connections 2024-09-10T10:45:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f538c1069e0 0x7f538c1a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f538c101370 0x7f538c199740 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f53780a2da0 0x7f53780a5260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 --2- 172.21.15.92:0/1742396842 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f538c1009d0 0x7f538c199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:45:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.685+0000 7f53909e8640 1 -- 172.21.15.92:0/1742396842 >> 172.21.15.92:0/1742396842 conn(0x7f538c0fc6b0 msgr2=0x7f538c0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:45:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.686+0000 7f53909e8640 1 -- 172.21.15.92:0/1742396842 shutdown_connections 2024-09-10T10:45:54.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:45:54.686+0000 7f53909e8640 1 -- 172.21.15.92:0/1742396842 wait complete. 2024-09-10T10:45:55.912 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:55 smithi092 ceph-mon[30834]: pgmap v288: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.9 MiB/s wr, 533 op/s 2024-09-10T10:45:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:55 smithi121 ceph-mon[35231]: pgmap v288: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.9 MiB/s wr, 533 op/s 2024-09-10T10:45:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:55 smithi097 ceph-mon[35213]: pgmap v288: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.9 MiB/s wr, 533 op/s 2024-09-10T10:45:58.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:57 smithi121 ceph-mon[35231]: pgmap v289: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.5 MiB/s wr, 802 op/s 2024-09-10T10:45:58.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:57 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:45:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:57 smithi097 ceph-mon[35213]: pgmap v289: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.5 MiB/s wr, 802 op/s 2024-09-10T10:45:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:57 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:45:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:57 smithi092 ceph-mon[30834]: pgmap v289: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.5 MiB/s wr, 802 op/s 2024-09-10T10:45:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:57 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:45:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 540.0 s, 2333.2 tps, lat 42.834 ms stddev 47.500 2024-09-10T10:46:00.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:45:59 smithi121 ceph-mon[35231]: pgmap v290: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.8 MiB/s wr, 520 op/s 2024-09-10T10:46:00.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:45:59 smithi097 ceph-mon[35213]: pgmap v290: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.8 MiB/s wr, 520 op/s 2024-09-10T10:46:00.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:45:59 smithi092 ceph-mon[30834]: pgmap v290: 97 pgs: 97 active+clean; 4.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.8 MiB/s wr, 520 op/s 2024-09-10T10:46:02.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:01 smithi121 ceph-mon[35231]: pgmap v291: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.4 MiB/s wr, 793 op/s 2024-09-10T10:46:02.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:01 smithi097 ceph-mon[35213]: pgmap v291: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.4 MiB/s wr, 793 op/s 2024-09-10T10:46:02.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:01 smithi092 ceph-mon[30834]: pgmap v291: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.4 MiB/s wr, 793 op/s 2024-09-10T10:46:03.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:02 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:46:03.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:02 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:46:03.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:02 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:46:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 545.0 s, 993.0 tps, lat 94.416 ms stddev 140.135 2024-09-10T10:46:04.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:03 smithi121 ceph-mon[35231]: pgmap v292: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.2 MiB/s wr, 541 op/s 2024-09-10T10:46:04.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:03 smithi097 ceph-mon[35213]: pgmap v292: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.2 MiB/s wr, 541 op/s 2024-09-10T10:46:04.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:03 smithi092 ceph-mon[30834]: pgmap v292: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.2 MiB/s wr, 541 op/s 2024-09-10T10:46:06.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:05 smithi121 ceph-mon[35231]: pgmap v293: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.2 MiB/s wr, 541 op/s 2024-09-10T10:46:06.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:05 smithi097 ceph-mon[35213]: pgmap v293: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.2 MiB/s wr, 541 op/s 2024-09-10T10:46:06.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:05 smithi092 ceph-mon[30834]: pgmap v293: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.2 MiB/s wr, 541 op/s 2024-09-10T10:46:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.827+0000 7f0e9772a640 1 -- 172.21.15.92:0/1296667229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 msgr2=0x7f0e901021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.827+0000 7f0e9772a640 1 --2- 172.21.15.92:0/1296667229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 0x7f0e901021b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000fc30 tx=0x7f0e8002e700 comp rx=0 tx=0).stop 2024-09-10T10:46:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.828+0000 7f0e9772a640 1 -- 172.21.15.92:0/1296667229 shutdown_connections 2024-09-10T10:46:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.828+0000 7f0e9772a640 1 --2- 172.21.15.92:0/1296667229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e901026f0 0x7f0e9010d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.828+0000 7f0e9772a640 1 --2- 172.21.15.92:0/1296667229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 0x7f0e901021b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.828+0000 7f0e9772a640 1 --2- 172.21.15.92:0/1296667229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e90100490 0x7f0e90100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.828+0000 7f0e9772a640 1 -- 172.21.15.92:0/1296667229 >> 172.21.15.92:0/1296667229 conn(0x7f0e900770f0 msgr2=0x7f0e900fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:07.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.835+0000 7f0e9772a640 1 -- 172.21.15.92:0/1296667229 shutdown_connections 2024-09-10T10:46:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.836+0000 7f0e9772a640 1 -- 172.21.15.92:0/1296667229 wait complete. 2024-09-10T10:46:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.837+0000 7f0e9772a640 1 Processor -- start 2024-09-10T10:46:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.841+0000 7f0e9772a640 1 -- start start 2024-09-10T10:46:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.841+0000 7f0e9772a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e90100490 0x7f0e901a72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.841+0000 7f0e9772a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 0x7f0e901a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.841+0000 7f0e9772a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e901026f0 0x7f0e901abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.841+0000 7f0e9772a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9010fe60 con 0x7f0e90101d70 2024-09-10T10:46:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.841+0000 7f0e9772a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9010fce0 con 0x7f0e901026f0 2024-09-10T10:46:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.841+0000 7f0e9772a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9010ffe0 con 0x7f0e90100490 2024-09-10T10:46:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.842+0000 7f0e94cc5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 0x7f0e901a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.842+0000 7f0e94cc5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 0x7f0e901a77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50828/0 (socket says 172.21.15.92:50828) 2024-09-10T10:46:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.842+0000 7f0e94cc5640 1 -- 172.21.15.92:0/2274289723 learned_addr learned my addr 172.21.15.92:0/2274289723 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.843+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e901026f0 0x7f0e901abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.843+0000 7f0e954c6640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e90100490 0x7f0e901a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.843+0000 7f0e94cc5640 1 -- 172.21.15.92:0/2274289723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e90100490 msgr2=0x7f0e901a72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.843+0000 7f0e94cc5640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e90100490 0x7f0e901a72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.843+0000 7f0e94cc5640 1 -- 172.21.15.92:0/2274289723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e901026f0 msgr2=0x7f0e901abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.843+0000 7f0e94cc5640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e901026f0 0x7f0e901abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.843+0000 7f0e94cc5640 1 -- 172.21.15.92:0/2274289723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e901ac270 con 0x7f0e90101d70 2024-09-10T10:46:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.844+0000 7f0e94cc5640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 0x7f0e901a77f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006010 tx=0x7f0e80033c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.844+0000 7f0e954c6640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e90100490 0x7f0e901a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:46:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.844+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e901026f0 0x7f0e901abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.844+0000 7f0e867fc640 1 -- 172.21.15.92:0/2274289723 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e80041030 con 0x7f0e90101d70 2024-09-10T10:46:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.844+0000 7f0e867fc640 1 -- 172.21.15.92:0/2274289723 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8000e940 con 0x7f0e90101d70 2024-09-10T10:46:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.844+0000 7f0e867fc640 1 -- 172.21.15.92:0/2274289723 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e80039030 con 0x7f0e90101d70 2024-09-10T10:46:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.848+0000 7f0e9772a640 1 -- 172.21.15.92:0/2274289723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e901ac500 con 0x7f0e90101d70 2024-09-10T10:46:07.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.848+0000 7f0e9772a640 1 -- 172.21.15.92:0/2274289723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9006bc10 con 0x7f0e90101d70 2024-09-10T10:46:07.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.852+0000 7f0e9a4c3740 1 Processor -- start 2024-09-10T10:46:07.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.859+0000 7f0e9a4c3740 1 -- start start 2024-09-10T10:46:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.859+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052aaf0 0x562ee052aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.859+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0535770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.859+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 0x562ee05380a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.859+0000 7f0e9a4c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562ee048f2f0 con 0x562ee052b410 2024-09-10T10:46:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.859+0000 7f0e9a4c3740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562ee0437270 con 0x562ee052aaf0 2024-09-10T10:46:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.859+0000 7f0e9a4c3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562ee048b2b0 con 0x562ee0535cb0 2024-09-10T10:46:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.861+0000 7f0e94cc5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 0x562ee05380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.861+0000 7f0e867fc640 1 -- 172.21.15.92:0/2274289723 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0e80044070 con 0x7f0e90101d70 2024-09-10T10:46:07.864 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.862+0000 7f0e95cc7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052aaf0 0x562ee052aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.862+0000 7f0e954c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0535770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.862+0000 7f0e954c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0535770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50842/0 (socket says 172.21.15.92:50842) 2024-09-10T10:46:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.862+0000 7f0e954c6640 1 -- 172.21.15.92:0/1355651360 learned_addr learned my addr 172.21.15.92:0/1355651360 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.862+0000 7f0e867fc640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0e7c0a2f00 0x7f0e7c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.862+0000 7f0e867fc640 1 -- 172.21.15.92:0/2274289723 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8499+0+0 (secure 0 0 0) 0x7f0e800ef540 con 0x7f0e90101d70 2024-09-10T10:46:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.864+0000 7f0e95cc7640 1 -- 172.21.15.92:0/1355651360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 msgr2=0x562ee05380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.864+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/1355651360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 0x562ee05380a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.864+0000 7f0e95cc7640 1 -- 172.21.15.92:0/1355651360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 msgr2=0x562ee0535770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:07.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.864+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/1355651360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0535770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.864+0000 7f0e95cc7640 1 -- 172.21.15.92:0/1355651360 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee0436340 con 0x562ee052aaf0 2024-09-10T10:46:07.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.864+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0e7c0a2f00 0x7f0e7c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.864+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/1355651360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052aaf0 0x562ee052aed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c005fd0 tx=0x7f0e8c00aaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dde86f861668a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.865+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0e7c0a2f00 0x7f0e7c0a53c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c022000 tx=0x7f0e8c023000 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:07.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.865+0000 7f0e7b7fe640 1 -- 172.21.15.92:0/1355651360 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c01c040 con 0x562ee052aaf0 2024-09-10T10:46:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.869+0000 7f0e7b7fe640 1 -- 172.21.15.92:0/1355651360 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8c018400 con 0x562ee052aaf0 2024-09-10T10:46:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.870+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/1355651360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052aaf0 msgr2=0x562ee052aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.870+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/1355651360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052aaf0 0x562ee052aed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c005fd0 tx=0x7f0e8c00aaf0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.873+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/1355651360 shutdown_connections 2024-09-10T10:46:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.873+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/1355651360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 0x562ee05380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.873+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/1355651360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0535770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.873+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/1355651360 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052aaf0 0x562ee052aed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.873+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/1355651360 >> 172.21.15.92:0/1355651360 conn(0x562ee0527060 msgr2=0x562ee0527440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.874+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/1355651360 shutdown_connections 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.877+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/1355651360 wait complete. 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.877+0000 7f0e9a4c3740 1 -- start start 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.877+0000 7f0e9a4c3740 1 Processor -- start 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.878+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 0x562ee0532ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.878+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee052b410 0x562ee0533020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.878+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 0x562ee0533560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.878+0000 7f0e9a4c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562ee0538920 con 0x562ee052aaf0 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.878+0000 7f0e9a4c3740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562ee0418290 con 0x562ee0535cb0 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.878+0000 7f0e9a4c3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562ee0538aa0 con 0x562ee052b410 2024-09-10T10:46:07.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.878+0000 7f0e9a4c3740 10 client.0 _ll_register_callbacks cb 0x562ee0449140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.879+0000 7f0e95cc7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 0x562ee0533560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.879+0000 7f0e95cc7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 0x562ee0533560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:53280/0 (socket says 172.21.15.92:53280) 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.879+0000 7f0e95cc7640 1 -- 172.21.15.92:0/216488848 learned_addr learned my addr 172.21.15.92:0/216488848 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.880+0000 7f0e95cc7640 1 -- 172.21.15.92:0/216488848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee052b410 msgr2=0x562ee0533020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.880+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee052b410 0x562ee0533020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.880+0000 7f0e95cc7640 1 -- 172.21.15.92:0/216488848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 msgr2=0x562ee0532ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.880+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 0x562ee0532ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.880+0000 7f0e95cc7640 1 -- 172.21.15.92:0/216488848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee01a2210 con 0x562ee0535cb0 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.880+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 0x562ee0533560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c007560 tx=0x7f0e8c018bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edc4534b31633ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.880+0000 7f0e78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:46:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.884+0000 7f0e78ff9640 1 -- 172.21.15.92:0/216488848 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c02f020 con 0x562ee0535cb0 2024-09-10T10:46:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.884+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/216488848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e8c018400 con 0x562ee0535cb0 2024-09-10T10:46:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.884+0000 7f0e78ff9640 1 -- 172.21.15.92:0/216488848 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8499+0+0 (secure 0 0 0) 0x7f0e8c0187b0 con 0x562ee0535cb0 2024-09-10T10:46:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.887+0000 7f0e78ff9640 1 -- 172.21.15.92:0/216488848 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f0e8c03a050 con 0x562ee0535cb0 2024-09-10T10:46:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.888+0000 7f0e9a4c3740 10 client.25544 fetch_fsmap learned FSMap version 53 2024-09-10T10:46:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.888+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/216488848 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x562ee026e620 con 0x562ee0535cb0 2024-09-10T10:46:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.889+0000 7f0e78ff9640 1 -- 172.21.15.92:0/216488848 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8c018400 con 0x562ee0535cb0 2024-09-10T10:46:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.889+0000 7f0e78ff9640 1 -- 172.21.15.92:0/216488848 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 53) ==== 8382+0+0 (secure 0 0 0) 0x7f0e8c02a040 con 0x562ee0535cb0 2024-09-10T10:46:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.889+0000 7f0e9a4c3740 10 client.25544 fetch_fsmap finished waiting for FSMap version 53 2024-09-10T10:46:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.889+0000 7f0e9a4c3740 10 client.25544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:46:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.889+0000 7f0e9a4c3740 20 client.25544 populate_metadata read hostname 'smithi092' 2024-09-10T10:46:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.889+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ee05680b0 0x562ee056a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.889+0000 7f0e9a4c3740 4 client.25544 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:46:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.889+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/216488848 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ee049ca20 con 0x562ee05680b0 2024-09-10T10:46:07.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.891+0000 7f0e954c6640 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ee05680b0 0x562ee056a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.898+0000 7f0e954c6640 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ee05680b0 0x562ee056a570 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb9787d144514b44 server_cookie=2b1f347eeee2d93e in_seq=0 out_seq=0 2024-09-10T10:46:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.898+0000 7f0e78ff9640 10 client.25544 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.903+0000 7f0e78ff9640 1 -- 172.21.15.92:0/216488848 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ee049ca20 con 0x562ee05680b0 2024-09-10T10:46:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.903+0000 7f0e78ff9640 10 client.25544 handle_command_reply: tid=0 2024-09-10T10:46:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.903+0000 7f0e9a4c3740 1 client.25544 shutdown 2024-09-10T10:46:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.907+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/216488848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 msgr2=0x562ee0533560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.907+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 0x562ee0533560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c007560 tx=0x7f0e8c018bf0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.908+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/216488848 shutdown_connections 2024-09-10T10:46:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.908+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ee05680b0 0x562ee056a570 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.909+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 0x562ee0533560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.909+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee052b410 0x562ee0533020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.909+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/216488848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 0x562ee0532ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.909+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/216488848 >> 172.21.15.92:0/216488848 conn(0x562ee0527060 msgr2=0x562ee052cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.909+0000 7f0e78ff9640 0 client.25544 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.909+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/216488848 shutdown_connections 2024-09-10T10:46:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.909+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/216488848 wait complete. 2024-09-10T10:46:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.909+0000 7f0e9a4c3740 20 client.25544 trim_cache size 0 max 16384 2024-09-10T10:46:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.933+0000 7f0e9a4c3740 1 Processor -- start 2024-09-10T10:46:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.934+0000 7f0e9a4c3740 1 -- start start 2024-09-10T10:46:07.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.934+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 0x562ee052d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.934+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052b410 0x562ee0533390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.934+0000 7f0e954c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 0x562ee052d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.934+0000 7f0e954c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 0x562ee052d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50862/0 (socket says 172.21.15.92:50862) 2024-09-10T10:46:07.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.934+0000 7f0e954c6640 1 -- 172.21.15.92:0/453204189 learned_addr learned my addr 172.21.15.92:0/453204189 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:07.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 0x562ee056fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e94cc5640 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052b410 0x562ee0533390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/453204189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901954f0 con 0x562ee052aaf0 2024-09-10T10:46:07.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/453204189 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90197120 con 0x562ee052b410 2024-09-10T10:46:07.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 0x562ee056fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/453204189 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90195bc0 con 0x562ee0535cb0 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e954c6640 1 -- 172.21.15.92:0/453204189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 msgr2=0x562ee056fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e954c6640 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 0x562ee056fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e954c6640 1 -- 172.21.15.92:0/453204189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052b410 msgr2=0x562ee0533390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e954c6640 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052b410 0x562ee0533390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e954c6640 1 -- 172.21.15.92:0/453204189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ee052b240 con 0x562ee052aaf0 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e95cc7640 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 0x562ee056fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.935+0000 7f0e94cc5640 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052b410 0x562ee0533390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.936+0000 7f0e954c6640 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 0x562ee052d4d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0e880071d0 tx=0x7f0e880077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3e565190324eec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.936+0000 7f0e7affd640 1 -- 172.21.15.92:0/453204189 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88023420 con 0x562ee052aaf0 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.936+0000 7f0e7affd640 1 -- 172.21.15.92:0/453204189 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8801e030 con 0x562ee052aaf0 2024-09-10T10:46:07.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.936+0000 7f0e7affd640 1 -- 172.21.15.92:0/453204189 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e880227c0 con 0x562ee052aaf0 2024-09-10T10:46:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.937+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/453204189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 msgr2=0x562ee052d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.937+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 0x562ee052d4d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0e880071d0 tx=0x7f0e880077d0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.937+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/453204189 shutdown_connections 2024-09-10T10:46:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.937+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee0535cb0 0x562ee056fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.937+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee052b410 0x562ee0533390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.937+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/453204189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052aaf0 0x562ee052d4d0 secure :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0e880071d0 tx=0x7f0e880077d0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.937+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/453204189 >> 172.21.15.92:0/453204189 conn(0x562ee0527060 msgr2=0x562ee0531bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:07.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.942+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/453204189 shutdown_connections 2024-09-10T10:46:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.942+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/453204189 wait complete. 2024-09-10T10:46:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.943+0000 7f0e9a4c3740 1 -- start start 2024-09-10T10:46:07.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.943+0000 7f0e9a4c3740 1 Processor -- start 2024-09-10T10:46:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.944+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0537790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.944+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 0x562ee053dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.944+0000 7f0e9a4c3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee053e2c0 0x562ee052fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.944+0000 7f0e9a4c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90196a50 con 0x562ee052b410 2024-09-10T10:46:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.944+0000 7f0e9a4c3740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901962c0 con 0x562ee0535cb0 2024-09-10T10:46:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.944+0000 7f0e9a4c3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901008b0 con 0x562ee053e2c0 2024-09-10T10:46:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.944+0000 7f0e9a4c3740 10 client.0 _ll_register_callbacks cb 0x7f0e88007240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:46:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.944+0000 7f0e954c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0537790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.945+0000 7f0e954c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0537790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50866/0 (socket says 172.21.15.92:50866) 2024-09-10T10:46:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.945+0000 7f0e954c6640 1 -- 172.21.15.92:0/3636614342 learned_addr learned my addr 172.21.15.92:0/3636614342 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.945+0000 7f0e954c6640 1 -- 172.21.15.92:0/3636614342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee053e2c0 msgr2=0x562ee052fd40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:46:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.945+0000 7f0e954c6640 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee053e2c0 0x562ee052fd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.945+0000 7f0e954c6640 1 -- 172.21.15.92:0/3636614342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 msgr2=0x562ee053dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.945+0000 7f0e954c6640 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 0x562ee053dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.945+0000 7f0e954c6640 1 -- 172.21.15.92:0/3636614342 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ee053e7f0 con 0x562ee052b410 2024-09-10T10:46:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.946+0000 7f0e954c6640 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0537790 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0e88007e40 tx=0x7f0e88014550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0618d1167668444 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:07.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.946+0000 7f0e78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:46:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.946+0000 7f0e78ff9640 1 -- 172.21.15.92:0/3636614342 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88027070 con 0x562ee052b410 2024-09-10T10:46:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.946+0000 7f0e78ff9640 1 -- 172.21.15.92:0/3636614342 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8499+0+0 (secure 0 0 0) 0x7f0e88014ad0 con 0x562ee052b410 2024-09-10T10:46:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.948+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/3636614342 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e8801e030 con 0x562ee052b410 2024-09-10T10:46:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.949+0000 7f0e78ff9640 1 -- 172.21.15.92:0/3636614342 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f0e88031050 con 0x562ee052b410 2024-09-10T10:46:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.952+0000 7f0e9a4c3740 10 client.16044 fetch_fsmap learned FSMap version 53 2024-09-10T10:46:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.952+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/3636614342 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x562ee0536500 con 0x562ee052b410 2024-09-10T10:46:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.955+0000 7f0e78ff9640 1 -- 172.21.15.92:0/3636614342 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e8801e030 con 0x562ee052b410 2024-09-10T10:46:07.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.955+0000 7f0e78ff9640 1 -- 172.21.15.92:0/3636614342 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 53) ==== 8382+0+0 (secure 0 0 0) 0x7f0e88023510 con 0x562ee052b410 2024-09-10T10:46:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.955+0000 7f0e9a4c3740 10 client.16044 fetch_fsmap finished waiting for FSMap version 53 2024-09-10T10:46:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.956+0000 7f0e9a4c3740 10 client.16044 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:46:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.956+0000 7f0e9a4c3740 20 client.16044 populate_metadata read hostname 'smithi092' 2024-09-10T10:46:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.956+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ee0536c80 0x562ee05d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.956+0000 7f0e9a4c3740 4 client.16044 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:46:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.956+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/3636614342 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ee0496d70 con 0x562ee0536c80 2024-09-10T10:46:07.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.956+0000 7f0e94cc5640 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ee0536c80 0x562ee05d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.961+0000 7f0e94cc5640 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ee0536c80 0x562ee05d4e20 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb3fcbff45d88a36 server_cookie=6ccec8b5447c5b2c in_seq=0 out_seq=0 2024-09-10T10:46:07.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:07.962+0000 7f0e78ff9640 10 client.16044 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e78ff9640 1 -- 172.21.15.92:0/3636614342 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562ee0496d70 con 0x562ee0536c80 2024-09-10T10:46:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e78ff9640 10 client.16044 handle_command_reply: tid=0 2024-09-10T10:46:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 client.16044 shutdown 2024-09-10T10:46:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/3636614342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 msgr2=0x562ee0537790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0537790 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0e88007e40 tx=0x7f0e88014550 comp rx=0 tx=0).stop 2024-09-10T10:46:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/3636614342 shutdown_connections 2024-09-10T10:46:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ee053e2c0 0x562ee052fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:08.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562ee0536c80 0x562ee05d4e20 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562ee0535cb0 0x562ee053dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 --2- 172.21.15.92:0/3636614342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562ee052b410 0x562ee0537790 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/3636614342 >> 172.21.15.92:0/3636614342 conn(0x562ee0527060 msgr2=0x562ee05259a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e78ff9640 0 client.16044 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/3636614342 shutdown_connections 2024-09-10T10:46:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.001+0000 7f0e9a4c3740 1 -- 172.21.15.92:0/3636614342 wait complete. 2024-09-10T10:46:08.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.002+0000 7f0e9a4c3740 20 client.16044 trim_cache size 0 max 16384 2024-09-10T10:46:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:46:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:46:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:46:08.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:46:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 -- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0e7c0a2f00 msgr2=0x7f0e7c0a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0e7c0a2f00 0x7f0e7c0a53c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c022000 tx=0x7f0e8c023000 comp rx=0 tx=0).stop 2024-09-10T10:46:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 -- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 msgr2=0x7f0e901a77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 0x7f0e901a77f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006010 tx=0x7f0e80033c60 comp rx=0 tx=0).stop 2024-09-10T10:46:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 -- 172.21.15.92:0/2274289723 shutdown_connections 2024-09-10T10:46:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f0e7c0a2f00 0x7f0e7c0a53c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f0e901026f0 0x7f0e901abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e90101d70 0x7f0e901a77f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:08.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 --2- 172.21.15.92:0/2274289723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e90100490 0x7f0e901a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 -- 172.21.15.92:0/2274289723 >> 172.21.15.92:0/2274289723 conn(0x7f0e900770f0 msgr2=0x7f0e90104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 -- 172.21.15.92:0/2274289723 shutdown_connections 2024-09-10T10:46:08.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:08.003+0000 7f0e9772a640 1 -- 172.21.15.92:0/2274289723 wait complete. 2024-09-10T10:46:08.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:07 smithi121 ceph-mon[35231]: pgmap v294: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 983 op/s 2024-09-10T10:46:08.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:07 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:46:08.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:07 smithi121 ceph-mon[35231]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T10:46:08.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:07 smithi097 ceph-mon[35213]: pgmap v294: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 983 op/s 2024-09-10T10:46:08.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:07 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:46:08.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:07 smithi097 ceph-mon[35213]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T10:46:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:07 smithi092 ceph-mon[30834]: pgmap v294: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 983 op/s 2024-09-10T10:46:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:07 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:46:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:07 smithi092 ceph-mon[30834]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T10:46:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 550.0 s, 369.6 tps, lat 286.574 ms stddev 367.061 2024-09-10T10:46:10.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:09 smithi121 ceph-mon[35231]: pgmap v296: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 12 MiB/s wr, 857 op/s 2024-09-10T10:46:10.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:09 smithi097 ceph-mon[35213]: pgmap v296: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 12 MiB/s wr, 857 op/s 2024-09-10T10:46:10.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:09 smithi092 ceph-mon[30834]: pgmap v296: 97 pgs: 97 active+clean; 4.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 12 MiB/s wr, 857 op/s 2024-09-10T10:46:12.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:11 smithi121 ceph-mon[35231]: pgmap v297: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 MiB/s wr, 1.75k op/s 2024-09-10T10:46:12.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:11 smithi097 ceph-mon[35213]: pgmap v297: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 MiB/s wr, 1.75k op/s 2024-09-10T10:46:12.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:11 smithi092 ceph-mon[30834]: pgmap v297: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 MiB/s wr, 1.75k op/s 2024-09-10T10:46:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 555.0 s, 2444.0 tps, lat 41.133 ms stddev 50.834 2024-09-10T10:46:14.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:13 smithi121 ceph-mon[35231]: pgmap v298: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 MiB/s wr, 1.75k op/s 2024-09-10T10:46:14.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:13 smithi097 ceph-mon[35213]: pgmap v298: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 MiB/s wr, 1.75k op/s 2024-09-10T10:46:14.114 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:13 smithi092 ceph-mon[30834]: pgmap v298: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 33 MiB/s wr, 1.75k op/s 2024-09-10T10:46:15.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:15 smithi121 ceph-mon[35231]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T10:46:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:15 smithi097 ceph-mon[35213]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T10:46:15.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:15 smithi092 ceph-mon[30834]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T10:46:16.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:16 smithi121 ceph-mon[35231]: pgmap v300: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 MiB/s wr, 1.52k op/s 2024-09-10T10:46:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:16 smithi097 ceph-mon[35213]: pgmap v300: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 MiB/s wr, 1.52k op/s 2024-09-10T10:46:16.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:16 smithi092 ceph-mon[30834]: pgmap v300: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 MiB/s wr, 1.52k op/s 2024-09-10T10:46:17.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:17 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:46:17.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:17 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:46:17.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:17 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:46:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 560.0 s, 2296.4 tps, lat 43.476 ms stddev 47.794 2024-09-10T10:46:18.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:18 smithi121 ceph-mon[35231]: pgmap v301: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 MiB/s wr, 1.58k op/s 2024-09-10T10:46:18.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:18 smithi097 ceph-mon[35213]: pgmap v301: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 MiB/s wr, 1.58k op/s 2024-09-10T10:46:18.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:18 smithi092 ceph-mon[30834]: pgmap v301: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 28 MiB/s wr, 1.58k op/s 2024-09-10T10:46:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:20 smithi121 ceph-mon[35231]: pgmap v302: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 1.56k op/s 2024-09-10T10:46:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:20 smithi097 ceph-mon[35213]: pgmap v302: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 1.56k op/s 2024-09-10T10:46:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:20 smithi092 ceph-mon[30834]: pgmap v302: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 MiB/s wr, 1.56k op/s 2024-09-10T10:46:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 -- 172.21.15.92:0/4264034880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e64101350 msgr2=0x7f2e6410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/4264034880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e64101350 0x7f2e6410d880 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009cd0 tx=0x7f2e5c02a8e0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 -- 172.21.15.92:0/4264034880 shutdown_connections 2024-09-10T10:46:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/4264034880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e64101350 0x7f2e6410d880 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/4264034880 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e641009b0 0x7f2e64100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/4264034880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e641069c0 0x7f2e64106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 -- 172.21.15.92:0/4264034880 >> 172.21.15.92:0/4264034880 conn(0x7f2e64077990 msgr2=0x7f2e640fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 -- 172.21.15.92:0/4264034880 shutdown_connections 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 -- 172.21.15.92:0/4264034880 wait complete. 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.111+0000 7f2e69e2e640 1 Processor -- start 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e69e2e640 1 -- start start 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e69e2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e641009b0 0x7f2e64199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e69e2e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e64101350 0x7f2e641996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e69e2e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e641069c0 0x7f2e641a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e69e2e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e64110e00 con 0x7f2e641009b0 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e69e2e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e64110c80 con 0x7f2e641069c0 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e69e2e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2e64110f80 con 0x7f2e64101350 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e641009b0 0x7f2e64199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e641009b0 0x7f2e64199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36080/0 (socket says 172.21.15.92:36080) 2024-09-10T10:46:21.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e637fe640 1 -- 172.21.15.92:0/89338119 learned_addr learned my addr 172.21.15.92:0/89338119 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:21.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e64101350 0x7f2e641996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.112+0000 7f2e63fff640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e641069c0 0x7f2e641a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.113+0000 7f2e63fff640 1 -- 172.21.15.92:0/89338119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e64101350 msgr2=0x7f2e641996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.113+0000 7f2e63fff640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e64101350 0x7f2e641996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.113+0000 7f2e63fff640 1 -- 172.21.15.92:0/89338119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e641009b0 msgr2=0x7f2e64199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.113+0000 7f2e63fff640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e641009b0 0x7f2e64199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.113+0000 7f2e63fff640 1 -- 172.21.15.92:0/89338119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e641a4730 con 0x7f2e641069c0 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.113+0000 7f2e63fff640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e641069c0 0x7f2e641a41f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c02ae00 tx=0x7f2e5c031df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.113+0000 7f2e60ff9640 1 -- 172.21.15.92:0/89338119 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c003d80 con 0x7f2e641069c0 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.114+0000 7f2e60ff9640 1 -- 172.21.15.92:0/89338119 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e5c004520 con 0x7f2e641069c0 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.114+0000 7f2e60ff9640 1 -- 172.21.15.92:0/89338119 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c030d40 con 0x7f2e641069c0 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.115+0000 7f2e69e2e640 1 -- 172.21.15.92:0/89338119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e641a4900 con 0x7f2e641069c0 2024-09-10T10:46:21.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.115+0000 7f2e69e2e640 1 -- 172.21.15.92:0/89338119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e641a4d70 con 0x7f2e641069c0 2024-09-10T10:46:21.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.117+0000 7f2e60ff9640 1 -- 172.21.15.92:0/89338119 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2e5c0046d0 con 0x7f2e641069c0 2024-09-10T10:46:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.117+0000 7f2e6cbcd740 1 Processor -- start 2024-09-10T10:46:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.118+0000 7f2e6cbcd740 1 -- start start 2024-09-10T10:46:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.120+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe895080 0x5603fe893990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.120+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe893ed0 0x5603fe894310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.120+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe8a7350 0x5603fe8a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.120+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5603fe7f82f0 con 0x5603fe895080 2024-09-10T10:46:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.120+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5603fe7a0270 con 0x5603fe8a7350 2024-09-10T10:46:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.120+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5603fe7f42b0 con 0x5603fe893ed0 2024-09-10T10:46:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.121+0000 7f2e60ff9640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2e4c0a2f80 0x7f2e4c0a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.121+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe895080 0x5603fe893990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.121+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe895080 0x5603fe893990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36088/0 (socket says 172.21.15.92:36088) 2024-09-10T10:46:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.121+0000 7f2e62ffd640 1 -- 172.21.15.92:0/981903179 learned_addr learned my addr 172.21.15.92:0/981903179 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.121+0000 7f2e60ff9640 1 -- 172.21.15.92:0/89338119 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7f2e5c02e030 con 0x7f2e641069c0 2024-09-10T10:46:21.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.121+0000 7f2e637fe640 1 --2- 172.21.15.92:0/981903179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe893ed0 0x5603fe894310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.125+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/981903179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe8a7350 0x5603fe8a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.127+0000 7f2e63fff640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2e4c0a2f80 0x7f2e4c0a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.127+0000 7f2e637fe640 1 -- 172.21.15.92:0/981903179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe8a7350 msgr2=0x5603fe8a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.127+0000 7f2e637fe640 1 --2- 172.21.15.92:0/981903179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe8a7350 0x5603fe8a9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.127+0000 7f2e637fe640 1 -- 172.21.15.92:0/981903179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe895080 msgr2=0x5603fe893990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.127+0000 7f2e637fe640 1 --2- 172.21.15.92:0/981903179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe895080 0x5603fe893990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.127+0000 7f2e637fe640 1 -- 172.21.15.92:0/981903179 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603fe79f340 con 0x5603fe893ed0 2024-09-10T10:46:21.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.127+0000 7f2e637fe640 1 --2- 172.21.15.92:0/981903179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe893ed0 0x5603fe894310 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009c70 tx=0x7f2e54011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83caac23ceae3f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:21.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.130+0000 7f2e49ffb640 1 -- 172.21.15.92:0/981903179 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54005220 con 0x5603fe893ed0 2024-09-10T10:46:21.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.130+0000 7f2e49ffb640 1 -- 172.21.15.92:0/981903179 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e54004c80 con 0x5603fe893ed0 2024-09-10T10:46:21.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.131+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/981903179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe893ed0 msgr2=0x5603fe894310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:21.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.131+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/981903179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe893ed0 0x5603fe894310 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009c70 tx=0x7f2e54011810 comp rx=0 tx=0).stop 2024-09-10T10:46:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.137+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/981903179 shutdown_connections 2024-09-10T10:46:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.137+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/981903179 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe8a7350 0x5603fe8a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.137+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/981903179 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe893ed0 0x5603fe894310 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.137+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/981903179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe895080 0x5603fe893990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.137+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/981903179 >> 172.21.15.92:0/981903179 conn(0x5603fe890060 msgr2=0x5603fe890440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:21.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.140+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/981903179 shutdown_connections 2024-09-10T10:46:21.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.140+0000 7f2e63fff640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2e4c0a2f80 0x7f2e4c0a5440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0bc840 tx=0x7f2e5c003f20 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:21.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.140+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/981903179 wait complete. 2024-09-10T10:46:21.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.141+0000 7f2e6cbcd740 1 -- start start 2024-09-10T10:46:21.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.141+0000 7f2e6cbcd740 1 Processor -- start 2024-09-10T10:46:21.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe893ed0 0x5603fe8a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe895080 0x5603fe8a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe8a7350 0x5603fe8a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5603fe89afc0 con 0x5603fe8a7350 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5603fe781290 con 0x5603fe893ed0 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe895080 0x5603fe8a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5603fe89b140 con 0x5603fe895080 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e6cbcd740 10 client.0 _ll_register_callbacks cb 0x5603fe7b2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe893ed0 0x5603fe8a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe893ed0 0x5603fe8a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:60464/0 (socket says 172.21.15.92:60464) 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe895080 0x5603fe8a6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34416/0 (socket says 172.21.15.92:34416) 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.142+0000 7f2e62ffd640 1 -- 172.21.15.92:0/3004309119 learned_addr learned my addr 172.21.15.92:0/3004309119 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.143+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe8a7350 0x5603fe8a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.143+0000 7f2e62ffd640 1 -- 172.21.15.92:0/3004309119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe895080 msgr2=0x5603fe8a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:21.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.143+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe895080 0x5603fe8a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.143+0000 7f2e62ffd640 1 -- 172.21.15.92:0/3004309119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe8a7350 msgr2=0x5603fe8a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:21.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.143+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe8a7350 0x5603fe8a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.143+0000 7f2e62ffd640 1 -- 172.21.15.92:0/3004309119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603fe50b210 con 0x5603fe893ed0 2024-09-10T10:46:21.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.143+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe893ed0 0x5603fe8a0ff0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009e50 tx=0x7f2e58004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a287516639d0a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:21.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.143+0000 7f2e42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:46:21.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.144+0000 7f2e42ffd640 1 -- 172.21.15.92:0/3004309119 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58005020 con 0x5603fe893ed0 2024-09-10T10:46:21.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.144+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3004309119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e54004c80 con 0x5603fe893ed0 2024-09-10T10:46:21.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.144+0000 7f2e42ffd640 1 -- 172.21.15.92:0/3004309119 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7f2e580051c0 con 0x5603fe893ed0 2024-09-10T10:46:21.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.144+0000 7f2e42ffd640 1 -- 172.21.15.92:0/3004309119 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f2e580053c0 con 0x5603fe893ed0 2024-09-10T10:46:21.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.144+0000 7f2e6cbcd740 10 client.25559 fetch_fsmap learned FSMap version 54 2024-09-10T10:46:21.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.144+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3004309119 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5603fe5d7620 con 0x5603fe893ed0 2024-09-10T10:46:21.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.145+0000 7f2e42ffd640 1 -- 172.21.15.92:0/3004309119 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e58005560 con 0x5603fe893ed0 2024-09-10T10:46:21.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.145+0000 7f2e42ffd640 1 -- 172.21.15.92:0/3004309119 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f2e580218d0 con 0x5603fe893ed0 2024-09-10T10:46:21.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.145+0000 7f2e6cbcd740 10 client.25559 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T10:46:21.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.145+0000 7f2e6cbcd740 10 client.25559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:46:21.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.145+0000 7f2e6cbcd740 20 client.25559 populate_metadata read hostname 'smithi092' 2024-09-10T10:46:21.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.145+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603fe8bfd00 0x5603fe8c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.145+0000 7f2e6cbcd740 4 client.25559 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:46:21.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.145+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3004309119 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2e54004c80 con 0x5603fe8bfd00 2024-09-10T10:46:21.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.146+0000 7f2e637fe640 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603fe8bfd00 0x5603fe8c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.147+0000 7f2e637fe640 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603fe8bfd00 0x5603fe8c2110 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ec3fdf7afda37f server_cookie=478726a4d5d8a904 in_seq=0 out_seq=0 2024-09-10T10:46:21.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.147+0000 7f2e42ffd640 10 client.25559 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:21.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.148+0000 7f2e42ffd640 1 -- 172.21.15.92:0/3004309119 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2e54004c80 con 0x5603fe8bfd00 2024-09-10T10:46:21.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.148+0000 7f2e42ffd640 10 client.25559 handle_command_reply: tid=0 2024-09-10T10:46:21.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.148+0000 7f2e6cbcd740 1 client.25559 shutdown 2024-09-10T10:46:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3004309119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe893ed0 msgr2=0x5603fe8a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe893ed0 0x5603fe8a0ff0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009e50 tx=0x7f2e58004730 comp rx=0 tx=0).stop 2024-09-10T10:46:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3004309119 shutdown_connections 2024-09-10T10:46:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe8a7350 0x5603fe8a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe895080 0x5603fe8a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603fe8bfd00 0x5603fe8c2110 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3004309119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe893ed0 0x5603fe8a0ff0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3004309119 >> 172.21.15.92:0/3004309119 conn(0x5603fe890060 msgr2=0x5603fe895dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e42ffd640 0 client.25559 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3004309119 shutdown_connections 2024-09-10T10:46:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3004309119 wait complete. 2024-09-10T10:46:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.149+0000 7f2e6cbcd740 20 client.25559 trim_cache size 0 max 16384 2024-09-10T10:46:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.169+0000 7f2e6cbcd740 1 Processor -- start 2024-09-10T10:46:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.169+0000 7f2e6cbcd740 1 -- start start 2024-09-10T10:46:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 0x5603fe8c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641ab490 con 0x5603fe893ed0 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641ad090 con 0x5603fe895080 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641abb60 con 0x5603fe8a7350 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8a6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36108/0 (socket says 172.21.15.92:36108) 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e62ffd640 1 -- 172.21.15.92:0/3287258450 learned_addr learned my addr 172.21.15.92:0/3287258450 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/3287258450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 0x5603fe8c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e637fe640 1 -- 172.21.15.92:0/3287258450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 msgr2=0x5603fe8c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e637fe640 1 --2- 172.21.15.92:0/3287258450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 0x5603fe8c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e637fe640 1 -- 172.21.15.92:0/3287258450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 msgr2=0x5603fe8a6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e637fe640 1 --2- 172.21.15.92:0/3287258450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8a6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e637fe640 1 -- 172.21.15.92:0/3287258450 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603fe8a1900 con 0x5603fe895080 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/3287258450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8a6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.170+0000 7f2e637fe640 1 --2- 172.21.15.92:0/3287258450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009350 tx=0x7f2e54005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5031c649a6dc469a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.171+0000 7f2e497fa640 1 -- 172.21.15.92:0/3287258450 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54005020 con 0x5603fe895080 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.171+0000 7f2e497fa640 1 -- 172.21.15.92:0/3287258450 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e54019940 con 0x5603fe895080 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.171+0000 7f2e497fa640 1 -- 172.21.15.92:0/3287258450 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54004b10 con 0x5603fe895080 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.171+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3287258450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 msgr2=0x5603fe8c7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.171+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3287258450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009350 tx=0x7f2e54005f90 comp rx=0 tx=0).stop 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.171+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3287258450 shutdown_connections 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.172+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3287258450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 0x5603fe8c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.172+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3287258450 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7a20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.172+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/3287258450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8a6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.172+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3287258450 >> 172.21.15.92:0/3287258450 conn(0x5603fe890060 msgr2=0x5603fe8a9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.173+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3287258450 shutdown_connections 2024-09-10T10:46:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.173+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/3287258450 wait complete. 2024-09-10T10:46:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.174+0000 7f2e6cbcd740 1 -- start start 2024-09-10T10:46:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.174+0000 7f2e6cbcd740 1 Processor -- start 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.174+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8d3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.174+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.174+0000 7f2e6cbcd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 0x5603fe8c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.174+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641ac9c0 con 0x5603fe893ed0 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.174+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641ac230 con 0x5603fe895080 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.174+0000 7f2e6cbcd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2e641a9490 con 0x5603fe8a7350 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e6cbcd740 10 client.0 _ll_register_callbacks cb 0x7f2e58009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8d3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8d3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36114/0 (socket says 172.21.15.92:36114) 2024-09-10T10:46:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e637fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:60486/0 (socket says 172.21.15.92:60486) 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e62ffd640 1 -- 172.21.15.92:0/2149147804 learned_addr learned my addr 172.21.15.92:0/2149147804 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 0x5603fe8c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e637fe640 1 -- 172.21.15.92:0/2149147804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 msgr2=0x5603fe8c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e637fe640 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 0x5603fe8c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e637fe640 1 -- 172.21.15.92:0/2149147804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 msgr2=0x5603fe8d3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e637fe640 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8d3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e637fe640 1 -- 172.21.15.92:0/2149147804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603fe8d1ae0 con 0x5603fe895080 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8d3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e637fe640 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5603fe79b550 tx=0x7f2e54005b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c655d6ed41cec370 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:46:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e42ffd640 1 -- 172.21.15.92:0/2149147804 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54019d00 con 0x5603fe895080 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e42ffd640 1 -- 172.21.15.92:0/2149147804 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7f2e54032040 con 0x5603fe895080 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/2149147804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e54019940 con 0x5603fe895080 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e42ffd640 1 -- 172.21.15.92:0/2149147804 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f2e5402d3c0 con 0x5603fe895080 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e6cbcd740 10 client.25565 fetch_fsmap learned FSMap version 54 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.175+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/2149147804 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5603fe92aa40 con 0x5603fe895080 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e42ffd640 1 -- 172.21.15.92:0/2149147804 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e54019940 con 0x5603fe895080 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e42ffd640 1 -- 172.21.15.92:0/2149147804 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f2e540406d0 con 0x5603fe895080 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e6cbcd740 10 client.25565 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e6cbcd740 10 client.25565 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e6cbcd740 20 client.25565 populate_metadata read hostname 'smithi092' 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603fe92af40 0x5603fe92d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e6cbcd740 4 client.25565 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:46:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/2149147804 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5603fe805a20 con 0x5603fe92af40 2024-09-10T10:46:21.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603fe92af40 0x5603fe92d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:21.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e42ffd640 10 client.25565 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:21.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.176+0000 7f2e62ffd640 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603fe92af40 0x5603fe92d360 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92cc1a7b608f3c52 server_cookie=bd16e860618b5c8b in_seq=0 out_seq=0 2024-09-10T10:46:21.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e42ffd640 1 -- 172.21.15.92:0/2149147804 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5603fe805a20 con 0x5603fe92af40 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e42ffd640 10 client.25565 handle_command_reply: tid=0 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 client.25565 shutdown 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/2149147804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 msgr2=0x5603fe8c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5603fe79b550 tx=0x7f2e54005b90 comp rx=0 tx=0).stop 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/2149147804 shutdown_connections 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603fe8a7350 0x5603fe8c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603fe92af40 0x5603fe92d360 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603fe895080 0x5603fe8c7450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 --2- 172.21.15.92:0/2149147804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603fe893ed0 0x5603fe8d3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/2149147804 >> 172.21.15.92:0/2149147804 conn(0x5603fe890060 msgr2=0x5603fe89b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e42ffd640 0 client.25565 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/2149147804 shutdown_connections 2024-09-10T10:46:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 1 -- 172.21.15.92:0/2149147804 wait complete. 2024-09-10T10:46:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.187+0000 7f2e6cbcd740 20 client.25565 trim_cache size 0 max 16384 2024-09-10T10:46:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:46:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:46:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:46:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:46:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 -- 172.21.15.92:0/89338119 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2e4c0a2f80 msgr2=0x7f2e4c0a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2e4c0a2f80 0x7f2e4c0a5440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0bc840 tx=0x7f2e5c003f20 comp rx=0 tx=0).stop 2024-09-10T10:46:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 -- 172.21.15.92:0/89338119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e641069c0 msgr2=0x7f2e641a41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e641069c0 0x7f2e641a41f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c02ae00 tx=0x7f2e5c031df0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 -- 172.21.15.92:0/89338119 shutdown_connections 2024-09-10T10:46:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2e4c0a2f80 0x7f2e4c0a5440 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2e641069c0 0x7f2e641a41f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2e64101350 0x7f2e641996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 --2- 172.21.15.92:0/89338119 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e641009b0 0x7f2e64199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 -- 172.21.15.92:0/89338119 >> 172.21.15.92:0/89338119 conn(0x7f2e64077990 msgr2=0x7f2e64103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 -- 172.21.15.92:0/89338119 shutdown_connections 2024-09-10T10:46:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:21.188+0000 7f2e69e2e640 1 -- 172.21.15.92:0/89338119 wait complete. 2024-09-10T10:46:22.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:22 smithi121 ceph-mon[35231]: pgmap v303: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 672 op/s 2024-09-10T10:46:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:22 smithi097 ceph-mon[35213]: pgmap v303: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 672 op/s 2024-09-10T10:46:22.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:22 smithi092 ceph-mon[30834]: pgmap v303: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 672 op/s 2024-09-10T10:46:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 565.0 s, 2349.6 tps, lat 42.752 ms stddev 47.705 2024-09-10T10:46:24.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:24 smithi121 ceph-mon[35231]: pgmap v304: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 672 op/s 2024-09-10T10:46:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:24 smithi097 ceph-mon[35213]: pgmap v304: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 672 op/s 2024-09-10T10:46:24.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:24 smithi092 ceph-mon[30834]: pgmap v304: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 672 op/s 2024-09-10T10:46:26.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:26 smithi121 ceph-mon[35231]: pgmap v305: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 662 op/s 2024-09-10T10:46:26.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:26 smithi097 ceph-mon[35213]: pgmap v305: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 662 op/s 2024-09-10T10:46:26.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:26 smithi092 ceph-mon[30834]: pgmap v305: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 662 op/s 2024-09-10T10:46:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 570.0 s, 2093.2 tps, lat 47.246 ms stddev 52.013 2024-09-10T10:46:28.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:28 smithi121 ceph-mon[35231]: pgmap v306: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 842 op/s 2024-09-10T10:46:28.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:28 smithi097 ceph-mon[35213]: pgmap v306: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 842 op/s 2024-09-10T10:46:28.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:28 smithi092 ceph-mon[30834]: pgmap v306: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 842 op/s 2024-09-10T10:46:30.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:30 smithi121 ceph-mon[35231]: pgmap v307: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.2 MiB/s wr, 557 op/s 2024-09-10T10:46:30.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:30 smithi097 ceph-mon[35213]: pgmap v307: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.2 MiB/s wr, 557 op/s 2024-09-10T10:46:30.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:30 smithi092 ceph-mon[30834]: pgmap v307: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.2 MiB/s wr, 557 op/s 2024-09-10T10:46:31.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:31 smithi121 ceph-mon[35231]: pgmap v308: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.6 MiB/s wr, 819 op/s 2024-09-10T10:46:31.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:31 smithi097 ceph-mon[35213]: pgmap v308: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.6 MiB/s wr, 819 op/s 2024-09-10T10:46:31.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:31 smithi092 ceph-mon[30834]: pgmap v308: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.6 MiB/s wr, 819 op/s 2024-09-10T10:46:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 575.0 s, 1631.0 tps, lat 61.910 ms stddev 66.584 2024-09-10T10:46:34.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:33 smithi121 ceph-mon[35231]: pgmap v309: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-09-10T10:46:34.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:33 smithi097 ceph-mon[35213]: pgmap v309: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-09-10T10:46:34.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:33 smithi092 ceph-mon[30834]: pgmap v309: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-09-10T10:46:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.314+0000 7f9e397a2640 1 -- 172.21.15.92:0/704857522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e34101180 msgr2=0x7f9e3410d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.314+0000 7f9e397a2640 1 --2- 172.21.15.92:0/704857522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e34101180 0x7f9e3410d6b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009cd0 tx=0x7f9e2c02a8e0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.314+0000 7f9e397a2640 1 -- 172.21.15.92:0/704857522 shutdown_connections 2024-09-10T10:46:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.314+0000 7f9e397a2640 1 --2- 172.21.15.92:0/704857522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e34101180 0x7f9e3410d6b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.314+0000 7f9e397a2640 1 --2- 172.21.15.92:0/704857522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e341007e0 0x7f9e34100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.314+0000 7f9e397a2640 1 --2- 172.21.15.92:0/704857522 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e341067f0 0x7f9e34106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.314+0000 7f9e397a2640 1 -- 172.21.15.92:0/704857522 >> 172.21.15.92:0/704857522 conn(0x7f9e340fc4e0 msgr2=0x7f9e340fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.314+0000 7f9e397a2640 1 -- 172.21.15.92:0/704857522 shutdown_connections 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.314+0000 7f9e397a2640 1 -- 172.21.15.92:0/704857522 wait complete. 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.315+0000 7f9e397a2640 1 Processor -- start 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.315+0000 7f9e397a2640 1 -- start start 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.315+0000 7f9e397a2640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e341007e0 0x7f9e34116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.315+0000 7f9e397a2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e34101180 0x7f9e34110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.315+0000 7f9e397a2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e341067f0 0x7f9e341107c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.315+0000 7f9e397a2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3410ecb0 con 0x7f9e341067f0 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.315+0000 7f9e397a2640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3410eb30 con 0x7f9e341007e0 2024-09-10T10:46:34.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.315+0000 7f9e397a2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3410ee30 con 0x7f9e34101180 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e38fa1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e341067f0 0x7f9e341107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e341007e0 0x7f9e34116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e38fa1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e341067f0 0x7f9e341107c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57374/0 (socket says 172.21.15.92:57374) 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e337fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e34101180 0x7f9e34110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e341007e0 0x7f9e34116210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:41446/0 (socket says 172.21.15.92:41446) 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e38fa1640 1 -- 172.21.15.92:0/980003093 learned_addr learned my addr 172.21.15.92:0/980003093 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e33fff640 1 -- 172.21.15.92:0/980003093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e34101180 msgr2=0x7f9e34110280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e33fff640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e34101180 0x7f9e34110280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e33fff640 1 -- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e341067f0 msgr2=0x7f9e341107c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e33fff640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e341067f0 0x7f9e341107c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e33fff640 1 -- 172.21.15.92:0/980003093 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e34110f40 con 0x7f9e341007e0 2024-09-10T10:46:34.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e341067f0 0x7f9e341107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:34.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e33fff640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e341007e0 0x7f9e34116210 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c970 tx=0x7f9e2400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:34.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e317fa640 1 -- 172.21.15.92:0/980003093 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24007b30 con 0x7f9e341007e0 2024-09-10T10:46:34.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.316+0000 7f9e397a2640 1 -- 172.21.15.92:0/980003093 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e341b3680 con 0x7f9e341007e0 2024-09-10T10:46:34.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.317+0000 7f9e397a2640 1 -- 172.21.15.92:0/980003093 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e341b3b90 con 0x7f9e341007e0 2024-09-10T10:46:34.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.317+0000 7f9e317fa640 1 -- 172.21.15.92:0/980003093 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e24005500 con 0x7f9e341007e0 2024-09-10T10:46:34.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.317+0000 7f9e317fa640 1 -- 172.21.15.92:0/980003093 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24004e40 con 0x7f9e341007e0 2024-09-10T10:46:34.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.319+0000 7f9e317fa640 1 -- 172.21.15.92:0/980003093 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9e24007cd0 con 0x7f9e341007e0 2024-09-10T10:46:34.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e3d879740 1 Processor -- start 2024-09-10T10:46:34.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e3d879740 1 -- start start 2024-09-10T10:46:34.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f097e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0988940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f098b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e3d879740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5615f08e22f0 con 0x5615f097dcc0 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e3d879740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5615f088a270 con 0x5615f097e5e0 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e3d879740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5615f08de2b0 con 0x5615f0988e80 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0988940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e38fa1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f097e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e38fa1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f097e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57390/0 (socket says 172.21.15.92:57390) 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e38fa1640 1 -- 172.21.15.92:0/2558190980 learned_addr learned my addr 172.21.15.92:0/2558190980 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e337fe640 1 --2- 172.21.15.92:0/2558190980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f098b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.320+0000 7f9e317fa640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9e1c0a2dc0 0x7f9e1c0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e38fa1640 1 -- 172.21.15.92:0/2558190980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 msgr2=0x5615f098b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/2558190980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f098b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e38fa1640 1 -- 172.21.15.92:0/2558190980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 msgr2=0x5615f0988940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/2558190980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0988940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e38fa1640 1 -- 172.21.15.92:0/2558190980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615f0889340 con 0x5615f097dcc0 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e337fe640 1 --2- 172.21.15.92:0/2558190980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f098b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e317fa640 1 -- 172.21.15.92:0/980003093 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7f9e240cedd0 con 0x7f9e341007e0 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9e1c0a2dc0 0x7f9e1c0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/2558190980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f097e0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c031c90 tx=0x7f9e2c031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5afbffab40e5b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e1a7fc640 1 -- 172.21.15.92:0/2558190980 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c042040 con 0x5615f097dcc0 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e1a7fc640 1 -- 172.21.15.92:0/2558190980 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e2c044070 con 0x5615f097dcc0 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e1a7fc640 1 -- 172.21.15.92:0/2558190980 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c048630 con 0x5615f097dcc0 2024-09-10T10:46:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.321+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9e1c0a2dc0 0x7f9e1c0a5280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c04d000 tx=0x7f9e2c04e000 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.322+0000 7f9e3d879740 1 -- 172.21.15.92:0/2558190980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 msgr2=0x5615f097e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.322+0000 7f9e3d879740 1 --2- 172.21.15.92:0/2558190980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f097e0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c031c90 tx=0x7f9e2c031cc0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.323+0000 7f9e3d879740 1 -- 172.21.15.92:0/2558190980 shutdown_connections 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.323+0000 7f9e3d879740 1 --2- 172.21.15.92:0/2558190980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f098b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.323+0000 7f9e3d879740 1 --2- 172.21.15.92:0/2558190980 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0988940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.323+0000 7f9e3d879740 1 --2- 172.21.15.92:0/2558190980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f097e0a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.323+0000 7f9e3d879740 1 -- 172.21.15.92:0/2558190980 >> 172.21.15.92:0/2558190980 conn(0x5615f097a230 msgr2=0x5615f097a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.323+0000 7f9e3d879740 1 -- 172.21.15.92:0/2558190980 shutdown_connections 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.323+0000 7f9e3d879740 1 -- 172.21.15.92:0/2558190980 wait complete. 2024-09-10T10:46:34.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e3d879740 1 -- start start 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e3d879740 1 Processor -- start 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0985d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f09862a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09867e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e3d879740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5615f098ba50 con 0x5615f097dcc0 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e3d879740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5615f086b290 con 0x5615f097e5e0 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e3d879740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5615f098bbd0 con 0x5615f0988e80 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e3d879740 10 client.0 _ll_register_callbacks cb 0x5615f089c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0985d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0985d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57392/0 (socket says 172.21.15.92:57392) 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.324+0000 7f9e33fff640 1 -- 172.21.15.92:0/264730159 learned_addr learned my addr 172.21.15.92:0/264730159 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:34.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09867e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e337fe640 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f09862a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e33fff640 1 -- 172.21.15.92:0/264730159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 msgr2=0x5615f09867e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e33fff640 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09867e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e33fff640 1 -- 172.21.15.92:0/264730159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 msgr2=0x5615f09862a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e33fff640 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f09862a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e33fff640 1 -- 172.21.15.92:0/264730159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615f05f5210 con 0x5615f097dcc0 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e337fe640 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f09862a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09867e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e33fff640 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0985d60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9e240cc560 tx=0x7f9e2409b210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a196e05dea6f6677 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e137fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e137fe640 1 -- 172.21.15.92:0/264730159 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2401d030 con 0x5615f097dcc0 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e137fe640 1 -- 172.21.15.92:0/264730159 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7f9e240b4270 con 0x5615f097dcc0 2024-09-10T10:46:34.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e3d879740 1 -- 172.21.15.92:0/264730159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e2c044070 con 0x5615f097dcc0 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e137fe640 1 -- 172.21.15.92:0/264730159 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f9e240cc980 con 0x5615f097dcc0 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e3d879740 10 client.16074 fetch_fsmap learned FSMap version 54 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.325+0000 7f9e3d879740 1 -- 172.21.15.92:0/264730159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5615f06c1620 con 0x5615f097dcc0 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.326+0000 7f9e137fe640 1 -- 172.21.15.92:0/264730159 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e2c044070 con 0x5615f097dcc0 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.326+0000 7f9e137fe640 1 -- 172.21.15.92:0/264730159 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f9e240bb1d0 con 0x5615f097dcc0 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.326+0000 7f9e3d879740 10 client.16074 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.326+0000 7f9e3d879740 10 client.16074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.326+0000 7f9e3d879740 20 client.16074 populate_metadata read hostname 'smithi092' 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.326+0000 7f9e3d879740 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5615f0999010 0x5615f099b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.326+0000 7f9e3d879740 4 client.16074 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:46:34.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.326+0000 7f9e3d879740 1 -- 172.21.15.92:0/264730159 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615f08efa20 con 0x5615f0999010 2024-09-10T10:46:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.327+0000 7f9e337fe640 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5615f0999010 0x5615f099b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.327+0000 7f9e337fe640 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5615f0999010 0x5615f099b400 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6e34b460d3c5334 server_cookie=4b468791d9c43a04 in_seq=0 out_seq=0 2024-09-10T10:46:34.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.327+0000 7f9e137fe640 10 client.16074 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.328+0000 7f9e137fe640 1 -- 172.21.15.92:0/264730159 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615f08efa20 con 0x5615f0999010 2024-09-10T10:46:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.328+0000 7f9e137fe640 10 client.16074 handle_command_reply: tid=0 2024-09-10T10:46:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.328+0000 7f9e3d879740 1 client.16074 shutdown 2024-09-10T10:46:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.328+0000 7f9e3d879740 1 -- 172.21.15.92:0/264730159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 msgr2=0x5615f0985d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.328+0000 7f9e3d879740 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0985d60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9e240cc560 tx=0x7f9e2409b210 comp rx=0 tx=0).stop 2024-09-10T10:46:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.328+0000 7f9e3d879740 1 -- 172.21.15.92:0/264730159 shutdown_connections 2024-09-10T10:46:34.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.329+0000 7f9e3d879740 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09867e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.329+0000 7f9e3d879740 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5615f0999010 0x5615f099b400 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.329+0000 7f9e3d879740 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f09862a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.329+0000 7f9e3d879740 1 --2- 172.21.15.92:0/264730159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0985d60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.329+0000 7f9e3d879740 1 -- 172.21.15.92:0/264730159 >> 172.21.15.92:0/264730159 conn(0x5615f097a230 msgr2=0x5615f097ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.329+0000 7f9e137fe640 0 client.16074 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.329+0000 7f9e3d879740 1 -- 172.21.15.92:0/264730159 shutdown_connections 2024-09-10T10:46:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.329+0000 7f9e3d879740 1 -- 172.21.15.92:0/264730159 wait complete. 2024-09-10T10:46:34.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.329+0000 7f9e3d879740 20 client.16074 trim_cache size 0 max 16384 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e3d879740 1 Processor -- start 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e3d879740 1 -- start start 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0986610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0979170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e3d879740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2000e660 con 0x5615f097dcc0 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e3d879740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9e20010260 con 0x5615f097e5e0 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e3d879740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2000ed30 con 0x5615f0988e80 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0986610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e337fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0979170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e337fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0979170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:41478/0 (socket says 172.21.15.92:41478) 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0986610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57400/0 (socket says 172.21.15.92:57400) 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.352+0000 7f9e337fe640 1 -- 172.21.15.92:0/564934635 learned_addr learned my addr 172.21.15.92:0/564934635 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e337fe640 1 -- 172.21.15.92:0/564934635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 msgr2=0x5615f09a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e337fe640 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e337fe640 1 -- 172.21.15.92:0/564934635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 msgr2=0x5615f0986610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e337fe640 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0986610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e337fe640 1 -- 172.21.15.92:0/564934635 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615f0979cd0 con 0x5615f097e5e0 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e33fff640 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0986610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e38fa1640 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e337fe640 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0979170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9e28005f00 tx=0x7f9e2800b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e80433b937b25e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:34.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e19ffb640 1 -- 172.21.15.92:0/564934635 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28003e80 con 0x5615f097e5e0 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e19ffb640 1 -- 172.21.15.92:0/564934635 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e28005500 con 0x5615f097e5e0 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.353+0000 7f9e19ffb640 1 -- 172.21.15.92:0/564934635 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28011680 con 0x5615f097e5e0 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 -- 172.21.15.92:0/564934635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 msgr2=0x5615f0979170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0979170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9e28005f00 tx=0x7f9e2800b390 comp rx=0 tx=0).stop 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 -- 172.21.15.92:0/564934635 shutdown_connections 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f0988e80 0x5615f09a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097e5e0 0x5615f0979170 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 --2- 172.21.15.92:0/564934635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f097dcc0 0x5615f0986610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 -- 172.21.15.92:0/564934635 >> 172.21.15.92:0/564934635 conn(0x5615f097a230 msgr2=0x5615f0978a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 -- 172.21.15.92:0/564934635 shutdown_connections 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 -- 172.21.15.92:0/564934635 wait complete. 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 -- start start 2024-09-10T10:46:34.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.354+0000 7f9e3d879740 1 Processor -- start 2024-09-10T10:46:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097dcc0 0x5615f0990ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f097e5e0 0x5615f0991400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e3d879740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f0988e80 0x5615f0982010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e3d879740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2000fb90 con 0x5615f0988e80 2024-09-10T10:46:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e3d879740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2000f400 con 0x5615f097dcc0 2024-09-10T10:46:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e3d879740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2000c660 con 0x5615f097e5e0 2024-09-10T10:46:34.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e38fa1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f0988e80 0x5615f0982010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097dcc0 0x5615f0990ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e3d879740 10 client.0 _ll_register_callbacks cb 0x7f9e240058a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e33fff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097dcc0 0x5615f0990ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:41484/0 (socket says 172.21.15.92:41484) 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e38fa1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f0988e80 0x5615f0982010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57410/0 (socket says 172.21.15.92:57410) 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e33fff640 1 -- 172.21.15.92:0/783136955 learned_addr learned my addr 172.21.15.92:0/783136955 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e337fe640 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f097e5e0 0x5615f0991400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e33fff640 1 -- 172.21.15.92:0/783136955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f097e5e0 msgr2=0x5615f0991400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e33fff640 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f097e5e0 0x5615f0991400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e33fff640 1 -- 172.21.15.92:0/783136955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f0988e80 msgr2=0x5615f0982010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e33fff640 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f0988e80 0x5615f0982010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.355+0000 7f9e33fff640 1 -- 172.21.15.92:0/783136955 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615f0991ac0 con 0x5615f097dcc0 2024-09-10T10:46:34.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.356+0000 7f9e33fff640 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097dcc0 0x5615f0990ec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9e240977e0 tx=0x7f9e240cf0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28ff7edd97c6b1e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.356+0000 7f9e137fe640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.356+0000 7f9e137fe640 1 -- 172.21.15.92:0/783136955 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e240bb2b0 con 0x5615f097dcc0 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.356+0000 7f9e137fe640 1 -- 172.21.15.92:0/783136955 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7f9e2409f120 con 0x5615f097dcc0 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.356+0000 7f9e3d879740 1 -- 172.21.15.92:0/783136955 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e28005500 con 0x5615f097dcc0 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.356+0000 7f9e137fe640 1 -- 172.21.15.92:0/783136955 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f9e240a3f40 con 0x5615f097dcc0 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.356+0000 7f9e3d879740 10 client.25580 fetch_fsmap learned FSMap version 54 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.356+0000 7f9e3d879740 1 -- 172.21.15.92:0/783136955 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5615f0a031d0 con 0x5615f097dcc0 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.357+0000 7f9e137fe640 1 -- 172.21.15.92:0/783136955 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e28005500 con 0x5615f097dcc0 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.357+0000 7f9e137fe640 1 -- 172.21.15.92:0/783136955 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f9e2409a440 con 0x5615f097dcc0 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.357+0000 7f9e3d879740 10 client.25580 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.357+0000 7f9e3d879740 10 client.25580 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.357+0000 7f9e3d879740 20 client.25580 populate_metadata read hostname 'smithi092' 2024-09-10T10:46:34.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.357+0000 7f9e3d879740 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5615f0a03810 0x5615f0a05c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:34.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.357+0000 7f9e3d879740 4 client.25580 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:46:34.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.357+0000 7f9e3d879740 1 -- 172.21.15.92:0/783136955 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5615f08e9d70 con 0x5615f0a03810 2024-09-10T10:46:34.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.358+0000 7f9e337fe640 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5615f0a03810 0x5615f0a05c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:34.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.358+0000 7f9e337fe640 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5615f0a03810 0x5615f0a05c30 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=569cfde75f503adc server_cookie=d02a5a1358596a27 in_seq=0 out_seq=0 2024-09-10T10:46:34.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.359+0000 7f9e137fe640 10 client.25580 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.365+0000 7f9e137fe640 1 -- 172.21.15.92:0/783136955 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5615f08e9d70 con 0x5615f0a03810 2024-09-10T10:46:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.365+0000 7f9e137fe640 10 client.25580 handle_command_reply: tid=0 2024-09-10T10:46:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.365+0000 7f9e3d879740 1 client.25580 shutdown 2024-09-10T10:46:34.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.365+0000 7f9e3d879740 1 -- 172.21.15.92:0/783136955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097dcc0 msgr2=0x5615f0990ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.365+0000 7f9e3d879740 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097dcc0 0x5615f0990ec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9e240977e0 tx=0x7f9e240cf0d0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.366+0000 7f9e3d879740 1 -- 172.21.15.92:0/783136955 shutdown_connections 2024-09-10T10:46:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.366+0000 7f9e3d879740 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5615f0988e80 0x5615f0982010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.366+0000 7f9e3d879740 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615f097e5e0 0x5615f0991400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.366+0000 7f9e3d879740 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5615f0a03810 0x5615f0a05c30 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.366+0000 7f9e3d879740 1 --2- 172.21.15.92:0/783136955 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5615f097dcc0 0x5615f0990ec0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.366+0000 7f9e3d879740 1 -- 172.21.15.92:0/783136955 >> 172.21.15.92:0/783136955 conn(0x5615f097a230 msgr2=0x5615f0979260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.366+0000 7f9e137fe640 0 client.25580 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.367+0000 7f9e3d879740 1 -- 172.21.15.92:0/783136955 shutdown_connections 2024-09-10T10:46:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.367+0000 7f9e3d879740 1 -- 172.21.15.92:0/783136955 wait complete. 2024-09-10T10:46:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.367+0000 7f9e3d879740 20 client.25580 trim_cache size 0 max 16384 2024-09-10T10:46:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:46:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:46:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:46:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:46:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 -- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9e1c0a2dc0 msgr2=0x7f9e1c0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9e1c0a2dc0 0x7f9e1c0a5280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c04d000 tx=0x7f9e2c04e000 comp rx=0 tx=0).stop 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 -- 172.21.15.92:0/980003093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e341007e0 msgr2=0x7f9e34116210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e341007e0 0x7f9e34116210 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c970 tx=0x7f9e2400ce30 comp rx=0 tx=0).stop 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 -- 172.21.15.92:0/980003093 shutdown_connections 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e341067f0 0x7f9e341107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e34101180 0x7f9e34110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9e1c0a2dc0 0x7f9e1c0a5280 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 --2- 172.21.15.92:0/980003093 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9e341007e0 0x7f9e34116210 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 -- 172.21.15.92:0/980003093 >> 172.21.15.92:0/980003093 conn(0x7f9e340fc4e0 msgr2=0x7f9e340fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 -- 172.21.15.92:0/980003093 shutdown_connections 2024-09-10T10:46:34.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:34.368+0000 7f9e397a2640 1 -- 172.21.15.92:0/980003093 wait complete. 2024-09-10T10:46:36.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:35 smithi121 ceph-mon[35231]: pgmap v310: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-09-10T10:46:36.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:35 smithi097 ceph-mon[35213]: pgmap v310: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-09-10T10:46:36.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:35 smithi092 ceph-mon[30834]: pgmap v310: 97 pgs: 97 active+clean; 4.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-09-10T10:46:38.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:37 smithi121 ceph-mon[35231]: pgmap v311: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 795 op/s 2024-09-10T10:46:38.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:37 smithi097 ceph-mon[35213]: pgmap v311: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 795 op/s 2024-09-10T10:46:38.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:37 smithi092 ceph-mon[30834]: pgmap v311: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 795 op/s 2024-09-10T10:46:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 580.0 s, 1997.0 tps, lat 50.073 ms stddev 53.150 2024-09-10T10:46:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:39 smithi121 ceph-mon[35231]: pgmap v312: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.7 MiB/s wr, 513 op/s 2024-09-10T10:46:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:39 smithi097 ceph-mon[35213]: pgmap v312: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.7 MiB/s wr, 513 op/s 2024-09-10T10:46:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:39 smithi092 ceph-mon[30834]: pgmap v312: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.7 MiB/s wr, 513 op/s 2024-09-10T10:46:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:41 smithi121 ceph-mon[35231]: pgmap v313: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 808 op/s 2024-09-10T10:46:42.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:41 smithi097 ceph-mon[35213]: pgmap v313: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 808 op/s 2024-09-10T10:46:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:41 smithi092 ceph-mon[30834]: pgmap v313: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 808 op/s 2024-09-10T10:46:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 585.0 s, 1999.4 tps, lat 49.714 ms stddev 57.574 2024-09-10T10:46:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:43 smithi121 ceph-mon[35231]: pgmap v314: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 546 op/s 2024-09-10T10:46:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:43 smithi097 ceph-mon[35213]: pgmap v314: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 546 op/s 2024-09-10T10:46:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:43 smithi092 ceph-mon[30834]: pgmap v314: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 546 op/s 2024-09-10T10:46:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:45 smithi121 ceph-mon[35231]: pgmap v315: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 546 op/s 2024-09-10T10:46:46.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:45 smithi097 ceph-mon[35213]: pgmap v315: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 546 op/s 2024-09-10T10:46:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:45 smithi092 ceph-mon[30834]: pgmap v315: 97 pgs: 97 active+clean; 4.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 546 op/s 2024-09-10T10:46:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.498+0000 7f83f0bc4640 1 -- 172.21.15.92:0/541535615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec101370 msgr2=0x7f83ec10d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.498+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/541535615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec101370 0x7f83ec10d8a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009cd0 tx=0x7f83e402a8e0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.498+0000 7f83f0bc4640 1 -- 172.21.15.92:0/541535615 shutdown_connections 2024-09-10T10:46:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.498+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/541535615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec101370 0x7f83ec10d8a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.498+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/541535615 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ec1009d0 0x7f83ec100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.498+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/541535615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83ec1069e0 0x7f83ec106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.498+0000 7f83f0bc4640 1 -- 172.21.15.92:0/541535615 >> 172.21.15.92:0/541535615 conn(0x7f83ec0fc6b0 msgr2=0x7f83ec0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.498+0000 7f83f0bc4640 1 -- 172.21.15.92:0/541535615 shutdown_connections 2024-09-10T10:46:47.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.498+0000 7f83f0bc4640 1 -- 172.21.15.92:0/541535615 wait complete. 2024-09-10T10:46:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83f0bc4640 1 Processor -- start 2024-09-10T10:46:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83f0bc4640 1 -- start start 2024-09-10T10:46:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83f0bc4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec1009d0 0x7f83ec199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83f0bc4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ec101370 0x7f83ec1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83f0bc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83ec1069e0 0x7f83ec1a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83f0bc4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec110e20 con 0x7f83ec1009d0 2024-09-10T10:46:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83f0bc4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec110ca0 con 0x7f83ec101370 2024-09-10T10:46:47.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83f0bc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec110fa0 con 0x7f83ec1069e0 2024-09-10T10:46:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83ea59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec1009d0 0x7f83ec199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83ea59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec1009d0 0x7f83ec199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49624/0 (socket says 172.21.15.92:49624) 2024-09-10T10:46:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83ea59c640 1 -- 172.21.15.92:0/2783369131 learned_addr learned my addr 172.21.15.92:0/2783369131 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.499+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ec101370 0x7f83ec1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.500+0000 7f83ead9d640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83ec1069e0 0x7f83ec1a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.500+0000 7f83ea59c640 1 -- 172.21.15.92:0/2783369131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83ec1069e0 msgr2=0x7f83ec1a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.500+0000 7f83ea59c640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83ec1069e0 0x7f83ec1a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.500+0000 7f83ea59c640 1 -- 172.21.15.92:0/2783369131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ec101370 msgr2=0x7f83ec1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.500+0000 7f83ea59c640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ec101370 0x7f83ec1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.500+0000 7f83ea59c640 1 -- 172.21.15.92:0/2783369131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec1a4750 con 0x7f83ec1009d0 2024-09-10T10:46:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.501+0000 7f83ea59c640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec1009d0 0x7f83ec199190 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00e9f0 tx=0x7f83dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.501+0000 7f83db7fe640 1 -- 172.21.15.92:0/2783369131 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00cd80 con 0x7f83ec1009d0 2024-09-10T10:46:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.501+0000 7f83f0bc4640 1 -- 172.21.15.92:0/2783369131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ec1a4920 con 0x7f83ec1009d0 2024-09-10T10:46:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.501+0000 7f83f0bc4640 1 -- 172.21.15.92:0/2783369131 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ec197210 con 0x7f83ec1009d0 2024-09-10T10:46:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.501+0000 7f83db7fe640 1 -- 172.21.15.92:0/2783369131 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83dc005500 con 0x7f83ec1009d0 2024-09-10T10:46:47.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.501+0000 7f83db7fe640 1 -- 172.21.15.92:0/2783369131 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc010430 con 0x7f83ec1009d0 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.504+0000 7f83db7fe640 1 -- 172.21.15.92:0/2783369131 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f83dc0105d0 con 0x7f83ec1009d0 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.504+0000 7f83f3a39740 1 Processor -- start 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.504+0000 7f83f3a39740 1 -- start start 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.504+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed379ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.504+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed37a410 0x562aed384770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.504+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed384cb0 0x562aed3870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.504+0000 7f83f3a39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562aed2de2f0 con 0x562aed379af0 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.504+0000 7f83f3a39740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562aed286270 con 0x562aed37a410 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.504+0000 7f83f3a39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562aed2da2b0 con 0x562aed384cb0 2024-09-10T10:46:47.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed379ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed379ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49638/0 (socket says 172.21.15.92:49638) 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 -- 172.21.15.92:0/1246046266 learned_addr learned my addr 172.21.15.92:0/1246046266 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed384cb0 0x562aed3870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ea59c640 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed37a410 0x562aed384770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83db7fe640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f83d40a2da0 0x7f83d40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 -- 172.21.15.92:0/1246046266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed384cb0 msgr2=0x562aed3870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed384cb0 0x562aed3870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 -- 172.21.15.92:0/1246046266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed37a410 msgr2=0x562aed384770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed37a410 0x562aed384770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 -- 172.21.15.92:0/1246046266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aed285340 con 0x562aed379af0 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed384cb0 0x562aed3870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83db7fe640 1 -- 172.21.15.92:0/2783369131 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7f83dc0cf710 con 0x7f83ec1009d0 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f83d40a2da0 0x7f83d40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83ead9d640 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed379ed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009a60 tx=0x7f83e4005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8684d77c5cad135e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83d8ff9640 1 -- 172.21.15.92:0/1246046266 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e40315b0 con 0x562aed379af0 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.505+0000 7f83d8ff9640 1 -- 172.21.15.92:0/1246046266 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83e4036040 con 0x562aed379af0 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83d8ff9640 1 -- 172.21.15.92:0/1246046266 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e40305a0 con 0x562aed379af0 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83f3a39740 1 -- 172.21.15.92:0/1246046266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 msgr2=0x562aed379ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83ead9d640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f83d40a2da0 0x7f83d40a5260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009430 tx=0x7f83e4048000 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed379ed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009a60 tx=0x7f83e4005f70 comp rx=0 tx=0).stop 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83f3a39740 1 -- 172.21.15.92:0/1246046266 shutdown_connections 2024-09-10T10:46:47.516 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed384cb0 0x562aed3870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed37a410 0x562aed384770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1246046266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed379ed0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83f3a39740 1 -- 172.21.15.92:0/1246046266 >> 172.21.15.92:0/1246046266 conn(0x562aed376060 msgr2=0x562aed376440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83f3a39740 1 -- 172.21.15.92:0/1246046266 shutdown_connections 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.506+0000 7f83f3a39740 1 -- 172.21.15.92:0/1246046266 wait complete. 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.507+0000 7f83f3a39740 1 -- start start 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.507+0000 7f83f3a39740 1 Processor -- start 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.507+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed381b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.507+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 0x562aed382090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.507+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 0x562aed3825d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.507+0000 7f83f3a39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562aed387880 con 0x562aed379af0 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.507+0000 7f83f3a39740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562aed267290 con 0x562aed384cb0 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.507+0000 7f83f3a39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562aed387a00 con 0x562aed37a410 2024-09-10T10:46:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.507+0000 7f83f3a39740 10 client.0 _ll_register_callbacks cb 0x562aed298140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ea59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed381b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ea59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed381b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49642/0 (socket says 172.21.15.92:49642) 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ea59c640 1 -- 172.21.15.92:0/1577959936 learned_addr learned my addr 172.21.15.92:0/1577959936 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ead9d640 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 0x562aed3825d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 0x562aed382090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ea59c640 1 -- 172.21.15.92:0/1577959936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 msgr2=0x562aed382090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ea59c640 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 0x562aed382090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ea59c640 1 -- 172.21.15.92:0/1577959936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 msgr2=0x562aed3825d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ea59c640 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 0x562aed3825d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ea59c640 1 -- 172.21.15.92:0/1577959936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aecff1210 con 0x562aed379af0 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 0x562aed382090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ead9d640 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 0x562aed3825d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83ea59c640 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed381b50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00c6a0 tx=0x7f83dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346813c1e832b522 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83d1ffb640 1 -- 172.21.15.92:0/1577959936 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc09c310 con 0x562aed379af0 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83d1ffb640 1 -- 172.21.15.92:0/1577959936 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7f83dc0cd0c0 con 0x562aed379af0 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83f3a39740 1 -- 172.21.15.92:0/1577959936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83e4036040 con 0x562aed379af0 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83d1ffb640 1 -- 172.21.15.92:0/1577959936 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f83dc0cd2c0 con 0x562aed379af0 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83f3a39740 10 client.16092 fetch_fsmap learned FSMap version 54 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.508+0000 7f83f3a39740 1 -- 172.21.15.92:0/1577959936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x562aed0bd620 con 0x562aed379af0 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83d1ffb640 1 -- 172.21.15.92:0/1577959936 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83e4036040 con 0x562aed379af0 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83d1ffb640 1 -- 172.21.15.92:0/1577959936 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f83dc09b060 con 0x562aed379af0 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83f3a39740 10 client.16092 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83f3a39740 10 client.16092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:46:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83f3a39740 20 client.16092 populate_metadata read hostname 'smithi092' 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562aed394d60 0x562aed397180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83f3a39740 4 client.16092 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83f3a39740 1 -- 172.21.15.92:0/1577959936 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aed2eba20 con 0x562aed394d60 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562aed394d60 0x562aed397180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83d1ffb640 10 client.16092 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.509+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562aed394d60 0x562aed397180 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=996d93ef6c62baa7 server_cookie=1d3ccdfd90fce511 in_seq=0 out_seq=0 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83d1ffb640 1 -- 172.21.15.92:0/1577959936 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562aed2eba20 con 0x562aed394d60 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83d1ffb640 10 client.16092 handle_command_reply: tid=0 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 client.16092 shutdown 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 -- 172.21.15.92:0/1577959936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 msgr2=0x562aed381b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed381b50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00c6a0 tx=0x7f83dc015000 comp rx=0 tx=0).stop 2024-09-10T10:46:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 -- 172.21.15.92:0/1577959936 shutdown_connections 2024-09-10T10:46:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562aed394d60 0x562aed397180 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 0x562aed3825d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 0x562aed382090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83d1ffb640 0 client.16092 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 --2- 172.21.15.92:0/1577959936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed379af0 0x562aed381b50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 -- 172.21.15.92:0/1577959936 >> 172.21.15.92:0/1577959936 conn(0x562aed376060 msgr2=0x562aed37bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 -- 172.21.15.92:0/1577959936 shutdown_connections 2024-09-10T10:46:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 1 -- 172.21.15.92:0/1577959936 wait complete. 2024-09-10T10:46:47.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.510+0000 7f83f3a39740 20 client.16092 trim_cache size 0 max 16384 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83f3a39740 1 Processor -- start 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83f3a39740 1 -- start start 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed379af0 0x562aed382400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 0x562aed39ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed384cb0 0x562aed39cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83f3a39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc00e660 con 0x562aed384cb0 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83f3a39740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc010260 con 0x562aed379af0 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83f3a39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc00ed30 con 0x562aed37a410 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83ead9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed384cb0 0x562aed39cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83ea59c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed379af0 0x562aed382400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83ead9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed384cb0 0x562aed39cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49646/0 (socket says 172.21.15.92:49646) 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83ead9d640 1 -- 172.21.15.92:0/2879611007 learned_addr learned my addr 172.21.15.92:0/2879611007 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/2879611007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 0x562aed39ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83ead9d640 1 -- 172.21.15.92:0/2879611007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 msgr2=0x562aed39ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83ead9d640 1 --2- 172.21.15.92:0/2879611007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 0x562aed39ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83ead9d640 1 -- 172.21.15.92:0/2879611007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed379af0 msgr2=0x562aed382400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83ead9d640 1 --2- 172.21.15.92:0/2879611007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed379af0 0x562aed382400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.528+0000 7f83ead9d640 1 -- 172.21.15.92:0/2879611007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aed375e90 con 0x562aed384cb0 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83ead9d640 1 --2- 172.21.15.92:0/2879611007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed384cb0 0x562aed39cfd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f83e4005f40 tx=0x7f83e40045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bc21825788d6ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83d3fff640 1 -- 172.21.15.92:0/2879611007 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e40315b0 con 0x562aed384cb0 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83d3fff640 1 -- 172.21.15.92:0/2879611007 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83e4036030 con 0x562aed384cb0 2024-09-10T10:46:47.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83d3fff640 1 -- 172.21.15.92:0/2879611007 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4030ba0 con 0x562aed384cb0 2024-09-10T10:46:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83f3a39740 1 -- 172.21.15.92:0/2879611007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed384cb0 msgr2=0x562aed39cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83f3a39740 1 --2- 172.21.15.92:0/2879611007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed384cb0 0x562aed39cfd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f83e4005f40 tx=0x7f83e40045b0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83f3a39740 1 -- 172.21.15.92:0/2879611007 shutdown_connections 2024-09-10T10:46:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83f3a39740 1 --2- 172.21.15.92:0/2879611007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed384cb0 0x562aed39cfd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83f3a39740 1 --2- 172.21.15.92:0/2879611007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed37a410 0x562aed39ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83f3a39740 1 --2- 172.21.15.92:0/2879611007 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed379af0 0x562aed382400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.529+0000 7f83f3a39740 1 -- 172.21.15.92:0/2879611007 >> 172.21.15.92:0/2879611007 conn(0x562aed376060 msgr2=0x562aed383bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 -- 172.21.15.92:0/2879611007 shutdown_connections 2024-09-10T10:46:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 -- 172.21.15.92:0/2879611007 wait complete. 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 -- start start 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 Processor -- start 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed379af0 0x562aed3884b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed37a410 0x562aed3889f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 0x562aed3f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc00fb90 con 0x562aed37a410 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc00f400 con 0x562aed384cb0 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc00c660 con 0x562aed379af0 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83f3a39740 10 client.0 _ll_register_callbacks cb 0x7f83dc0d5220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83e9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed37a410 0x562aed3889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83e9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed37a410 0x562aed3889f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49658/0 (socket says 172.21.15.92:49658) 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83e9d9b640 1 -- 172.21.15.92:0/444458568 learned_addr learned my addr 172.21.15.92:0/444458568 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:46:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83ea59c640 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed379af0 0x562aed3884b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83ead9d640 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 0x562aed3f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.530+0000 7f83e9d9b640 1 -- 172.21.15.92:0/444458568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed379af0 msgr2=0x562aed3884b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed379af0 0x562aed3884b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83e9d9b640 1 -- 172.21.15.92:0/444458568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 msgr2=0x562aed3f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 0x562aed3f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83e9d9b640 1 -- 172.21.15.92:0/444458568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aed3f8090 con 0x562aed37a410 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83ea59c640 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed379af0 0x562aed3884b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83e9d9b640 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed37a410 0x562aed3889f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x562aed3773e0 tx=0x7f83e0012ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16c86d4f2610dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:46:47.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83d1ffb640 1 -- 172.21.15.92:0/444458568 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0004230 con 0x562aed37a410 2024-09-10T10:46:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83d1ffb640 1 -- 172.21.15.92:0/444458568 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7f83e00043d0 con 0x562aed37a410 2024-09-10T10:46:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83f3a39740 1 -- 172.21.15.92:0/444458568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83e4036030 con 0x562aed37a410 2024-09-10T10:46:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83d1ffb640 1 -- 172.21.15.92:0/444458568 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f83e00035f0 con 0x562aed37a410 2024-09-10T10:46:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83f3a39740 10 client.16098 fetch_fsmap learned FSMap version 54 2024-09-10T10:46:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83f3a39740 1 -- 172.21.15.92:0/444458568 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x562aed3ff4b0 con 0x562aed37a410 2024-09-10T10:46:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83d1ffb640 1 -- 172.21.15.92:0/444458568 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83e4036030 con 0x562aed37a410 2024-09-10T10:46:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83d1ffb640 1 -- 172.21.15.92:0/444458568 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f83e0010950 con 0x562aed37a410 2024-09-10T10:46:47.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83f3a39740 10 client.16098 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T10:46:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83f3a39740 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:46:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83f3a39740 20 client.16098 populate_metadata read hostname 'smithi092' 2024-09-10T10:46:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83f3a39740 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562aed3ffd20 0x562aed402140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:46:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83f3a39740 4 client.16098 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:46:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.531+0000 7f83f3a39740 1 -- 172.21.15.92:0/444458568 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562aed2e5d70 con 0x562aed3ffd20 2024-09-10T10:46:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.532+0000 7f83ea59c640 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562aed3ffd20 0x562aed402140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:46:47.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.532+0000 7f83ea59c640 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562aed3ffd20 0x562aed402140 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83629bb1f02f281e server_cookie=e9f6a99bda1b9d38 in_seq=0 out_seq=0 2024-09-10T10:46:47.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.532+0000 7f83d1ffb640 10 client.16098 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83d1ffb640 1 -- 172.21.15.92:0/444458568 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562aed2e5d70 con 0x562aed3ffd20 2024-09-10T10:46:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83d1ffb640 10 client.16098 handle_command_reply: tid=0 2024-09-10T10:46:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 client.16098 shutdown 2024-09-10T10:46:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 -- 172.21.15.92:0/444458568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed37a410 msgr2=0x562aed3889f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:47.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed37a410 0x562aed3889f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x562aed3773e0 tx=0x7f83e0012ae0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 -- 172.21.15.92:0/444458568 shutdown_connections 2024-09-10T10:46:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562aed3ffd20 0x562aed402140 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562aed384cb0 0x562aed3f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aed37a410 0x562aed3889f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 --2- 172.21.15.92:0/444458568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562aed379af0 0x562aed3884b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83d1ffb640 0 client.16098 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:46:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 -- 172.21.15.92:0/444458568 >> 172.21.15.92:0/444458568 conn(0x562aed376060 msgr2=0x562aed37b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 -- 172.21.15.92:0/444458568 shutdown_connections 2024-09-10T10:46:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 1 -- 172.21.15.92:0/444458568 wait complete. 2024-09-10T10:46:47.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.539+0000 7f83f3a39740 20 client.16098 trim_cache size 0 max 16384 2024-09-10T10:46:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:46:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:46:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:46:47.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:46:47.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 -- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f83d40a2da0 msgr2=0x7f83d40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f83d40a2da0 0x7f83d40a5260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009430 tx=0x7f83e4048000 comp rx=0 tx=0).stop 2024-09-10T10:46:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 -- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec1009d0 msgr2=0x7f83ec199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:46:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec1009d0 0x7f83ec199190 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00e9f0 tx=0x7f83dc00edf0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 -- 172.21.15.92:0/2783369131 shutdown_connections 2024-09-10T10:46:47.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83ec1069e0 0x7f83ec1a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f83d40a2da0 0x7f83d40a5260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f83ec101370 0x7f83ec1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 --2- 172.21.15.92:0/2783369131 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83ec1009d0 0x7f83ec199190 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:46:47.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 -- 172.21.15.92:0/2783369131 >> 172.21.15.92:0/2783369131 conn(0x7f83ec0fc6b0 msgr2=0x7f83ec0fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:46:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 -- 172.21.15.92:0/2783369131 shutdown_connections 2024-09-10T10:46:47.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:46:47.540+0000 7f83f0bc4640 1 -- 172.21.15.92:0/2783369131 wait complete. 2024-09-10T10:46:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:47 smithi121 ceph-mon[35231]: pgmap v316: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 850 op/s 2024-09-10T10:46:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:47 smithi097 ceph-mon[35213]: pgmap v316: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 850 op/s 2024-09-10T10:46:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:47 smithi092 ceph-mon[30834]: pgmap v316: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.3 MiB/s wr, 850 op/s 2024-09-10T10:46:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 590.0 s, 1904.0 tps, lat 52.421 ms stddev 57.035 2024-09-10T10:46:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:49 smithi121 ceph-mon[35231]: pgmap v317: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 598 op/s 2024-09-10T10:46:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:49 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:46:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:49 smithi097 ceph-mon[35213]: pgmap v317: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 598 op/s 2024-09-10T10:46:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:49 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:46:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:49 smithi092 ceph-mon[30834]: pgmap v317: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 598 op/s 2024-09-10T10:46:50.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:49 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:46:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: pgmap v318: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 899 op/s 2024-09-10T10:46:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.542 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:52 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: pgmap v318: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 899 op/s 2024-09-10T10:46:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.571 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:52 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: pgmap v318: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 899 op/s 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:52.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:52 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 595.0 s, 1578.6 tps, lat 63.360 ms stddev 74.468 2024-09-10T10:46:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:53 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi097 to 176.0M 2024-09-10T10:46:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:53 smithi121 ceph-mon[35231]: Unable to set osd_memory_target on smithi097 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-10T10:46:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:53 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-10T10:46:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:53 smithi121 ceph-mon[35231]: Unable to set osd_memory_target on smithi121 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T10:46:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:53 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:53 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:53 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi097 to 176.0M 2024-09-10T10:46:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:53 smithi097 ceph-mon[35213]: Unable to set osd_memory_target on smithi097 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-10T10:46:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:53 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-10T10:46:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:53 smithi097 ceph-mon[35213]: Unable to set osd_memory_target on smithi121 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T10:46:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:53 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:53.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:53 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:53 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi097 to 176.0M 2024-09-10T10:46:53.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:53 smithi092 ceph-mon[30834]: Unable to set osd_memory_target on smithi097 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-10T10:46:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:53 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-10T10:46:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:53 smithi092 ceph-mon[30834]: Unable to set osd_memory_target on smithi121 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T10:46:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:53 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:53.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:53 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:54 smithi121 ceph-mon[35231]: pgmap v319: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 605 op/s 2024-09-10T10:46:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:46:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:46:54.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:54 smithi097 ceph-mon[35213]: pgmap v319: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 605 op/s 2024-09-10T10:46:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:46:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:46:54.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:54.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:54 smithi092 ceph-mon[30834]: pgmap v319: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 605 op/s 2024-09-10T10:46:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T10:46:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:46:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:46:54.611 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:46:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:55 smithi121 ceph-mon[35231]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-10T10:46:55.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:55 smithi121 ceph-mon[35231]: Unable to set osd_memory_target on smithi092 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-10T10:46:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:55 smithi097 ceph-mon[35213]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-10T10:46:55.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:55 smithi097 ceph-mon[35213]: Unable to set osd_memory_target on smithi092 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-10T10:46:55.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:55 smithi092 ceph-mon[30834]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-10T10:46:55.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:55 smithi092 ceph-mon[30834]: Unable to set osd_memory_target on smithi092 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-09-10T10:46:56.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:56 smithi097 ceph-mon[35213]: pgmap v320: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 605 op/s 2024-09-10T10:46:56.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:56 smithi092 ceph-mon[30834]: pgmap v320: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 605 op/s 2024-09-10T10:46:56.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:56 smithi121 ceph-mon[35231]: pgmap v320: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 605 op/s 2024-09-10T10:46:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 600.0 s, 1783.2 tps, lat 56.206 ms stddev 62.249 2024-09-10T10:46:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:46:58 smithi097 ceph-mon[35213]: pgmap v321: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 921 op/s 2024-09-10T10:46:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:46:58 smithi092 ceph-mon[30834]: pgmap v321: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 921 op/s 2024-09-10T10:46:58.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:46:58 smithi121 ceph-mon[35231]: pgmap v321: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 921 op/s 2024-09-10T10:47:00.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:00 smithi097 ceph-mon[35213]: pgmap v322: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 617 op/s 2024-09-10T10:47:00.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:00 smithi092 ceph-mon[30834]: pgmap v322: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 617 op/s 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 -- 172.21.15.92:0/3694817336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3081009d0 msgr2=0x7ff308100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 --2- 172.21.15.92:0/3694817336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3081009d0 0x7ff308100e30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009930 tx=0x7ff2f002a420 comp rx=0 tx=0).stop 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 -- 172.21.15.92:0/3694817336 shutdown_connections 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 --2- 172.21.15.92:0/3694817336 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff308101370 0x7ff30810d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 --2- 172.21.15.92:0/3694817336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3081009d0 0x7ff308100e30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 --2- 172.21.15.92:0/3694817336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081069e0 0x7ff308106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 -- 172.21.15.92:0/3694817336 >> 172.21.15.92:0/3694817336 conn(0x7ff3080fc6f0 msgr2=0x7ff3080feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 -- 172.21.15.92:0/3694817336 shutdown_connections 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 -- 172.21.15.92:0/3694817336 wait complete. 2024-09-10T10:47:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.645+0000 7ff30e366640 1 Processor -- start 2024-09-10T10:47:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff30e366640 1 -- start start 2024-09-10T10:47:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff30e366640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081009d0 0x7ff308197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff30e366640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff308101370 0x7ff3081977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff30e366640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3081069e0 0x7ff30819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff30e366640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff308110e20 con 0x7ff308101370 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff30e366640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff308110ca0 con 0x7ff3081069e0 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff30e366640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff308110fa0 con 0x7ff3081009d0 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff2fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff308101370 0x7ff3081977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff2fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff308101370 0x7ff3081977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43376/0 (socket says 172.21.15.92:43376) 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff2fffff640 1 -- 172.21.15.92:0/3334635109 learned_addr learned my addr 172.21.15.92:0/3334635109 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff30c903640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3081069e0 0x7ff30819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff307fff640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081009d0 0x7ff308197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff2fffff640 1 -- 172.21.15.92:0/3334635109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081009d0 msgr2=0x7ff308197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081009d0 0x7ff308197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff2fffff640 1 -- 172.21.15.92:0/3334635109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3081069e0 msgr2=0x7ff30819bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3081069e0 0x7ff30819bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff2fffff640 1 -- 172.21.15.92:0/3334635109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30819c280 con 0x7ff308101370 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff30c903640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3081069e0 0x7ff30819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.646+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff308101370 0x7ff3081977d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009230 tx=0x7ff2f0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.647+0000 7ff305ffb640 1 -- 172.21.15.92:0/3334635109 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f003f030 con 0x7ff308101370 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.647+0000 7ff30e366640 1 -- 172.21.15.92:0/3334635109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30819c510 con 0x7ff308101370 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.647+0000 7ff305ffb640 1 -- 172.21.15.92:0/3334635109 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f0004440 con 0x7ff308101370 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.647+0000 7ff305ffb640 1 -- 172.21.15.92:0/3334635109 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0035070 con 0x7ff308101370 2024-09-10T10:47:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.647+0000 7ff30e366640 1 -- 172.21.15.92:0/3334635109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3081a3e00 con 0x7ff308101370 2024-09-10T10:47:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.650+0000 7ff305ffb640 1 -- 172.21.15.92:0/3334635109 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff2f0042030 con 0x7ff308101370 2024-09-10T10:47:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.650+0000 7ff3111dc740 1 Processor -- start 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.650+0000 7ff3111dc740 1 -- start start 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.650+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 0x5603d054dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.650+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 0x5603d055a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d055d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff3111dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5603d04b22f0 con 0x5603d054d970 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff3111dc740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5603d045a270 con 0x5603d055aec0 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff3111dc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5603d04ae2b0 con 0x5603d054e290 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff30c903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 0x5603d054dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d055d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff305ffb640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2f40a2da0 0x7ff2f40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d055d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:45980/0 (socket says 172.21.15.92:45980) 2024-09-10T10:47:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff30c903640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 0x5603d054dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43382/0 (socket says 172.21.15.92:43382) 2024-09-10T10:47:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fffff640 1 -- 172.21.15.92:0/2553202524 learned_addr learned my addr 172.21.15.92:0/2553202524 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff307fff640 1 --2- 172.21.15.92:0/2553202524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 0x5603d055a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff30c903640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2f40a2da0 0x7ff2f40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fffff640 1 -- 172.21.15.92:0/2553202524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 msgr2=0x5603d055a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fffff640 1 --2- 172.21.15.92:0/2553202524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 0x5603d055a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fffff640 1 -- 172.21.15.92:0/2553202524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 msgr2=0x5603d054dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fffff640 1 --2- 172.21.15.92:0/2553202524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 0x5603d054dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fffff640 1 -- 172.21.15.92:0/2553202524 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d0459340 con 0x5603d055aec0 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff305ffb640 1 -- 172.21.15.92:0/3334635109 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7ff2f00ef6f0 con 0x7ff308101370 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fffff640 1 --2- 172.21.15.92:0/2553202524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d055d2b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00b86d0 tx=0x7ff2f0086640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb9c4d1d96a826d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff30c903640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2f40a2da0 0x7ff2f40a5260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff3000049d0 tx=0x7ff300004ab0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.651+0000 7ff2fe7fc640 1 -- 172.21.15.92:0/2553202524 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0049050 con 0x5603d055aec0 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff2fe7fc640 1 -- 172.21.15.92:0/2553202524 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f00f6040 con 0x5603d055aec0 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff2fe7fc640 1 -- 172.21.15.92:0/2553202524 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f00ed100 con 0x5603d055aec0 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff3111dc740 1 -- 172.21.15.92:0/2553202524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 msgr2=0x5603d055d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff3111dc740 1 --2- 172.21.15.92:0/2553202524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d055d2b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00b86d0 tx=0x7ff2f0086640 comp rx=0 tx=0).stop 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff3111dc740 1 -- 172.21.15.92:0/2553202524 shutdown_connections 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff3111dc740 1 --2- 172.21.15.92:0/2553202524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d055d2b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff3111dc740 1 --2- 172.21.15.92:0/2553202524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 0x5603d055a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff3111dc740 1 --2- 172.21.15.92:0/2553202524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 0x5603d054dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff3111dc740 1 -- 172.21.15.92:0/2553202524 >> 172.21.15.92:0/2553202524 conn(0x5603d054a060 msgr2=0x5603d054a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff3111dc740 1 -- 172.21.15.92:0/2553202524 shutdown_connections 2024-09-10T10:47:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.652+0000 7ff3111dc740 1 -- 172.21.15.92:0/2553202524 wait complete. 2024-09-10T10:47:00.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.653+0000 7ff3111dc740 1 -- start start 2024-09-10T10:47:00.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff3111dc740 1 Processor -- start 2024-09-10T10:47:00.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 0x5603d0557dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 0x5603d0558310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0558850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff3111dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5603d055d8b0 con 0x5603d054d970 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff3111dc740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5603d043b290 con 0x5603d055aec0 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff3111dc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5603d055da30 con 0x5603d054e290 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff3111dc740 10 client.0 _ll_register_callbacks cb 0x5603d046c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff30c903640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0558850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff307fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 0x5603d0557dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff30c903640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0558850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:45990/0 (socket says 172.21.15.92:45990) 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff30c903640 1 -- 172.21.15.92:0/3145061778 learned_addr learned my addr 172.21.15.92:0/3145061778 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.654+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 0x5603d0558310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff30c903640 1 -- 172.21.15.92:0/3145061778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 msgr2=0x5603d0558310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:00.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff30c903640 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 0x5603d0558310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff30c903640 1 -- 172.21.15.92:0/3145061778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 msgr2=0x5603d0557dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff30c903640 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 0x5603d0557dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff30c903640 1 -- 172.21.15.92:0/3145061778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d01c5210 con 0x5603d055aec0 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff30c903640 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0558850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff300010ba0 tx=0x7ff300004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19b0098b01c53f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff2e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3145061778 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000208f0 con 0x5603d055aec0 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff3111dc740 1 -- 172.21.15.92:0/3145061778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2f00f6040 con 0x5603d055aec0 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3145061778 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7ff300020a90 con 0x5603d055aec0 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3145061778 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ff300020c90 con 0x5603d055aec0 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff3111dc740 10 client.25610 fetch_fsmap learned FSMap version 54 2024-09-10T10:47:00.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff3111dc740 1 -- 172.21.15.92:0/3145061778 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5603d0291620 con 0x5603d055aec0 2024-09-10T10:47:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.655+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3145061778 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f00f6040 con 0x5603d055aec0 2024-09-10T10:47:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3145061778 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7ff30001f040 con 0x5603d055aec0 2024-09-10T10:47:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff3111dc740 10 client.25610 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T10:47:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff3111dc740 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff3111dc740 20 client.25610 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603d056aba0 0x5603d056d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff3111dc740 4 client.25610 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:47:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff3111dc740 1 -- 172.21.15.92:0/3145061778 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603d04bfa20 con 0x5603d056aba0 2024-09-10T10:47:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff307fff640 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603d056aba0 0x5603d056d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff2e77fe640 10 client.25610 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.656+0000 7ff307fff640 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603d056aba0 0x5603d056d020 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18764f361cbbe25a server_cookie=cf4985b00aad19fd in_seq=0 out_seq=0 2024-09-10T10:47:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.657+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3145061778 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603d04bfa20 con 0x5603d056aba0 2024-09-10T10:47:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.657+0000 7ff2e77fe640 10 client.25610 handle_command_reply: tid=0 2024-09-10T10:47:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.657+0000 7ff3111dc740 1 client.25610 shutdown 2024-09-10T10:47:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.658+0000 7ff3111dc740 1 -- 172.21.15.92:0/3145061778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 msgr2=0x5603d0558850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.658+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0558850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff300010ba0 tx=0x7ff300004a40 comp rx=0 tx=0).stop 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.658+0000 7ff3111dc740 1 -- 172.21.15.92:0/3145061778 shutdown_connections 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.658+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603d056aba0 0x5603d056d020 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.658+0000 7ff2e77fe640 0 client.25610 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.658+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0558850 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.658+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054e290 0x5603d0558310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.658+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3145061778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054d970 0x5603d0557dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.658+0000 7ff3111dc740 1 -- 172.21.15.92:0/3145061778 >> 172.21.15.92:0/3145061778 conn(0x5603d054a060 msgr2=0x5603d054fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.659+0000 7ff3111dc740 1 -- 172.21.15.92:0/3145061778 shutdown_connections 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.659+0000 7ff3111dc740 1 -- 172.21.15.92:0/3145061778 wait complete. 2024-09-10T10:47:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.659+0000 7ff3111dc740 20 client.25610 trim_cache size 0 max 16384 2024-09-10T10:47:00.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.677+0000 7ff3111dc740 1 Processor -- start 2024-09-10T10:47:00.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.677+0000 7ff3111dc740 1 -- start start 2024-09-10T10:47:00.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.678+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054d970 0x5603d05566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.678+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0562fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.678+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0563510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.678+0000 7ff3111dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081ab490 con 0x5603d054e290 2024-09-10T10:47:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.678+0000 7ff3111dc740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081ad090 con 0x5603d055aec0 2024-09-10T10:47:00.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.678+0000 7ff3111dc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081abb60 con 0x5603d054d970 2024-09-10T10:47:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.684+0000 7ff30c903640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0563510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.684+0000 7ff30c903640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0563510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:46002/0 (socket says 172.21.15.92:46002) 2024-09-10T10:47:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.684+0000 7ff30c903640 1 -- 172.21.15.92:0/3816756031 learned_addr learned my addr 172.21.15.92:0/3816756031 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:00.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.684+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3816756031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0562fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.686+0000 7ff2fffff640 1 -- 172.21.15.92:0/3816756031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054d970 msgr2=0x5603d05566a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:47:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.686+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3816756031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054d970 0x5603d05566a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.686+0000 7ff2fffff640 1 -- 172.21.15.92:0/3816756031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 msgr2=0x5603d0563510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.686+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3816756031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0563510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.686+0000 7ff2fffff640 1 -- 172.21.15.92:0/3816756031 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d0549e90 con 0x5603d054e290 2024-09-10T10:47:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.687+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3816756031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0562fd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00f0000 tx=0x7ff2f0003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65742b15c5ce409 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.687+0000 7ff2fdffb640 1 -- 172.21.15.92:0/3816756031 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f00d1050 con 0x5603d054e290 2024-09-10T10:47:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.687+0000 7ff2fdffb640 1 -- 172.21.15.92:0/3816756031 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f00bbd00 con 0x5603d054e290 2024-09-10T10:47:00.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.687+0000 7ff2fdffb640 1 -- 172.21.15.92:0/3816756031 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0049040 con 0x5603d054e290 2024-09-10T10:47:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.692+0000 7ff3111dc740 1 -- 172.21.15.92:0/3816756031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 msgr2=0x5603d0562fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:00.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.692+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3816756031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0562fd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00f0000 tx=0x7ff2f0003f50 comp rx=0 tx=0).stop 2024-09-10T10:47:00.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.696+0000 7ff3111dc740 1 -- 172.21.15.92:0/3816756031 shutdown_connections 2024-09-10T10:47:00.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.696+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3816756031 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d055aec0 0x5603d0563510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.696+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3816756031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0562fd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.696+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3816756031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d054d970 0x5603d05566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.696+0000 7ff3111dc740 1 -- 172.21.15.92:0/3816756031 >> 172.21.15.92:0/3816756031 conn(0x5603d054a060 msgr2=0x5603d05491c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:00.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.702+0000 7ff3111dc740 1 -- 172.21.15.92:0/3816756031 shutdown_connections 2024-09-10T10:47:00.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.704+0000 7ff3111dc740 1 -- 172.21.15.92:0/3816756031 wait complete. 2024-09-10T10:47:00.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.705+0000 7ff3111dc740 1 -- start start 2024-09-10T10:47:00.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.705+0000 7ff3111dc740 1 Processor -- start 2024-09-10T10:47:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.709+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d054d970 0x5603d0554d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.709+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0555270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.709+0000 7ff3111dc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d055aec0 0x5603d05557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.709+0000 7ff3111dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081ac9c0 con 0x5603d054e290 2024-09-10T10:47:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.709+0000 7ff3111dc740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081ac230 con 0x5603d054d970 2024-09-10T10:47:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.709+0000 7ff3111dc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081a9490 con 0x5603d055aec0 2024-09-10T10:47:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.709+0000 7ff3111dc740 10 client.0 _ll_register_callbacks cb 0x7ff3000107f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:00.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.710+0000 7ff30c903640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d055aec0 0x5603d05557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.710+0000 7ff30c903640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d055aec0 0x5603d05557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:45074/0 (socket says 172.21.15.92:45074) 2024-09-10T10:47:00.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.710+0000 7ff30c903640 1 -- 172.21.15.92:0/3122239526 learned_addr learned my addr 172.21.15.92:0/3122239526 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.711+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0555270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.712+0000 7ff2fffff640 1 -- 172.21.15.92:0/3122239526 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d055aec0 msgr2=0x5603d05557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.712+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d055aec0 0x5603d05557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.712+0000 7ff2fffff640 1 -- 172.21.15.92:0/3122239526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d054d970 msgr2=0x5603d0554d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:47:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.712+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d054d970 0x5603d0554d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.712+0000 7ff2fffff640 1 -- 172.21.15.92:0/3122239526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d0561090 con 0x5603d054e290 2024-09-10T10:47:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.712+0000 7ff2fffff640 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0555270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff2f003b5a0 tx=0x7ff2f0003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55288721daded3c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:00.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.712+0000 7ff2e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:47:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.713+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3122239526 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f00d1050 con 0x5603d054e290 2024-09-10T10:47:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.713+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3122239526 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8455+0+0 (secure 0 0 0) 0x7ff2f00b8370 con 0x5603d054e290 2024-09-10T10:47:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.713+0000 7ff3111dc740 1 -- 172.21.15.92:0/3122239526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2f00bbd00 con 0x5603d054e290 2024-09-10T10:47:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.715+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3122239526 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ff2f0049070 con 0x5603d054e290 2024-09-10T10:47:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.718+0000 7ff3111dc740 10 client.16116 fetch_fsmap learned FSMap version 54 2024-09-10T10:47:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.718+0000 7ff3111dc740 1 -- 172.21.15.92:0/3122239526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5603d05ed380 con 0x5603d054e290 2024-09-10T10:47:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.719+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3122239526 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f00bbd00 con 0x5603d054e290 2024-09-10T10:47:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.719+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3122239526 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7ff2f00d4070 con 0x5603d054e290 2024-09-10T10:47:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.719+0000 7ff3111dc740 10 client.16116 fetch_fsmap finished waiting for FSMap version 54 2024-09-10T10:47:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.719+0000 7ff3111dc740 10 client.16116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.719+0000 7ff3111dc740 20 client.16116 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.719+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603d056aba0 0x5603d05ef870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.719+0000 7ff3111dc740 4 client.16116 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:47:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.719+0000 7ff3111dc740 1 -- 172.21.15.92:0/3122239526 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5603d04b9d70 con 0x5603d056aba0 2024-09-10T10:47:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.721+0000 7ff307fff640 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603d056aba0 0x5603d05ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.723+0000 7ff307fff640 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603d056aba0 0x5603d05ef870 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7fa2c977325d852 server_cookie=abfedb40a1e01fc2 in_seq=0 out_seq=0 2024-09-10T10:47:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.724+0000 7ff2e77fe640 10 client.16116 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.757+0000 7ff2e77fe640 1 -- 172.21.15.92:0/3122239526 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5603d04b9d70 con 0x5603d056aba0 2024-09-10T10:47:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.757+0000 7ff2e77fe640 10 client.16116 handle_command_reply: tid=0 2024-09-10T10:47:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.757+0000 7ff3111dc740 1 client.16116 shutdown 2024-09-10T10:47:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 -- 172.21.15.92:0/3122239526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 msgr2=0x5603d0555270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0555270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff2f003b5a0 tx=0x7ff2f0003df0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 -- 172.21.15.92:0/3122239526 shutdown_connections 2024-09-10T10:47:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5603d055aec0 0x5603d05557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5603d054e290 0x5603d0555270 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5603d056aba0 0x5603d05ef870 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 --2- 172.21.15.92:0/3122239526 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5603d054d970 0x5603d0554d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 -- 172.21.15.92:0/3122239526 >> 172.21.15.92:0/3122239526 conn(0x5603d054a060 msgr2=0x5603d05489a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff2e77fe640 0 client.16116 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 -- 172.21.15.92:0/3122239526 shutdown_connections 2024-09-10T10:47:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 1 -- 172.21.15.92:0/3122239526 wait complete. 2024-09-10T10:47:00.762 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.758+0000 7ff3111dc740 20 client.16116 trim_cache size 0 max 16384 2024-09-10T10:47:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:47:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:47:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:47:00.763 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 -- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2f40a2da0 msgr2=0x7ff2f40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2f40a2da0 0x7ff2f40a5260 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff3000049d0 tx=0x7ff300004ab0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 -- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff308101370 msgr2=0x7ff3081977d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff308101370 0x7ff3081977d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009230 tx=0x7ff2f0004040 comp rx=0 tx=0).stop 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 -- 172.21.15.92:0/3334635109 shutdown_connections 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2f40a2da0 0x7ff2f40a5260 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff3081069e0 0x7ff30819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff308101370 0x7ff3081977d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 --2- 172.21.15.92:0/3334635109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081009d0 0x7ff308197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 -- 172.21.15.92:0/3334635109 >> 172.21.15.92:0/3334635109 conn(0x7ff3080fc6f0 msgr2=0x7ff3080fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 -- 172.21.15.92:0/3334635109 shutdown_connections 2024-09-10T10:47:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:00.759+0000 7ff30e366640 1 -- 172.21.15.92:0/3334635109 wait complete. 2024-09-10T10:47:00.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:00 smithi121 ceph-mon[35231]: pgmap v322: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 12 MiB/s wr, 617 op/s 2024-09-10T10:47:02.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:02 smithi097 ceph-mon[35213]: pgmap v323: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 19 MiB/s wr, 889 op/s 2024-09-10T10:47:02.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:02 smithi092 ceph-mon[30834]: pgmap v323: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 19 MiB/s wr, 889 op/s 2024-09-10T10:47:02.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:02 smithi121 ceph-mon[35231]: pgmap v323: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 19 MiB/s wr, 889 op/s 2024-09-10T10:47:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 605.0 s, 1169.4 tps, lat 86.196 ms stddev 173.921 2024-09-10T10:47:04.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:04 smithi097 ceph-mon[35213]: pgmap v324: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 587 op/s 2024-09-10T10:47:04.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:04 smithi092 ceph-mon[30834]: pgmap v324: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 587 op/s 2024-09-10T10:47:04.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:04 smithi121 ceph-mon[35231]: pgmap v324: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 587 op/s 2024-09-10T10:47:06.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:06 smithi121 ceph-mon[35231]: pgmap v325: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 587 op/s 2024-09-10T10:47:06.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:06 smithi097 ceph-mon[35213]: pgmap v325: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 587 op/s 2024-09-10T10:47:06.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:06 smithi092 ceph-mon[30834]: pgmap v325: 97 pgs: 97 active+clean; 4.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 587 op/s 2024-09-10T10:47:07.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:07 smithi121 ceph-mon[35231]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T10:47:07.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:07 smithi097 ceph-mon[35213]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T10:47:07.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:07 smithi092 ceph-mon[30834]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T10:47:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 610.0 s, 1595.0 tps, lat 61.893 ms stddev 90.569 2024-09-10T10:47:08.792 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:08 smithi121 ceph-mon[35231]: pgmap v327: 97 pgs: 97 active+clean; 5.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 MiB/s wr, 1.68k op/s 2024-09-10T10:47:08.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:08 smithi097 ceph-mon[35213]: pgmap v327: 97 pgs: 97 active+clean; 5.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 MiB/s wr, 1.68k op/s 2024-09-10T10:47:08.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:08 smithi092 ceph-mon[30834]: pgmap v327: 97 pgs: 97 active+clean; 5.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 MiB/s wr, 1.68k op/s 2024-09-10T10:47:10.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:10 smithi121 ceph-mon[35231]: pgmap v328: 97 pgs: 97 active+clean; 5.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 MiB/s wr, 1.68k op/s 2024-09-10T10:47:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:10 smithi097 ceph-mon[35213]: pgmap v328: 97 pgs: 97 active+clean; 5.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 MiB/s wr, 1.68k op/s 2024-09-10T10:47:10.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:10 smithi092 ceph-mon[30834]: pgmap v328: 97 pgs: 97 active+clean; 5.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 47 MiB/s wr, 1.68k op/s 2024-09-10T10:47:12.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:12 smithi121 ceph-mon[35231]: pgmap v329: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 47 MiB/s wr, 1.85k op/s 2024-09-10T10:47:12.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:12 smithi097 ceph-mon[35213]: pgmap v329: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 47 MiB/s wr, 1.85k op/s 2024-09-10T10:47:12.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:12 smithi092 ceph-mon[30834]: pgmap v329: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 47 MiB/s wr, 1.85k op/s 2024-09-10T10:47:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 615.0 s, 1885.2 tps, lat 53.335 ms stddev 63.439 2024-09-10T10:47:13.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:13 smithi121 ceph-mon[35231]: pgmap v330: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 47 MiB/s wr, 1.85k op/s 2024-09-10T10:47:13.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:13 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:47:13.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:13 smithi097 ceph-mon[35213]: pgmap v330: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 47 MiB/s wr, 1.85k op/s 2024-09-10T10:47:13.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:13 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:47:13.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:13 smithi092 ceph-mon[30834]: pgmap v330: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 47 MiB/s wr, 1.85k op/s 2024-09-10T10:47:13.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:13 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:47:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.883+0000 7f67b16c0640 1 -- 172.21.15.92:0/1268683616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 msgr2=0x7f67ac106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.883+0000 7f67b16c0640 1 --2- 172.21.15.92:0/1268683616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 0x7f67ac106dc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f679c009930 tx=0x7f679c02a420 comp rx=0 tx=0).stop 2024-09-10T10:47:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.883+0000 7f67b16c0640 1 -- 172.21.15.92:0/1268683616 shutdown_connections 2024-09-10T10:47:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.883+0000 7f67b16c0640 1 --2- 172.21.15.92:0/1268683616 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67ac101370 0x7f67ac10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.883+0000 7f67b16c0640 1 --2- 172.21.15.92:0/1268683616 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67ac1009d0 0x7f67ac100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.883+0000 7f67b16c0640 1 --2- 172.21.15.92:0/1268683616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 0x7f67ac106dc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.883+0000 7f67b16c0640 1 -- 172.21.15.92:0/1268683616 >> 172.21.15.92:0/1268683616 conn(0x7f67ac0fc6b0 msgr2=0x7f67ac0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.883+0000 7f67b16c0640 1 -- 172.21.15.92:0/1268683616 shutdown_connections 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.883+0000 7f67b16c0640 1 -- 172.21.15.92:0/1268683616 wait complete. 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67b16c0640 1 Processor -- start 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67b16c0640 1 -- start start 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67b16c0640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67ac1009d0 0x7f67ac1025a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67b16c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67ac101370 0x7f67ac102ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67b16c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 0x7f67ac103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67b16c0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac110e20 con 0x7f67ac1069e0 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67b16c0640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac110ca0 con 0x7f67ac1009d0 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67b16c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac110fa0 con 0x7f67ac101370 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 0x7f67ac103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 0x7f67ac103020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59810/0 (socket says 172.21.15.92:59810) 2024-09-10T10:47:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67ab7fe640 1 -- 172.21.15.92:0/3453949614 learned_addr learned my addr 172.21.15.92:0/3453949614 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67ac1009d0 0x7f67ac1025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67ac101370 0x7f67ac102ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67ab7fe640 1 -- 172.21.15.92:0/3453949614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67ac101370 msgr2=0x7f67ac102ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67ac101370 0x7f67ac102ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67ab7fe640 1 -- 172.21.15.92:0/3453949614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67ac1009d0 msgr2=0x7f67ac1025a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67ac1009d0 0x7f67ac1025a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.884+0000 7f67ab7fe640 1 -- 172.21.15.92:0/3453949614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac1a6800 con 0x7f67ac1069e0 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.885+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67ac101370 0x7f67ac102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.885+0000 7f67aaffd640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67ac1009d0 0x7f67ac1025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.885+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 0x7f67ac103020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f67a400eb10 tx=0x7f67a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.885+0000 7f6793fff640 1 -- 172.21.15.92:0/3453949614 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4004b20 con 0x7f67ac1069e0 2024-09-10T10:47:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.885+0000 7f6793fff640 1 -- 172.21.15.92:0/3453949614 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67a4004cc0 con 0x7f67ac1069e0 2024-09-10T10:47:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.885+0000 7f67b16c0640 1 -- 172.21.15.92:0/3453949614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ac1a6af0 con 0x7f67ac1069e0 2024-09-10T10:47:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.885+0000 7f6793fff640 1 -- 172.21.15.92:0/3453949614 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4010760 con 0x7f67ac1069e0 2024-09-10T10:47:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.885+0000 7f67b16c0640 1 -- 172.21.15.92:0/3453949614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ac1a7040 con 0x7f67ac1069e0 2024-09-10T10:47:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.888+0000 7f6793fff640 1 -- 172.21.15.92:0/3453949614 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f67a4005020 con 0x7f67ac1069e0 2024-09-10T10:47:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.888+0000 7f67b4454740 1 Processor -- start 2024-09-10T10:47:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.888+0000 7f67b4454740 1 -- start start 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f6793fff640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f67940a2da0 0x7f67940a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67b4454740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c79af0 0x564263c79ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67b4454740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c7a410 0x564263c84770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67b4454740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67b4454740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564263bde2f0 con 0x564263c7a410 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67b4454740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564263b86270 con 0x564263c79af0 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67b4454740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564263bda2b0 con 0x564263c84cb0 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f6793fff640 1 -- 172.21.15.92:0/3453949614 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8499+0+0 (secure 0 0 0) 0x7f67a40cfb20 con 0x7f67ac1069e0 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f67940a2da0 0x7f67940a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c79af0 0x564263c79ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c79af0 0x564263c79ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:43156/0 (socket says 172.21.15.92:43156) 2024-09-10T10:47:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67aaffd640 1 -- 172.21.15.92:0/3285181608 learned_addr learned my addr 172.21.15.92:0/3285181608 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/3285181608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67aaffd640 1 -- 172.21.15.92:0/3285181608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 msgr2=0x564263c870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67aaffd640 1 --2- 172.21.15.92:0/3285181608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67aaffd640 1 -- 172.21.15.92:0/3285181608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c7a410 msgr2=0x564263c84770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67aaffd640 1 --2- 172.21.15.92:0/3285181608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c7a410 0x564263c84770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67aaffd640 1 -- 172.21.15.92:0/3285181608 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564263b85340 con 0x564263c79af0 2024-09-10T10:47:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.889+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/3285181608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:47:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.890+0000 7f67aaffd640 1 --2- 172.21.15.92:0/3285181608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c79af0 0x564263c79ed0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f679c000c00 tx=0x7f679c005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=719c270b3f1fe89b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.890+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f67940a2da0 0x7f67940a5260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67ac104030 tx=0x7f67a00117b0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.890+0000 7f67917fa640 1 -- 172.21.15.92:0/3285181608 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c035040 con 0x564263c79af0 2024-09-10T10:47:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.890+0000 7f67917fa640 1 -- 172.21.15.92:0/3285181608 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f679c031830 con 0x564263c79af0 2024-09-10T10:47:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.890+0000 7f67917fa640 1 -- 172.21.15.92:0/3285181608 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c003d40 con 0x564263c79af0 2024-09-10T10:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.891+0000 7f67b4454740 1 -- 172.21.15.92:0/3285181608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c79af0 msgr2=0x564263c79ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.892+0000 7f67b4454740 1 --2- 172.21.15.92:0/3285181608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c79af0 0x564263c79ed0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f679c000c00 tx=0x7f679c005d50 comp rx=0 tx=0).stop 2024-09-10T10:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.892+0000 7f67b4454740 1 -- 172.21.15.92:0/3285181608 shutdown_connections 2024-09-10T10:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.892+0000 7f67b4454740 1 --2- 172.21.15.92:0/3285181608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.892+0000 7f67b4454740 1 --2- 172.21.15.92:0/3285181608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c7a410 0x564263c84770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.892+0000 7f67b4454740 1 --2- 172.21.15.92:0/3285181608 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c79af0 0x564263c79ed0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.892+0000 7f67b4454740 1 -- 172.21.15.92:0/3285181608 >> 172.21.15.92:0/3285181608 conn(0x564263c76060 msgr2=0x564263c76440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.892+0000 7f67b4454740 1 -- 172.21.15.92:0/3285181608 shutdown_connections 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.892+0000 7f67b4454740 1 -- 172.21.15.92:0/3285181608 wait complete. 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.893+0000 7f67b4454740 1 -- start start 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.893+0000 7f67b4454740 1 Processor -- start 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.893+0000 7f67b4454740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c79af0 0x564263c81aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67b4454740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c81fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67b4454740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c84cb0 0x564263c82520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67b4454740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564263c87880 con 0x564263c84cb0 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c84cb0 0x564263c82520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67aa7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c81fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67ab7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c84cb0 0x564263c82520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59838/0 (socket says 172.21.15.92:59838) 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67ab7fe640 1 -- 172.21.15.92:0/2823454563 learned_addr learned my addr 172.21.15.92:0/2823454563 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67b4454740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x564263b67290 con 0x564263c7a410 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67aaffd640 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c79af0 0x564263c81aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67b4454740 1 -- 172.21.15.92:0/2823454563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564263c87a00 con 0x564263c79af0 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67b4454740 10 client.0 _ll_register_callbacks cb 0x564263b98140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67aa7fc640 1 -- 172.21.15.92:0/2823454563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c79af0 msgr2=0x564263c81aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c79af0 0x564263c81aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67aa7fc640 1 -- 172.21.15.92:0/2823454563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c84cb0 msgr2=0x564263c82520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c84cb0 0x564263c82520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67aa7fc640 1 -- 172.21.15.92:0/2823454563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642638f1210 con 0x564263c7a410 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c84cb0 0x564263c82520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:47:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.894+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c81fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f67a0011cb0 tx=0x7f67a0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c764575dfbc2704 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.895+0000 7f678eff5640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.895+0000 7f678eff5640 1 -- 172.21.15.92:0/2823454563 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0026060 con 0x564263c7a410 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.895+0000 7f678eff5640 1 -- 172.21.15.92:0/2823454563 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8499+0+0 (secure 0 0 0) 0x7f67a0004440 con 0x564263c7a410 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.895+0000 7f67b4454740 1 -- 172.21.15.92:0/2823454563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f679c031830 con 0x564263c7a410 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.895+0000 7f678eff5640 1 -- 172.21.15.92:0/2823454563 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f67a000f950 con 0x564263c7a410 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.895+0000 7f67b4454740 10 client.25625 fetch_fsmap learned FSMap version 55 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.895+0000 7f67b4454740 1 -- 172.21.15.92:0/2823454563 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5642639bd620 con 0x564263c7a410 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.895+0000 7f678eff5640 1 -- 172.21.15.92:0/2823454563 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f679c031830 con 0x564263c7a410 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f678eff5640 1 -- 172.21.15.92:0/2823454563 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 55) ==== 8382+0+0 (secure 0 0 0) 0x7f67a0021450 con 0x564263c7a410 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f67b4454740 10 client.25625 fetch_fsmap finished waiting for FSMap version 55 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f67b4454740 10 client.25625 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:13.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f67b4454740 20 client.25625 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f67b4454740 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x564263c94bf0 0x564263c97050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f67b4454740 4 client.25625 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f67b4454740 1 -- 172.21.15.92:0/2823454563 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564263beba20 con 0x564263c94bf0 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f67aaffd640 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x564263c94bf0 0x564263c97050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f67aaffd640 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x564263c94bf0 0x564263c97050 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66f4725b592f5127 server_cookie=76475620b1b38a1c in_seq=0 out_seq=0 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.896+0000 7f678eff5640 10 client.25625 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f678eff5640 1 -- 172.21.15.92:0/2823454563 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564263beba20 con 0x564263c94bf0 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f678eff5640 10 client.25625 handle_command_reply: tid=0 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 client.25625 shutdown 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 -- 172.21.15.92:0/2823454563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 msgr2=0x564263c81fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c81fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f67a0011cb0 tx=0x7f67a0004730 comp rx=0 tx=0).stop 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 -- 172.21.15.92:0/2823454563 shutdown_connections 2024-09-10T10:47:13.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c84cb0 0x564263c82520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x564263c94bf0 0x564263c97050 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f678eff5640 0 client.25625 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c81fe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 --2- 172.21.15.92:0/2823454563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c79af0 0x564263c81aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 -- 172.21.15.92:0/2823454563 >> 172.21.15.92:0/2823454563 conn(0x564263c76060 msgr2=0x564263c7bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 -- 172.21.15.92:0/2823454563 shutdown_connections 2024-09-10T10:47:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 1 -- 172.21.15.92:0/2823454563 wait complete. 2024-09-10T10:47:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.897+0000 7f67b4454740 20 client.25625 trim_cache size 0 max 16384 2024-09-10T10:47:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.916+0000 7f67b4454740 1 Processor -- start 2024-09-10T10:47:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.916+0000 7f67b4454740 1 -- start start 2024-09-10T10:47:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.916+0000 7f67b4454740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c83dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.916+0000 7f67b4454740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c82350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.916+0000 7f67b4454740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c9c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.916+0000 7f67b4454740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1af940 con 0x564263c79af0 2024-09-10T10:47:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.916+0000 7f67b4454740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1b1540 con 0x564263c7a410 2024-09-10T10:47:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.916+0000 7f67b4454740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1b0010 con 0x564263c84cb0 2024-09-10T10:47:13.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.916+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c83dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c83dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59844/0 (socket says 172.21.15.92:59844) 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aa7fc640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c82350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aaffd640 1 -- 172.21.15.92:0/2577360979 learned_addr learned my addr 172.21.15.92:0/2577360979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c9c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aaffd640 1 -- 172.21.15.92:0/2577360979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 msgr2=0x564263c9c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aaffd640 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c9c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aaffd640 1 -- 172.21.15.92:0/2577360979 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 msgr2=0x564263c82350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aaffd640 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c82350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aaffd640 1 -- 172.21.15.92:0/2577360979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564263c7a240 con 0x564263c79af0 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c9c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:47:13.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c82350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f67aaffd640 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c83dd0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f679c033000 tx=0x7f679c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb16b872b4f7fdef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f6790ff9640 1 -- 172.21.15.92:0/2577360979 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c035040 con 0x564263c79af0 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f6790ff9640 1 -- 172.21.15.92:0/2577360979 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f679c005040 con 0x564263c79af0 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.917+0000 7f6790ff9640 1 -- 172.21.15.92:0/2577360979 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c004c00 con 0x564263c79af0 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 -- 172.21.15.92:0/2577360979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 msgr2=0x564263c83dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c83dd0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f679c033000 tx=0x7f679c02a420 comp rx=0 tx=0).stop 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 -- 172.21.15.92:0/2577360979 shutdown_connections 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c9c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c82350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 --2- 172.21.15.92:0/2577360979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c83dd0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 -- 172.21.15.92:0/2577360979 >> 172.21.15.92:0/2577360979 conn(0x564263c76060 msgr2=0x564263c80a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 -- 172.21.15.92:0/2577360979 shutdown_connections 2024-09-10T10:47:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 -- 172.21.15.92:0/2577360979 wait complete. 2024-09-10T10:47:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 -- start start 2024-09-10T10:47:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.918+0000 7f67b4454740 1 Processor -- start 2024-09-10T10:47:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67b4454740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c7e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67b4454740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c7e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67b4454740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c8bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67b4454740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1b0e70 con 0x564263c79af0 2024-09-10T10:47:13.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67b4454740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1b06e0 con 0x564263c7a410 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67b4454740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1ad940 con 0x564263c84cb0 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67b4454740 10 client.0 _ll_register_callbacks cb 0x7f67a0009c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c7e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aaffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c7e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59854/0 (socket says 172.21.15.92:59854) 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aaffd640 1 -- 172.21.15.92:0/3615042420 learned_addr learned my addr 172.21.15.92:0/3615042420 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c7e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c8bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aaffd640 1 -- 172.21.15.92:0/3615042420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 msgr2=0x564263c8bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aaffd640 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c8bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aaffd640 1 -- 172.21.15.92:0/3615042420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 msgr2=0x564263c7e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aaffd640 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c7e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:13.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aaffd640 1 -- 172.21.15.92:0/3615042420 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564263c8c1d0 con 0x564263c79af0 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67ab7fe640 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c8bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67aaffd640 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c7e480 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f679c005ec0 tx=0x7f679c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa425b6f2c151f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f678eff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f678eff5640 1 -- 172.21.15.92:0/3615042420 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c035070 con 0x564263c79af0 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f678eff5640 1 -- 172.21.15.92:0/3615042420 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8499+0+0 (secure 0 0 0) 0x7f679c031d10 con 0x564263c79af0 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f67b4454740 1 -- 172.21.15.92:0/3615042420 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f679c005040 con 0x564263c79af0 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.919+0000 7f678eff5640 1 -- 172.21.15.92:0/3615042420 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f679c0317f0 con 0x564263c79af0 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f67b4454740 10 client.16131 fetch_fsmap learned FSMap version 55 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f67b4454740 1 -- 172.21.15.92:0/3615042420 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x564263c8d420 con 0x564263c79af0 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f678eff5640 1 -- 172.21.15.92:0/3615042420 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f679c005040 con 0x564263c79af0 2024-09-10T10:47:13.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f678eff5640 1 -- 172.21.15.92:0/3615042420 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 55) ==== 8382+0+0 (secure 0 0 0) 0x7f679c050070 con 0x564263c79af0 2024-09-10T10:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f67b4454740 10 client.16131 fetch_fsmap finished waiting for FSMap version 55 2024-09-10T10:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f67b4454740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f67b4454740 20 client.16131 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f67b4454740 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x564263c94bf0 0x564263d01940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f67b4454740 4 client.16131 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f67b4454740 1 -- 172.21.15.92:0/3615042420 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564263be5d70 con 0x564263c94bf0 2024-09-10T10:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.920+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x564263c94bf0 0x564263d01940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.921+0000 7f678eff5640 10 client.16131 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:13.921+0000 7f67aa7fc640 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x564263c94bf0 0x564263d01940 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21ddf6c2df6f81c2 server_cookie=2d1798671bcf7453 in_seq=0 out_seq=0 2024-09-10T10:47:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f678eff5640 1 -- 172.21.15.92:0/3615042420 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564263be5d70 con 0x564263c94bf0 2024-09-10T10:47:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f678eff5640 10 client.16131 handle_command_reply: tid=0 2024-09-10T10:47:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 client.16131 shutdown 2024-09-10T10:47:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 -- 172.21.15.92:0/3615042420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 msgr2=0x564263c7e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c7e480 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f679c005ec0 tx=0x7f679c031400 comp rx=0 tx=0).stop 2024-09-10T10:47:14.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 -- 172.21.15.92:0/3615042420 shutdown_connections 2024-09-10T10:47:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564263c84cb0 0x564263c8bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x564263c94bf0 0x564263d01940 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f678eff5640 0 client.16131 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x564263c7a410 0x564263c7e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 --2- 172.21.15.92:0/3615042420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564263c79af0 0x564263c7e480 secure :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f679c005ec0 tx=0x7f679c031400 comp rx=0 tx=0).stop 2024-09-10T10:47:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 -- 172.21.15.92:0/3615042420 >> 172.21.15.92:0/3615042420 conn(0x564263c76060 msgr2=0x564263c749a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 -- 172.21.15.92:0/3615042420 shutdown_connections 2024-09-10T10:47:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 1 -- 172.21.15.92:0/3615042420 wait complete. 2024-09-10T10:47:14.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.021+0000 7f67b4454740 20 client.16131 trim_cache size 0 max 16384 2024-09-10T10:47:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:47:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:47:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:47:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:47:14.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 -- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f67940a2da0 msgr2=0x7f67940a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f67940a2da0 0x7f67940a5260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67ac104030 tx=0x7f67a00117b0 comp rx=0 tx=0).stop 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 -- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 msgr2=0x7f67ac103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 0x7f67ac103020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f67a400eb10 tx=0x7f67a400c2d0 comp rx=0 tx=0).stop 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 -- 172.21.15.92:0/3453949614 shutdown_connections 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67ac1069e0 0x7f67ac103020 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67ac101370 0x7f67ac102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f67940a2da0 0x7f67940a5260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 --2- 172.21.15.92:0/3453949614 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f67ac1009d0 0x7f67ac1025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.022+0000 7f67b16c0640 1 -- 172.21.15.92:0/3453949614 >> 172.21.15.92:0/3453949614 conn(0x7f67ac0fc6b0 msgr2=0x7f67ac06a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.023+0000 7f67b16c0640 1 -- 172.21.15.92:0/3453949614 shutdown_connections 2024-09-10T10:47:14.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:14.023+0000 7f67b16c0640 1 -- 172.21.15.92:0/3453949614 wait complete. 2024-09-10T10:47:15.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:15 smithi121 ceph-mon[35231]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T10:47:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:15 smithi097 ceph-mon[35213]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T10:47:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:15 smithi092 ceph-mon[30834]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T10:47:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:16 smithi121 ceph-mon[35231]: pgmap v332: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 603 op/s 2024-09-10T10:47:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:16 smithi097 ceph-mon[35213]: pgmap v332: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 603 op/s 2024-09-10T10:47:16.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:16 smithi092 ceph-mon[30834]: pgmap v332: 97 pgs: 97 active+clean; 4.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 603 op/s 2024-09-10T10:47:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 620.0 s, 1754.4 tps, lat 57.398 ms stddev 60.541 2024-09-10T10:47:18.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:18 smithi121 ceph-mon[35231]: pgmap v333: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 860 op/s 2024-09-10T10:47:18.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:18 smithi097 ceph-mon[35213]: pgmap v333: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 860 op/s 2024-09-10T10:47:18.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:18 smithi092 ceph-mon[30834]: pgmap v333: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 860 op/s 2024-09-10T10:47:19.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:19 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:47:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:19 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:47:19.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:19 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:47:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:20 smithi121 ceph-mon[35231]: pgmap v334: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 860 op/s 2024-09-10T10:47:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:20 smithi097 ceph-mon[35213]: pgmap v334: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 860 op/s 2024-09-10T10:47:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:20 smithi092 ceph-mon[30834]: pgmap v334: 97 pgs: 97 active+clean; 4.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 860 op/s 2024-09-10T10:47:22.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:22 smithi121 ceph-mon[35231]: pgmap v335: 97 pgs: 97 active+clean; 4.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 25 MiB/s wr, 1.71k op/s 2024-09-10T10:47:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:22 smithi097 ceph-mon[35213]: pgmap v335: 97 pgs: 97 active+clean; 4.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 25 MiB/s wr, 1.71k op/s 2024-09-10T10:47:22.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:22 smithi092 ceph-mon[30834]: pgmap v335: 97 pgs: 97 active+clean; 4.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 25 MiB/s wr, 1.71k op/s 2024-09-10T10:47:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 625.0 s, 2070.4 tps, lat 48.145 ms stddev 90.085 2024-09-10T10:47:23.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:23 smithi121 ceph-mon[35231]: pgmap v336: 97 pgs: 97 active+clean; 4.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 25 MiB/s wr, 1.71k op/s 2024-09-10T10:47:23.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:23 smithi097 ceph-mon[35213]: pgmap v336: 97 pgs: 97 active+clean; 4.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 25 MiB/s wr, 1.71k op/s 2024-09-10T10:47:23.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:23 smithi092 ceph-mon[30834]: pgmap v336: 97 pgs: 97 active+clean; 4.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 25 MiB/s wr, 1.71k op/s 2024-09-10T10:47:26.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:25 smithi121 ceph-mon[35231]: pgmap v337: 97 pgs: 97 active+clean; 4.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 MiB/s wr, 1.68k op/s 2024-09-10T10:47:26.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:25 smithi097 ceph-mon[35213]: pgmap v337: 97 pgs: 97 active+clean; 4.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 MiB/s wr, 1.68k op/s 2024-09-10T10:47:26.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:25 smithi092 ceph-mon[30834]: pgmap v337: 97 pgs: 97 active+clean; 4.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 MiB/s wr, 1.68k op/s 2024-09-10T10:47:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.176+0000 7f6945396640 1 -- 172.21.15.92:0/546576113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69401091f0 msgr2=0x7f6940110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.176+0000 7f6945396640 1 --2- 172.21.15.92:0/546576113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69401091f0 0x7f6940110250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6930009930 tx=0x7f693002a480 comp rx=0 tx=0).stop 2024-09-10T10:47:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.181+0000 7f6945396640 1 -- 172.21.15.92:0/546576113 shutdown_connections 2024-09-10T10:47:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.181+0000 7f6945396640 1 --2- 172.21.15.92:0/546576113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f694011b140 0x7f694011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.181+0000 7f6945396640 1 --2- 172.21.15.92:0/546576113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69401095d0 0x7f6940109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.181+0000 7f6945396640 1 --2- 172.21.15.92:0/546576113 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69401091f0 0x7f6940110250 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.181+0000 7f6945396640 1 -- 172.21.15.92:0/546576113 >> 172.21.15.92:0/546576113 conn(0x7f694006ce00 msgr2=0x7f694006d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.190+0000 7f6945396640 1 -- 172.21.15.92:0/546576113 shutdown_connections 2024-09-10T10:47:27.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.190+0000 7f6945396640 1 -- 172.21.15.92:0/546576113 wait complete. 2024-09-10T10:47:27.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.191+0000 7f6945396640 1 Processor -- start 2024-09-10T10:47:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.192+0000 7f6945396640 1 -- start start 2024-09-10T10:47:27.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f6945396640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69401091f0 0x7f69401a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f6945396640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69401095d0 0x7f69401a7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f6945396640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f694011b140 0x7f69401abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f6945396640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6940120dd0 con 0x7f69401091f0 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f6945396640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6940120c50 con 0x7f69401095d0 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f6945396640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6940120f50 con 0x7f694011b140 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f693effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69401091f0 0x7f69401a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f693effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69401091f0 0x7f69401a72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55488/0 (socket says 172.21.15.92:55488) 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f693effd640 1 -- 172.21.15.92:0/3031002816 learned_addr learned my addr 172.21.15.92:0/3031002816 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.193+0000 7f693f7fe640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f694011b140 0x7f69401abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.194+0000 7f693e7fc640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69401095d0 0x7f69401a7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.194+0000 7f693effd640 1 -- 172.21.15.92:0/3031002816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f694011b140 msgr2=0x7f69401abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:27.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.194+0000 7f693effd640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f694011b140 0x7f69401abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.194+0000 7f693effd640 1 -- 172.21.15.92:0/3031002816 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69401095d0 msgr2=0x7f69401a7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.194+0000 7f693effd640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69401095d0 0x7f69401a7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.194+0000 7f693effd640 1 -- 172.21.15.92:0/3031002816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69401ac280 con 0x7f69401091f0 2024-09-10T10:47:27.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.194+0000 7f693effd640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69401091f0 0x7f69401a72c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f693002aa70 tx=0x7f6930032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.195+0000 7f6927fff640 1 -- 172.21.15.92:0/3031002816 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693003f030 con 0x7f69401091f0 2024-09-10T10:47:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.195+0000 7f6945396640 1 -- 172.21.15.92:0/3031002816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69401ac510 con 0x7f69401091f0 2024-09-10T10:47:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.195+0000 7f6945396640 1 -- 172.21.15.92:0/3031002816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6940110920 con 0x7f69401091f0 2024-09-10T10:47:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.195+0000 7f6927fff640 1 -- 172.21.15.92:0/3031002816 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6930032e40 con 0x7f69401091f0 2024-09-10T10:47:27.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.195+0000 7f6927fff640 1 -- 172.21.15.92:0/3031002816 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930035070 con 0x7f69401091f0 2024-09-10T10:47:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.211+0000 7f6927fff640 1 -- 172.21.15.92:0/3031002816 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6930042030 con 0x7f69401091f0 2024-09-10T10:47:27.211 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.211+0000 7f6948208740 1 Processor -- start 2024-09-10T10:47:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.212+0000 7f6927fff640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f69280a2fd0 0x7f69280a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.212 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.212+0000 7f6927fff640 1 -- 172.21.15.92:0/3031002816 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8455+0+0 (secure 0 0 0) 0x7f69300efa80 con 0x7f69401091f0 2024-09-10T10:47:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.217+0000 7f6948208740 1 -- start start 2024-09-10T10:47:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.217+0000 7f693f7fe640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f69280a2fd0 0x7f69280a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.217+0000 7f6948208740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d963ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.217+0000 7f6948208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d964410 0x55a54d96e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.217+0000 7f6948208740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d9710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.217+0000 7f6948208740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a54d8c82f0 con 0x55a54d963af0 2024-09-10T10:47:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.217+0000 7f6948208740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a54d870270 con 0x55a54d96ecb0 2024-09-10T10:47:27.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.217+0000 7f6948208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a54d8c42b0 con 0x55a54d964410 2024-09-10T10:47:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.219+0000 7f693effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d963ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.219+0000 7f693effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d963ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55500/0 (socket says 172.21.15.92:55500) 2024-09-10T10:47:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.219+0000 7f693effd640 1 -- 172.21.15.92:0/3560613202 learned_addr learned my addr 172.21.15.92:0/3560613202 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:27.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.219+0000 7f693f7fe640 1 --2- 172.21.15.92:0/3560613202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d9710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.220+0000 7f693e7fc640 1 --2- 172.21.15.92:0/3560613202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d964410 0x55a54d96e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.221+0000 7f693f7fe640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f69280a2fd0 0x7f69280a5490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6938009fd0 tx=0x7f693800c820 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.221+0000 7f693f7fe640 1 -- 172.21.15.92:0/3560613202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d964410 msgr2=0x55a54d96e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.221+0000 7f693f7fe640 1 --2- 172.21.15.92:0/3560613202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d964410 0x55a54d96e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.221+0000 7f693f7fe640 1 -- 172.21.15.92:0/3560613202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 msgr2=0x55a54d963ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.221+0000 7f693f7fe640 1 --2- 172.21.15.92:0/3560613202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d963ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.221+0000 7f693f7fe640 1 -- 172.21.15.92:0/3560613202 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a54d86f340 con 0x55a54d96ecb0 2024-09-10T10:47:27.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.221+0000 7f693f7fe640 1 --2- 172.21.15.92:0/3560613202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d9710a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f693800cfd0 tx=0x7f693801b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7ecd5dd5be9faf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.227+0000 7f69257fa640 1 -- 172.21.15.92:0/3560613202 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938027070 con 0x55a54d96ecb0 2024-09-10T10:47:27.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.227+0000 7f69257fa640 1 -- 172.21.15.92:0/3560613202 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f693801e070 con 0x55a54d96ecb0 2024-09-10T10:47:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.228+0000 7f6948208740 1 -- 172.21.15.92:0/3560613202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 msgr2=0x55a54d9710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:27.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.228+0000 7f6948208740 1 --2- 172.21.15.92:0/3560613202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d9710a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f693800cfd0 tx=0x7f693801b000 comp rx=0 tx=0).stop 2024-09-10T10:47:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.230+0000 7f6948208740 1 -- 172.21.15.92:0/3560613202 shutdown_connections 2024-09-10T10:47:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.230+0000 7f6948208740 1 --2- 172.21.15.92:0/3560613202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d9710a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.230+0000 7f6948208740 1 --2- 172.21.15.92:0/3560613202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d964410 0x55a54d96e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.230+0000 7f6948208740 1 --2- 172.21.15.92:0/3560613202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d963ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.230+0000 7f6948208740 1 -- 172.21.15.92:0/3560613202 >> 172.21.15.92:0/3560613202 conn(0x55a54d960060 msgr2=0x55a54d960440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:27.233 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.233+0000 7f6948208740 1 -- 172.21.15.92:0/3560613202 shutdown_connections 2024-09-10T10:47:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.233+0000 7f6948208740 1 -- 172.21.15.92:0/3560613202 wait complete. 2024-09-10T10:47:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.233+0000 7f6948208740 1 -- start start 2024-09-10T10:47:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.233+0000 7f6948208740 1 Processor -- start 2024-09-10T10:47:27.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f6948208740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 0x55a54d96bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f6948208740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d964410 0x55a54d96c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f6948208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d96ecb0 0x55a54d96c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f6948208740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a54d9718d0 con 0x55a54d964410 2024-09-10T10:47:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f6948208740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55a54d851290 con 0x55a54d963af0 2024-09-10T10:47:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f6948208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a54d971a50 con 0x55a54d96ecb0 2024-09-10T10:47:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f6948208740 10 client.0 _ll_register_callbacks cb 0x55a54d882140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f693e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d964410 0x55a54d96c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f693e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d964410 0x55a54d96c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55512/0 (socket says 172.21.15.92:55512) 2024-09-10T10:47:27.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.234+0000 7f693e7fc640 1 -- 172.21.15.92:0/805347379 learned_addr learned my addr 172.21.15.92:0/805347379 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.237+0000 7f693e7fc640 1 -- 172.21.15.92:0/805347379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d96ecb0 msgr2=0x55a54d96c540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:47:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.237+0000 7f693e7fc640 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d96ecb0 0x55a54d96c540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.237+0000 7f693e7fc640 1 -- 172.21.15.92:0/805347379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 msgr2=0x55a54d96bac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:47:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.237+0000 7f693e7fc640 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 0x55a54d96bac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.237+0000 7f693e7fc640 1 -- 172.21.15.92:0/805347379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a54d5db210 con 0x55a54d964410 2024-09-10T10:47:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.238+0000 7f693e7fc640 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d964410 0x55a54d96c000 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f693400e1d0 tx=0x7f693400e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d534b8ff9bfdd8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.238+0000 7f6922ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:47:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.239+0000 7f6922ff5640 1 -- 172.21.15.92:0/805347379 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934018020 con 0x55a54d964410 2024-09-10T10:47:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.239+0000 7f6948208740 1 -- 172.21.15.92:0/805347379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f693801e070 con 0x55a54d964410 2024-09-10T10:47:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.239+0000 7f6922ff5640 1 -- 172.21.15.92:0/805347379 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8455+0+0 (secure 0 0 0) 0x7f6934013660 con 0x55a54d964410 2024-09-10T10:47:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.241+0000 7f6922ff5640 1 -- 172.21.15.92:0/805347379 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f6934023050 con 0x55a54d964410 2024-09-10T10:47:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.242+0000 7f6948208740 10 client.16140 fetch_fsmap learned FSMap version 56 2024-09-10T10:47:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.242+0000 7f6948208740 1 -- 172.21.15.92:0/805347379 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55a54d6a7620 con 0x55a54d964410 2024-09-10T10:47:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.242+0000 7f6922ff5640 1 -- 172.21.15.92:0/805347379 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f693801e070 con 0x55a54d964410 2024-09-10T10:47:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.242+0000 7f6922ff5640 1 -- 172.21.15.92:0/805347379 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f6934014a10 con 0x55a54d964410 2024-09-10T10:47:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.242+0000 7f6948208740 10 client.16140 fetch_fsmap finished waiting for FSMap version 56 2024-09-10T10:47:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.242+0000 7f6948208740 10 client.16140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.242+0000 7f6948208740 20 client.16140 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.243+0000 7f6948208740 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a54d97f270 0x55a54d981710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.243+0000 7f6948208740 4 client.16140 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:47:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.243+0000 7f6948208740 1 -- 172.21.15.92:0/805347379 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a54d8d5a20 con 0x55a54d97f270 2024-09-10T10:47:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.243+0000 7f693effd640 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a54d97f270 0x55a54d981710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.243+0000 7f693effd640 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a54d97f270 0x55a54d981710 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb98ca7809e2719 server_cookie=e7dbc96dfd9f43c3 in_seq=0 out_seq=0 2024-09-10T10:47:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.243+0000 7f6922ff5640 10 client.16140 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.244+0000 7f6922ff5640 1 -- 172.21.15.92:0/805347379 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a54d8d5a20 con 0x55a54d97f270 2024-09-10T10:47:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.244+0000 7f6922ff5640 10 client.16140 handle_command_reply: tid=0 2024-09-10T10:47:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.245+0000 7f6948208740 1 client.16140 shutdown 2024-09-10T10:47:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.245+0000 7f6948208740 1 -- 172.21.15.92:0/805347379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d964410 msgr2=0x55a54d96c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.245+0000 7f6948208740 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d964410 0x55a54d96c000 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f693400e1d0 tx=0x7f693400e690 comp rx=0 tx=0).stop 2024-09-10T10:47:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.245+0000 7f6948208740 1 -- 172.21.15.92:0/805347379 shutdown_connections 2024-09-10T10:47:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.245+0000 7f6948208740 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d96ecb0 0x55a54d96c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.245+0000 7f6948208740 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d964410 0x55a54d96c000 secure :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f693400e1d0 tx=0x7f693400e690 comp rx=0 tx=0).stop 2024-09-10T10:47:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.245+0000 7f6948208740 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a54d97f270 0x55a54d981710 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.245+0000 7f6948208740 1 --2- 172.21.15.92:0/805347379 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 0x55a54d96bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.246+0000 7f6948208740 1 -- 172.21.15.92:0/805347379 >> 172.21.15.92:0/805347379 conn(0x55a54d960060 msgr2=0x55a54d965dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:27.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.246+0000 7f6922ff5640 0 client.16140 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.251+0000 7f6948208740 1 -- 172.21.15.92:0/805347379 shutdown_connections 2024-09-10T10:47:27.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.251+0000 7f6948208740 1 -- 172.21.15.92:0/805347379 wait complete. 2024-09-10T10:47:27.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.255+0000 7f6948208740 20 client.16140 trim_cache size 0 max 16384 2024-09-10T10:47:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.285+0000 7f6948208740 1 Processor -- start 2024-09-10T10:47:27.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.285+0000 7f6948208740 1 -- start start 2024-09-10T10:47:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.285+0000 7f6948208740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d96c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.285+0000 7f6948208740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d986fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.285+0000 7f6948208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 0x55a54d9655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.286+0000 7f6948208740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f692c00e7d0 con 0x55a54d963af0 2024-09-10T10:47:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.286+0000 7f6948208740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f692c0103d0 con 0x55a54d96ecb0 2024-09-10T10:47:27.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.286+0000 7f6948208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f692c00eea0 con 0x55a54d987520 2024-09-10T10:47:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.287+0000 7f693f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 0x55a54d9655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.287+0000 7f693effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d96c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.287+0000 7f693effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d96c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55514/0 (socket says 172.21.15.92:55514) 2024-09-10T10:47:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.287+0000 7f693effd640 1 -- 172.21.15.92:0/176371996 learned_addr learned my addr 172.21.15.92:0/176371996 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.289+0000 7f693e7fc640 1 --2- 172.21.15.92:0/176371996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d986fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.292+0000 7f693e7fc640 1 -- 172.21.15.92:0/176371996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 msgr2=0x55a54d9655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.292+0000 7f693e7fc640 1 --2- 172.21.15.92:0/176371996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 0x55a54d9655a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.292+0000 7f693e7fc640 1 -- 172.21.15.92:0/176371996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 msgr2=0x55a54d96c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.292+0000 7f693e7fc640 1 --2- 172.21.15.92:0/176371996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d96c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.292+0000 7f693e7fc640 1 -- 172.21.15.92:0/176371996 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a54d96e610 con 0x55a54d96ecb0 2024-09-10T10:47:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.292+0000 7f693e7fc640 1 --2- 172.21.15.92:0/176371996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d986fe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55a54d96cbb0 tx=0x7f693400c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=806570ac85fd269c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.293+0000 7f6924ff9640 1 -- 172.21.15.92:0/176371996 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693402b070 con 0x55a54d96ecb0 2024-09-10T10:47:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.293+0000 7f6924ff9640 1 -- 172.21.15.92:0/176371996 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6934012600 con 0x55a54d96ecb0 2024-09-10T10:47:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.293+0000 7f6924ff9640 1 -- 172.21.15.92:0/176371996 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934018040 con 0x55a54d96ecb0 2024-09-10T10:47:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.295+0000 7f6948208740 1 -- 172.21.15.92:0/176371996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 msgr2=0x55a54d986fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.295+0000 7f6948208740 1 --2- 172.21.15.92:0/176371996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d986fe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55a54d96cbb0 tx=0x7f693400c840 comp rx=0 tx=0).stop 2024-09-10T10:47:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.299+0000 7f6948208740 1 -- 172.21.15.92:0/176371996 shutdown_connections 2024-09-10T10:47:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.299+0000 7f6948208740 1 --2- 172.21.15.92:0/176371996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 0x55a54d9655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.299+0000 7f6948208740 1 --2- 172.21.15.92:0/176371996 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d96ecb0 0x55a54d986fe0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.299+0000 7f6948208740 1 --2- 172.21.15.92:0/176371996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d963af0 0x55a54d96c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.299+0000 7f6948208740 1 -- 172.21.15.92:0/176371996 >> 172.21.15.92:0/176371996 conn(0x55a54d960060 msgr2=0x55a54d96ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.300+0000 7f6948208740 1 -- 172.21.15.92:0/176371996 shutdown_connections 2024-09-10T10:47:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.302+0000 7f6948208740 1 -- 172.21.15.92:0/176371996 wait complete. 2024-09-10T10:47:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.302+0000 7f6948208740 1 -- start start 2024-09-10T10:47:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.302+0000 7f6948208740 1 Processor -- start 2024-09-10T10:47:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.305+0000 7f6948208740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 0x55a54d977350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.305+0000 7f6948208740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d96ecb0 0x55a54d968690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.305+0000 7f6948208740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 0x55a54d968bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.305+0000 7f6948208740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f692c00fd00 con 0x55a54d96ecb0 2024-09-10T10:47:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.305+0000 7f6948208740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f692c00f570 con 0x55a54d963af0 2024-09-10T10:47:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.305+0000 7f6948208740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f692c00c7d0 con 0x55a54d987520 2024-09-10T10:47:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.305+0000 7f6948208740 10 client.0 _ll_register_callbacks cb 0x7f6934006f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.307+0000 7f693effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 0x55a54d977350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.307+0000 7f693effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 0x55a54d977350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:42938/0 (socket says 172.21.15.92:42938) 2024-09-10T10:47:27.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.307+0000 7f693effd640 1 -- 172.21.15.92:0/2808281322 learned_addr learned my addr 172.21.15.92:0/2808281322 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.311+0000 7f693f7fe640 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 0x55a54d968bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.311+0000 7f693e7fc640 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d96ecb0 0x55a54d968690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.311+0000 7f693effd640 1 -- 172.21.15.92:0/2808281322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 msgr2=0x55a54d968bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:27.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.311+0000 7f693effd640 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 0x55a54d968bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.311+0000 7f693effd640 1 -- 172.21.15.92:0/2808281322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d96ecb0 msgr2=0x55a54d968690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:27.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.311+0000 7f693effd640 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d96ecb0 0x55a54d968690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.311+0000 7f693effd640 1 -- 172.21.15.92:0/2808281322 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a54d969270 con 0x55a54d963af0 2024-09-10T10:47:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.315+0000 7f693effd640 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 0x55a54d977350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69300b8950 tx=0x7f69300dc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21815d92e28992 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.317+0000 7f6922ff5640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:47:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.317+0000 7f6922ff5640 1 -- 172.21.15.92:0/2808281322 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69300c0330 con 0x55a54d963af0 2024-09-10T10:47:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.317+0000 7f6948208740 1 -- 172.21.15.92:0/2808281322 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6934012600 con 0x55a54d963af0 2024-09-10T10:47:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.317+0000 7f6922ff5640 1 -- 172.21.15.92:0/2808281322 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8455+0+0 (secure 0 0 0) 0x7f69300b85f0 con 0x55a54d963af0 2024-09-10T10:47:27.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.323+0000 7f6922ff5640 1 -- 172.21.15.92:0/2808281322 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f69300cc050 con 0x55a54d963af0 2024-09-10T10:47:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.326+0000 7f6948208740 10 client.25643 fetch_fsmap learned FSMap version 56 2024-09-10T10:47:27.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.326+0000 7f6948208740 1 -- 172.21.15.92:0/2808281322 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55a54d9e9fb0 con 0x55a54d963af0 2024-09-10T10:47:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.332+0000 7f6922ff5640 1 -- 172.21.15.92:0/2808281322 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6934012600 con 0x55a54d963af0 2024-09-10T10:47:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.332+0000 7f6922ff5640 1 -- 172.21.15.92:0/2808281322 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f69300dabc0 con 0x55a54d963af0 2024-09-10T10:47:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.332+0000 7f6948208740 10 client.25643 fetch_fsmap finished waiting for FSMap version 56 2024-09-10T10:47:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.332+0000 7f6948208740 10 client.25643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:27.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.332+0000 7f6948208740 20 client.25643 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.332+0000 7f6948208740 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a54d9ea6e0 0x55a54d9ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.332+0000 7f6948208740 4 client.25643 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:47:27.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.332+0000 7f6948208740 1 -- 172.21.15.92:0/2808281322 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a54d9676a0 con 0x55a54d9ea6e0 2024-09-10T10:47:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.334+0000 7f693e7fc640 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a54d9ea6e0 0x55a54d9ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.338+0000 7f693e7fc640 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a54d9ea6e0 0x55a54d9ecb00 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac87181880643ebe server_cookie=7569694e615d5cdf in_seq=0 out_seq=0 2024-09-10T10:47:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.339+0000 7f6922ff5640 10 client.25643 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.411+0000 7f6922ff5640 1 -- 172.21.15.92:0/2808281322 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a54d9676a0 con 0x55a54d9ea6e0 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.411+0000 7f6922ff5640 10 client.25643 handle_command_reply: tid=0 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.411+0000 7f6948208740 1 client.25643 shutdown 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 -- 172.21.15.92:0/2808281322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 msgr2=0x55a54d977350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 0x55a54d977350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69300b8950 tx=0x7f69300dc040 comp rx=0 tx=0).stop 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 -- 172.21.15.92:0/2808281322 shutdown_connections 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a54d987520 0x55a54d968bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a54d96ecb0 0x55a54d968690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55a54d9ea6e0 0x55a54d9ecb00 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 --2- 172.21.15.92:0/2808281322 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55a54d963af0 0x55a54d977350 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 -- 172.21.15.92:0/2808281322 >> 172.21.15.92:0/2808281322 conn(0x55a54d960060 msgr2=0x55a54d9655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6922ff5640 0 client.25643 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 -- 172.21.15.92:0/2808281322 shutdown_connections 2024-09-10T10:47:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 1 -- 172.21.15.92:0/2808281322 wait complete. 2024-09-10T10:47:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.412+0000 7f6948208740 20 client.25643 trim_cache size 0 max 16384 2024-09-10T10:47:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:47:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:47:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:47:27.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:47:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 -- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f69280a2fd0 msgr2=0x7f69280a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f69280a2fd0 0x7f69280a5490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6938009fd0 tx=0x7f693800c820 comp rx=0 tx=0).stop 2024-09-10T10:47:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 -- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69401091f0 msgr2=0x7f69401a72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69401091f0 0x7f69401a72c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f693002aa70 tx=0x7f6930032cd0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 -- 172.21.15.92:0/3031002816 shutdown_connections 2024-09-10T10:47:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f694011b140 0x7f69401abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f69280a2fd0 0x7f69280a5490 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f69401095d0 0x7f69401a7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 --2- 172.21.15.92:0/3031002816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69401091f0 0x7f69401a72c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 -- 172.21.15.92:0/3031002816 >> 172.21.15.92:0/3031002816 conn(0x7f694006ce00 msgr2=0x7f694011b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 -- 172.21.15.92:0/3031002816 shutdown_connections 2024-09-10T10:47:27.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:27.413+0000 7f6945396640 1 -- 172.21.15.92:0/3031002816 wait complete. 2024-09-10T10:47:27.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:27 smithi097 ceph-mon[35213]: pgmap v338: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 27 MiB/s wr, 1.75k op/s 2024-09-10T10:47:27.913 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:27 smithi092 ceph-mon[30834]: pgmap v338: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 27 MiB/s wr, 1.75k op/s 2024-09-10T10:47:28.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:27 smithi121 ceph-mon[35231]: pgmap v338: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 27 MiB/s wr, 1.75k op/s 2024-09-10T10:47:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 630.0 s, 1585.8 tps, lat 62.433 ms stddev 92.581 2024-09-10T10:47:30.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:29 smithi121 ceph-mon[35231]: pgmap v339: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2024-09-10T10:47:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:29 smithi097 ceph-mon[35213]: pgmap v339: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2024-09-10T10:47:30.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:29 smithi092 ceph-mon[30834]: pgmap v339: 97 pgs: 97 active+clean; 4.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2024-09-10T10:47:32.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:31 smithi121 ceph-mon[35231]: pgmap v340: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 32 MiB/s wr, 2.44k op/s 2024-09-10T10:47:32.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:31 smithi097 ceph-mon[35213]: pgmap v340: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 32 MiB/s wr, 2.44k op/s 2024-09-10T10:47:32.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:31 smithi092 ceph-mon[30834]: pgmap v340: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 32 MiB/s wr, 2.44k op/s 2024-09-10T10:47:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 635.0 s, 2183.8 tps, lat 45.933 ms stddev 53.771 2024-09-10T10:47:34.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:33 smithi121 ceph-mon[35231]: pgmap v341: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2024-09-10T10:47:34.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:33 smithi097 ceph-mon[35213]: pgmap v341: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2024-09-10T10:47:34.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:33 smithi092 ceph-mon[30834]: pgmap v341: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2024-09-10T10:47:36.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:35 smithi121 ceph-mon[35231]: pgmap v342: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2024-09-10T10:47:36.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:35 smithi097 ceph-mon[35213]: pgmap v342: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2024-09-10T10:47:36.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:35 smithi092 ceph-mon[30834]: pgmap v342: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2024-09-10T10:47:38.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:37 smithi121 ceph-mon[35231]: pgmap v343: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 21 MiB/s wr, 1.59k op/s 2024-09-10T10:47:38.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:37 smithi097 ceph-mon[35213]: pgmap v343: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 21 MiB/s wr, 1.59k op/s 2024-09-10T10:47:38.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:37 smithi092 ceph-mon[30834]: pgmap v343: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 21 MiB/s wr, 1.59k op/s 2024-09-10T10:47:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 640.0 s, 1904.0 tps, lat 53.007 ms stddev 64.771 2024-09-10T10:47:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:39 smithi121 ceph-mon[35231]: pgmap v344: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 15 MiB/s wr, 1.27k op/s 2024-09-10T10:47:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:39 smithi097 ceph-mon[35213]: pgmap v344: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 15 MiB/s wr, 1.27k op/s 2024-09-10T10:47:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:39 smithi092 ceph-mon[30834]: pgmap v344: 97 pgs: 97 active+clean; 5.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 15 MiB/s wr, 1.27k op/s 2024-09-10T10:47:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.552+0000 7f54d90c9640 1 -- 172.21.15.92:0/2950412917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54d41091f0 msgr2=0x7f54d4110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:40.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.552+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2950412917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54d41091f0 0x7f54d4110250 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009cd0 tx=0x7f54cc02a930 comp rx=0 tx=0).stop 2024-09-10T10:47:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.553+0000 7f54d90c9640 1 -- 172.21.15.92:0/2950412917 shutdown_connections 2024-09-10T10:47:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.553+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2950412917 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d411b140 0x7f54d411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.553+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2950412917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54d41095d0 0x7f54d4109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.553+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2950412917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54d41091f0 0x7f54d4110250 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.553+0000 7f54d90c9640 1 -- 172.21.15.92:0/2950412917 >> 172.21.15.92:0/2950412917 conn(0x7f54d406ce00 msgr2=0x7f54d406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.557+0000 7f54d90c9640 1 -- 172.21.15.92:0/2950412917 shutdown_connections 2024-09-10T10:47:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.558+0000 7f54d90c9640 1 -- 172.21.15.92:0/2950412917 wait complete. 2024-09-10T10:47:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.559+0000 7f54d90c9640 1 Processor -- start 2024-09-10T10:47:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.560+0000 7f54d90c9640 1 -- start start 2024-09-10T10:47:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.560+0000 7f54d90c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54d41091f0 0x7f54d41a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.560+0000 7f54d90c9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54d41095d0 0x7f54d41a7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.560+0000 7f54d90c9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d411b140 0x7f54d41abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.560+0000 7f54d90c9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4120d50 con 0x7f54d41091f0 2024-09-10T10:47:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.560+0000 7f54d90c9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4120bd0 con 0x7f54d411b140 2024-09-10T10:47:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.560+0000 7f54d90c9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4120ed0 con 0x7f54d41095d0 2024-09-10T10:47:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.560+0000 7f54d2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54d41091f0 0x7f54d41a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.560+0000 7f54d259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54d41095d0 0x7f54d41a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54d2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54d41091f0 0x7f54d41a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39280/0 (socket says 172.21.15.92:39280) 2024-09-10T10:47:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54d2d9d640 1 -- 172.21.15.92:0/2533382853 learned_addr learned my addr 172.21.15.92:0/2533382853 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54d359e640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d411b140 0x7f54d41abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54d259c640 1 -- 172.21.15.92:0/2533382853 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d411b140 msgr2=0x7f54d41abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54d259c640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d411b140 0x7f54d41abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54d259c640 1 -- 172.21.15.92:0/2533382853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54d41091f0 msgr2=0x7f54d41a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54d259c640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54d41091f0 0x7f54d41a71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54d259c640 1 -- 172.21.15.92:0/2533382853 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d41ac1d0 con 0x7f54d41095d0 2024-09-10T10:47:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54d259c640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54d41095d0 0x7f54d41a7720 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00d6d0 tx=0x7f54bc00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.561+0000 7f54cbfff640 1 -- 172.21.15.92:0/2533382853 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc017070 con 0x7f54d41095d0 2024-09-10T10:47:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.562+0000 7f54cbfff640 1 -- 172.21.15.92:0/2533382853 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54bc009820 con 0x7f54d41095d0 2024-09-10T10:47:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.562+0000 7f54cbfff640 1 -- 172.21.15.92:0/2533382853 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc004d00 con 0x7f54d41095d0 2024-09-10T10:47:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.562+0000 7f54d90c9640 1 -- 172.21.15.92:0/2533382853 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d41ac4c0 con 0x7f54d41095d0 2024-09-10T10:47:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.562+0000 7f54d90c9640 1 -- 172.21.15.92:0/2533382853 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d41b3d50 con 0x7f54d41095d0 2024-09-10T10:47:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.562+0000 7f54d359e640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d411b140 0x7f54d41abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:47:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.566+0000 7f54cbfff640 1 -- 172.21.15.92:0/2533382853 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f54bc0099d0 con 0x7f54d41095d0 2024-09-10T10:47:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.566+0000 7f54dbe61740 1 Processor -- start 2024-09-10T10:47:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.566+0000 7f54dbe61740 1 -- start start 2024-09-10T10:47:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.566+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d93af0 0x561ad9d93ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.566+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9da10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54dbe61740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561ad9cf82f0 con 0x561ad9d94410 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54dbe61740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561ad9ca0270 con 0x561ad9d9ecb0 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54dbe61740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561ad9cf42b0 con 0x561ad9d93af0 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9da10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d359e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d93af0 0x561ad9d93ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9da10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:60760/0 (socket says 172.21.15.92:60760) 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d259c640 1 -- 172.21.15.92:0/4236517627 learned_addr learned my addr 172.21.15.92:0/4236517627 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/4236517627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d259c640 1 -- 172.21.15.92:0/4236517627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d93af0 msgr2=0x561ad9d93ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d259c640 1 --2- 172.21.15.92:0/4236517627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d93af0 0x561ad9d93ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d259c640 1 -- 172.21.15.92:0/4236517627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 msgr2=0x561ad9d9e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d259c640 1 --2- 172.21.15.92:0/4236517627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d259c640 1 -- 172.21.15.92:0/4236517627 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ad9c9f340 con 0x561ad9d9ecb0 2024-09-10T10:47:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.567+0000 7f54d259c640 1 --2- 172.21.15.92:0/4236517627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9da10a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0cc3d0 tx=0x7f54bc0d7570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba8f9beb6a5aeb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.568+0000 7f54c97fa640 1 -- 172.21.15.92:0/4236517627 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0e2070 con 0x561ad9d9ecb0 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.568+0000 7f54c97fa640 1 -- 172.21.15.92:0/4236517627 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54bc0ddae0 con 0x561ad9d9ecb0 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.568+0000 7f54c97fa640 1 -- 172.21.15.92:0/4236517627 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0dcb90 con 0x561ad9d9ecb0 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.568+0000 7f54cbfff640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f54c00a2ef0 0x7f54c00a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.568+0000 7f54cbfff640 1 -- 172.21.15.92:0/2533382853 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8455+0+0 (secure 0 0 0) 0x7f54bc0ced60 con 0x7f54d41095d0 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54dbe61740 1 -- 172.21.15.92:0/4236517627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 msgr2=0x561ad9da10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54dbe61740 1 --2- 172.21.15.92:0/4236517627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9da10a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0cc3d0 tx=0x7f54bc0d7570 comp rx=0 tx=0).stop 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54d359e640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f54c00a2ef0 0x7f54c00a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54dbe61740 1 -- 172.21.15.92:0/4236517627 shutdown_connections 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54dbe61740 1 --2- 172.21.15.92:0/4236517627 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9da10a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54dbe61740 1 --2- 172.21.15.92:0/4236517627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54dbe61740 1 --2- 172.21.15.92:0/4236517627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d93af0 0x561ad9d93ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54dbe61740 1 -- 172.21.15.92:0/4236517627 >> 172.21.15.92:0/4236517627 conn(0x561ad9d90060 msgr2=0x561ad9d90440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54dbe61740 1 -- 172.21.15.92:0/4236517627 shutdown_connections 2024-09-10T10:47:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54dbe61740 1 -- 172.21.15.92:0/4236517627 wait complete. 2024-09-10T10:47:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.569+0000 7f54d359e640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f54c00a2ef0 0x7f54c00a53b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54c4006fd0 tx=0x7f54c4008040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.570+0000 7f54dbe61740 1 -- start start 2024-09-10T10:47:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.570+0000 7f54dbe61740 1 Processor -- start 2024-09-10T10:47:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.570+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d9bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.570+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.570+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 0x561ad9d9c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.570+0000 7f54dbe61740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561ad9da1880 con 0x561ad9d94410 2024-09-10T10:47:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.570+0000 7f54dbe61740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561ad9c81290 con 0x561ad9d93af0 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.570+0000 7f54dbe61740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561ad9da1a00 con 0x561ad9d9ecb0 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.570+0000 7f54dbe61740 10 client.0 _ll_register_callbacks cb 0x561ad9cb2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.571+0000 7f54d259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.571+0000 7f54d259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39308/0 (socket says 172.21.15.92:39308) 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.571+0000 7f54d259c640 1 -- 172.21.15.92:0/3160588175 learned_addr learned my addr 172.21.15.92:0/3160588175 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.571+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d9bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.571+0000 7f54d259c640 1 -- 172.21.15.92:0/3160588175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 msgr2=0x561ad9d9c640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.571+0000 7f54d259c640 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 0x561ad9d9c640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.571+0000 7f54d259c640 1 -- 172.21.15.92:0/3160588175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 msgr2=0x561ad9d9bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.571+0000 7f54d259c640 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d9bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.571+0000 7f54d259c640 1 -- 172.21.15.92:0/3160588175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ad9a0b210 con 0x561ad9d94410 2024-09-10T10:47:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.572+0000 7f54d259c640 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9c100 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f54bc000c00 tx=0x7f54bc0d24d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2840c685c8505fad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.572+0000 7f54ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:47:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.572+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3160588175 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc020050 con 0x561ad9d94410 2024-09-10T10:47:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.572+0000 7f54dbe61740 1 -- 172.21.15.92:0/3160588175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54bc0ddae0 con 0x561ad9d94410 2024-09-10T10:47:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.572+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3160588175 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8455+0+0 (secure 0 0 0) 0x7f54bc0978d0 con 0x561ad9d94410 2024-09-10T10:47:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.573+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3160588175 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f54bc097500 con 0x561ad9d94410 2024-09-10T10:47:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.573+0000 7f54dbe61740 10 client.16158 fetch_fsmap learned FSMap version 56 2024-09-10T10:47:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.573+0000 7f54dbe61740 1 -- 172.21.15.92:0/3160588175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x561ad9ad7620 con 0x561ad9d94410 2024-09-10T10:47:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.573+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3160588175 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54bc09b960 con 0x561ad9d94410 2024-09-10T10:47:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.573+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3160588175 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f54bc0cc710 con 0x561ad9d94410 2024-09-10T10:47:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.574+0000 7f54dbe61740 10 client.16158 fetch_fsmap finished waiting for FSMap version 56 2024-09-10T10:47:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.574+0000 7f54dbe61740 10 client.16158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.574+0000 7f54dbe61740 20 client.16158 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.574+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561ad9daeab0 0x561ad9db0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.574+0000 7f54dbe61740 4 client.16158 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:47:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.574+0000 7f54dbe61740 1 -- 172.21.15.92:0/3160588175 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f54bc0ddae0 con 0x561ad9daeab0 2024-09-10T10:47:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.574+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561ad9daeab0 0x561ad9db0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.574+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561ad9daeab0 0x561ad9db0ea0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76887d899bb36813 server_cookie=5abb3be509c6e2dc in_seq=0 out_seq=0 2024-09-10T10:47:40.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.574+0000 7f54ba7fc640 10 client.16158 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.575+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3160588175 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f54bc0ddae0 con 0x561ad9daeab0 2024-09-10T10:47:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.575+0000 7f54ba7fc640 10 client.16158 handle_command_reply: tid=0 2024-09-10T10:47:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.575+0000 7f54dbe61740 1 client.16158 shutdown 2024-09-10T10:47:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 -- 172.21.15.92:0/3160588175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 msgr2=0x561ad9d9c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9c100 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f54bc000c00 tx=0x7f54bc0d24d0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 -- 172.21.15.92:0/3160588175 shutdown_connections 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 0x561ad9d9c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9c100 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561ad9daeab0 0x561ad9db0ea0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3160588175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d9bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54ba7fc640 0 client.16158 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 -- 172.21.15.92:0/3160588175 >> 172.21.15.92:0/3160588175 conn(0x561ad9d90060 msgr2=0x561ad9d95dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 -- 172.21.15.92:0/3160588175 shutdown_connections 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 1 -- 172.21.15.92:0/3160588175 wait complete. 2024-09-10T10:47:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.576+0000 7f54dbe61740 20 client.16158 trim_cache size 0 max 16384 2024-09-10T10:47:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.595+0000 7f54dbe61740 1 Processor -- start 2024-09-10T10:47:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.595+0000 7f54dbe61740 1 -- start start 2024-09-10T10:47:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 0x561ad9d9c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54dbe61740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54d41bc5c0 con 0x561ad9d94410 2024-09-10T10:47:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54dbe61740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f54d41be1c0 con 0x561ad9d93af0 2024-09-10T10:47:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54dbe61740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f54d41bcc90 con 0x561ad9d9ecb0 2024-09-10T10:47:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54d2d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54d259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54d2d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:60782/0 (socket says 172.21.15.92:60782) 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54d2d9d640 1 -- 172.21.15.92:0/15998338 learned_addr learned my addr 172.21.15.92:0/15998338 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54d359e640 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 0x561ad9d9c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54d2d9d640 1 -- 172.21.15.92:0/15998338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 msgr2=0x561ad9d9c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 0x561ad9d9c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.596+0000 7f54d2d9d640 1 -- 172.21.15.92:0/15998338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 msgr2=0x561ad9d9a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.597+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.597+0000 7f54d2d9d640 1 -- 172.21.15.92:0/15998338 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ad9db1300 con 0x561ad9d93af0 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.597+0000 7f54d359e640 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 0x561ad9d9c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.597+0000 7f54d259c640 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.597+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d964d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54cc006010 tx=0x7f54cc02ae30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=797ebaadf82ac52a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.597+0000 7f54c8ff9640 1 -- 172.21.15.92:0/15998338 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc003d40 con 0x561ad9d93af0 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.597+0000 7f54c8ff9640 1 -- 172.21.15.92:0/15998338 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54cc036040 con 0x561ad9d93af0 2024-09-10T10:47:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.597+0000 7f54c8ff9640 1 -- 172.21.15.92:0/15998338 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0046a0 con 0x561ad9d93af0 2024-09-10T10:47:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 -- 172.21.15.92:0/15998338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 msgr2=0x561ad9d964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d964d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f54cc006010 tx=0x7f54cc02ae30 comp rx=0 tx=0).stop 2024-09-10T10:47:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 -- 172.21.15.92:0/15998338 shutdown_connections 2024-09-10T10:47:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d9ecb0 0x561ad9d9c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d94410 0x561ad9d9a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 --2- 172.21.15.92:0/15998338 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d93af0 0x561ad9d964d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 -- 172.21.15.92:0/15998338 >> 172.21.15.92:0/15998338 conn(0x561ad9d90060 msgr2=0x561ad9d9dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:40.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 -- 172.21.15.92:0/15998338 shutdown_connections 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 -- 172.21.15.92:0/15998338 wait complete. 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 -- start start 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.598+0000 7f54dbe61740 1 Processor -- start 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d93af0 0x561ad9da7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d94410 0x561ad9d98740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54dbe61740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9d98c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d93af0 0x561ad9da7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54dbe61740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54d41bdaf0 con 0x561ad9d93af0 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d2d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d93af0 0x561ad9da7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39324/0 (socket says 172.21.15.92:39324) 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54dbe61740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f54d41bd360 con 0x561ad9d9ecb0 2024-09-10T10:47:40.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d2d9d640 1 -- 172.21.15.92:0/3400475346 learned_addr learned my addr 172.21.15.92:0/3400475346 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54dbe61740 1 -- 172.21.15.92:0/3400475346 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f54d41ba5c0 con 0x561ad9d94410 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d259c640 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d94410 0x561ad9d98740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d359e640 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9d98c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54dbe61740 10 client.0 _ll_register_callbacks cb 0x7f54bc0e0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d259c640 1 -- 172.21.15.92:0/3400475346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 msgr2=0x561ad9d98c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d259c640 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9d98c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d259c640 1 -- 172.21.15.92:0/3400475346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d93af0 msgr2=0x561ad9da7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d259c640 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d93af0 0x561ad9da7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d259c640 1 -- 172.21.15.92:0/3400475346 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ad9d992f0 con 0x561ad9d94410 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d93af0 0x561ad9da7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54d259c640 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d94410 0x561ad9d98740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54bc099510 tx=0x7f54bc0097b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dce9b07770f5f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:47:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3400475346 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc020070 con 0x561ad9d94410 2024-09-10T10:47:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54dbe61740 1 -- 172.21.15.92:0/3400475346 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54cc036040 con 0x561ad9d94410 2024-09-10T10:47:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.599+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3400475346 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8455+0+0 (secure 0 0 0) 0x7f54bc0978d0 con 0x561ad9d94410 2024-09-10T10:47:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3400475346 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f54bc09abc0 con 0x561ad9d94410 2024-09-10T10:47:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54dbe61740 10 client.25678 fetch_fsmap learned FSMap version 56 2024-09-10T10:47:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54dbe61740 1 -- 172.21.15.92:0/3400475346 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x561ad9e19290 con 0x561ad9d94410 2024-09-10T10:47:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3400475346 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54cc036040 con 0x561ad9d94410 2024-09-10T10:47:40.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3400475346 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f54bc0ccbe0 con 0x561ad9d94410 2024-09-10T10:47:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54dbe61740 10 client.25678 fetch_fsmap finished waiting for FSMap version 56 2024-09-10T10:47:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54dbe61740 10 client.25678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54dbe61740 20 client.25678 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561ad9e198c0 0x561ad9e1bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54dbe61740 4 client.25678 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:47:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54dbe61740 1 -- 172.21.15.92:0/3400475346 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ad9d05a20 con 0x561ad9e198c0 2024-09-10T10:47:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.600+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561ad9e198c0 0x561ad9e1bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.601+0000 7f54d2d9d640 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561ad9e198c0 0x561ad9e1bce0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9daa7b3f505b8c20 server_cookie=aba499ec585b411e in_seq=0 out_seq=0 2024-09-10T10:47:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.601+0000 7f54ba7fc640 10 client.25678 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54ba7fc640 1 -- 172.21.15.92:0/3400475346 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ad9d05a20 con 0x561ad9e198c0 2024-09-10T10:47:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54ba7fc640 10 client.25678 handle_command_reply: tid=0 2024-09-10T10:47:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 client.25678 shutdown 2024-09-10T10:47:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 -- 172.21.15.92:0/3400475346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d94410 msgr2=0x561ad9d98740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:40.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d94410 0x561ad9d98740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54bc099510 tx=0x7f54bc0097b0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 -- 172.21.15.92:0/3400475346 shutdown_connections 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561ad9e198c0 0x561ad9e1bce0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561ad9d9ecb0 0x561ad9d98c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54ba7fc640 0 client.25678 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ad9d94410 0x561ad9d98740 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 --2- 172.21.15.92:0/3400475346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561ad9d93af0 0x561ad9da7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 -- 172.21.15.92:0/3400475346 >> 172.21.15.92:0/3400475346 conn(0x561ad9d90060 msgr2=0x561ad9da9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 -- 172.21.15.92:0/3400475346 shutdown_connections 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 1 -- 172.21.15.92:0/3400475346 wait complete. 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.657+0000 7f54dbe61740 20 client.25678 trim_cache size 0 max 16384 2024-09-10T10:47:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:47:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:47:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:47:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 -- 172.21.15.92:0/2533382853 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f54c00a2ef0 msgr2=0x7f54c00a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f54c00a2ef0 0x7f54c00a53b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f54c4006fd0 tx=0x7f54c4008040 comp rx=0 tx=0).stop 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 -- 172.21.15.92:0/2533382853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54d41095d0 msgr2=0x7f54d41a7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54d41095d0 0x7f54d41a7720 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00d6d0 tx=0x7f54bc00db90 comp rx=0 tx=0).stop 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 -- 172.21.15.92:0/2533382853 shutdown_connections 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f54c00a2ef0 0x7f54c00a53b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f54d411b140 0x7f54d41abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54d41095d0 0x7f54d41a7720 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 --2- 172.21.15.92:0/2533382853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54d41091f0 0x7f54d41a71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 -- 172.21.15.92:0/2533382853 >> 172.21.15.92:0/2533382853 conn(0x7f54d406ce00 msgr2=0x7f54d411b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.658+0000 7f54d90c9640 1 -- 172.21.15.92:0/2533382853 shutdown_connections 2024-09-10T10:47:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:40.659+0000 7f54d90c9640 1 -- 172.21.15.92:0/2533382853 wait complete. 2024-09-10T10:47:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:41 smithi121 ceph-mon[35231]: pgmap v345: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 19 MiB/s wr, 1.60k op/s 2024-09-10T10:47:42.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:41 smithi097 ceph-mon[35213]: pgmap v345: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 19 MiB/s wr, 1.60k op/s 2024-09-10T10:47:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:41 smithi092 ceph-mon[30834]: pgmap v345: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 19 MiB/s wr, 1.60k op/s 2024-09-10T10:47:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 645.0 s, 2025.4 tps, lat 49.145 ms stddev 60.550 2024-09-10T10:47:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:43 smithi121 ceph-mon[35231]: pgmap v346: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 598 op/s 2024-09-10T10:47:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:43 smithi097 ceph-mon[35213]: pgmap v346: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 598 op/s 2024-09-10T10:47:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:43 smithi092 ceph-mon[30834]: pgmap v346: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 598 op/s 2024-09-10T10:47:46.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:45 smithi121 ceph-mon[35231]: pgmap v347: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 598 op/s 2024-09-10T10:47:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:45 smithi097 ceph-mon[35213]: pgmap v347: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 598 op/s 2024-09-10T10:47:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:45 smithi092 ceph-mon[30834]: pgmap v347: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.1 MiB/s wr, 598 op/s 2024-09-10T10:47:48.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:47 smithi121 ceph-mon[35231]: pgmap v348: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 930 op/s 2024-09-10T10:47:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:47 smithi097 ceph-mon[35213]: pgmap v348: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 930 op/s 2024-09-10T10:47:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:47 smithi092 ceph-mon[30834]: pgmap v348: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 930 op/s 2024-09-10T10:47:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 650.0 s, 2025.4 tps, lat 49.349 ms stddev 56.786 2024-09-10T10:47:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:49 smithi121 ceph-mon[35231]: pgmap v349: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.5 MiB/s wr, 663 op/s 2024-09-10T10:47:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:49 smithi097 ceph-mon[35213]: pgmap v349: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.5 MiB/s wr, 663 op/s 2024-09-10T10:47:50.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:49 smithi092 ceph-mon[30834]: pgmap v349: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.5 MiB/s wr, 663 op/s 2024-09-10T10:47:52.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:51 smithi121 ceph-mon[35231]: pgmap v350: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 925 op/s 2024-09-10T10:47:52.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:51 smithi097 ceph-mon[35213]: pgmap v350: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 925 op/s 2024-09-10T10:47:52.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:51 smithi092 ceph-mon[30834]: pgmap v350: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 12 MiB/s wr, 925 op/s 2024-09-10T10:47:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 655.0 s, 1941.6 tps, lat 51.251 ms stddev 57.701 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.796+0000 7f2ca4843640 1 -- 172.21.15.92:0/1132079990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c98099880 msgr2=0x7f2c980a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.796+0000 7f2ca4843640 1 --2- 172.21.15.92:0/1132079990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c98099880 0x7f2c980a1420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0050280 tx=0x7f2ca0096bd0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.796+0000 7f2ca4843640 1 -- 172.21.15.92:0/1132079990 shutdown_connections 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.796+0000 7f2ca4843640 1 --2- 172.21.15.92:0/1132079990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c98099880 0x7f2c980a1420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.796+0000 7f2ca4843640 1 --2- 172.21.15.92:0/1132079990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c98095520 0x7f2c98099170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.796+0000 7f2ca4843640 1 --2- 172.21.15.92:0/1132079990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c98094b70 0x7f2c98094f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.796+0000 7f2ca4843640 1 -- 172.21.15.92:0/1132079990 >> 172.21.15.92:0/1132079990 conn(0x7f2c9800a1e0 msgr2=0x7f2c9800a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.796+0000 7f2ca4843640 1 -- 172.21.15.92:0/1132079990 shutdown_connections 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.796+0000 7f2ca4843640 1 -- 172.21.15.92:0/1132079990 wait complete. 2024-09-10T10:47:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.797+0000 7f2ca4843640 1 Processor -- start 2024-09-10T10:47:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.797+0000 7f2ca4843640 1 -- start start 2024-09-10T10:47:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.797+0000 7f2ca4843640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c98094b70 0x7f2c9812bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2ca4843640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c98099880 0x7f2c9812c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2ca4843640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c98130690 0x7f2c98130b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2ca4843640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c980a4810 con 0x7f2c98099880 2024-09-10T10:47:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2ca4843640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2c980a4690 con 0x7f2c98130690 2024-09-10T10:47:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2ca4843640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c980a4990 con 0x7f2c98094b70 2024-09-10T10:47:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c98094b70 0x7f2c9812bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c98099880 0x7f2c9812c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c98094b70 0x7f2c9812bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:56896/0 (socket says 172.21.15.92:56896) 2024-09-10T10:47:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/2754881038 learned_addr learned my addr 172.21.15.92:0/2754881038 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c98099880 0x7f2c9812c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42150/0 (socket says 172.21.15.92:42150) 2024-09-10T10:47:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c98130690 0x7f2c98130b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/2754881038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c98130690 msgr2=0x7f2c98130b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c98130690 0x7f2c98130b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c98099880 msgr2=0x7f2c9812c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c98099880 0x7f2c9812c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/2754881038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c98131180 con 0x7f2c98094b70 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9effd640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c98099880 0x7f2c9812c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c98094b70 0x7f2c9812bdd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009d20 tx=0x7f2c9400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.798+0000 7f2c9cff9640 1 -- 172.21.15.92:0/2754881038 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94005220 con 0x7f2c98094b70 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.799+0000 7f2c9cff9640 1 -- 172.21.15.92:0/2754881038 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c94012550 con 0x7f2c98094b70 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.799+0000 7f2c9cff9640 1 -- 172.21.15.92:0/2754881038 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94004e00 con 0x7f2c98094b70 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.799+0000 7f2ca4843640 1 -- 172.21.15.92:0/2754881038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c98131470 con 0x7f2c98094b70 2024-09-10T10:47:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.799+0000 7f2ca4843640 1 -- 172.21.15.92:0/2754881038 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c980963c0 con 0x7f2c98094b70 2024-09-10T10:47:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.802+0000 7f2ca8847740 1 Processor -- start 2024-09-10T10:47:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2ca8847740 1 -- start start 2024-09-10T10:47:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2c9cff9640 1 -- 172.21.15.92:0/2754881038 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2c94023440 con 0x7f2c98094b70 2024-09-10T10:47:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c6fcc0 0x563b11c700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c705e0 0x563b11c7a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c7ae80 0x563b11c7d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2ca8847740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563b11bd42f0 con 0x563b11c7ae80 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2ca8847740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563b11b7c270 con 0x563b11c705e0 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2ca8847740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563b11bd02b0 con 0x563b11c6fcc0 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c705e0 0x563b11c7a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2c9ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c6fcc0 0x563b11c700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c705e0 0x563b11c7a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:37606/0 (socket says 172.21.15.92:37606) 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.803+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/3561145289 learned_addr learned my addr 172.21.15.92:0/3561145289 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c9effd640 1 --2- 172.21.15.92:0/3561145289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c7ae80 0x563b11c7d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/3561145289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c6fcc0 msgr2=0x563b11c700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/3561145289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c6fcc0 0x563b11c700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/3561145289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c7ae80 msgr2=0x563b11c7d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/3561145289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c7ae80 0x563b11c7d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/3561145289 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b11b7b340 con 0x563b11c705e0 2024-09-10T10:47:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/3561145289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c705e0 0x563b11c7a940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2c940d0920 tx=0x7f2c940d59f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5d557cebb9e1d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c9cff9640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2c900a2d80 0x7f2c900a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c89ffb640 1 -- 172.21.15.92:0/3561145289 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9409ec00 con 0x563b11c705e0 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2c900a2d80 0x7f2c900a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c89ffb640 1 -- 172.21.15.92:0/3561145289 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c9409feb0 con 0x563b11c705e0 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.804+0000 7f2c89ffb640 1 -- 172.21.15.92:0/3561145289 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9409ef30 con 0x563b11c705e0 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.805+0000 7f2c9cff9640 1 -- 172.21.15.92:0/2754881038 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8455+0+0 (secure 0 0 0) 0x7f2c940d32b0 con 0x7f2c98094b70 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.805+0000 7f2ca8847740 1 -- 172.21.15.92:0/3561145289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c705e0 msgr2=0x563b11c7a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.805+0000 7f2ca8847740 1 --2- 172.21.15.92:0/3561145289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c705e0 0x563b11c7a940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2c940d0920 tx=0x7f2c940d59f0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.805+0000 7f2ca8847740 1 -- 172.21.15.92:0/3561145289 shutdown_connections 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.805+0000 7f2ca8847740 1 --2- 172.21.15.92:0/3561145289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c7ae80 0x563b11c7d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.806+0000 7f2ca8847740 1 --2- 172.21.15.92:0/3561145289 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c705e0 0x563b11c7a940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.806+0000 7f2ca8847740 1 --2- 172.21.15.92:0/3561145289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c6fcc0 0x563b11c700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.806+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2c900a2d80 0x7f2c900a5240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0051790 tx=0x7f2ca0079040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.806+0000 7f2ca8847740 1 -- 172.21.15.92:0/3561145289 >> 172.21.15.92:0/3561145289 conn(0x563b11c6c230 msgr2=0x563b11c6c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.806+0000 7f2ca8847740 1 -- 172.21.15.92:0/3561145289 shutdown_connections 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.806+0000 7f2ca8847740 1 -- 172.21.15.92:0/3561145289 wait complete. 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.806+0000 7f2ca8847740 1 -- start start 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.806+0000 7f2ca8847740 1 Processor -- start 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c6fcc0 0x563b11c77dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c705e0 0x563b11c78300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c7ae80 0x563b11c78840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2ca8847740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563b11c86260 con 0x563b11c705e0 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2ca8847740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x563b11b5d290 con 0x563b11c6fcc0 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2ca8847740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563b11c863e0 con 0x563b11c7ae80 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2ca8847740 10 client.0 _ll_register_callbacks cb 0x563b11b8e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c705e0 0x563b11c78300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c705e0 0x563b11c78300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42176/0 (socket says 172.21.15.92:42176) 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c7ae80 0x563b11c78840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9effd640 1 -- 172.21.15.92:0/357580020 learned_addr learned my addr 172.21.15.92:0/357580020 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c6fcc0 0x563b11c77dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9ffff640 1 -- 172.21.15.92:0/357580020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c6fcc0 msgr2=0x563b11c77dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c6fcc0 0x563b11c77dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9ffff640 1 -- 172.21.15.92:0/357580020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c705e0 msgr2=0x563b11c78300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c705e0 0x563b11c78300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9ffff640 1 -- 172.21.15.92:0/357580020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b118e7210 con 0x563b11c7ae80 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c7ae80 0x563b11c78840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0067b40 tx=0x7f2ca0096bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6a292945c03d97d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.807+0000 7f2c7effd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.808+0000 7f2c7effd640 1 -- 172.21.15.92:0/357580020 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca006b7d0 con 0x563b11c7ae80 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.808+0000 7f2c7effd640 1 -- 172.21.15.92:0/357580020 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8455+0+0 (secure 0 0 0) 0x7f2ca006b970 con 0x563b11c7ae80 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.808+0000 7f2ca8847740 1 -- 172.21.15.92:0/357580020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c9409feb0 con 0x563b11c7ae80 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.808+0000 7f2c7effd640 1 -- 172.21.15.92:0/357580020 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f2ca0063020 con 0x563b11c7ae80 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.808+0000 7f2ca8847740 10 client.25690 fetch_fsmap learned FSMap version 56 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.808+0000 7f2ca8847740 1 -- 172.21.15.92:0/357580020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x563b119b3620 con 0x563b11c7ae80 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.808+0000 7f2c7effd640 1 -- 172.21.15.92:0/357580020 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c9409feb0 con 0x563b11c7ae80 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.808+0000 7f2c7effd640 1 -- 172.21.15.92:0/357580020 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f2ca00984e0 con 0x563b11c7ae80 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.808+0000 7f2ca8847740 10 client.25690 fetch_fsmap finished waiting for FSMap version 56 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.809+0000 7f2ca8847740 10 client.25690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.809+0000 7f2ca8847740 20 client.25690 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.809+0000 7f2ca8847740 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563b11c93880 0x563b11c95ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.809+0000 7f2ca8847740 4 client.25690 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:47:53.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.809+0000 7f2ca8847740 1 -- 172.21.15.92:0/357580020 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b11be1a20 con 0x563b11c93880 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.809+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563b11c93880 0x563b11c95ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.809+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563b11c93880 0x563b11c95ca0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be46686487c8ac90 server_cookie=d29153673bb37ae6 in_seq=0 out_seq=0 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.809+0000 7f2c7effd640 10 client.25690 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2c7effd640 1 -- 172.21.15.92:0/357580020 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b11be1a20 con 0x563b11c93880 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2c7effd640 10 client.25690 handle_command_reply: tid=0 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 client.25690 shutdown 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 -- 172.21.15.92:0/357580020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c7ae80 msgr2=0x563b11c78840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c7ae80 0x563b11c78840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0067b40 tx=0x7f2ca0096bd0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 -- 172.21.15.92:0/357580020 shutdown_connections 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c7ae80 0x563b11c78840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c705e0 0x563b11c78300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563b11c93880 0x563b11c95ca0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 --2- 172.21.15.92:0/357580020 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c6fcc0 0x563b11c77dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 -- 172.21.15.92:0/357580020 >> 172.21.15.92:0/357580020 conn(0x563b11c6c230 msgr2=0x563b11c71f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2c7effd640 0 client.25690 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 -- 172.21.15.92:0/357580020 shutdown_connections 2024-09-10T10:47:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 1 -- 172.21.15.92:0/357580020 wait complete. 2024-09-10T10:47:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.810+0000 7f2ca8847740 20 client.25690 trim_cache size 0 max 16384 2024-09-10T10:47:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.829+0000 7f2ca8847740 1 Processor -- start 2024-09-10T10:47:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.829+0000 7f2ca8847740 1 -- start start 2024-09-10T10:47:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.829+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c72730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.829+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 0x563b11c6b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.829+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c9b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2ca8847740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9813ef00 con 0x563b11c6fcc0 2024-09-10T10:47:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2ca8847740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2c98140b00 con 0x563b11c7ae80 2024-09-10T10:47:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2ca8847740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9813f5d0 con 0x563b11c705e0 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c9b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c72730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9ffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c9b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:37622/0 (socket says 172.21.15.92:37622) 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9ffff640 1 -- 172.21.15.92:0/1002877238 learned_addr learned my addr 172.21.15.92:0/1002877238 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c72730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42188/0 (socket says 172.21.15.92:42188) 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 0x563b11c6b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9ffff640 1 -- 172.21.15.92:0/1002877238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 msgr2=0x563b11c6b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/1002877238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 0x563b11c6b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9ffff640 1 -- 172.21.15.92:0/1002877238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 msgr2=0x563b11c72730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/1002877238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c72730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9ffff640 1 -- 172.21.15.92:0/1002877238 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b11c6a7b0 con 0x563b11c7ae80 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/1002877238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c72730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:47:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/1002877238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c9b5b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0098900 tx=0x7f2ca0068340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d564527a053d54f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c897fa640 1 -- 172.21.15.92:0/1002877238 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00c6030 con 0x563b11c7ae80 2024-09-10T10:47:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c897fa640 1 -- 172.21.15.92:0/1002877238 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ca00b3070 con 0x563b11c7ae80 2024-09-10T10:47:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.830+0000 7f2c897fa640 1 -- 172.21.15.92:0/1002877238 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0098b70 con 0x563b11c7ae80 2024-09-10T10:47:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.831+0000 7f2ca8847740 1 -- 172.21.15.92:0/1002877238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 msgr2=0x563b11c9b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.831+0000 7f2ca8847740 1 --2- 172.21.15.92:0/1002877238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c9b5b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0098900 tx=0x7f2ca0068340 comp rx=0 tx=0).stop 2024-09-10T10:47:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.831+0000 7f2ca8847740 1 -- 172.21.15.92:0/1002877238 shutdown_connections 2024-09-10T10:47:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.831+0000 7f2ca8847740 1 --2- 172.21.15.92:0/1002877238 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c9b5b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.831+0000 7f2ca8847740 1 --2- 172.21.15.92:0/1002877238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 0x563b11c6b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.831+0000 7f2ca8847740 1 --2- 172.21.15.92:0/1002877238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c72730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.831+0000 7f2ca8847740 1 -- 172.21.15.92:0/1002877238 >> 172.21.15.92:0/1002877238 conn(0x563b11c6c230 msgr2=0x563b11c6aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.831+0000 7f2ca8847740 1 -- 172.21.15.92:0/1002877238 shutdown_connections 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.831+0000 7f2ca8847740 1 -- 172.21.15.92:0/1002877238 wait complete. 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2ca8847740 1 -- start start 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2ca8847740 1 Processor -- start 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c8b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 0x563b11c8bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2ca8847740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c74400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2ca8847740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c98140430 con 0x563b11c6fcc0 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2ca8847740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9813fca0 con 0x563b11c7ae80 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2ca8847740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9813cf00 con 0x563b11c705e0 2024-09-10T10:47:53.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c8b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.832+0000 7f2c9f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c8b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42202/0 (socket says 172.21.15.92:42202) 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/2163424612 learned_addr learned my addr 172.21.15.92:0/2163424612 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c9effd640 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 0x563b11c8bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c9ffff640 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c74400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2ca8847740 10 client.0 _ll_register_callbacks cb 0x7f2ca00689d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/2163424612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 msgr2=0x563b11c8bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 0x563b11c8bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/2163424612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 msgr2=0x563b11c74400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c74400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c9f7fe640 1 -- 172.21.15.92:0/2163424612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b11c749c0 con 0x563b11c6fcc0 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c9f7fe640 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c8b700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2c9409c180 tx=0x7f2c94009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0d18bb9b747871 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c7effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:47:53.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.833+0000 7f2c7effd640 1 -- 172.21.15.92:0/2163424612 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9409f110 con 0x563b11c6fcc0 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2c7effd640 1 -- 172.21.15.92:0/2163424612 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8455+0+0 (secure 0 0 0) 0x7f2c940db040 con 0x563b11c6fcc0 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2ca8847740 1 -- 172.21.15.92:0/2163424612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca00b3070 con 0x563b11c6fcc0 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2c7effd640 1 -- 172.21.15.92:0/2163424612 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f2c9409f2f0 con 0x563b11c6fcc0 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2ca8847740 10 client.16182 fetch_fsmap learned FSMap version 56 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2ca8847740 1 -- 172.21.15.92:0/2163424612 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x563b11cfde90 con 0x563b11c6fcc0 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2c7effd640 1 -- 172.21.15.92:0/2163424612 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ca00b3070 con 0x563b11c6fcc0 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2c7effd640 1 -- 172.21.15.92:0/2163424612 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f2c94019070 con 0x563b11c6fcc0 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2ca8847740 10 client.16182 fetch_fsmap finished waiting for FSMap version 56 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2ca8847740 10 client.16182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.834+0000 7f2ca8847740 20 client.16182 populate_metadata read hostname 'smithi092' 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.835+0000 7f2ca8847740 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563b11cfe220 0x563b11d00640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.835+0000 7f2ca8847740 4 client.16182 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:47:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.835+0000 7f2ca8847740 1 -- 172.21.15.92:0/2163424612 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563b11bdbd70 con 0x563b11cfe220 2024-09-10T10:47:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.835+0000 7f2c9effd640 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563b11cfe220 0x563b11d00640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:47:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.835+0000 7f2c7effd640 10 client.16182 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.835+0000 7f2c9effd640 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563b11cfe220 0x563b11d00640 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d243121e99ac407b server_cookie=12e743a7ce78db9b in_seq=0 out_seq=0 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.847+0000 7f2c7effd640 1 -- 172.21.15.92:0/2163424612 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563b11bdbd70 con 0x563b11cfe220 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.847+0000 7f2c7effd640 10 client.16182 handle_command_reply: tid=0 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 client.16182 shutdown 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 -- 172.21.15.92:0/2163424612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 msgr2=0x563b11c8b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c8b700 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2c9409c180 tx=0x7f2c94009f90 comp rx=0 tx=0).stop 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 -- 172.21.15.92:0/2163424612 shutdown_connections 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x563b11cfe220 0x563b11d00640 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x563b11c7ae80 0x563b11c74400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2c7effd640 0 client.16182 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:47:53.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b11c705e0 0x563b11c8bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 --2- 172.21.15.92:0/2163424612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563b11c6fcc0 0x563b11c8b700 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 -- 172.21.15.92:0/2163424612 >> 172.21.15.92:0/2163424612 conn(0x563b11c6c230 msgr2=0x563b11c79620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 -- 172.21.15.92:0/2163424612 shutdown_connections 2024-09-10T10:47:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 1 -- 172.21.15.92:0/2163424612 wait complete. 2024-09-10T10:47:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.848+0000 7f2ca8847740 20 client.16182 trim_cache size 0 max 16384 2024-09-10T10:47:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:47:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:47:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:47:53.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:47:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 -- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2c900a2d80 msgr2=0x7f2c900a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2c900a2d80 0x7f2c900a5240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0051790 tx=0x7f2ca0079040 comp rx=0 tx=0).stop 2024-09-10T10:47:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 -- 172.21.15.92:0/2754881038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c98094b70 msgr2=0x7f2c9812bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:47:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c98094b70 0x7f2c9812bdd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009d20 tx=0x7f2c9400c6a0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 -- 172.21.15.92:0/2754881038 shutdown_connections 2024-09-10T10:47:53.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2c900a2d80 0x7f2c900a5240 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2c98130690 0x7f2c98130b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c98099880 0x7f2c9812c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 --2- 172.21.15.92:0/2754881038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c98094b70 0x7f2c9812bdd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:47:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 -- 172.21.15.92:0/2754881038 >> 172.21.15.92:0/2754881038 conn(0x7f2c9800a1e0 msgr2=0x7f2c98098360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:47:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 -- 172.21.15.92:0/2754881038 shutdown_connections 2024-09-10T10:47:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:47:53.849+0000 7f2ca4843640 1 -- 172.21.15.92:0/2754881038 wait complete. 2024-09-10T10:47:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:53 smithi121 ceph-mon[35231]: pgmap v351: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 594 op/s 2024-09-10T10:47:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:53 smithi097 ceph-mon[35213]: pgmap v351: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 594 op/s 2024-09-10T10:47:54.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:53 smithi092 ceph-mon[30834]: pgmap v351: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 594 op/s 2024-09-10T10:47:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:47:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:47:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:47:55.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:47:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:47:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:47:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:47:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:47:55.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:47:55.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:47:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:47:55.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:47:56.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:55 smithi121 ceph-mon[35231]: pgmap v352: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 594 op/s 2024-09-10T10:47:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:55 smithi097 ceph-mon[35213]: pgmap v352: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 594 op/s 2024-09-10T10:47:56.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:55 smithi092 ceph-mon[30834]: pgmap v352: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 594 op/s 2024-09-10T10:47:58.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:57 smithi121 ceph-mon[35231]: pgmap v353: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 859 op/s 2024-09-10T10:47:58.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:57 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:47:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:57 smithi097 ceph-mon[35213]: pgmap v353: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 859 op/s 2024-09-10T10:47:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:57 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:47:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:57 smithi092 ceph-mon[30834]: pgmap v353: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 859 op/s 2024-09-10T10:47:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:57 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:47:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 660.0 s, 2088.2 tps, lat 47.833 ms stddev 57.307 2024-09-10T10:48:00.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:47:59 smithi121 ceph-mon[35231]: pgmap v354: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.6 MiB/s wr, 527 op/s 2024-09-10T10:48:00.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:47:59 smithi097 ceph-mon[35213]: pgmap v354: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.6 MiB/s wr, 527 op/s 2024-09-10T10:48:00.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:47:59 smithi092 ceph-mon[30834]: pgmap v354: 97 pgs: 97 active+clean; 5.1 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.6 MiB/s wr, 527 op/s 2024-09-10T10:48:02.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:01 smithi121 ceph-mon[35231]: pgmap v355: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 10 MiB/s wr, 814 op/s 2024-09-10T10:48:02.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:01 smithi097 ceph-mon[35213]: pgmap v355: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 10 MiB/s wr, 814 op/s 2024-09-10T10:48:02.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:01 smithi092 ceph-mon[30834]: pgmap v355: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 10 MiB/s wr, 814 op/s 2024-09-10T10:48:03.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:02 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:48:03.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:02 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:48:03.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:02 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:48:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 665.0 s, 1220.6 tps, lat 80.214 ms stddev 118.676 2024-09-10T10:48:04.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:03 smithi121 ceph-mon[35231]: pgmap v356: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.6 MiB/s wr, 552 op/s 2024-09-10T10:48:04.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:03 smithi097 ceph-mon[35213]: pgmap v356: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.6 MiB/s wr, 552 op/s 2024-09-10T10:48:04.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:03 smithi092 ceph-mon[30834]: pgmap v356: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.6 MiB/s wr, 552 op/s 2024-09-10T10:48:06.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:05 smithi121 ceph-mon[35231]: pgmap v357: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.6 MiB/s wr, 552 op/s 2024-09-10T10:48:06.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:05 smithi097 ceph-mon[35213]: pgmap v357: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.6 MiB/s wr, 552 op/s 2024-09-10T10:48:06.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:05 smithi092 ceph-mon[30834]: pgmap v357: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.6 MiB/s wr, 552 op/s 2024-09-10T10:48:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:06.994+0000 7f62bcb6d640 1 -- 172.21.15.92:0/2084069174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62b8100d60 msgr2=0x7f62b8104da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:06.994+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/2084069174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62b8100d60 0x7f62b8104da0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f62a800fc00 tx=0x7f62a802a2a0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.001+0000 7f62bcb6d640 1 -- 172.21.15.92:0/2084069174 shutdown_connections 2024-09-10T10:48:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.001+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/2084069174 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62b8105500 0x7f62b810d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.001+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/2084069174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62b8100d60 0x7f62b8104da0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.001+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/2084069174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62b81003b0 0x7f62b8100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.001+0000 7f62bcb6d640 1 -- 172.21.15.92:0/2084069174 >> 172.21.15.92:0/2084069174 conn(0x7f62b8077160 msgr2=0x7f62b80fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:07.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.004+0000 7f62bcb6d640 1 -- 172.21.15.92:0/2084069174 shutdown_connections 2024-09-10T10:48:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.005+0000 7f62bcb6d640 1 -- 172.21.15.92:0/2084069174 wait complete. 2024-09-10T10:48:07.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.006+0000 7f62bcb6d640 1 Processor -- start 2024-09-10T10:48:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62bcb6d640 1 -- start start 2024-09-10T10:48:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62bcb6d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62b81003b0 0x7f62b8073980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62bcb6d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62b8105500 0x7f62b8073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62bcb6d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62b806cb10 0x7f62b806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62bcb6d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f62b810fd30 con 0x7f62b806cb10 2024-09-10T10:48:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62bcb6d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f62b810fbb0 con 0x7f62b8105500 2024-09-10T10:48:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62bcb6d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f62b810feb0 con 0x7f62b81003b0 2024-09-10T10:48:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62b81003b0 0x7f62b8073980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62b81003b0 0x7f62b8073980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:38776/0 (socket says 172.21.15.92:38776) 2024-09-10T10:48:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.008+0000 7f62b659c640 1 -- 172.21.15.92:0/875678363 learned_addr learned my addr 172.21.15.92:0/875678363 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.010+0000 7f62b659c640 1 -- 172.21.15.92:0/875678363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62b8105500 msgr2=0x7f62b8073ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:48:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.010+0000 7f62b659c640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62b8105500 0x7f62b8073ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.010+0000 7f62b659c640 1 -- 172.21.15.92:0/875678363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62b806cb10 msgr2=0x7f62b806cfc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:48:07.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.010+0000 7f62b659c640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62b806cb10 0x7f62b806cfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.010+0000 7f62b659c640 1 -- 172.21.15.92:0/875678363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b80714a0 con 0x7f62b81003b0 2024-09-10T10:48:07.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.011+0000 7f62b659c640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62b81003b0 0x7f62b8073980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00d950 tx=0x7f62ac00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.014+0000 7f62a77fe640 1 -- 172.21.15.92:0/875678363 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac017070 con 0x7f62b81003b0 2024-09-10T10:48:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.014+0000 7f62a77fe640 1 -- 172.21.15.92:0/875678363 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62ac009c30 con 0x7f62b81003b0 2024-09-10T10:48:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.014+0000 7f62a77fe640 1 -- 172.21.15.92:0/875678363 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00f6b0 con 0x7f62b81003b0 2024-09-10T10:48:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.014+0000 7f62bcb6d640 1 -- 172.21.15.92:0/875678363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b8071730 con 0x7f62b81003b0 2024-09-10T10:48:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.014+0000 7f62bcb6d640 1 -- 172.21.15.92:0/875678363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b8071c30 con 0x7f62b81003b0 2024-09-10T10:48:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.018+0000 7f62bf9e8740 1 Processor -- start 2024-09-10T10:48:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.018+0000 7f62bf9e8740 1 -- start start 2024-09-10T10:48:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.018+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e1af0 0x561e668e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.018+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e668ec770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.018+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.018+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561e668462f0 con 0x561e668e1af0 2024-09-10T10:48:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.018+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561e667ee270 con 0x561e668eccb0 2024-09-10T10:48:07.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.018+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561e668422b0 con 0x561e668e2410 2024-09-10T10:48:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e1af0 0x561e668e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e1af0 0x561e668e1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41172/0 (socket says 172.21.15.92:41172) 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b6d9d640 1 -- 172.21.15.92:0/184114895 learned_addr learned my addr 172.21.15.92:0/184114895 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b5d9b640 1 --2- 172.21.15.92:0/184114895 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b6d9d640 1 -- 172.21.15.92:0/184114895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 msgr2=0x561e668ec770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/184114895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e668ec770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b6d9d640 1 -- 172.21.15.92:0/184114895 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 msgr2=0x561e668ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/184114895 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668ef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b6d9d640 1 -- 172.21.15.92:0/184114895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e667ed340 con 0x561e668e1af0 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62b5d9b640 1 --2- 172.21.15.92:0/184114895 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.019+0000 7f62a77fe640 1 -- 172.21.15.92:0/875678363 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f62ac00f850 con 0x7f62b81003b0 2024-09-10T10:48:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.020+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/184114895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e1af0 0x561e668e1ed0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b7d0 tx=0x7f62b000bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8c03027203d52a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.020+0000 7f62a77fe640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62a00a2fd0 0x7f62a00a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.021+0000 7f62a77fe640 1 -- 172.21.15.92:0/875678363 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8499+0+0 (secure 0 0 0) 0x7f62ac0cf010 con 0x7f62b81003b0 2024-09-10T10:48:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.021+0000 7f62b659c640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62a00a2fd0 0x7f62a00a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.022+0000 7f62a4ff9640 1 -- 172.21.15.92:0/184114895 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b000be20 con 0x561e668e1af0 2024-09-10T10:48:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.022+0000 7f62a4ff9640 1 -- 172.21.15.92:0/184114895 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b00142e0 con 0x561e668e1af0 2024-09-10T10:48:07.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.022+0000 7f62a4ff9640 1 -- 172.21.15.92:0/184114895 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0005020 con 0x561e668e1af0 2024-09-10T10:48:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.023+0000 7f62bf9e8740 1 -- 172.21.15.92:0/184114895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e1af0 msgr2=0x561e668e1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.023+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/184114895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e1af0 0x561e668e1ed0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b7d0 tx=0x7f62b000bbd0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.023+0000 7f62b659c640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62a00a2fd0 0x7f62a00a5490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x561e668deec0 tx=0x7f62ac005bd0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.023+0000 7f62bf9e8740 1 -- 172.21.15.92:0/184114895 shutdown_connections 2024-09-10T10:48:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.023+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/184114895 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.023+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/184114895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e668ec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.023+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/184114895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e1af0 0x561e668e1ed0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.023+0000 7f62bf9e8740 1 -- 172.21.15.92:0/184114895 >> 172.21.15.92:0/184114895 conn(0x561e668de060 msgr2=0x561e668de440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.025+0000 7f62bf9e8740 1 -- 172.21.15.92:0/184114895 shutdown_connections 2024-09-10T10:48:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.025+0000 7f62bf9e8740 1 -- 172.21.15.92:0/184114895 wait complete. 2024-09-10T10:48:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.025+0000 7f62bf9e8740 1 -- start start 2024-09-10T10:48:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.026+0000 7f62bf9e8740 1 Processor -- start 2024-09-10T10:48:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.026+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.026+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e668ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.026+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 0x561e668ea620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.026+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561e668ef880 con 0x561e668eccb0 2024-09-10T10:48:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.026+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x561e667cf290 con 0x561e668e1af0 2024-09-10T10:48:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.026+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561e668efa00 con 0x561e668e2410 2024-09-10T10:48:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.026+0000 7f62bf9e8740 10 client.0 _ll_register_callbacks cb 0x561e66800140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.027+0000 7f62b6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 0x561e668ea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.027+0000 7f62b6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 0x561e668ea620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41180/0 (socket says 172.21.15.92:41180) 2024-09-10T10:48:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.027+0000 7f62b6d9d640 1 -- 172.21.15.92:0/1133014085 learned_addr learned my addr 172.21.15.92:0/1133014085 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.027+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.027+0000 7f62b5d9b640 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e668ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.028+0000 7f62b6d9d640 1 -- 172.21.15.92:0/1133014085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 msgr2=0x561e668ea0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.028+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e668ea0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.028+0000 7f62b6d9d640 1 -- 172.21.15.92:0/1133014085 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 msgr2=0x561e668e9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.028+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668e9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.028+0000 7f62b6d9d640 1 -- 172.21.15.92:0/1133014085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e66559210 con 0x561e668eccb0 2024-09-10T10:48:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.028+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 0x561e668ea620 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f62b00148e0 tx=0x7f62b000abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6bd5eeefa7f393 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.028+0000 7f629dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:48:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.029+0000 7f629dffb640 1 -- 172.21.15.92:0/1133014085 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b0004e80 con 0x561e668eccb0 2024-09-10T10:48:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.029+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1133014085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b00142e0 con 0x561e668eccb0 2024-09-10T10:48:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.029+0000 7f629dffb640 1 -- 172.21.15.92:0/1133014085 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8499+0+0 (secure 0 0 0) 0x7f62b0011040 con 0x561e668eccb0 2024-09-10T10:48:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.029+0000 7f629dffb640 1 -- 172.21.15.92:0/1133014085 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f62b0003970 con 0x561e668eccb0 2024-09-10T10:48:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.030+0000 7f62bf9e8740 10 client.16191 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.030+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1133014085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x561e66625620 con 0x561e668eccb0 2024-09-10T10:48:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.036+0000 7f629dffb640 1 -- 172.21.15.92:0/1133014085 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b00142e0 con 0x561e668eccb0 2024-09-10T10:48:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.036+0000 7f629dffb640 1 -- 172.21.15.92:0/1133014085 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7f62b0005050 con 0x561e668eccb0 2024-09-10T10:48:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.037+0000 7f62bf9e8740 10 client.16191 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.037+0000 7f62bf9e8740 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.037+0000 7f62bf9e8740 20 client.16191 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.037+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561e668fcbd0 0x561e668fefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.037+0000 7f62bf9e8740 4 client.16191 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:48:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.037+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1133014085 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e66853a20 con 0x561e668fcbd0 2024-09-10T10:48:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.044+0000 7f62b5d9b640 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561e668fcbd0 0x561e668fefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.047+0000 7f62b5d9b640 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561e668fcbd0 0x561e668fefc0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cff6fb898035c78 server_cookie=339a2bc6cef834d in_seq=0 out_seq=0 2024-09-10T10:48:07.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.047+0000 7f629dffb640 10 client.16191 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:07.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.048+0000 7f629dffb640 1 -- 172.21.15.92:0/1133014085 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e66853a20 con 0x561e668fcbd0 2024-09-10T10:48:07.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.048+0000 7f629dffb640 10 client.16191 handle_command_reply: tid=0 2024-09-10T10:48:07.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.051+0000 7f62bf9e8740 1 client.16191 shutdown 2024-09-10T10:48:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.055+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1133014085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 msgr2=0x561e668ea620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:07.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.055+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 0x561e668ea620 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f62b00148e0 tx=0x7f62b000abe0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.058+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1133014085 shutdown_connections 2024-09-10T10:48:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.058+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 0x561e668ea620 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.058+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e668ea0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.058+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561e668fcbd0 0x561e668fefc0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.058+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1133014085 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668e9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.058+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1133014085 >> 172.21.15.92:0/1133014085 conn(0x561e668de060 msgr2=0x561e668e3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:07.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.058+0000 7f629dffb640 0 client.16191 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:07.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.067+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1133014085 shutdown_connections 2024-09-10T10:48:07.070 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.068+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1133014085 wait complete. 2024-09-10T10:48:07.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.072+0000 7f62bf9e8740 20 client.16191 trim_cache size 0 max 16384 2024-09-10T10:48:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.103+0000 7f62bf9e8740 1 Processor -- start 2024-09-10T10:48:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.104+0000 7f62bf9e8740 1 -- start start 2024-09-10T10:48:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.104+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668ea450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.104+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e66904750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.104+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 0x561e66904c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.104+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f629800e800 con 0x561e668eccb0 2024-09-10T10:48:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.104+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f62980103a0 con 0x561e668e1af0 2024-09-10T10:48:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.104+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f629800eed0 con 0x561e668e2410 2024-09-10T10:48:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.105+0000 7f62b6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.105+0000 7f62b6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668ea450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:42962/0 (socket says 172.21.15.92:42962) 2024-09-10T10:48:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.105+0000 7f62b6d9d640 1 -- 172.21.15.92:0/985047548 learned_addr learned my addr 172.21.15.92:0/985047548 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.105+0000 7f62b5d9b640 1 --2- 172.21.15.92:0/985047548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e66904750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.106+0000 7f62b6d9d640 1 -- 172.21.15.92:0/985047548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 msgr2=0x561e66904750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.106+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/985047548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e66904750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.106+0000 7f62b6d9d640 1 -- 172.21.15.92:0/985047548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 msgr2=0x561e66904c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.106+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/985047548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 0x561e66904c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.106+0000 7f62b6d9d640 1 -- 172.21.15.92:0/985047548 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e668decf0 con 0x561e668e1af0 2024-09-10T10:48:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.107+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/985047548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668ea450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62b000aa10 tx=0x7f62b000bbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d19bcf705233ef84 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.111+0000 7f629ffff640 1 -- 172.21.15.92:0/985047548 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00142e0 con 0x561e668e1af0 2024-09-10T10:48:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.111+0000 7f629ffff640 1 -- 172.21.15.92:0/985047548 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b00057c0 con 0x561e668e1af0 2024-09-10T10:48:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.111+0000 7f629ffff640 1 -- 172.21.15.92:0/985047548 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b001e5c0 con 0x561e668e1af0 2024-09-10T10:48:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.113+0000 7f62bf9e8740 1 -- 172.21.15.92:0/985047548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 msgr2=0x561e668ea450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.113+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/985047548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668ea450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f62b000aa10 tx=0x7f62b000bbd0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.114+0000 7f62bf9e8740 1 -- 172.21.15.92:0/985047548 shutdown_connections 2024-09-10T10:48:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.114+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/985047548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668eccb0 0x561e66904c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.114+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/985047548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e2410 0x561e66904750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.114+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/985047548 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668e1af0 0x561e668ea450 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.114+0000 7f62bf9e8740 1 -- 172.21.15.92:0/985047548 >> 172.21.15.92:0/985047548 conn(0x561e668de060 msgr2=0x561e668ebc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:07.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.117+0000 7f62bf9e8740 1 -- 172.21.15.92:0/985047548 shutdown_connections 2024-09-10T10:48:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.121+0000 7f62bf9e8740 1 -- 172.21.15.92:0/985047548 wait complete. 2024-09-10T10:48:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.121+0000 7f62bf9e8740 1 -- start start 2024-09-10T10:48:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.121+0000 7f62bf9e8740 1 Processor -- start 2024-09-10T10:48:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.121+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e1af0 0x561e668f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.121+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e2410 0x561e668f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.121+0000 7f62bf9e8740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.122+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f629800fcd0 con 0x561e668e2410 2024-09-10T10:48:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.122+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f629800f5a0 con 0x561e668eccb0 2024-09-10T10:48:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.122+0000 7f62bf9e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f629800c800 con 0x561e668e1af0 2024-09-10T10:48:07.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.122+0000 7f62bf9e8740 10 client.0 _ll_register_callbacks cb 0x7f62b000a940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.124+0000 7f62b6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.124+0000 7f62b6d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668f03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:42978/0 (socket says 172.21.15.92:42978) 2024-09-10T10:48:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.124+0000 7f62b6d9d640 1 -- 172.21.15.92:0/1325322751 learned_addr learned my addr 172.21.15.92:0/1325322751 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.124+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e1af0 0x561e668f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.124+0000 7f62b5d9b640 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e2410 0x561e668f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.125+0000 7f62b6d9d640 1 -- 172.21.15.92:0/1325322751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e1af0 msgr2=0x561e668f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.125+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e1af0 0x561e668f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.125+0000 7f62b6d9d640 1 -- 172.21.15.92:0/1325322751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e2410 msgr2=0x561e668f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.125+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e2410 0x561e668f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.125+0000 7f62b6d9d640 1 -- 172.21.15.92:0/1325322751 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e668d92d0 con 0x561e668eccb0 2024-09-10T10:48:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.125+0000 7f62b6d9d640 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668f03d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f62b0005d70 tx=0x7f62b000b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ac948d1de74387c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.126+0000 7f629dffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:48:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.129+0000 7f629dffb640 1 -- 172.21.15.92:0/1325322751 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b00052c0 con 0x561e668eccb0 2024-09-10T10:48:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.129+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1325322751 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b00057c0 con 0x561e668eccb0 2024-09-10T10:48:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.129+0000 7f629dffb640 1 -- 172.21.15.92:0/1325322751 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8499+0+0 (secure 0 0 0) 0x7f62b0011070 con 0x561e668eccb0 2024-09-10T10:48:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.130+0000 7f629dffb640 1 -- 172.21.15.92:0/1325322751 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f62b001e440 con 0x561e668eccb0 2024-09-10T10:48:07.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.130+0000 7f62bf9e8740 10 client.25691 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.130+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1325322751 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x561e669670f0 con 0x561e668eccb0 2024-09-10T10:48:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.138+0000 7f629dffb640 1 -- 172.21.15.92:0/1325322751 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b00057c0 con 0x561e668eccb0 2024-09-10T10:48:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.139+0000 7f629dffb640 1 -- 172.21.15.92:0/1325322751 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7f62b0032040 con 0x561e668eccb0 2024-09-10T10:48:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.142+0000 7f62bf9e8740 10 client.25691 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.142+0000 7f62bf9e8740 10 client.25691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.142+0000 7f62bf9e8740 20 client.25691 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.142+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561e66967650 0x561e66969a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.142+0000 7f62bf9e8740 4 client.25691 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:48:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.142+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1325322751 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e6684dd70 con 0x561e66967650 2024-09-10T10:48:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.143+0000 7f62b5d9b640 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561e66967650 0x561e66969a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.143+0000 7f62b5d9b640 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561e66967650 0x561e66969a40 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78896012a3e14261 server_cookie=fc60f28f9029a2a4 in_seq=0 out_seq=0 2024-09-10T10:48:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.143+0000 7f629dffb640 10 client.25691 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.167+0000 7f629dffb640 1 -- 172.21.15.92:0/1325322751 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e6684dd70 con 0x561e66967650 2024-09-10T10:48:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.167+0000 7f629dffb640 10 client.25691 handle_command_reply: tid=0 2024-09-10T10:48:07.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.167+0000 7f62bf9e8740 1 client.25691 shutdown 2024-09-10T10:48:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.170+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1325322751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 msgr2=0x561e668f03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:07.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.170+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668f03d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f62b0005d70 tx=0x7f62b000b730 comp rx=0 tx=0).stop 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.171+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1325322751 shutdown_connections 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.171+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x561e66967650 0x561e66969a40 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.171+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x561e668eccb0 0x561e668f03d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.171+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561e668e2410 0x561e668f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.171+0000 7f62bf9e8740 1 --2- 172.21.15.92:0/1325322751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561e668e1af0 0x561e668f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.171+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1325322751 >> 172.21.15.92:0/1325322751 conn(0x561e668de060 msgr2=0x561e668e3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.172+0000 7f629dffb640 0 client.25691 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.172+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1325322751 shutdown_connections 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.172+0000 7f62bf9e8740 1 -- 172.21.15.92:0/1325322751 wait complete. 2024-09-10T10:48:07.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.172+0000 7f62bf9e8740 20 client.25691 trim_cache size 0 max 16384 2024-09-10T10:48:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:48:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:48:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:48:07.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 -- 172.21.15.92:0/875678363 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62a00a2fd0 msgr2=0x7f62a00a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62a00a2fd0 0x7f62a00a5490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x561e668deec0 tx=0x7f62ac005bd0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 -- 172.21.15.92:0/875678363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62b81003b0 msgr2=0x7f62b8073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62b81003b0 0x7f62b8073980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00d950 tx=0x7f62ac00de10 comp rx=0 tx=0).stop 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 -- 172.21.15.92:0/875678363 shutdown_connections 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62b806cb10 0x7f62b806cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f62a00a2fd0 0x7f62a00a5490 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f62b8105500 0x7f62b8073ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 --2- 172.21.15.92:0/875678363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f62b81003b0 0x7f62b8073980 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.174+0000 7f62bcb6d640 1 -- 172.21.15.92:0/875678363 >> 172.21.15.92:0/875678363 conn(0x7f62b8077160 msgr2=0x7f62b8103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:07.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.175+0000 7f62bcb6d640 1 -- 172.21.15.92:0/875678363 shutdown_connections 2024-09-10T10:48:07.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:07.175+0000 7f62bcb6d640 1 -- 172.21.15.92:0/875678363 wait complete. 2024-09-10T10:48:08.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:07 smithi121 ceph-mon[35231]: pgmap v358: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.7 MiB/s wr, 721 op/s 2024-09-10T10:48:08.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:07 smithi121 ceph-mon[35231]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T10:48:08.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:07 smithi097 ceph-mon[35213]: pgmap v358: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.7 MiB/s wr, 721 op/s 2024-09-10T10:48:08.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:07 smithi097 ceph-mon[35213]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T10:48:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:07 smithi092 ceph-mon[30834]: pgmap v358: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.7 MiB/s wr, 721 op/s 2024-09-10T10:48:08.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:07 smithi092 ceph-mon[30834]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T10:48:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 670.0 s, 243.6 tps, lat 403.820 ms stddev 279.325 2024-09-10T10:48:10.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:09 smithi121 ceph-mon[35231]: pgmap v360: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.5 MiB/s wr, 547 op/s 2024-09-10T10:48:10.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:09 smithi097 ceph-mon[35213]: pgmap v360: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.5 MiB/s wr, 547 op/s 2024-09-10T10:48:10.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:09 smithi092 ceph-mon[30834]: pgmap v360: 97 pgs: 97 active+clean; 5.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.5 MiB/s wr, 547 op/s 2024-09-10T10:48:12.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:11 smithi121 ceph-mon[35231]: pgmap v361: 97 pgs: 97 active+clean; 4.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.5 MiB/s wr, 378 op/s 2024-09-10T10:48:12.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:11 smithi097 ceph-mon[35213]: pgmap v361: 97 pgs: 97 active+clean; 4.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.5 MiB/s wr, 378 op/s 2024-09-10T10:48:12.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:11 smithi092 ceph-mon[30834]: pgmap v361: 97 pgs: 97 active+clean; 4.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.5 MiB/s wr, 378 op/s 2024-09-10T10:48:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 675.0 s, 554.6 tps, lat 185.970 ms stddev 266.533 2024-09-10T10:48:14.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:13 smithi121 ceph-mon[35231]: pgmap v362: 97 pgs: 97 active+clean; 4.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.5 MiB/s wr, 378 op/s 2024-09-10T10:48:14.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:13 smithi097 ceph-mon[35213]: pgmap v362: 97 pgs: 97 active+clean; 4.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.5 MiB/s wr, 378 op/s 2024-09-10T10:48:14.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:13 smithi092 ceph-mon[30834]: pgmap v362: 97 pgs: 97 active+clean; 4.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.5 MiB/s wr, 378 op/s 2024-09-10T10:48:15.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:15 smithi121 ceph-mon[35231]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T10:48:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:15 smithi097 ceph-mon[35213]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T10:48:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:15 smithi092 ceph-mon[30834]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T10:48:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:16 smithi121 ceph-mon[35231]: pgmap v364: 97 pgs: 97 active+clean; 4.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.6 MiB/s wr, 220 op/s 2024-09-10T10:48:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:16 smithi097 ceph-mon[35213]: pgmap v364: 97 pgs: 97 active+clean; 4.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.6 MiB/s wr, 220 op/s 2024-09-10T10:48:16.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:16 smithi092 ceph-mon[30834]: pgmap v364: 97 pgs: 97 active+clean; 4.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.6 MiB/s wr, 220 op/s 2024-09-10T10:48:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 680.0 s, 2002.2 tps, lat 50.570 ms stddev 57.517 2024-09-10T10:48:18.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:18 smithi121 ceph-mon[35231]: pgmap v365: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 1.82k op/s 2024-09-10T10:48:18.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:18 smithi097 ceph-mon[35213]: pgmap v365: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 1.82k op/s 2024-09-10T10:48:18.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:18 smithi092 ceph-mon[30834]: pgmap v365: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 26 MiB/s wr, 1.82k op/s 2024-09-10T10:48:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.318+0000 7f411301e640 1 -- 172.21.15.92:0/318266435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f410c1091f0 msgr2=0x7f410c110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.318+0000 7f411301e640 1 --2- 172.21.15.92:0/318266435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f410c1091f0 0x7f410c110250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009890 tx=0x7f40f402a390 comp rx=0 tx=0).stop 2024-09-10T10:48:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.324+0000 7f411301e640 1 -- 172.21.15.92:0/318266435 shutdown_connections 2024-09-10T10:48:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.324+0000 7f411301e640 1 --2- 172.21.15.92:0/318266435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f410c11b140 0x7f410c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.324+0000 7f411301e640 1 --2- 172.21.15.92:0/318266435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f410c1095d0 0x7f410c109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.324+0000 7f411301e640 1 --2- 172.21.15.92:0/318266435 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f410c1091f0 0x7f410c110250 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.324+0000 7f411301e640 1 -- 172.21.15.92:0/318266435 >> 172.21.15.92:0/318266435 conn(0x7f410c06ce00 msgr2=0x7f410c06d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.324+0000 7f411301e640 1 -- 172.21.15.92:0/318266435 shutdown_connections 2024-09-10T10:48:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.325+0000 7f411301e640 1 -- 172.21.15.92:0/318266435 wait complete. 2024-09-10T10:48:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.326+0000 7f411301e640 1 Processor -- start 2024-09-10T10:48:20.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.326+0000 7f411301e640 1 -- start start 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.326+0000 7f411301e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f410c1091f0 0x7f410c118670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.326+0000 7f411301e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f410c1095d0 0x7f410c118bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.326+0000 7f411301e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f410c11b140 0x7f410c111970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.326+0000 7f411301e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f410c120cf0 con 0x7f410c1091f0 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.326+0000 7f411301e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f410c120b70 con 0x7f410c11b140 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.326+0000 7f411301e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f410c120e70 con 0x7f410c1095d0 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.326+0000 7f4110dba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f410c1091f0 0x7f410c118670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.327+0000 7f41115bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f410c11b140 0x7f410c111970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.327+0000 7f41115bb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f410c11b140 0x7f410c111970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:34512/0 (socket says 172.21.15.92:34512) 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.327+0000 7f41115bb640 1 -- 172.21.15.92:0/299286861 learned_addr learned my addr 172.21.15.92:0/299286861 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.327+0000 7f4110dba640 1 -- 172.21.15.92:0/299286861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f410c1095d0 msgr2=0x7f410c118bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.327+0000 7f4110dba640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f410c1095d0 0x7f410c118bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.328+0000 7f4110dba640 1 -- 172.21.15.92:0/299286861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f410c11b140 msgr2=0x7f410c111970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.328+0000 7f4110dba640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f410c11b140 0x7f410c111970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.328+0000 7f4110dba640 1 -- 172.21.15.92:0/299286861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410c112230 con 0x7f410c1091f0 2024-09-10T10:48:20.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.328+0000 7f4110dba640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f410c1091f0 0x7f410c118670 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009890 tx=0x7f40f4033d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.329+0000 7f4109ffb640 1 -- 172.21.15.92:0/299286861 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4037040 con 0x7f410c1091f0 2024-09-10T10:48:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.329+0000 7f4109ffb640 1 -- 172.21.15.92:0/299286861 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f4040070 con 0x7f410c1091f0 2024-09-10T10:48:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.329+0000 7f4109ffb640 1 -- 172.21.15.92:0/299286861 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f40054e0 con 0x7f410c1091f0 2024-09-10T10:48:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.330+0000 7f411301e640 1 -- 172.21.15.92:0/299286861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410c1124c0 con 0x7f410c1091f0 2024-09-10T10:48:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.330+0000 7f411301e640 1 -- 172.21.15.92:0/299286861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f410c116370 con 0x7f410c1091f0 2024-09-10T10:48:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.336+0000 7f4109ffb640 1 -- 172.21.15.92:0/299286861 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f40f4004240 con 0x7f410c1091f0 2024-09-10T10:48:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.337+0000 7f4115e8d740 1 Processor -- start 2024-09-10T10:48:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.337+0000 7f4115e8d740 1 -- start start 2024-09-10T10:48:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.342+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83aaaf0 0x55c3a83aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.342+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.342+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83b5cb0 0x55c3a83b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.342+0000 7f41115bb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83aaaf0 0x55c3a83aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.342+0000 7f41115bb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83aaaf0 0x55c3a83aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:43040/0 (socket says 172.21.15.92:43040) 2024-09-10T10:48:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.342+0000 7f41115bb640 1 -- 172.21.15.92:0/4167198694 learned_addr learned my addr 172.21.15.92:0/4167198694 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.342+0000 7f4115e8d740 1 -- 172.21.15.92:0/4167198694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c3a830f2f0 con 0x55c3a83ab410 2024-09-10T10:48:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.342+0000 7f4115e8d740 1 -- 172.21.15.92:0/4167198694 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55c3a82b7270 con 0x55c3a83b5cb0 2024-09-10T10:48:20.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.342+0000 7f4115e8d740 1 -- 172.21.15.92:0/4167198694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c3a830b2b0 con 0x55c3a83aaaf0 2024-09-10T10:48:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.344+0000 7f4110dba640 1 --2- 172.21.15.92:0/4167198694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.344+0000 7f4109ffb640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f40f80a2fd0 0x7f40f80a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.344+0000 7f4109ffb640 1 -- 172.21.15.92:0/299286861 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7f40f40eec70 con 0x7f410c1091f0 2024-09-10T10:48:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.346+0000 7f41115bb640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f40f80a2fd0 0x7f40f80a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.346+0000 7f41115bb640 1 -- 172.21.15.92:0/4167198694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83b5cb0 msgr2=0x55c3a83b80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:20.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.346+0000 7f41115bb640 1 --2- 172.21.15.92:0/4167198694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83b5cb0 0x55c3a83b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.346+0000 7f41115bb640 1 -- 172.21.15.92:0/4167198694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 msgr2=0x55c3a83b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.346+0000 7f41115bb640 1 --2- 172.21.15.92:0/4167198694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.346+0000 7f41115bb640 1 -- 172.21.15.92:0/4167198694 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a82b6340 con 0x55c3a83aaaf0 2024-09-10T10:48:20.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.346+0000 7f41115bb640 1 --2- 172.21.15.92:0/4167198694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83aaaf0 0x55c3a83aaed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4104005f40 tx=0x7f4104013f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=901b1d4687d3e93d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:20.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.348+0000 7f41115bb640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f40f80a2fd0 0x7f40f80a5490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4104022000 tx=0x7f4104020000 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.350+0000 7f4102ffd640 1 -- 172.21.15.92:0/4167198694 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104013500 con 0x55c3a83aaaf0 2024-09-10T10:48:20.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.350+0000 7f4102ffd640 1 -- 172.21.15.92:0/4167198694 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4104023070 con 0x55c3a83aaaf0 2024-09-10T10:48:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.351+0000 7f4115e8d740 1 -- 172.21.15.92:0/4167198694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83aaaf0 msgr2=0x55c3a83aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.351+0000 7f4115e8d740 1 --2- 172.21.15.92:0/4167198694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83aaaf0 0x55c3a83aaed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4104005f40 tx=0x7f4104013f50 comp rx=0 tx=0).stop 2024-09-10T10:48:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.355+0000 7f4115e8d740 1 -- 172.21.15.92:0/4167198694 shutdown_connections 2024-09-10T10:48:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.355+0000 7f4115e8d740 1 --2- 172.21.15.92:0/4167198694 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83b5cb0 0x55c3a83b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.355+0000 7f4115e8d740 1 --2- 172.21.15.92:0/4167198694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.355+0000 7f4115e8d740 1 --2- 172.21.15.92:0/4167198694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83aaaf0 0x55c3a83aaed0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.357 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.355+0000 7f4115e8d740 1 -- 172.21.15.92:0/4167198694 >> 172.21.15.92:0/4167198694 conn(0x55c3a83a7060 msgr2=0x55c3a83a7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:20.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.359+0000 7f4115e8d740 1 -- 172.21.15.92:0/4167198694 shutdown_connections 2024-09-10T10:48:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.359+0000 7f4115e8d740 1 -- 172.21.15.92:0/4167198694 wait complete. 2024-09-10T10:48:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.360+0000 7f4115e8d740 1 -- start start 2024-09-10T10:48:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.360+0000 7f4115e8d740 1 Processor -- start 2024-09-10T10:48:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 0x55c3a83b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f4115e8d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c3a83b88d0 con 0x55c3a83ab410 2024-09-10T10:48:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f4115e8d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55c3a8298290 con 0x55c3a83aaaf0 2024-09-10T10:48:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f4115e8d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c3a83b8a50 con 0x55c3a83b5cb0 2024-09-10T10:48:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f4115e8d740 10 client.0 _ll_register_callbacks cb 0x55c3a82c9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f410bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f4110dba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f410bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:32960/0 (socket says 172.21.15.92:32960) 2024-09-10T10:48:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f4110dba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:34530/0 (socket says 172.21.15.92:34530) 2024-09-10T10:48:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f410bfff640 1 -- 172.21.15.92:0/2277533861 learned_addr learned my addr 172.21.15.92:0/2277533861 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.361+0000 7f41115bb640 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 0x55c3a83b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f4110dba640 1 -- 172.21.15.92:0/2277533861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 msgr2=0x55c3a83b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f4110dba640 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 0x55c3a83b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f4110dba640 1 -- 172.21.15.92:0/2277533861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 msgr2=0x55c3a83b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f4110dba640 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f4110dba640 1 -- 172.21.15.92:0/2277533861 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a8022210 con 0x55c3a83aaaf0 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f4110dba640 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83b2b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f40f40ec480 tx=0x7f40f40b7b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b81e3d13b201add5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f40ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f40ebfff640 1 -- 172.21.15.92:0/2277533861 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f40b93c0 con 0x55c3a83aaaf0 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f40ebfff640 1 -- 172.21.15.92:0/2277533861 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7f40f40c3c70 con 0x55c3a83aaaf0 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f4115e8d740 1 -- 172.21.15.92:0/2277533861 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4104023070 con 0x55c3a83aaaf0 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f40ebfff640 1 -- 172.21.15.92:0/2277533861 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f40f40d4280 con 0x55c3a83aaaf0 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f4115e8d740 10 client.25700 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f4115e8d740 1 -- 172.21.15.92:0/2277533861 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55c3a80ee620 con 0x55c3a83aaaf0 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.362+0000 7f40ebfff640 1 -- 172.21.15.92:0/2277533861 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4104023070 con 0x55c3a83aaaf0 2024-09-10T10:48:20.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.363+0000 7f40ebfff640 1 -- 172.21.15.92:0/2277533861 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7f40f403a070 con 0x55c3a83aaaf0 2024-09-10T10:48:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.364+0000 7f4115e8d740 10 client.25700 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.364+0000 7f4115e8d740 10 client.25700 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.364+0000 7f4115e8d740 20 client.25700 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.364+0000 7f4115e8d740 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c3a83c5d00 0x55c3a83c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.364+0000 7f4115e8d740 4 client.25700 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:48:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.364+0000 7f410bfff640 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c3a83c5d00 0x55c3a83c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.364+0000 7f4115e8d740 1 -- 172.21.15.92:0/2277533861 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3a831ca20 con 0x55c3a83c5d00 2024-09-10T10:48:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.366+0000 7f410bfff640 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c3a83c5d00 0x55c3a83c81a0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d85814dc1c2609ff server_cookie=48bb70117088aac3 in_seq=0 out_seq=0 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.366+0000 7f40ebfff640 10 client.25700 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.366+0000 7f40ebfff640 1 -- 172.21.15.92:0/2277533861 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3a831ca20 con 0x55c3a83c5d00 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.366+0000 7f40ebfff640 10 client.25700 handle_command_reply: tid=0 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.366+0000 7f4115e8d740 1 client.25700 shutdown 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 -- 172.21.15.92:0/2277533861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 msgr2=0x55c3a83b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83b2b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f40f40ec480 tx=0x7f40f40b7b10 comp rx=0 tx=0).stop 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 -- 172.21.15.92:0/2277533861 shutdown_connections 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 0x55c3a83b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c3a83c5d00 0x55c3a83c81a0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 --2- 172.21.15.92:0/2277533861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83b2b50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 -- 172.21.15.92:0/2277533861 >> 172.21.15.92:0/2277533861 conn(0x55c3a83a7060 msgr2=0x55c3a83acdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f40ebfff640 0 client.25700 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 -- 172.21.15.92:0/2277533861 shutdown_connections 2024-09-10T10:48:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 1 -- 172.21.15.92:0/2277533861 wait complete. 2024-09-10T10:48:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.367+0000 7f4115e8d740 20 client.25700 trim_cache size 0 max 16384 2024-09-10T10:48:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.389+0000 7f4115e8d740 1 Processor -- start 2024-09-10T10:48:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.389+0000 7f4115e8d740 1 -- start start 2024-09-10T10:48:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.389+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.389+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.389+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 0x55c3a83cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.389+0000 7f4115e8d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f410c1c4c00 con 0x55c3a83ab410 2024-09-10T10:48:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.389+0000 7f4115e8d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f410c1c67a0 con 0x55c3a83aaaf0 2024-09-10T10:48:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.389+0000 7f4115e8d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f410c1c52d0 con 0x55c3a83b5cb0 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f41115bb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 0x55c3a83cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f410bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f4110dba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f410bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:32972/0 (socket says 172.21.15.92:32972) 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f410bfff640 1 -- 172.21.15.92:0/1110084108 learned_addr learned my addr 172.21.15.92:0/1110084108 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f4110dba640 1 -- 172.21.15.92:0/1110084108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 msgr2=0x55c3a83cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f4110dba640 1 --2- 172.21.15.92:0/1110084108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 0x55c3a83cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f4110dba640 1 -- 172.21.15.92:0/1110084108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 msgr2=0x55c3a83b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f4110dba640 1 --2- 172.21.15.92:0/1110084108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.396 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f4110dba640 1 -- 172.21.15.92:0/1110084108 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a83a6e90 con 0x55c3a83aaaf0 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f4110dba640 1 --2- 172.21.15.92:0/1110084108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83ad5b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40f40bb210 tx=0x7f40f402a390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e86a43918f5fa9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f41027fc640 1 -- 172.21.15.92:0/1110084108 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f40b93c0 con 0x55c3a83aaaf0 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f41027fc640 1 -- 172.21.15.92:0/1110084108 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f40d3030 con 0x55c3a83aaaf0 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.390+0000 7f41027fc640 1 -- 172.21.15.92:0/1110084108 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f40badc0 con 0x55c3a83aaaf0 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 -- 172.21.15.92:0/1110084108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 msgr2=0x55c3a83ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1110084108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83ad5b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40f40bb210 tx=0x7f40f402a390 comp rx=0 tx=0).stop 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 -- 172.21.15.92:0/1110084108 shutdown_connections 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1110084108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83b5cb0 0x55c3a83cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1110084108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83ab410 0x55c3a83b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1110084108 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83ad5b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 -- 172.21.15.92:0/1110084108 >> 172.21.15.92:0/1110084108 conn(0x55c3a83a7060 msgr2=0x55c3a83b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:20.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 -- 172.21.15.92:0/1110084108 shutdown_connections 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 -- 172.21.15.92:0/1110084108 wait complete. 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.391+0000 7f4115e8d740 1 -- start start 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4115e8d740 1 Processor -- start 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83be280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83ab410 0x55c3a83af660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4115e8d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83b5cb0 0x55c3a83afba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4115e8d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f410c1c60d0 con 0x55c3a83b5cb0 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4115e8d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f410c1c59a0 con 0x55c3a83aaaf0 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4115e8d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f410c1c2c90 con 0x55c3a83ab410 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4115e8d740 10 client.0 _ll_register_callbacks cb 0x7f40f40b7490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f41115bb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83b5cb0 0x55c3a83afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f410bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83ab410 0x55c3a83af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4110dba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f410bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83ab410 0x55c3a83af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:43070/0 (socket says 172.21.15.92:43070) 2024-09-10T10:48:20.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f410bfff640 1 -- 172.21.15.92:0/1621019940 learned_addr learned my addr 172.21.15.92:0/1621019940 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4110dba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83be280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:34542/0 (socket says 172.21.15.92:34542) 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f410bfff640 1 -- 172.21.15.92:0/1621019940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 msgr2=0x55c3a83be280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f410bfff640 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83be280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f410bfff640 1 -- 172.21.15.92:0/1621019940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83b5cb0 msgr2=0x55c3a83afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f410bfff640 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83b5cb0 0x55c3a83afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f410bfff640 1 -- 172.21.15.92:0/1621019940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a83b0190 con 0x55c3a83ab410 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.392+0000 7f4110dba640 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f410bfff640 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83ab410 0x55c3a83af660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f40fc005fd0 tx=0x7f40fc004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=456bfb0252a9e262 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f40ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f40ebfff640 1 -- 172.21.15.92:0/1621019940 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc003d50 con 0x55c3a83ab410 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f4115e8d740 1 -- 172.21.15.92:0/1621019940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40f40d3030 con 0x55c3a83ab410 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f40ebfff640 1 -- 172.21.15.92:0/1621019940 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7f40fc022470 con 0x55c3a83ab410 2024-09-10T10:48:20.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f40ebfff640 1 -- 172.21.15.92:0/1621019940 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f40fc022670 con 0x55c3a83ab410 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f4115e8d740 10 client.25726 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f4115e8d740 1 -- 172.21.15.92:0/1621019940 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55c3a8430900 con 0x55c3a83ab410 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f40ebfff640 1 -- 172.21.15.92:0/1621019940 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f40d3030 con 0x55c3a83ab410 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f40ebfff640 1 -- 172.21.15.92:0/1621019940 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7f40fc0108d0 con 0x55c3a83ab410 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f4115e8d740 10 client.25726 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.393+0000 7f4115e8d740 10 client.25726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.394+0000 7f4115e8d740 20 client.25726 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.394+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c3a84310f0 0x55c3a8433510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.394+0000 7f4115e8d740 4 client.25726 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.394+0000 7f4115e8d740 1 -- 172.21.15.92:0/1621019940 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3a8316d70 con 0x55c3a84310f0 2024-09-10T10:48:20.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.394+0000 7f4110dba640 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c3a84310f0 0x55c3a8433510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.395+0000 7f40ebfff640 10 client.25726 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:20.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.395+0000 7f4110dba640 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c3a84310f0 0x55c3a8433510 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f9e3487989f3696 server_cookie=bb148cc217fb04d0 in_seq=0 out_seq=0 2024-09-10T10:48:20.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.403+0000 7f40ebfff640 1 -- 172.21.15.92:0/1621019940 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3a8316d70 con 0x55c3a84310f0 2024-09-10T10:48:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.403+0000 7f40ebfff640 10 client.25726 handle_command_reply: tid=0 2024-09-10T10:48:20.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.403+0000 7f4115e8d740 1 client.25726 shutdown 2024-09-10T10:48:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 -- 172.21.15.92:0/1621019940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83ab410 msgr2=0x55c3a83af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83ab410 0x55c3a83af660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f40fc005fd0 tx=0x7f40fc004410 comp rx=0 tx=0).stop 2024-09-10T10:48:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 -- 172.21.15.92:0/1621019940 shutdown_connections 2024-09-10T10:48:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3a83b5cb0 0x55c3a83afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c3a83ab410 0x55c3a83af660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c3a84310f0 0x55c3a8433510 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 --2- 172.21.15.92:0/1621019940 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c3a83aaaf0 0x55c3a83be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f40ebfff640 0 client.25726 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 -- 172.21.15.92:0/1621019940 >> 172.21.15.92:0/1621019940 conn(0x55c3a83a7060 msgr2=0x55c3a83a59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 -- 172.21.15.92:0/1621019940 shutdown_connections 2024-09-10T10:48:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 1 -- 172.21.15.92:0/1621019940 wait complete. 2024-09-10T10:48:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.404+0000 7f4115e8d740 20 client.25726 trim_cache size 0 max 16384 2024-09-10T10:48:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:48:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:48:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:48:20.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:48:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 -- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f40f80a2fd0 msgr2=0x7f40f80a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f40f80a2fd0 0x7f40f80a5490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4104022000 tx=0x7f4104020000 comp rx=0 tx=0).stop 2024-09-10T10:48:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 -- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f410c1091f0 msgr2=0x7f410c118670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f410c1091f0 0x7f410c118670 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009890 tx=0x7f40f4033d10 comp rx=0 tx=0).stop 2024-09-10T10:48:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 -- 172.21.15.92:0/299286861 shutdown_connections 2024-09-10T10:48:20.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f40f80a2fd0 0x7f40f80a5490 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f410c11b140 0x7f410c111970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f410c1095d0 0x7f410c118bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 --2- 172.21.15.92:0/299286861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f410c1091f0 0x7f410c118670 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 -- 172.21.15.92:0/299286861 >> 172.21.15.92:0/299286861 conn(0x7f410c06ce00 msgr2=0x7f410c11b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 -- 172.21.15.92:0/299286861 shutdown_connections 2024-09-10T10:48:20.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:20.405+0000 7f411301e640 1 -- 172.21.15.92:0/299286861 wait complete. 2024-09-10T10:48:20.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:20 smithi121 ceph-mon[35231]: pgmap v366: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 1.79k op/s 2024-09-10T10:48:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:20 smithi097 ceph-mon[35213]: pgmap v366: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 1.79k op/s 2024-09-10T10:48:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:20 smithi092 ceph-mon[30834]: pgmap v366: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 26 MiB/s wr, 1.79k op/s 2024-09-10T10:48:22.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:22 smithi121 ceph-mon[35231]: pgmap v367: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.94k op/s 2024-09-10T10:48:22.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:22 smithi097 ceph-mon[35213]: pgmap v367: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.94k op/s 2024-09-10T10:48:22.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:22 smithi092 ceph-mon[30834]: pgmap v367: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.94k op/s 2024-09-10T10:48:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 685.0 s, 2005.6 tps, lat 50.015 ms stddev 53.508 2024-09-10T10:48:24.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:24 smithi121 ceph-mon[35231]: pgmap v368: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.94k op/s 2024-09-10T10:48:24.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:24 smithi097 ceph-mon[35213]: pgmap v368: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.94k op/s 2024-09-10T10:48:24.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:24 smithi092 ceph-mon[30834]: pgmap v368: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.94k op/s 2024-09-10T10:48:25.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:25 smithi121 ceph-mon[35231]: pgmap v369: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.91k op/s 2024-09-10T10:48:25.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:25 smithi097 ceph-mon[35213]: pgmap v369: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.91k op/s 2024-09-10T10:48:25.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:25 smithi092 ceph-mon[30834]: pgmap v369: 97 pgs: 97 active+clean; 4.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 28 MiB/s wr, 1.91k op/s 2024-09-10T10:48:28.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:27 smithi121 ceph-mon[35231]: pgmap v370: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 1.93k op/s 2024-09-10T10:48:28.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:27 smithi097 ceph-mon[35213]: pgmap v370: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 1.93k op/s 2024-09-10T10:48:28.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:27 smithi092 ceph-mon[30834]: pgmap v370: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 MiB/s wr, 1.93k op/s 2024-09-10T10:48:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 690.0 s, 2275.6 tps, lat 43.694 ms stddev 50.483 2024-09-10T10:48:30.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:29 smithi121 ceph-mon[35231]: pgmap v371: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 578 op/s 2024-09-10T10:48:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:29 smithi097 ceph-mon[35213]: pgmap v371: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 578 op/s 2024-09-10T10:48:30.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:29 smithi092 ceph-mon[30834]: pgmap v371: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 578 op/s 2024-09-10T10:48:32.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:31 smithi121 ceph-mon[35231]: pgmap v372: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.2 MiB/s wr, 859 op/s 2024-09-10T10:48:32.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:31 smithi097 ceph-mon[35213]: pgmap v372: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.2 MiB/s wr, 859 op/s 2024-09-10T10:48:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:31 smithi092 ceph-mon[30834]: pgmap v372: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 9.2 MiB/s wr, 859 op/s 2024-09-10T10:48:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 695.0 s, 1613.8 tps, lat 62.213 ms stddev 66.018 2024-09-10T10:48:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.530+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/2602277339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 msgr2=0x7f6c3810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.530+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/2602277339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 0x7f6c3810d8a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009cd0 tx=0x7f6c3002a8e0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.530+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/2602277339 shutdown_connections 2024-09-10T10:48:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.530+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/2602277339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 0x7f6c3810d8a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.530+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/2602277339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c381009d0 0x7f6c38100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.530+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/2602277339 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c381069e0 0x7f6c38106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.530+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/2602277339 >> 172.21.15.92:0/2602277339 conn(0x7f6c380fc6f0 msgr2=0x7f6c380feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/2602277339 shutdown_connections 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/2602277339 wait complete. 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 Processor -- start 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 -- start start 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c381009d0 0x7f6c38199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 0x7f6c38199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c381069e0 0x7f6c381a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38110e20 con 0x7f6c38101370 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38110ca0 con 0x7f6c381009d0 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3f5e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38110fa0 con 0x7f6c381069e0 2024-09-10T10:48:33.535 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.531+0000 7f6c3cb7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 0x7f6c38199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3db81640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c381069e0 0x7f6c381a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3cb7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 0x7f6c38199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52024/0 (socket says 172.21.15.92:52024) 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3cb7f640 1 -- 172.21.15.92:0/1807856697 learned_addr learned my addr 172.21.15.92:0/1807856697 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3d380640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c381009d0 0x7f6c38199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3cb7f640 1 -- 172.21.15.92:0/1807856697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c381069e0 msgr2=0x7f6c381a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c381069e0 0x7f6c381a41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3cb7f640 1 -- 172.21.15.92:0/1807856697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c381009d0 msgr2=0x7f6c38199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c381009d0 0x7f6c38199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3cb7f640 1 -- 172.21.15.92:0/1807856697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c381a4710 con 0x7f6c38101370 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 0x7f6c38199690 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800e9f0 tx=0x7f6c2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c2e7fc640 1 -- 172.21.15.92:0/1807856697 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800cd80 con 0x7f6c38101370 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.532+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/1807856697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c38196f40 con 0x7f6c38101370 2024-09-10T10:48:33.536 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.533+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/1807856697 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c38197490 con 0x7f6c38101370 2024-09-10T10:48:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.533+0000 7f6c2e7fc640 1 -- 172.21.15.92:0/1807856697 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c28005500 con 0x7f6c38101370 2024-09-10T10:48:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.533+0000 7f6c2e7fc640 1 -- 172.21.15.92:0/1807856697 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28010690 con 0x7f6c38101370 2024-09-10T10:48:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.535+0000 7f6c2e7fc640 1 -- 172.21.15.92:0/1807856697 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6c28010830 con 0x7f6c38101370 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.535+0000 7f6c42457740 1 Processor -- start 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.535+0000 7f6c42457740 1 -- start start 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c42457740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7d7af0 0x56257f7d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c42457740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 0x56257f7e2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c42457740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7e2cb0 0x56257f7e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c42457740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56257f73c2f0 con 0x56257f7d7af0 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c42457740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56257f6e4270 con 0x56257f7e2cb0 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c42457740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56257f7382b0 con 0x56257f7d8410 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3db81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7d7af0 0x56257f7d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3db81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7d7af0 0x56257f7d7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52034/0 (socket says 172.21.15.92:52034) 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3db81640 1 -- 172.21.15.92:0/3295638475 learned_addr learned my addr 172.21.15.92:0/3295638475 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7e2cb0 0x56257f7e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3d380640 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 0x56257f7e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3db81640 1 -- 172.21.15.92:0/3295638475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 msgr2=0x56257f7e2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3db81640 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 0x56257f7e2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3db81640 1 -- 172.21.15.92:0/3295638475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7e2cb0 msgr2=0x56257f7e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3db81640 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7e2cb0 0x56257f7e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3db81640 1 -- 172.21.15.92:0/3295638475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56257f6e3340 con 0x56257f7d7af0 2024-09-10T10:48:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7e2cb0 0x56257f7e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c2e7fc640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c240a2e20 0x7f6c240a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.536+0000 7f6c3db81640 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7d7af0 0x56257f7d7ed0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009cd0 tx=0x7f6c30009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8545570d01992501 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:33.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.537+0000 7f6c237fe640 1 -- 172.21.15.92:0/3295638475 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3004c070 con 0x56257f7d7af0 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.537+0000 7f6c3d380640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c240a2e20 0x7f6c240a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.537+0000 7f6c2e7fc640 1 -- 172.21.15.92:0/1807856697 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7f6c280cf6c0 con 0x7f6c38101370 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.537+0000 7f6c237fe640 1 -- 172.21.15.92:0/3295638475 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c30036040 con 0x56257f7d7af0 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.537+0000 7f6c237fe640 1 -- 172.21.15.92:0/3295638475 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3003cae0 con 0x56257f7d7af0 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.537+0000 7f6c42457740 1 -- 172.21.15.92:0/3295638475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7d7af0 msgr2=0x56257f7d7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.537+0000 7f6c3d380640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c240a2e20 0x7f6c240a52e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56257f7d4ec0 tx=0x7f6c34005f90 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7d7af0 0x56257f7d7ed0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009cd0 tx=0x7f6c30009a20 comp rx=0 tx=0).stop 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 -- 172.21.15.92:0/3295638475 shutdown_connections 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7e2cb0 0x56257f7e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 0x56257f7e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 --2- 172.21.15.92:0/3295638475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7d7af0 0x56257f7d7ed0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 -- 172.21.15.92:0/3295638475 >> 172.21.15.92:0/3295638475 conn(0x56257f7d4060 msgr2=0x56257f7d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 -- 172.21.15.92:0/3295638475 shutdown_connections 2024-09-10T10:48:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 -- 172.21.15.92:0/3295638475 wait complete. 2024-09-10T10:48:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 -- start start 2024-09-10T10:48:33.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 Processor -- start 2024-09-10T10:48:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7dfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.538+0000 7f6c42457740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 0x56257f7e0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c42457740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c42457740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56257f7e5880 con 0x56257f7e2cb0 2024-09-10T10:48:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c42457740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56257f6c5290 con 0x56257f7d8410 2024-09-10T10:48:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c42457740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56257f7e5a00 con 0x56257f7d7af0 2024-09-10T10:48:33.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3d380640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7dfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3d380640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7dfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:59742/0 (socket says 172.21.15.92:59742) 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3d380640 1 -- 172.21.15.92:0/444724601 learned_addr learned my addr 172.21.15.92:0/444724601 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 0x56257f7e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3db81640 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c42457740 10 client.0 _ll_register_callbacks cb 0x56257f6f6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3d380640 1 -- 172.21.15.92:0/444724601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 msgr2=0x56257f7e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3d380640 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 0x56257f7e0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3d380640 1 -- 172.21.15.92:0/444724601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 msgr2=0x56257f7e05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3d380640 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7e05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3d380640 1 -- 172.21.15.92:0/444724601 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56257f44f210 con 0x56257f7d7af0 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c42457740 1 -- 172.21.15.92:0/444724601 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c30036040 con 0x56257f7d7af0 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3db81640 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7e05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:48:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c3d380640 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7dfb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6c340045f0 tx=0x7f6c34004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba9b52956c2f886 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c20ff9640 10 client.25738 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c20ff9640 1 -- 172.21.15.92:0/444724601 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3401f640 con 0x56257f7d7af0 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c20ff9640 1 -- 172.21.15.92:0/444724601 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7f6c3401f7e0 con 0x56257f7d7af0 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c20ff9640 1 -- 172.21.15.92:0/444724601 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f6c3401fa40 con 0x56257f7d7af0 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c42457740 10 client.25738 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.539+0000 7f6c42457740 1 -- 172.21.15.92:0/444724601 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=58}) -- 0x56257f51b620 con 0x56257f7d7af0 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c20ff9640 1 -- 172.21.15.92:0/444724601 <== mon.1 v2:172.21.15.121:3300/0 4 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7f6c34027070 con 0x56257f7d7af0 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c42457740 10 client.25738 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c42457740 10 client.25738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c42457740 20 client.25738 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c42457740 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56257f7f2ae0 0x56257f7f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c42457740 4 client.25738 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:48:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c42457740 1 -- 172.21.15.92:0/444724601 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56257f749a20 con 0x56257f7f2ae0 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56257f7f2ae0 0x56257f7f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c20ff9640 10 client.25738 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.540+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56257f7f2ae0 0x56257f7f4f40 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6fccbb62153bd16 server_cookie=6f1a78a629658c31 in_seq=0 out_seq=0 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.541+0000 7f6c20ff9640 1 -- 172.21.15.92:0/444724601 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56257f749a20 con 0x56257f7f2ae0 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.541+0000 7f6c20ff9640 10 client.25738 handle_command_reply: tid=0 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.542+0000 7f6c42457740 1 client.25738 shutdown 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.543+0000 7f6c42457740 1 -- 172.21.15.92:0/444724601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 msgr2=0x56257f7dfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.543+0000 7f6c42457740 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7dfb30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6c340045f0 tx=0x7f6c34004730 comp rx=0 tx=0).stop 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.543+0000 7f6c42457740 1 -- 172.21.15.92:0/444724601 shutdown_connections 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.543+0000 7f6c42457740 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7e05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.543+0000 7f6c42457740 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56257f7f2ae0 0x56257f7f4f40 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.543+0000 7f6c42457740 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 0x56257f7e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.543+0000 7f6c20ff9640 0 client.25738 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.543+0000 7f6c42457740 1 --2- 172.21.15.92:0/444724601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7dfb30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.543+0000 7f6c42457740 1 -- 172.21.15.92:0/444724601 >> 172.21.15.92:0/444724601 conn(0x56257f7d4060 msgr2=0x56257f7d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.544+0000 7f6c42457740 1 -- 172.21.15.92:0/444724601 shutdown_connections 2024-09-10T10:48:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.544+0000 7f6c42457740 1 -- 172.21.15.92:0/444724601 wait complete. 2024-09-10T10:48:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.544+0000 7f6c42457740 20 client.25738 trim_cache size 0 max 16384 2024-09-10T10:48:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.561+0000 7f6c42457740 1 Processor -- start 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.561+0000 7f6c42457740 1 -- start start 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.561+0000 7f6c42457740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7e03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.561+0000 7f6c42457740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 0x56257f7d9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.561+0000 7f6c42457740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7fa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.561+0000 7f6c42457740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00e5d0 con 0x56257f7e2cb0 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.561+0000 7f6c42457740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c010170 con 0x56257f7d8410 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.561+0000 7f6c42457740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00eca0 con 0x56257f7d7af0 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3db81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7fa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3db81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7fa850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52054/0 (socket says 172.21.15.92:52054) 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3cb7f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 0x56257f7d9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3db81640 1 -- 172.21.15.92:0/1296636471 learned_addr learned my addr 172.21.15.92:0/1296636471 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3d380640 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7e03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3db81640 1 -- 172.21.15.92:0/1296636471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 msgr2=0x56257f7e03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3db81640 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7e03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3db81640 1 -- 172.21.15.92:0/1296636471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 msgr2=0x56257f7d9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3db81640 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 0x56257f7d9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3db81640 1 -- 172.21.15.92:0/1296636471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56257f7d3e90 con 0x56257f7e2cb0 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 0x56257f7d9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3d380640 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7e03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c3db81640 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7fa850 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6c30004ab0 tx=0x7f6c30000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe15ff70b42ccfe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c22ffd640 1 -- 172.21.15.92:0/1296636471 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3004c040 con 0x56257f7e2cb0 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c22ffd640 1 -- 172.21.15.92:0/1296636471 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c30003970 con 0x56257f7e2cb0 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.562+0000 7f6c22ffd640 1 -- 172.21.15.92:0/1296636471 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3003cd30 con 0x56257f7e2cb0 2024-09-10T10:48:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 -- 172.21.15.92:0/1296636471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 msgr2=0x56257f7fa850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7fa850 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6c30004ab0 tx=0x7f6c30000f40 comp rx=0 tx=0).stop 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 -- 172.21.15.92:0/1296636471 shutdown_connections 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f7fa850 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d8410 0x56257f7d9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 --2- 172.21.15.92:0/1296636471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d7af0 0x56257f7e03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 -- 172.21.15.92:0/1296636471 >> 172.21.15.92:0/1296636471 conn(0x56257f7d4060 msgr2=0x56257f7d9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 -- 172.21.15.92:0/1296636471 shutdown_connections 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 -- 172.21.15.92:0/1296636471 wait complete. 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.563+0000 7f6c42457740 1 -- start start 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c42457740 1 Processor -- start 2024-09-10T10:48:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c42457740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d7af0 0x56257f7e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c42457740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 0x56257f7e7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c42457740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f85c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c42457740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00faa0 con 0x56257f7e2cb0 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c42457740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00f370 con 0x56257f7d7af0 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c42457740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00c5d0 con 0x56257f7d8410 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c42457740 10 client.0 _ll_register_callbacks cb 0x7f6c340044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3db81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f85c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3d380640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d7af0 0x56257f7e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3db81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f85c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52062/0 (socket says 172.21.15.92:52062) 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3db81640 1 -- 172.21.15.92:0/1994100100 learned_addr learned my addr 172.21.15.92:0/1994100100 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3cb7f640 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 0x56257f7e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3db81640 1 -- 172.21.15.92:0/1994100100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 msgr2=0x56257f7e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3db81640 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 0x56257f7e7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3db81640 1 -- 172.21.15.92:0/1994100100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d7af0 msgr2=0x56257f7e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3db81640 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d7af0 0x56257f7e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3db81640 1 -- 172.21.15.92:0/1994100100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56257f85ce10 con 0x56257f7e2cb0 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.564+0000 7f6c3d380640 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d7af0 0x56257f7e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c3db81640 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f85c820 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009bf0 tx=0x7f6c30003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a4e15782fbae3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c20ff9640 1 -- 172.21.15.92:0/1994100100 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30064060 con 0x56257f7e2cb0 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c42457740 1 -- 172.21.15.92:0/1994100100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c30003970 con 0x56257f7e2cb0 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c20ff9640 1 -- 172.21.15.92:0/1994100100 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7f6c30031ac0 con 0x56257f7e2cb0 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c20ff9640 1 -- 172.21.15.92:0/1994100100 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f6c30031d00 con 0x56257f7e2cb0 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c42457740 10 client.16227 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c42457740 1 -- 172.21.15.92:0/1994100100 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x56257f85e0e0 con 0x56257f7e2cb0 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c20ff9640 1 -- 172.21.15.92:0/1994100100 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c30003970 con 0x56257f7e2cb0 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.565+0000 7f6c20ff9640 1 -- 172.21.15.92:0/1994100100 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7f6c30046070 con 0x56257f7e2cb0 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.566+0000 7f6c42457740 10 client.16227 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.566+0000 7f6c42457740 10 client.16227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.566+0000 7f6c42457740 20 client.16227 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.566+0000 7f6c42457740 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56257f85e360 0x56257f860750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.566+0000 7f6c42457740 4 client.16227 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.566+0000 7f6c42457740 1 -- 172.21.15.92:0/1994100100 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56257f743d70 con 0x56257f85e360 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.566+0000 7f6c3d380640 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56257f85e360 0x56257f860750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.567+0000 7f6c3d380640 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56257f85e360 0x56257f860750 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb55b414a1efec7c server_cookie=3ae84532628d97d2 in_seq=0 out_seq=0 2024-09-10T10:48:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.567+0000 7f6c20ff9640 10 client.16227 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:33.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.578+0000 7f6c20ff9640 1 -- 172.21.15.92:0/1994100100 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56257f743d70 con 0x56257f85e360 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.578+0000 7f6c20ff9640 10 client.16227 handle_command_reply: tid=0 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.578+0000 7f6c42457740 1 client.16227 shutdown 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.578+0000 7f6c42457740 1 -- 172.21.15.92:0/1994100100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 msgr2=0x56257f85c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.578+0000 7f6c42457740 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f85c820 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009bf0 tx=0x7f6c30003e90 comp rx=0 tx=0).stop 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.578+0000 7f6c42457740 1 -- 172.21.15.92:0/1994100100 shutdown_connections 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.578+0000 7f6c42457740 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56257f7e2cb0 0x56257f85c820 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.578+0000 7f6c42457740 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56257f7d8410 0x56257f7e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.578+0000 7f6c42457740 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56257f85e360 0x56257f860750 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.579+0000 7f6c42457740 1 --2- 172.21.15.92:0/1994100100 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56257f7d7af0 0x56257f7e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.579+0000 7f6c42457740 1 -- 172.21.15.92:0/1994100100 >> 172.21.15.92:0/1994100100 conn(0x56257f7d4060 msgr2=0x56257f7d9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.579+0000 7f6c20ff9640 0 client.16227 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.579+0000 7f6c42457740 1 -- 172.21.15.92:0/1994100100 shutdown_connections 2024-09-10T10:48:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.579+0000 7f6c42457740 1 -- 172.21.15.92:0/1994100100 wait complete. 2024-09-10T10:48:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.579+0000 7f6c42457740 20 client.16227 trim_cache size 0 max 16384 2024-09-10T10:48:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:48:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:48:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:48:33.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:48:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.581+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c240a2e20 msgr2=0x7f6c240a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.581+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c240a2e20 0x7f6c240a52e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56257f7d4ec0 tx=0x7f6c34005f90 comp rx=0 tx=0).stop 2024-09-10T10:48:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.581+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 msgr2=0x7f6c38199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.581+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 0x7f6c38199690 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800e9f0 tx=0x7f6c2800edf0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.582+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/1807856697 shutdown_connections 2024-09-10T10:48:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.582+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c381069e0 0x7f6c381a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.582+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c38101370 0x7f6c38199690 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.582+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c240a2e20 0x7f6c240a52e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.582+0000 7f6c3f5e4640 1 --2- 172.21.15.92:0/1807856697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c381009d0 0x7f6c38199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.582+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/1807856697 >> 172.21.15.92:0/1807856697 conn(0x7f6c380fc6f0 msgr2=0x7f6c380fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.582+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/1807856697 shutdown_connections 2024-09-10T10:48:33.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:33.582+0000 7f6c3f5e4640 1 -- 172.21.15.92:0/1807856697 wait complete. 2024-09-10T10:48:34.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:33 smithi121 ceph-mon[35231]: pgmap v373: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 593 op/s 2024-09-10T10:48:34.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:33 smithi097 ceph-mon[35213]: pgmap v373: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 593 op/s 2024-09-10T10:48:34.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:33 smithi092 ceph-mon[30834]: pgmap v373: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 593 op/s 2024-09-10T10:48:36.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:35 smithi121 ceph-mon[35231]: pgmap v374: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 593 op/s 2024-09-10T10:48:36.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:35 smithi097 ceph-mon[35213]: pgmap v374: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 593 op/s 2024-09-10T10:48:36.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:35 smithi092 ceph-mon[30834]: pgmap v374: 97 pgs: 97 active+clean; 4.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 593 op/s 2024-09-10T10:48:38.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:37 smithi121 ceph-mon[35231]: pgmap v375: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.9 MiB/s wr, 852 op/s 2024-09-10T10:48:38.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:37 smithi097 ceph-mon[35213]: pgmap v375: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.9 MiB/s wr, 852 op/s 2024-09-10T10:48:38.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:37 smithi092 ceph-mon[30834]: pgmap v375: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.9 MiB/s wr, 852 op/s 2024-09-10T10:48:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 700.0 s, 2025.0 tps, lat 48.809 ms stddev 53.799 2024-09-10T10:48:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:39 smithi121 ceph-mon[35231]: pgmap v376: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 540 op/s 2024-09-10T10:48:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:39 smithi097 ceph-mon[35213]: pgmap v376: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 540 op/s 2024-09-10T10:48:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:39 smithi092 ceph-mon[30834]: pgmap v376: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.4 MiB/s wr, 540 op/s 2024-09-10T10:48:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:41 smithi121 ceph-mon[35231]: pgmap v377: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.6 MiB/s wr, 828 op/s 2024-09-10T10:48:42.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:41 smithi097 ceph-mon[35213]: pgmap v377: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.6 MiB/s wr, 828 op/s 2024-09-10T10:48:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:41 smithi092 ceph-mon[30834]: pgmap v377: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 8.6 MiB/s wr, 828 op/s 2024-09-10T10:48:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 705.0 s, 1609.8 tps, lat 62.403 ms stddev 67.659 2024-09-10T10:48:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:43 smithi121 ceph-mon[35231]: pgmap v378: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 547 op/s 2024-09-10T10:48:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:43 smithi097 ceph-mon[35213]: pgmap v378: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 547 op/s 2024-09-10T10:48:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:43 smithi092 ceph-mon[30834]: pgmap v378: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 547 op/s 2024-09-10T10:48:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:45 smithi121 ceph-mon[35231]: pgmap v379: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 547 op/s 2024-09-10T10:48:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:45 smithi097 ceph-mon[35213]: pgmap v379: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 547 op/s 2024-09-10T10:48:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:45 smithi092 ceph-mon[30834]: pgmap v379: 97 pgs: 97 active+clean; 4.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.7 MiB/s wr, 547 op/s 2024-09-10T10:48:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.686+0000 7ff2f4077640 1 -- 172.21.15.92:0/2929617542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec101150 msgr2=0x7ff2ec107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.686+0000 7ff2f4077640 1 --2- 172.21.15.92:0/2929617542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec101150 0x7ff2ec107990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009930 tx=0x7ff2e002a4d0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.686+0000 7ff2f4077640 1 -- 172.21.15.92:0/2929617542 shutdown_connections 2024-09-10T10:48:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.686+0000 7ff2f4077640 1 --2- 172.21.15.92:0/2929617542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec1080f0 0x7ff2ec10ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.686+0000 7ff2f4077640 1 --2- 172.21.15.92:0/2929617542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec101150 0x7ff2ec107990 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.686+0000 7ff2f4077640 1 --2- 172.21.15.92:0/2929617542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec100830 0x7ff2ec100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.686+0000 7ff2f4077640 1 -- 172.21.15.92:0/2929617542 >> 172.21.15.92:0/2929617542 conn(0x7ff2ec075f20 msgr2=0x7ff2ec076330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.686+0000 7ff2f4077640 1 -- 172.21.15.92:0/2929617542 shutdown_connections 2024-09-10T10:48:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.686+0000 7ff2f4077640 1 -- 172.21.15.92:0/2929617542 wait complete. 2024-09-10T10:48:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f4077640 1 Processor -- start 2024-09-10T10:48:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f4077640 1 -- start start 2024-09-10T10:48:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f4077640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec100830 0x7ff2ec1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f4077640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec101150 0x7ff2ec198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f4077640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec1080f0 0x7ff2ec19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f4077640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec111f20 con 0x7ff2ec1080f0 2024-09-10T10:48:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f4077640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec111da0 con 0x7ff2ec101150 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f4077640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1120a0 con 0x7ff2ec100830 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f2614640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec1080f0 0x7ff2ec19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f1e13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec100830 0x7ff2ec1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f2614640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec1080f0 0x7ff2ec19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36866/0 (socket says 172.21.15.92:36866) 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f2614640 1 -- 172.21.15.92:0/987917986 learned_addr learned my addr 172.21.15.92:0/987917986 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f1e13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec100830 0x7ff2ec1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34184/0 (socket says 172.21.15.92:34184) 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.687+0000 7ff2f1612640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec101150 0x7ff2ec198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2f2614640 1 -- 172.21.15.92:0/987917986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec100830 msgr2=0x7ff2ec1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2f2614640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec100830 0x7ff2ec1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2f2614640 1 -- 172.21.15.92:0/987917986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec101150 msgr2=0x7ff2ec198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2f2614640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec101150 0x7ff2ec198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2f2614640 1 -- 172.21.15.92:0/987917986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec19d3b0 con 0x7ff2ec1080f0 2024-09-10T10:48:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec100830 0x7ff2ec1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2f2614640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec1080f0 0x7ff2ec19cc80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009c40 tx=0x7ff2e400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2eaffd640 1 -- 172.21.15.92:0/987917986 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4009e50 con 0x7ff2ec1080f0 2024-09-10T10:48:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2f4077640 1 -- 172.21.15.92:0/987917986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec19d6a0 con 0x7ff2ec1080f0 2024-09-10T10:48:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2eaffd640 1 -- 172.21.15.92:0/987917986 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2e4005500 con 0x7ff2ec1080f0 2024-09-10T10:48:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2eaffd640 1 -- 172.21.15.92:0/987917986 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4019670 con 0x7ff2ec1080f0 2024-09-10T10:48:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.688+0000 7ff2f4077640 1 -- 172.21.15.92:0/987917986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec1016d0 con 0x7ff2ec1080f0 2024-09-10T10:48:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.691+0000 7ff2f6e0f740 1 Processor -- start 2024-09-10T10:48:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2eaffd640 1 -- 172.21.15.92:0/987917986 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff2e4004f70 con 0x7ff2ec1080f0 2024-09-10T10:48:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f6e0f740 1 -- start start 2024-09-10T10:48:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f6f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f9410 0x55fa6f703770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 0x55fa6f7060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fa6f65d2f0 con 0x55fa6f703cb0 2024-09-10T10:48:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fa6f605270 con 0x55fa6f6f8af0 2024-09-10T10:48:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fa6f6592b0 con 0x55fa6f6f9410 2024-09-10T10:48:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f1612640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f6f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f1e13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f9410 0x55fa6f703770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f1612640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f6f8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:32928/0 (socket says 172.21.15.92:32928) 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f1612640 1 -- 172.21.15.92:0/3757656135 learned_addr learned my addr 172.21.15.92:0/3757656135 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2f1612640 1 --2- 172.21.15.92:0/3757656135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 0x55fa6f7060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.692+0000 7ff2eaffd640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2d40a2f40 0x7ff2d40a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3757656135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 msgr2=0x55fa6f6f8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/3757656135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f6f8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3757656135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 msgr2=0x55fa6f7060a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/3757656135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 0x55fa6f7060a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3757656135 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6f604340 con 0x55fa6f6f9410 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2f2614640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2d40a2f40 0x7ff2d40a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2eaffd640 1 -- 172.21.15.92:0/987917986 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7ff2e40d2ce0 con 0x7ff2ec1080f0 2024-09-10T10:48:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/3757656135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f9410 0x55fa6f703770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc005fd0 tx=0x7ff2dc011c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=761431f37767cc40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2d3fff640 1 -- 172.21.15.92:0/3757656135 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc004d20 con 0x55fa6f6f9410 2024-09-10T10:48:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2f2614640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2d40a2f40 0x7ff2d40a5400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2e409eff0 tx=0x7ff2e4066040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2d3fff640 1 -- 172.21.15.92:0/3757656135 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2dc00f9a0 con 0x55fa6f6f9410 2024-09-10T10:48:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.693+0000 7ff2d3fff640 1 -- 172.21.15.92:0/3757656135 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc004470 con 0x55fa6f6f9410 2024-09-10T10:48:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.694+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3757656135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f9410 msgr2=0x55fa6f703770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.694+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3757656135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f9410 0x55fa6f703770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc005fd0 tx=0x7ff2dc011c70 comp rx=0 tx=0).stop 2024-09-10T10:48:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.694+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3757656135 shutdown_connections 2024-09-10T10:48:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.694+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3757656135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 0x55fa6f7060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.694+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3757656135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f9410 0x55fa6f703770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.694+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3757656135 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f6f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.694+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3757656135 >> 172.21.15.92:0/3757656135 conn(0x55fa6f6f5060 msgr2=0x55fa6f6f5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.694+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3757656135 shutdown_connections 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.694+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3757656135 wait complete. 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f6e0f740 1 -- start start 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f6e0f740 1 Processor -- start 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f8af0 0x55fa6f700b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f9410 0x55fa6f7010b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 0x55fa6f7015f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fa6f706880 con 0x55fa6f703cb0 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55fa6f5e6290 con 0x55fa6f6f9410 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fa6f706a00 con 0x55fa6f6f8af0 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f6e0f740 10 client.0 _ll_register_callbacks cb 0x55fa6f617140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f1612640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 0x55fa6f7015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f1612640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f8af0 0x55fa6f700b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f1e13640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f9410 0x55fa6f7010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f1612640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f8af0 0x55fa6f700b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34200/0 (socket says 172.21.15.92:34200) 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.695+0000 7ff2f1612640 1 -- 172.21.15.92:0/2734089700 learned_addr learned my addr 172.21.15.92:0/2734089700 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.696+0000 7ff2f1612640 1 -- 172.21.15.92:0/2734089700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f8af0 msgr2=0x55fa6f700b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.696+0000 7ff2f1612640 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f8af0 0x55fa6f700b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.696+0000 7ff2f1612640 1 -- 172.21.15.92:0/2734089700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f9410 msgr2=0x55fa6f7010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.696+0000 7ff2f1612640 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f9410 0x55fa6f7010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.696+0000 7ff2f1612640 1 -- 172.21.15.92:0/2734089700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6f370210 con 0x55fa6f703cb0 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.696+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f9410 0x55fa6f7010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.696+0000 7ff2f1612640 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 0x55fa6f7015f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec077240 tx=0x7ff2e002a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2d998c46c35fbf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.696+0000 7ff2d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:48:46.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2d17fa640 1 -- 172.21.15.92:0/2734089700 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0035030 con 0x55fa6f703cb0 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2d17fa640 1 -- 172.21.15.92:0/2734089700 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7ff2e0004260 con 0x55fa6f703cb0 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/2734089700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2dc00f9a0 con 0x55fa6f703cb0 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2d17fa640 1 -- 172.21.15.92:0/2734089700 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7ff2e0004460 con 0x55fa6f703cb0 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2f6e0f740 10 client.16239 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/2734089700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55fa6f43c620 con 0x55fa6f703cb0 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2d17fa640 1 -- 172.21.15.92:0/2734089700 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2dc00f9a0 con 0x55fa6f703cb0 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2d17fa640 1 -- 172.21.15.92:0/2734089700 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7ff2e0004b20 con 0x55fa6f703cb0 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2f6e0f740 10 client.16239 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2f6e0f740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2f6e0f740 20 client.16239 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.697+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fa6f713bd0 0x55fa6f715fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.698+0000 7ff2f6e0f740 4 client.16239 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:48:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.698+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/2734089700 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa6f66aa20 con 0x55fa6f713bd0 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.698+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fa6f713bd0 0x55fa6f715fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.698+0000 7ff2d17fa640 10 client.16239 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.698+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fa6f713bd0 0x55fa6f715fc0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ff141e030745568 server_cookie=f1b47e25babdb30d in_seq=0 out_seq=0 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2d17fa640 1 -- 172.21.15.92:0/2734089700 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fa6f66aa20 con 0x55fa6f713bd0 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2d17fa640 10 client.16239 handle_command_reply: tid=0 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2f6e0f740 1 client.16239 shutdown 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/2734089700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 msgr2=0x55fa6f7015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 0x55fa6f7015f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec077240 tx=0x7ff2e002a4d0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/2734089700 shutdown_connections 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f703cb0 0x55fa6f7015f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fa6f713bd0 0x55fa6f715fc0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f9410 0x55fa6f7010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/2734089700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f6f8af0 0x55fa6f700b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/2734089700 >> 172.21.15.92:0/2734089700 conn(0x55fa6f6f5060 msgr2=0x55fa6f6fad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.699+0000 7ff2d17fa640 0 client.16239 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.700+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/2734089700 shutdown_connections 2024-09-10T10:48:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.700+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/2734089700 wait complete. 2024-09-10T10:48:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.700+0000 7ff2f6e0f740 20 client.16239 trim_cache size 0 max 16384 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f6e0f740 1 Processor -- start 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f6e0f740 1 -- start start 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f701420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f702ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 0x55fa6f71b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1ab570 con 0x55fa6f6f9410 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1ad110 con 0x55fa6f6f8af0 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1abc40 con 0x55fa6f703cb0 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f1e13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f702ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f1e13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f702ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36892/0 (socket says 172.21.15.92:36892) 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f1612640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f701420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3031829821 learned_addr learned my addr 172.21.15.92:0/3031829821 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.718+0000 7ff2f1612640 1 --2- 172.21.15.92:0/3031829821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 0x55fa6f71b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3031829821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 msgr2=0x55fa6f71b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/3031829821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 0x55fa6f71b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3031829821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 msgr2=0x55fa6f701420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/3031829821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f701420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3031829821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa6f6f02d0 con 0x55fa6f6f9410 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2f1612640 1 --2- 172.21.15.92:0/3031829821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f701420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/3031829821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f702ae0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0040c0 tx=0x7ff2dc0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce743a3127958c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2d37fe640 1 -- 172.21.15.92:0/3031829821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc01e040 con 0x55fa6f6f9410 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2d37fe640 1 -- 172.21.15.92:0/3031829821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2dc01f040 con 0x55fa6f6f9410 2024-09-10T10:48:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.719+0000 7ff2d37fe640 1 -- 172.21.15.92:0/3031829821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc005870 con 0x55fa6f6f9410 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3031829821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 msgr2=0x55fa6f702ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3031829821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f702ae0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0040c0 tx=0x7ff2dc0040f0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3031829821 shutdown_connections 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3031829821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 0x55fa6f71b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3031829821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f702ae0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3031829821 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f701420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3031829821 >> 172.21.15.92:0/3031829821 conn(0x55fa6f6f5060 msgr2=0x55fa6f7023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3031829821 shutdown_connections 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3031829821 wait complete. 2024-09-10T10:48:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 -- start start 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.721+0000 7ff2f6e0f740 1 Processor -- start 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f70c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f6fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f6e0f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 0x55fa6f6fde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1aca40 con 0x55fa6f6f9410 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1ac310 con 0x55fa6f6f8af0 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f6e0f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1a9570 con 0x55fa6f703cb0 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f6e0f740 10 client.0 _ll_register_callbacks cb 0x7ff2e0032e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1e13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f6fd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1e13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f6fd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36900/0 (socket says 172.21.15.92:36900) 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3013209660 learned_addr learned my addr 172.21.15.92:0/3013209660 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1612640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 0x55fa6f6fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1612640 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f70c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3013209660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 msgr2=0x55fa6f6fde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 0x55fa6f6fde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3013209660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 msgr2=0x55fa6f70c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f70c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1e13640 1 -- 172.21.15.92:0/3013209660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6f6fe670 con 0x55fa6f6f9410 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2f1e13640 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f6fd8e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009560 tx=0x7ff2dc003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc3899f49f318d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.722+0000 7ff2d17fa640 1 -- 172.21.15.92:0/3013209660 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc011250 con 0x55fa6f6f9410 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2d17fa640 1 -- 172.21.15.92:0/3013209660 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7ff2dc0051c0 con 0x55fa6f6f9410 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3013209660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2dc01f040 con 0x55fa6f6f9410 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2d17fa640 1 -- 172.21.15.92:0/3013209660 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7ff2dc0113f0 con 0x55fa6f6f9410 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f6e0f740 10 client.16245 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3013209660 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55fa6f77e8f0 con 0x55fa6f6f9410 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2d17fa640 1 -- 172.21.15.92:0/3013209660 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2dc01f040 con 0x55fa6f6f9410 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2d17fa640 1 -- 172.21.15.92:0/3013209660 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7ff2dc02e030 con 0x55fa6f6f9410 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f6e0f740 10 client.16245 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f6e0f740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f6e0f740 20 client.16245 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fa6f77ecd0 0x55fa6f7810f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f6e0f740 4 client.16245 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3013209660 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fa6f664d70 con 0x55fa6f77ecd0 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.723+0000 7ff2f1612640 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fa6f77ecd0 0x55fa6f7810f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.724+0000 7ff2d17fa640 10 client.16245 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:46.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.724+0000 7ff2f1612640 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fa6f77ecd0 0x55fa6f7810f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f043ccd2289e3d server_cookie=b8f26f3785005771 in_seq=0 out_seq=0 2024-09-10T10:48:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2d17fa640 1 -- 172.21.15.92:0/3013209660 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fa6f664d70 con 0x55fa6f77ecd0 2024-09-10T10:48:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2d17fa640 10 client.16245 handle_command_reply: tid=0 2024-09-10T10:48:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2f6e0f740 1 client.16245 shutdown 2024-09-10T10:48:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3013209660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 msgr2=0x55fa6f6fd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f6fd8e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009560 tx=0x7ff2dc003a30 comp rx=0 tx=0).stop 2024-09-10T10:48:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3013209660 shutdown_connections 2024-09-10T10:48:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fa6f703cb0 0x55fa6f6fde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa6f6f9410 0x55fa6f6fd8e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55fa6f77ecd0 0x55fa6f7810f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2f6e0f740 1 --2- 172.21.15.92:0/3013209660 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55fa6f6f8af0 0x55fa6f70c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3013209660 >> 172.21.15.92:0/3013209660 conn(0x55fa6f6f5060 msgr2=0x55fa6f6f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.736+0000 7ff2d17fa640 0 client.16245 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3013209660 shutdown_connections 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f6e0f740 1 -- 172.21.15.92:0/3013209660 wait complete. 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f6e0f740 20 client.16245 trim_cache size 0 max 16384 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:48:46.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:48:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 -- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2d40a2f40 msgr2=0x7ff2d40a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2d40a2f40 0x7ff2d40a5400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2e409eff0 tx=0x7ff2e4066040 comp rx=0 tx=0).stop 2024-09-10T10:48:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 -- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec1080f0 msgr2=0x7ff2ec19cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:46.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec1080f0 0x7ff2ec19cc80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009c40 tx=0x7ff2e400b690 comp rx=0 tx=0).stop 2024-09-10T10:48:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 -- 172.21.15.92:0/987917986 shutdown_connections 2024-09-10T10:48:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2ec1080f0 0x7ff2ec19cc80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7ff2d40a2f40 0x7ff2d40a5400 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7ff2ec101150 0x7ff2ec198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 --2- 172.21.15.92:0/987917986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2ec100830 0x7ff2ec1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 -- 172.21.15.92:0/987917986 >> 172.21.15.92:0/987917986 conn(0x7ff2ec075f20 msgr2=0x7ff2ec105b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 -- 172.21.15.92:0/987917986 shutdown_connections 2024-09-10T10:48:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:46.737+0000 7ff2f4077640 1 -- 172.21.15.92:0/987917986 wait complete. 2024-09-10T10:48:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:47 smithi121 ceph-mon[35231]: pgmap v380: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.6 MiB/s wr, 846 op/s 2024-09-10T10:48:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:47 smithi097 ceph-mon[35213]: pgmap v380: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.6 MiB/s wr, 846 op/s 2024-09-10T10:48:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:47 smithi092 ceph-mon[30834]: pgmap v380: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.6 MiB/s wr, 846 op/s 2024-09-10T10:48:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 710.0 s, 1868.8 tps, lat 53.802 ms stddev 58.179 2024-09-10T10:48:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:49 smithi121 ceph-mon[35231]: pgmap v381: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 587 op/s 2024-09-10T10:48:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:49 smithi097 ceph-mon[35213]: pgmap v381: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 587 op/s 2024-09-10T10:48:50.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:49 smithi092 ceph-mon[30834]: pgmap v381: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 587 op/s 2024-09-10T10:48:52.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:51 smithi121 ceph-mon[35231]: pgmap v382: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.6 MiB/s wr, 848 op/s 2024-09-10T10:48:52.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:51 smithi097 ceph-mon[35213]: pgmap v382: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.6 MiB/s wr, 848 op/s 2024-09-10T10:48:52.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:51 smithi092 ceph-mon[30834]: pgmap v382: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.6 MiB/s wr, 848 op/s 2024-09-10T10:48:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 715.0 s, 1661.2 tps, lat 59.563 ms stddev 65.197 2024-09-10T10:48:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:53 smithi121 ceph-mon[35231]: pgmap v383: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 560 op/s 2024-09-10T10:48:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:53 smithi097 ceph-mon[35213]: pgmap v383: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 560 op/s 2024-09-10T10:48:54.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:53 smithi092 ceph-mon[30834]: pgmap v383: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 560 op/s 2024-09-10T10:48:55.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:54 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:48:55.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:54 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:48:55.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:54 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:48:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: pgmap v384: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 560 op/s 2024-09-10T10:48:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:48:56.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:48:56.292 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: pgmap v384: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 560 op/s 2024-09-10T10:48:56.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:48:56.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:48:56.321 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: pgmap v384: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 560 op/s 2024-09-10T10:48:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:48:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:48:56.361 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:48:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 720.0 s, 1816.0 tps, lat 55.419 ms stddev 61.107 2024-09-10T10:48:58.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:57 smithi121 ceph-mon[35231]: pgmap v385: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.1 MiB/s wr, 817 op/s 2024-09-10T10:48:58.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:57 smithi097 ceph-mon[35213]: pgmap v385: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.1 MiB/s wr, 817 op/s 2024-09-10T10:48:58.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:57 smithi092 ceph-mon[30834]: pgmap v385: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.1 MiB/s wr, 817 op/s 2024-09-10T10:48:59.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.838+0000 7f88f6058640 1 -- 172.21.15.92:0/3940889215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 msgr2=0x7f88f0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.838+0000 7f88f6058640 1 --2- 172.21.15.92:0/3940889215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 0x7f88f0100c50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009930 tx=0x7f88e002a420 comp rx=0 tx=0).stop 2024-09-10T10:48:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.838+0000 7f88f6058640 1 -- 172.21.15.92:0/3940889215 shutdown_connections 2024-09-10T10:48:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.838+0000 7f88f6058640 1 --2- 172.21.15.92:0/3940889215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f0101190 0x7f88f010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.838+0000 7f88f6058640 1 --2- 172.21.15.92:0/3940889215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 0x7f88f0100c50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.838+0000 7f88f6058640 1 --2- 172.21.15.92:0/3940889215 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88f0106800 0x7f88f0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.838+0000 7f88f6058640 1 -- 172.21.15.92:0/3940889215 >> 172.21.15.92:0/3940889215 conn(0x7f88f00fc4f0 msgr2=0x7f88f00fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.838+0000 7f88f6058640 1 -- 172.21.15.92:0/3940889215 shutdown_connections 2024-09-10T10:48:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.838+0000 7f88f6058640 1 -- 172.21.15.92:0/3940889215 wait complete. 2024-09-10T10:48:59.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f6058640 1 Processor -- start 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f6058640 1 -- start start 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f6058640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 0x7f88f0199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f6058640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f0101190 0x7f88f0199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f6058640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88f0106800 0x7f88f01a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f6058640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0110c40 con 0x7f88f01007f0 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f6058640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0110ac0 con 0x7f88f0106800 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f6058640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0110dc0 con 0x7f88f0101190 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 0x7f88f0199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 0x7f88f0199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47086/0 (socket says 172.21.15.92:47086) 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5056640 1 -- 172.21.15.92:0/2174510343 learned_addr learned my addr 172.21.15.92:0/2174510343 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:59.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f4855640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f0101190 0x7f88f0199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5857640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88f0106800 0x7f88f01a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5056640 1 -- 172.21.15.92:0/2174510343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f0101190 msgr2=0x7f88f0199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5056640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f0101190 0x7f88f0199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5056640 1 -- 172.21.15.92:0/2174510343 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88f0106800 msgr2=0x7f88f01a41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5056640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88f0106800 0x7f88f01a41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5056640 1 -- 172.21.15.92:0/2174510343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f01a46f0 con 0x7f88f01007f0 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88f5056640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 0x7f88f0199130 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00e9f0 tx=0x7f88ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.839+0000 7f88e67fc640 1 -- 172.21.15.92:0/2174510343 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00cd80 con 0x7f88f01007f0 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.840+0000 7f88f6058640 1 -- 172.21.15.92:0/2174510343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f01a48c0 con 0x7f88f01007f0 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.840+0000 7f88e67fc640 1 -- 172.21.15.92:0/2174510343 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88ec010910 con 0x7f88f01007f0 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.840+0000 7f88e67fc640 1 -- 172.21.15.92:0/2174510343 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0188f0 con 0x7f88f01007f0 2024-09-10T10:48:59.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.840+0000 7f88f6058640 1 -- 172.21.15.92:0/2174510343 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f01a4e30 con 0x7f88f01007f0 2024-09-10T10:48:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.843+0000 7f88e67fc640 1 -- 172.21.15.92:0/2174510343 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f88ec010ac0 con 0x7f88f01007f0 2024-09-10T10:48:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88fa05b740 1 Processor -- start 2024-09-10T10:48:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88fa05b740 1 -- start start 2024-09-10T10:48:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab5ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 0x55830ab6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab71680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88fa05b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55830aac42f0 con 0x55830ab6f290 2024-09-10T10:48:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88fa05b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55830aa6c270 con 0x55830ab5fba0 2024-09-10T10:48:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88fa05b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55830aac02b0 con 0x55830ab604c0 2024-09-10T10:48:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88f5857640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab5ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88f4855640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab71680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88f5056640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 0x55830ab6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88f5857640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab5ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:35842/0 (socket says 172.21.15.92:35842) 2024-09-10T10:48:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88f5857640 1 -- 172.21.15.92:0/4076509795 learned_addr learned my addr 172.21.15.92:0/4076509795 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.844+0000 7f88e67fc640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f88dc0a2cf0 0x7f88dc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88f5857640 1 -- 172.21.15.92:0/4076509795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 msgr2=0x55830ab6ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88f5857640 1 --2- 172.21.15.92:0/4076509795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 0x55830ab6ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88f5857640 1 -- 172.21.15.92:0/4076509795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 msgr2=0x55830ab71680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88e67fc640 1 -- 172.21.15.92:0/2174510343 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7f88ec0cf750 con 0x7f88f01007f0 2024-09-10T10:48:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88f5857640 1 --2- 172.21.15.92:0/4076509795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab71680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88f5857640 1 -- 172.21.15.92:0/4076509795 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830aa6b340 con 0x55830ab5fba0 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88f4855640 1 --2- 172.21.15.92:0/4076509795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab71680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88f5857640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f88dc0a2cf0 0x7f88dc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88f5857640 1 --2- 172.21.15.92:0/4076509795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab5ff80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88e8013560 tx=0x7f88e8013a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f86f350eb858ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88db7fe640 1 -- 172.21.15.92:0/4076509795 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e800f640 con 0x55830ab5fba0 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88db7fe640 1 -- 172.21.15.92:0/4076509795 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88e8013150 con 0x55830ab5fba0 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88f5857640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f88dc0a2cf0 0x7f88dc0a51b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88e8022000 tx=0x7f88e801f000 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.845+0000 7f88db7fe640 1 -- 172.21.15.92:0/4076509795 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e80108d0 con 0x55830ab5fba0 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.846+0000 7f88fa05b740 1 -- 172.21.15.92:0/4076509795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 msgr2=0x55830ab5ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.846+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4076509795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab5ff80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88e8013560 tx=0x7f88e8013a20 comp rx=0 tx=0).stop 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.846+0000 7f88fa05b740 1 -- 172.21.15.92:0/4076509795 shutdown_connections 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.846+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4076509795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab71680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.846+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4076509795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 0x55830ab6ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.846+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4076509795 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab5ff80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.846+0000 7f88fa05b740 1 -- 172.21.15.92:0/4076509795 >> 172.21.15.92:0/4076509795 conn(0x55830ab5c230 msgr2=0x55830ab5c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.846+0000 7f88fa05b740 1 -- 172.21.15.92:0/4076509795 shutdown_connections 2024-09-10T10:48:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.846+0000 7f88fa05b740 1 -- 172.21.15.92:0/4076509795 wait complete. 2024-09-10T10:48:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88fa05b740 1 -- start start 2024-09-10T10:48:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88fa05b740 1 Processor -- start 2024-09-10T10:48:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab6c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 0x55830ab6c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 0x55830ab6cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88fa05b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55830ab71ec0 con 0x55830ab5fba0 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88fa05b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55830aa4d290 con 0x55830ab604c0 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88fa05b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55830ab72040 con 0x55830ab6f290 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88fa05b740 10 client.0 _ll_register_callbacks cb 0x55830aa7e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88f5056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab6c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88f5056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab6c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47106/0 (socket says 172.21.15.92:47106) 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88f5056640 1 -- 172.21.15.92:0/4278858373 learned_addr learned my addr 172.21.15.92:0/4278858373 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88f4855640 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 0x55830ab6c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.847+0000 7f88f5857640 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 0x55830ab6cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88f5056640 1 -- 172.21.15.92:0/4278858373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 msgr2=0x55830ab6cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88f5056640 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 0x55830ab6cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88f5056640 1 -- 172.21.15.92:0/4278858373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 msgr2=0x55830ab6c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:59.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88f5056640 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 0x55830ab6c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88f5056640 1 -- 172.21.15.92:0/4278858373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55830a7d7210 con 0x55830ab5fba0 2024-09-10T10:48:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88f4855640 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 0x55830ab6c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:48:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88f5056640 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab6c1f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00c6a0 tx=0x7f88ec09b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292b857f2be5413d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:48:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88d8ff9640 1 -- 172.21.15.92:0/4278858373 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0a0060 con 0x55830ab5fba0 2024-09-10T10:48:59.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88d8ff9640 1 -- 172.21.15.92:0/4278858373 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7f88ec09b1b0 con 0x55830ab5fba0 2024-09-10T10:48:59.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.848+0000 7f88fa05b740 1 -- 172.21.15.92:0/4278858373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88e8013150 con 0x55830ab5fba0 2024-09-10T10:48:59.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.849+0000 7f88d8ff9640 1 -- 172.21.15.92:0/4278858373 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f88ec09b3b0 con 0x55830ab5fba0 2024-09-10T10:48:59.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.849+0000 7f88fa05b740 10 client.16257 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.849+0000 7f88fa05b740 1 -- 172.21.15.92:0/4278858373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55830a8a3620 con 0x55830ab5fba0 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.850+0000 7f88d8ff9640 1 -- 172.21.15.92:0/4278858373 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88ec0b8020 con 0x55830ab5fba0 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.850+0000 7f88d8ff9640 1 -- 172.21.15.92:0/4278858373 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7f88ec097c10 con 0x55830ab5fba0 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.850+0000 7f88fa05b740 10 client.16257 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.850+0000 7f88fa05b740 10 client.16257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.850+0000 7f88fa05b740 20 client.16257 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.850+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55830ab7f350 0x55830ab81740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.850+0000 7f88fa05b740 4 client.16257 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.850+0000 7f88fa05b740 1 -- 172.21.15.92:0/4278858373 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f88e8013150 con 0x55830ab7f350 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.850+0000 7f88f4855640 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55830ab7f350 0x55830ab81740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.851+0000 7f88d8ff9640 10 client.16257 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.851+0000 7f88f4855640 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55830ab7f350 0x55830ab81740 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6388e95e55003d83 server_cookie=4783fb3535b40c46 in_seq=0 out_seq=0 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88d8ff9640 1 -- 172.21.15.92:0/4278858373 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f88e8013150 con 0x55830ab7f350 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88d8ff9640 10 client.16257 handle_command_reply: tid=0 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 client.16257 shutdown 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 -- 172.21.15.92:0/4278858373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 msgr2=0x55830ab6c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab6c1f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00c6a0 tx=0x7f88ec09b6c0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 -- 172.21.15.92:0/4278858373 shutdown_connections 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 0x55830ab6cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55830ab7f350 0x55830ab81740 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 0x55830ab6c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88d8ff9640 0 client.16257 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 --2- 172.21.15.92:0/4278858373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab6c1f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 -- 172.21.15.92:0/4278858373 >> 172.21.15.92:0/4278858373 conn(0x55830ab5c230 msgr2=0x55830ab61f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:59.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 -- 172.21.15.92:0/4278858373 shutdown_connections 2024-09-10T10:48:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 1 -- 172.21.15.92:0/4278858373 wait complete. 2024-09-10T10:48:59.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.852+0000 7f88fa05b740 20 client.16257 trim_cache size 0 max 16384 2024-09-10T10:48:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.870+0000 7f88fa05b740 1 Processor -- start 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88fa05b740 1 -- start start 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab87010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 0x55830ab87550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 0x55830ab69450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88fa05b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f88f01ab420 con 0x55830ab5fba0 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88fa05b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f88f01acfc0 con 0x55830ab604c0 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88fa05b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f88f01abaf0 con 0x55830ab6f290 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab87010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5056640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab87010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47118/0 (socket says 172.21.15.92:47118) 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5056640 1 -- 172.21.15.92:0/2723746734 learned_addr learned my addr 172.21.15.92:0/2723746734 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f4855640 1 --2- 172.21.15.92:0/2723746734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 0x55830ab87550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5857640 1 --2- 172.21.15.92:0/2723746734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 0x55830ab69450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5056640 1 -- 172.21.15.92:0/2723746734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 msgr2=0x55830ab69450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5056640 1 --2- 172.21.15.92:0/2723746734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 0x55830ab69450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5056640 1 -- 172.21.15.92:0/2723746734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 msgr2=0x55830ab87550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5056640 1 --2- 172.21.15.92:0/2723746734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 0x55830ab87550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5056640 1 -- 172.21.15.92:0/2723746734 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55830ab602f0 con 0x55830ab5fba0 2024-09-10T10:48:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.871+0000 7f88f5056640 1 --2- 172.21.15.92:0/2723746734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab87010 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0cd4e0 tx=0x7f88ec0a4aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca85ebeb128e853 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.872+0000 7f88daffd640 1 -- 172.21.15.92:0/2723746734 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec09b1b0 con 0x55830ab5fba0 2024-09-10T10:48:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.872+0000 7f88daffd640 1 -- 172.21.15.92:0/2723746734 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88ec018bd0 con 0x55830ab5fba0 2024-09-10T10:48:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.872+0000 7f88daffd640 1 -- 172.21.15.92:0/2723746734 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec097cb0 con 0x55830ab5fba0 2024-09-10T10:48:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 -- 172.21.15.92:0/2723746734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 msgr2=0x55830ab87010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 --2- 172.21.15.92:0/2723746734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab87010 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0cd4e0 tx=0x7f88ec0a4aa0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 -- 172.21.15.92:0/2723746734 shutdown_connections 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 --2- 172.21.15.92:0/2723746734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab6f290 0x55830ab69450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 --2- 172.21.15.92:0/2723746734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab604c0 0x55830ab87550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 --2- 172.21.15.92:0/2723746734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab5fba0 0x55830ab87010 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 -- 172.21.15.92:0/2723746734 >> 172.21.15.92:0/2723746734 conn(0x55830ab5c230 msgr2=0x55830ab6e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 -- 172.21.15.92:0/2723746734 shutdown_connections 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 -- 172.21.15.92:0/2723746734 wait complete. 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 -- start start 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.873+0000 7f88fa05b740 1 Processor -- start 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab69130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 0x55830ab69670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88fa05b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab69bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88fa05b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f88f01ac8f0 con 0x55830ab6f290 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88fa05b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f88f01ac1c0 con 0x55830ab5fba0 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88fa05b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f88f01a9420 con 0x55830ab604c0 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88fa05b740 10 client.0 _ll_register_callbacks cb 0x7f88ec009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5857640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab69bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5857640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab69bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47122/0 (socket says 172.21.15.92:47122) 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5857640 1 -- 172.21.15.92:0/499294701 learned_addr learned my addr 172.21.15.92:0/499294701 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5056640 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab69130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f4855640 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 0x55830ab69670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5857640 1 -- 172.21.15.92:0/499294701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 msgr2=0x55830ab69670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5857640 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 0x55830ab69670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5857640 1 -- 172.21.15.92:0/499294701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 msgr2=0x55830ab69130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5857640 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab69130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5857640 1 -- 172.21.15.92:0/499294701 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55830abe8fe0 con 0x55830ab6f290 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88f5857640 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab69bb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f88e8010540 tx=0x7f88e8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381432fb8bee2c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88d8ff9640 1 -- 172.21.15.92:0/499294701 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8009480 con 0x55830ab6f290 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88d8ff9640 1 -- 172.21.15.92:0/499294701 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8455+0+0 (secure 0 0 0) 0x7f88e8018040 con 0x55830ab6f290 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.874+0000 7f88fa05b740 1 -- 172.21.15.92:0/499294701 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88ec018bd0 con 0x55830ab6f290 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88d8ff9640 1 -- 172.21.15.92:0/499294701 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f88e8039050 con 0x55830ab6f290 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88fa05b740 10 client.16263 fetch_fsmap learned FSMap version 58 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88fa05b740 1 -- 172.21.15.92:0/499294701 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55830abea230 con 0x55830ab6f290 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88d8ff9640 1 -- 172.21.15.92:0/499294701 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88ec018bd0 con 0x55830ab6f290 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88d8ff9640 1 -- 172.21.15.92:0/499294701 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7f88e8027420 con 0x55830ab6f290 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88fa05b740 10 client.16263 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88fa05b740 10 client.16263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88fa05b740 20 client.16263 populate_metadata read hostname 'smithi092' 2024-09-10T10:48:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88fa05b740 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55830abea7b0 0x55830abecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:48:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88fa05b740 4 client.16263 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:48:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88fa05b740 1 -- 172.21.15.92:0/499294701 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55830aad1a20 con 0x55830abea7b0 2024-09-10T10:48:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88f5056640 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55830abea7b0 0x55830abecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:48:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88d8ff9640 10 client.16263 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.875+0000 7f88f5056640 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55830abea7b0 0x55830abecbd0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b19ca3247ee109d server_cookie=813ac76cef0c7af6 in_seq=0 out_seq=0 2024-09-10T10:48:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.887+0000 7f88d8ff9640 1 -- 172.21.15.92:0/499294701 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55830aad1a20 con 0x55830abea7b0 2024-09-10T10:48:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.888+0000 7f88d8ff9640 10 client.16263 handle_command_reply: tid=0 2024-09-10T10:48:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.888+0000 7f88fa05b740 1 client.16263 shutdown 2024-09-10T10:48:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 -- 172.21.15.92:0/499294701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 msgr2=0x55830ab69bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab69bb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f88e8010540 tx=0x7f88e8004a50 comp rx=0 tx=0).stop 2024-09-10T10:48:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 -- 172.21.15.92:0/499294701 shutdown_connections 2024-09-10T10:48:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55830ab6f290 0x55830ab69bb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55830ab604c0 0x55830ab69670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55830abea7b0 0x55830abecbd0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 --2- 172.21.15.92:0/499294701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55830ab5fba0 0x55830ab69130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 -- 172.21.15.92:0/499294701 >> 172.21.15.92:0/499294701 conn(0x55830ab5c230 msgr2=0x55830ab6da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88d8ff9640 0 client.16263 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:48:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 -- 172.21.15.92:0/499294701 shutdown_connections 2024-09-10T10:48:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.889+0000 7f88fa05b740 1 -- 172.21.15.92:0/499294701 wait complete. 2024-09-10T10:48:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.890+0000 7f88fa05b740 20 client.16263 trim_cache size 0 max 16384 2024-09-10T10:48:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:48:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:48:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:48:59.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:48:59.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 -- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f88dc0a2cf0 msgr2=0x7f88dc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f88dc0a2cf0 0x7f88dc0a51b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88e8022000 tx=0x7f88e801f000 comp rx=0 tx=0).stop 2024-09-10T10:48:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 -- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 msgr2=0x7f88f0199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:48:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 0x7f88f0199130 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00e9f0 tx=0x7f88ec00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 -- 172.21.15.92:0/2174510343 shutdown_connections 2024-09-10T10:48:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f88dc0a2cf0 0x7f88dc0a51b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f88f0106800 0x7f88f01a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88f0101190 0x7f88f0199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 --2- 172.21.15.92:0/2174510343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88f01007f0 0x7f88f0199130 secure :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00e9f0 tx=0x7f88ec00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:48:59.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.891+0000 7f88f6058640 1 -- 172.21.15.92:0/2174510343 >> 172.21.15.92:0/2174510343 conn(0x7f88f00fc4f0 msgr2=0x7f88f00fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:48:59.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.902+0000 7f88f6058640 1 -- 172.21.15.92:0/2174510343 shutdown_connections 2024-09-10T10:48:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:48:59.907+0000 7f88f6058640 1 -- 172.21.15.92:0/2174510343 wait complete. 2024-09-10T10:49:00.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:48:59 smithi121 ceph-mon[35231]: pgmap v386: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 518 op/s 2024-09-10T10:49:00.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:48:59 smithi097 ceph-mon[35213]: pgmap v386: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 518 op/s 2024-09-10T10:49:00.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:48:59 smithi092 ceph-mon[30834]: pgmap v386: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.2 MiB/s wr, 518 op/s 2024-09-10T10:49:02.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:01 smithi121 ceph-mon[35231]: pgmap v387: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.3 MiB/s wr, 724 op/s 2024-09-10T10:49:02.319 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:01 smithi097 ceph-mon[35213]: pgmap v387: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.3 MiB/s wr, 724 op/s 2024-09-10T10:49:02.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:01 smithi092 ceph-mon[30834]: pgmap v387: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.3 MiB/s wr, 724 op/s 2024-09-10T10:49:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 725.0 s, 1239.2 tps, lat 77.914 ms stddev 129.378 2024-09-10T10:49:04.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:03 smithi121 ceph-mon[35231]: pgmap v388: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 523 op/s 2024-09-10T10:49:04.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:03 smithi097 ceph-mon[35213]: pgmap v388: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 523 op/s 2024-09-10T10:49:04.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:03 smithi092 ceph-mon[30834]: pgmap v388: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 523 op/s 2024-09-10T10:49:06.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:05 smithi121 ceph-mon[35231]: pgmap v389: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 523 op/s 2024-09-10T10:49:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:05 smithi097 ceph-mon[35213]: pgmap v389: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 523 op/s 2024-09-10T10:49:06.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:05 smithi092 ceph-mon[30834]: pgmap v389: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 523 op/s 2024-09-10T10:49:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 730.0 s, 331.6 tps, lat 308.677 ms stddev 383.442 2024-09-10T10:49:08.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:07 smithi121 ceph-mon[35231]: pgmap v390: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.2 MiB/s wr, 685 op/s 2024-09-10T10:49:08.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:08 smithi121 ceph-mon[35231]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T10:49:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:08 smithi097 ceph-mon[35213]: pgmap v390: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.2 MiB/s wr, 685 op/s 2024-09-10T10:49:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:08 smithi097 ceph-mon[35213]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T10:49:08.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:07 smithi092 ceph-mon[30834]: pgmap v390: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.2 MiB/s wr, 685 op/s 2024-09-10T10:49:08.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:07 smithi092 ceph-mon[30834]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T10:49:10.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:10 smithi121 ceph-mon[35231]: pgmap v392: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.2 MiB/s wr, 514 op/s 2024-09-10T10:49:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:10 smithi097 ceph-mon[35213]: pgmap v392: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.2 MiB/s wr, 514 op/s 2024-09-10T10:49:10.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:10 smithi092 ceph-mon[30834]: pgmap v392: 97 pgs: 97 active+clean; 4.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.2 MiB/s wr, 514 op/s 2024-09-10T10:49:12.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:12 smithi121 ceph-mon[35231]: pgmap v393: 97 pgs: 97 active+clean; 4.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 22 MiB/s wr, 1.48k op/s 2024-09-10T10:49:12.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:12 smithi097 ceph-mon[35213]: pgmap v393: 97 pgs: 97 active+clean; 4.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 22 MiB/s wr, 1.48k op/s 2024-09-10T10:49:12.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:12 smithi092 ceph-mon[30834]: pgmap v393: 97 pgs: 97 active+clean; 4.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 22 MiB/s wr, 1.48k op/s 2024-09-10T10:49:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.058+0000 7fc5dcaba640 1 -- 172.21.15.92:0/3839486399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81069c0 msgr2=0x7fc5d8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:13.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.058+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/3839486399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81069c0 0x7fc5d8106da0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009890 tx=0x7fc5c802a380 comp rx=0 tx=0).stop 2024-09-10T10:49:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.059+0000 7fc5dcaba640 1 -- 172.21.15.92:0/3839486399 shutdown_connections 2024-09-10T10:49:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.059+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/3839486399 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5d8101350 0x7fc5d810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.059+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/3839486399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5d81009b0 0x7fc5d8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.059+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/3839486399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81069c0 0x7fc5d8106da0 secure :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009890 tx=0x7fc5c802a380 comp rx=0 tx=0).stop 2024-09-10T10:49:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.059+0000 7fc5dcaba640 1 -- 172.21.15.92:0/3839486399 >> 172.21.15.92:0/3839486399 conn(0x7fc5d8077990 msgr2=0x7fc5d80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.060+0000 7fc5dcaba640 1 -- 172.21.15.92:0/3839486399 shutdown_connections 2024-09-10T10:49:13.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.060+0000 7fc5dcaba640 1 -- 172.21.15.92:0/3839486399 wait complete. 2024-09-10T10:49:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.061+0000 7fc5dcaba640 1 Processor -- start 2024-09-10T10:49:13.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.061+0000 7fc5dcaba640 1 -- start start 2024-09-10T10:49:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.061+0000 7fc5dcaba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81009b0 0x7fc5d8196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5dcaba640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5d8101350 0x7fc5d81968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5dcaba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5d819ac20 0x7fc5d819b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5dcaba640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d810fd00 con 0x7fc5d81009b0 2024-09-10T10:49:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5d659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81009b0 0x7fc5d8196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5d659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81009b0 0x7fc5d8196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57948/0 (socket says 172.21.15.92:57948) 2024-09-10T10:49:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5d659c640 1 -- 172.21.15.92:0/2723405171 learned_addr learned my addr 172.21.15.92:0/2723405171 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5d6d9d640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5d819ac20 0x7fc5d819b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d810fb80 con 0x7fc5d8101350 2024-09-10T10:49:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5cffff640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5d8101350 0x7fc5d81968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.062+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d810fe80 con 0x7fc5d819ac20 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.063+0000 7fc5d659c640 1 -- 172.21.15.92:0/2723405171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5d819ac20 msgr2=0x7fc5d819b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.063+0000 7fc5d659c640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5d819ac20 0x7fc5d819b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.063+0000 7fc5d659c640 1 -- 172.21.15.92:0/2723405171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5d8101350 msgr2=0x7fc5d81968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.063+0000 7fc5d659c640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5d8101350 0x7fc5d81968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.063+0000 7fc5d659c640 1 -- 172.21.15.92:0/2723405171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d819b710 con 0x7fc5d81009b0 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.063+0000 7fc5cffff640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5d8101350 0x7fc5d81968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.063+0000 7fc5d659c640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81009b0 0x7fc5d8196360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8005940 tx=0x7fc5c8032750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.064+0000 7fc5cf7fe640 1 -- 172.21.15.92:0/2723405171 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8037070 con 0x7fc5d81009b0 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.064+0000 7fc5cf7fe640 1 -- 172.21.15.92:0/2723405171 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5c8040070 con 0x7fc5d81009b0 2024-09-10T10:49:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.064+0000 7fc5cf7fe640 1 -- 172.21.15.92:0/2723405171 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8005650 con 0x7fc5d81009b0 2024-09-10T10:49:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.064+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d819b9a0 con 0x7fc5d81009b0 2024-09-10T10:49:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.064+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d81a30b0 con 0x7fc5d81009b0 2024-09-10T10:49:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.069+0000 7fc5cf7fe640 1 -- 172.21.15.92:0/2723405171 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc5c8030550 con 0x7fc5d81009b0 2024-09-10T10:49:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.071+0000 7fc5cf7fe640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc5c40a2f80 0x7fc5c40a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.071+0000 7fc5cf7fe640 1 -- 172.21.15.92:0/2723405171 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8499+0+0 (secure 0 0 0) 0x7fc5c80f33b0 con 0x7fc5d81009b0 2024-09-10T10:49:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.072+0000 7fc5cffff640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc5c40a2f80 0x7fc5c40a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.072+0000 7fc5df855740 1 Processor -- start 2024-09-10T10:49:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.072+0000 7fc5df855740 1 -- start start 2024-09-10T10:49:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5df855740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b3539db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5df855740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b353a2f0 0x55e7b3555780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5cffff640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc5c40a2f80 0x7fc5c40a5440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80fffd0 tx=0x7fc5c000f040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5d659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b3539db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5d659c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b3539db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:53938/0 (socket says 172.21.15.92:53938) 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b353a2f0 0x55e7b3555780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5cffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b353a2f0 0x55e7b3555780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57954/0 (socket says 172.21.15.92:57954) 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5d659c640 1 -- 172.21.15.92:0/861933944 learned_addr learned my addr 172.21.15.92:0/861933944 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5df855740 1 --2- 172.21.15.92:0/861933944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b3555cc0 0x55e7b35580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5df855740 1 -- 172.21.15.92:0/861933944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e7b349e2f0 con 0x55e7b353a2f0 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5df855740 1 -- 172.21.15.92:0/861933944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e7b3446270 con 0x55e7b35399d0 2024-09-10T10:49:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5df855740 1 -- 172.21.15.92:0/861933944 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e7b349a2b0 con 0x55e7b3555cc0 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5d6d9d640 1 --2- 172.21.15.92:0/861933944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b3555cc0 0x55e7b35580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5d659c640 1 -- 172.21.15.92:0/861933944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b3555cc0 msgr2=0x55e7b35580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5d659c640 1 --2- 172.21.15.92:0/861933944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b3555cc0 0x55e7b35580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5d659c640 1 -- 172.21.15.92:0/861933944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b353a2f0 msgr2=0x55e7b3555780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5d659c640 1 --2- 172.21.15.92:0/861933944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b353a2f0 0x55e7b3555780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.073+0000 7fc5d659c640 1 -- 172.21.15.92:0/861933944 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7b3445340 con 0x55e7b35399d0 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.074+0000 7fc5d659c640 1 --2- 172.21.15.92:0/861933944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b3539db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8035040 tx=0x7fc5c8005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537759c7b372a807 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.074+0000 7fc5ccff9640 1 -- 172.21.15.92:0/861933944 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80d7030 con 0x55e7b35399d0 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.074+0000 7fc5ccff9640 1 -- 172.21.15.92:0/861933944 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5c8038040 con 0x55e7b35399d0 2024-09-10T10:49:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.074+0000 7fc5ccff9640 1 -- 172.21.15.92:0/861933944 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80bdd70 con 0x55e7b35399d0 2024-09-10T10:49:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.075+0000 7fc5df855740 1 -- 172.21.15.92:0/861933944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 msgr2=0x55e7b3539db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.075+0000 7fc5df855740 1 --2- 172.21.15.92:0/861933944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b3539db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8035040 tx=0x7fc5c8005f90 comp rx=0 tx=0).stop 2024-09-10T10:49:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.075+0000 7fc5df855740 1 -- 172.21.15.92:0/861933944 shutdown_connections 2024-09-10T10:49:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.075+0000 7fc5df855740 1 --2- 172.21.15.92:0/861933944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b3555cc0 0x55e7b35580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.075+0000 7fc5df855740 1 --2- 172.21.15.92:0/861933944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b353a2f0 0x55e7b3555780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.075+0000 7fc5df855740 1 --2- 172.21.15.92:0/861933944 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b3539db0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.075+0000 7fc5df855740 1 -- 172.21.15.92:0/861933944 >> 172.21.15.92:0/861933944 conn(0x55e7b3536060 msgr2=0x55e7b3536440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.075+0000 7fc5df855740 1 -- 172.21.15.92:0/861933944 shutdown_connections 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.075+0000 7fc5df855740 1 -- 172.21.15.92:0/861933944 wait complete. 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.076+0000 7fc5df855740 1 -- start start 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.076+0000 7fc5df855740 1 Processor -- start 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.076+0000 7fc5df855740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 0x55e7b3552c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.076+0000 7fc5df855740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 0x55e7b3553180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.076+0000 7fc5df855740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.076+0000 7fc5df855740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e7b35586b0 con 0x55e7b3555cc0 2024-09-10T10:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.076+0000 7fc5df855740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55e7b3427290 con 0x55e7b353a2f0 2024-09-10T10:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.076+0000 7fc5df855740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e7b3558830 con 0x55e7b35399d0 2024-09-10T10:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.076+0000 7fc5df855740 10 client.0 _ll_register_callbacks cb 0x55e7b3458140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.077+0000 7fc5d6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.077+0000 7fc5d6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57964/0 (socket says 172.21.15.92:57964) 2024-09-10T10:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.077+0000 7fc5d6d9d640 1 -- 172.21.15.92:0/1823177102 learned_addr learned my addr 172.21.15.92:0/1823177102 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.078+0000 7fc5d6d9d640 1 -- 172.21.15.92:0/1823177102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 msgr2=0x55e7b3552c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.078+0000 7fc5d6d9d640 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 0x55e7b3552c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.078+0000 7fc5d6d9d640 1 -- 172.21.15.92:0/1823177102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 msgr2=0x55e7b3553180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.078+0000 7fc5d6d9d640 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 0x55e7b3553180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.078+0000 7fc5d6d9d640 1 -- 172.21.15.92:0/1823177102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7b31b1210 con 0x55e7b3555cc0 2024-09-10T10:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.078+0000 7fc5d6d9d640 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35536c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009fc0 tx=0x7fc5d0012e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30054cd317d8e28c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:13.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.078+0000 7fc5bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.079+0000 7fc5bdffb640 1 -- 172.21.15.92:0/1823177102 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0003b70 con 0x55e7b3555cc0 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.079+0000 7fc5bdffb640 1 -- 172.21.15.92:0/1823177102 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8499+0+0 (secure 0 0 0) 0x7fc5d0003d10 con 0x55e7b3555cc0 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.079+0000 7fc5df855740 1 -- 172.21.15.92:0/1823177102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5c8038040 con 0x55e7b3555cc0 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.079+0000 7fc5bdffb640 1 -- 172.21.15.92:0/1823177102 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fc5d000f960 con 0x55e7b3555cc0 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.079+0000 7fc5df855740 10 client.16275 fetch_fsmap learned FSMap version 58 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.080+0000 7fc5df855740 1 -- 172.21.15.92:0/1823177102 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55e7b327d620 con 0x55e7b3555cc0 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.080+0000 7fc5bdffb640 1 -- 172.21.15.92:0/1823177102 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5c8038040 con 0x55e7b3555cc0 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.080+0000 7fc5bdffb640 1 -- 172.21.15.92:0/1823177102 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7fc5d0036470 con 0x55e7b3555cc0 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.080+0000 7fc5df855740 10 client.16275 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:49:13.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.080+0000 7fc5df855740 10 client.16275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.080+0000 7fc5df855740 20 client.16275 populate_metadata read hostname 'smithi092' 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.080+0000 7fc5df855740 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55e7b355cf00 0x55e7b355f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.080+0000 7fc5df855740 4 client.16275 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.080+0000 7fc5df855740 1 -- 172.21.15.92:0/1823177102 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7b34aba20 con 0x55e7b355cf00 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.081+0000 7fc5d659c640 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55e7b355cf00 0x55e7b355f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.081+0000 7fc5bdffb640 10 client.16275 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.081+0000 7fc5d659c640 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55e7b355cf00 0x55e7b355f3a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ef61ce763f0396c server_cookie=3b87d40e36c7780e in_seq=0 out_seq=0 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5bdffb640 1 -- 172.21.15.92:0/1823177102 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7b34aba20 con 0x55e7b355cf00 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5bdffb640 10 client.16275 handle_command_reply: tid=0 2024-09-10T10:49:13.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 client.16275 shutdown 2024-09-10T10:49:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 -- 172.21.15.92:0/1823177102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 msgr2=0x55e7b35536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:13.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35536c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009fc0 tx=0x7fc5d0012e70 comp rx=0 tx=0).stop 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 -- 172.21.15.92:0/1823177102 shutdown_connections 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35536c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55e7b355cf00 0x55e7b355f3a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5bdffb640 0 client.16275 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 0x55e7b3553180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 --2- 172.21.15.92:0/1823177102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 0x55e7b3552c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 -- 172.21.15.92:0/1823177102 >> 172.21.15.92:0/1823177102 conn(0x55e7b3536060 msgr2=0x55e7b35351c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 -- 172.21.15.92:0/1823177102 shutdown_connections 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.082+0000 7fc5df855740 1 -- 172.21.15.92:0/1823177102 wait complete. 2024-09-10T10:49:13.086 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.083+0000 7fc5df855740 20 client.16275 trim_cache size 0 max 16384 2024-09-10T10:49:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.102+0000 7fc5df855740 1 Processor -- start 2024-09-10T10:49:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.102+0000 7fc5df855740 1 -- start start 2024-09-10T10:49:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.103+0000 7fc5df855740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 0x55e7b3554bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.103+0000 7fc5df855740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 0x55e7b354fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.103+0000 7fc5df855740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35503c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.103+0000 7fc5d659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 0x55e7b3554bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.103+0000 7fc5d659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 0x55e7b3554bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:42706/0 (socket says 172.21.15.92:42706) 2024-09-10T10:49:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.103+0000 7fc5cffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 0x55e7b354fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.103+0000 7fc5cffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 0x55e7b354fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:53952/0 (socket says 172.21.15.92:53952) 2024-09-10T10:49:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.104+0000 7fc5d659c640 1 -- 172.21.15.92:0/137667274 learned_addr learned my addr 172.21.15.92:0/137667274 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.104+0000 7fc5d6d9d640 1 --2- 172.21.15.92:0/137667274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.104+0000 7fc5df855740 1 -- 172.21.15.92:0/137667274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81a3280 con 0x55e7b3555cc0 2024-09-10T10:49:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.104+0000 7fc5df855740 1 -- 172.21.15.92:0/137667274 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81a4dd0 con 0x55e7b353a2f0 2024-09-10T10:49:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.104+0000 7fc5df855740 1 -- 172.21.15.92:0/137667274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81a3900 con 0x55e7b35399d0 2024-09-10T10:49:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.105+0000 7fc5d659c640 1 -- 172.21.15.92:0/137667274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 msgr2=0x55e7b354fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.105+0000 7fc5d659c640 1 --2- 172.21.15.92:0/137667274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 0x55e7b354fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.105+0000 7fc5d659c640 1 -- 172.21.15.92:0/137667274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 msgr2=0x55e7b35503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.105+0000 7fc5d659c640 1 --2- 172.21.15.92:0/137667274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.105+0000 7fc5d659c640 1 -- 172.21.15.92:0/137667274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7b354e7f0 con 0x55e7b35399d0 2024-09-10T10:49:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.105+0000 7fc5d659c640 1 --2- 172.21.15.92:0/137667274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 0x55e7b3554bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80bf690 tx=0x7fc5c80bdc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed8bac4ca38eb969 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.105+0000 7fc5bffff640 1 -- 172.21.15.92:0/137667274 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80de070 con 0x55e7b35399d0 2024-09-10T10:49:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.105+0000 7fc5bffff640 1 -- 172.21.15.92:0/137667274 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5c80dc070 con 0x55e7b35399d0 2024-09-10T10:49:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.105+0000 7fc5bffff640 1 -- 172.21.15.92:0/137667274 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c80d7040 con 0x55e7b35399d0 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 -- 172.21.15.92:0/137667274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 msgr2=0x55e7b3554bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 --2- 172.21.15.92:0/137667274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 0x55e7b3554bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80bf690 tx=0x7fc5c80bdc90 comp rx=0 tx=0).stop 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 -- 172.21.15.92:0/137667274 shutdown_connections 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 --2- 172.21.15.92:0/137667274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 --2- 172.21.15.92:0/137667274 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b353a2f0 0x55e7b354fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 --2- 172.21.15.92:0/137667274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b35399d0 0x55e7b3554bb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 -- 172.21.15.92:0/137667274 >> 172.21.15.92:0/137667274 conn(0x55e7b3536060 msgr2=0x55e7b35544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 -- 172.21.15.92:0/137667274 shutdown_connections 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 -- 172.21.15.92:0/137667274 wait complete. 2024-09-10T10:49:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 -- start start 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.106+0000 7fc5df855740 1 Processor -- start 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5df855740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b356f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5df855740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b353a2f0 0x55e7b356fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5df855740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5df855740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81a4700 con 0x55e7b3555cc0 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5df855740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d81a3fd0 con 0x55e7b35399d0 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5df855740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d80723d0 con 0x55e7b353a2f0 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57980/0 (socket says 172.21.15.92:57980) 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d6d9d640 1 -- 172.21.15.92:0/2894823876 learned_addr learned my addr 172.21.15.92:0/2894823876 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5df855740 10 client.0 _ll_register_callbacks cb 0x7fc5d0009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5cffff640 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b353a2f0 0x55e7b356fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d659c640 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b356f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d6d9d640 1 -- 172.21.15.92:0/2894823876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b353a2f0 msgr2=0x55e7b356fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d6d9d640 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b353a2f0 0x55e7b356fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d6d9d640 1 -- 172.21.15.92:0/2894823876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 msgr2=0x55e7b356f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d6d9d640 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b356f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d6d9d640 1 -- 172.21.15.92:0/2894823876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7b35c9610 con 0x55e7b3555cc0 2024-09-10T10:49:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5d6d9d640 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35c8f70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0012630 tx=0x7fc5d0012660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c48c1a2c85d85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.107+0000 7fc5bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:49:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.108+0000 7fc5bdffb640 1 -- 172.21.15.92:0/2894823876 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0045060 con 0x55e7b3555cc0 2024-09-10T10:49:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.108+0000 7fc5bdffb640 1 -- 172.21.15.92:0/2894823876 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8499+0+0 (secure 0 0 0) 0x7fc5d0036ab0 con 0x55e7b3555cc0 2024-09-10T10:49:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.108+0000 7fc5df855740 1 -- 172.21.15.92:0/2894823876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5c80dc070 con 0x55e7b3555cc0 2024-09-10T10:49:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.108+0000 7fc5bdffb640 1 -- 172.21.15.92:0/2894823876 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fc5d003c040 con 0x55e7b3555cc0 2024-09-10T10:49:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.108+0000 7fc5df855740 10 client.16281 fetch_fsmap learned FSMap version 58 2024-09-10T10:49:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.108+0000 7fc5df855740 1 -- 172.21.15.92:0/2894823876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55e7b35d0a10 con 0x55e7b3555cc0 2024-09-10T10:49:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.108+0000 7fc5bdffb640 1 -- 172.21.15.92:0/2894823876 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5c80dc070 con 0x55e7b3555cc0 2024-09-10T10:49:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.108+0000 7fc5bdffb640 1 -- 172.21.15.92:0/2894823876 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 58) ==== 8378+0+0 (secure 0 0 0) 0x7fc5d0005040 con 0x55e7b3555cc0 2024-09-10T10:49:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.109+0000 7fc5df855740 10 client.16281 fetch_fsmap finished waiting for FSMap version 58 2024-09-10T10:49:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.109+0000 7fc5df855740 10 client.16281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:49:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.109+0000 7fc5df855740 20 client.16281 populate_metadata read hostname 'smithi092' 2024-09-10T10:49:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.109+0000 7fc5df855740 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55e7b355cf00 0x55e7b35d3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.109+0000 7fc5df855740 4 client.16281 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:49:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.109+0000 7fc5df855740 1 -- 172.21.15.92:0/2894823876 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e7b34a5d70 con 0x55e7b355cf00 2024-09-10T10:49:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.109+0000 7fc5d659c640 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55e7b355cf00 0x55e7b35d3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.109+0000 7fc5bdffb640 10 client.16281 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.109+0000 7fc5d659c640 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55e7b355cf00 0x55e7b35d3230 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424459cda1b76879 server_cookie=4cacf6c1ac45adae in_seq=0 out_seq=0 2024-09-10T10:49:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5bdffb640 1 -- 172.21.15.92:0/2894823876 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e7b34a5d70 con 0x55e7b355cf00 2024-09-10T10:49:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5bdffb640 10 client.16281 handle_command_reply: tid=0 2024-09-10T10:49:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5df855740 1 client.16281 shutdown 2024-09-10T10:49:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5df855740 1 -- 172.21.15.92:0/2894823876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 msgr2=0x55e7b35c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5df855740 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35c8f70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0012630 tx=0x7fc5d0012660 comp rx=0 tx=0).stop 2024-09-10T10:49:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5df855740 1 -- 172.21.15.92:0/2894823876 shutdown_connections 2024-09-10T10:49:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5df855740 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e7b3555cc0 0x55e7b35c8f70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5df855740 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e7b353a2f0 0x55e7b356fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5df855740 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55e7b355cf00 0x55e7b35d3230 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5bdffb640 0 client.16281 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5df855740 1 --2- 172.21.15.92:0/2894823876 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55e7b35399d0 0x55e7b356f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.118+0000 7fc5df855740 1 -- 172.21.15.92:0/2894823876 >> 172.21.15.92:0/2894823876 conn(0x55e7b3536060 msgr2=0x55e7b3553420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5df855740 1 -- 172.21.15.92:0/2894823876 shutdown_connections 2024-09-10T10:49:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5df855740 1 -- 172.21.15.92:0/2894823876 wait complete. 2024-09-10T10:49:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5df855740 20 client.16281 trim_cache size 0 max 16384 2024-09-10T10:49:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:49:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:49:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:49:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:49:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc5c40a2f80 msgr2=0x7fc5c40a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc5c40a2f80 0x7fc5c40a5440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5d80fffd0 tx=0x7fc5c000f040 comp rx=0 tx=0).stop 2024-09-10T10:49:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81009b0 msgr2=0x7fc5d8196360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81009b0 0x7fc5d8196360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8005940 tx=0x7fc5c8032750 comp rx=0 tx=0).stop 2024-09-10T10:49:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 shutdown_connections 2024-09-10T10:49:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc5d819ac20 0x7fc5d819b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc5c40a2f80 0x7fc5c40a5440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc5d8101350 0x7fc5d81968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 --2- 172.21.15.92:0/2723405171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5d81009b0 0x7fc5d8196360 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 >> 172.21.15.92:0/2723405171 conn(0x7fc5d8077990 msgr2=0x7fc5d81039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 shutdown_connections 2024-09-10T10:49:13.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:13.119+0000 7fc5dcaba640 1 -- 172.21.15.92:0/2723405171 wait complete. 2024-09-10T10:49:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 735.0 s, 2112.4 tps, lat 47.941 ms stddev 60.874 2024-09-10T10:49:14.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:14 smithi121 ceph-mon[35231]: pgmap v394: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 1.92k op/s 2024-09-10T10:49:14.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:14 smithi097 ceph-mon[35213]: pgmap v394: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 1.92k op/s 2024-09-10T10:49:14.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:14 smithi092 ceph-mon[30834]: pgmap v394: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 29 MiB/s wr, 1.92k op/s 2024-09-10T10:49:15.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:15 smithi121 ceph-mon[35231]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T10:49:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:15 smithi097 ceph-mon[35213]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T10:49:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:15 smithi092 ceph-mon[30834]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T10:49:16.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:16 smithi121 ceph-mon[35231]: pgmap v396: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 35 MiB/s wr, 2.16k op/s 2024-09-10T10:49:16.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:16 smithi097 ceph-mon[35213]: pgmap v396: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 35 MiB/s wr, 2.16k op/s 2024-09-10T10:49:16.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:16 smithi092 ceph-mon[30834]: pgmap v396: 97 pgs: 97 active+clean; 4.3 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 35 MiB/s wr, 2.16k op/s 2024-09-10T10:49:17.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:17 smithi121 ceph-mon[35231]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 2.16k op/s 2024-09-10T10:49:17.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:17 smithi097 ceph-mon[35213]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 2.16k op/s 2024-09-10T10:49:17.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:17 smithi092 ceph-mon[30834]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 2.16k op/s 2024-09-10T10:49:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 740.0 s, 2556.4 tps, lat 39.367 ms stddev 45.878 2024-09-10T10:49:19.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:19 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:49:19.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:19 smithi121 ceph-mon[35231]: pgmap v398: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 2.08k op/s 2024-09-10T10:49:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:19 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:49:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:19 smithi097 ceph-mon[35213]: pgmap v398: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 2.08k op/s 2024-09-10T10:49:19.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:19 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:49:19.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:19 smithi092 ceph-mon[30834]: pgmap v398: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 MiB/s wr, 2.08k op/s 2024-09-10T10:49:22.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:21 smithi121 ceph-mon[35231]: pgmap v399: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-10T10:49:22.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:21 smithi097 ceph-mon[35213]: pgmap v399: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-10T10:49:22.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:21 smithi092 ceph-mon[30834]: pgmap v399: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-10T10:49:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 745.0 s, 2371.4 tps, lat 41.593 ms stddev 48.379 2024-09-10T10:49:24.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:23 smithi121 ceph-mon[35231]: pgmap v400: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.0 MiB/s wr, 714 op/s 2024-09-10T10:49:24.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:23 smithi097 ceph-mon[35213]: pgmap v400: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.0 MiB/s wr, 714 op/s 2024-09-10T10:49:24.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:23 smithi092 ceph-mon[30834]: pgmap v400: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.0 MiB/s wr, 714 op/s 2024-09-10T10:49:26.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:25 smithi121 ceph-mon[35231]: pgmap v401: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.9 MiB/s wr, 704 op/s 2024-09-10T10:49:26.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:25 smithi097 ceph-mon[35213]: pgmap v401: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.9 MiB/s wr, 704 op/s 2024-09-10T10:49:26.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:25 smithi092 ceph-mon[30834]: pgmap v401: 97 pgs: 97 active+clean; 4.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.9 MiB/s wr, 704 op/s 2024-09-10T10:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.247+0000 7f4af7166640 1 -- 172.21.15.92:0/485565510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 msgr2=0x7f4af010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.247+0000 7f4af7166640 1 --2- 172.21.15.92:0/485565510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 0x7f4af010d880 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009cd0 tx=0x7f4ae802a8e0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.247+0000 7f4af7166640 1 -- 172.21.15.92:0/485565510 shutdown_connections 2024-09-10T10:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.247+0000 7f4af7166640 1 --2- 172.21.15.92:0/485565510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 0x7f4af010d880 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.247+0000 7f4af7166640 1 --2- 172.21.15.92:0/485565510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4af01009b0 0x7f4af0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.247+0000 7f4af7166640 1 --2- 172.21.15.92:0/485565510 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4af01069c0 0x7f4af0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.247+0000 7f4af7166640 1 -- 172.21.15.92:0/485565510 >> 172.21.15.92:0/485565510 conn(0x7f4af0077990 msgr2=0x7f4af00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.247+0000 7f4af7166640 1 -- 172.21.15.92:0/485565510 shutdown_connections 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.247+0000 7f4af7166640 1 -- 172.21.15.92:0/485565510 wait complete. 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4af7166640 1 Processor -- start 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4af7166640 1 -- start start 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4af7166640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4af01009b0 0x7f4af0197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4af7166640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 0x7f4af01977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4aeffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 0x7f4af01977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4aeffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 0x7f4af01977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46806/0 (socket says 172.21.15.92:46806) 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4af7166640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4af01069c0 0x7f4af019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4aeffff640 1 -- 172.21.15.92:0/3929675451 learned_addr learned my addr 172.21.15.92:0/3929675451 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0110e50 con 0x7f4af0101350 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0110cd0 con 0x7f4af01009b0 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0110fd0 con 0x7f4af01069c0 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.248+0000 7f4af4f02640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4af01009b0 0x7f4af0197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4af5703640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4af01069c0 0x7f4af019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4aeffff640 1 -- 172.21.15.92:0/3929675451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4af01069c0 msgr2=0x7f4af019bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4aeffff640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4af01069c0 0x7f4af019bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4aeffff640 1 -- 172.21.15.92:0/3929675451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4af01009b0 msgr2=0x7f4af0197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4aeffff640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4af01009b0 0x7f4af0197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4aeffff640 1 -- 172.21.15.92:0/3929675451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af019c270 con 0x7f4af0101350 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4aeffff640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 0x7f4af01977c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009f20 tx=0x7f4adc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4aedffb640 1 -- 172.21.15.92:0/3929675451 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc020070 con 0x7f4af0101350 2024-09-10T10:49:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af019c560 con 0x7f4af0101350 2024-09-10T10:49:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4aedffb640 1 -- 172.21.15.92:0/3929675451 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4adc00cd80 con 0x7f4af0101350 2024-09-10T10:49:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4aedffb640 1 -- 172.21.15.92:0/3929675451 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc01bbb0 con 0x7f4af0101350 2024-09-10T10:49:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.249+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af00698a0 con 0x7f4af0101350 2024-09-10T10:49:26.255 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af9fde740 1 Processor -- start 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af9fde740 1 -- start start 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f3250ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f325e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af9fde740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5631f31b52f0 con 0x5631f325bcb0 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af9fde740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5631f315d270 con 0x5631f3250af0 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af9fde740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5631f31b12b0 con 0x5631f3251410 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af4f02640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.253+0000 7f4af4f02640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:40772/0 (socket says 172.21.15.92:40772) 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4af4f02640 1 -- 172.21.15.92:0/3137289408 learned_addr learned my addr 172.21.15.92:0/3137289408 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4af5703640 1 --2- 172.21.15.92:0/3137289408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f3250ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.256 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4aedffb640 1 -- 172.21.15.92:0/3929675451 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4adc023070 con 0x7f4af0101350 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4af4f02640 1 -- 172.21.15.92:0/3137289408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 msgr2=0x5631f3250ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4af4f02640 1 --2- 172.21.15.92:0/3137289408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f3250ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4af4f02640 1 -- 172.21.15.92:0/3137289408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 msgr2=0x5631f325e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4af4f02640 1 --2- 172.21.15.92:0/3137289408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f325e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4af4f02640 1 -- 172.21.15.92:0/3137289408 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f315c340 con 0x5631f3251410 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4af5703640 1 --2- 172.21.15.92:0/3137289408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f3250ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4af4f02640 1 --2- 172.21.15.92:0/3137289408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325b770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009bf0 tx=0x7f4ae4005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a50207f1c07c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4adaffd640 1 -- 172.21.15.92:0/3137289408 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4017400 con 0x5631f3251410 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4adaffd640 1 -- 172.21.15.92:0/3137289408 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae4017a80 con 0x5631f3251410 2024-09-10T10:49:26.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4adaffd640 1 -- 172.21.15.92:0/3137289408 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4016a60 con 0x5631f3251410 2024-09-10T10:49:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.254+0000 7f4aedffb640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4ae00a2da0 0x7f4ae00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4aedffb640 1 -- 172.21.15.92:0/3929675451 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7f4adc0d34a0 con 0x7f4af0101350 2024-09-10T10:49:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af5703640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4ae00a2da0 0x7f4ae00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.261 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af5703640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4ae00a2da0 0x7f4ae00a5260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8004af0 tx=0x7f4ae8005d80 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af9fde740 1 -- 172.21.15.92:0/3137289408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 msgr2=0x5631f325b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af9fde740 1 --2- 172.21.15.92:0/3137289408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325b770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009bf0 tx=0x7f4ae4005f90 comp rx=0 tx=0).stop 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af9fde740 1 -- 172.21.15.92:0/3137289408 shutdown_connections 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af9fde740 1 --2- 172.21.15.92:0/3137289408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f325e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af9fde740 1 --2- 172.21.15.92:0/3137289408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325b770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af9fde740 1 --2- 172.21.15.92:0/3137289408 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f3250ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af9fde740 1 -- 172.21.15.92:0/3137289408 >> 172.21.15.92:0/3137289408 conn(0x5631f324d060 msgr2=0x5631f324d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af9fde740 1 -- 172.21.15.92:0/3137289408 shutdown_connections 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.255+0000 7f4af9fde740 1 -- 172.21.15.92:0/3137289408 wait complete. 2024-09-10T10:49:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af9fde740 1 -- start start 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af9fde740 1 Processor -- start 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f3250af0 0x5631f3258b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f32590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f325bcb0 0x5631f32595e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af9fde740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5631f325e880 con 0x5631f3250af0 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af9fde740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5631f313e290 con 0x5631f325bcb0 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af9fde740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5631f325ea00 con 0x5631f3251410 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af4f02640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f3250af0 0x5631f3258b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af4f02640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f3250af0 0x5631f3258b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46828/0 (socket says 172.21.15.92:46828) 2024-09-10T10:49:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.256+0000 7f4af4f02640 1 -- 172.21.15.92:0/2995421501 learned_addr learned my addr 172.21.15.92:0/2995421501 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4af9fde740 10 client.0 _ll_register_callbacks cb 0x5631f316f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4aeffff640 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f32590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4af4f02640 1 -- 172.21.15.92:0/2995421501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 msgr2=0x5631f32590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4af4f02640 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f32590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4af4f02640 1 -- 172.21.15.92:0/2995421501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f325bcb0 msgr2=0x5631f32595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4af4f02640 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f325bcb0 0x5631f32595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4af4f02640 1 -- 172.21.15.92:0/2995421501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f2ec8210 con 0x5631f3250af0 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4af4f02640 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f3250af0 0x5631f3258b60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4010010 tx=0x7f4ae4016360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c359913f50d7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4acffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:49:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4acffff640 1 -- 172.21.15.92:0/2995421501 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4017810 con 0x5631f3250af0 2024-09-10T10:49:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4acffff640 1 -- 172.21.15.92:0/2995421501 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7f4ae4005040 con 0x5631f3250af0 2024-09-10T10:49:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4af9fde740 1 -- 172.21.15.92:0/2995421501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae4017a80 con 0x5631f3250af0 2024-09-10T10:49:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.257+0000 7f4acffff640 1 -- 172.21.15.92:0/2995421501 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f4ae4005240 con 0x5631f3250af0 2024-09-10T10:49:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4af9fde740 10 client.16290 fetch_fsmap learned FSMap version 59 2024-09-10T10:49:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4af9fde740 1 -- 172.21.15.92:0/2995421501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x5631f2f94620 con 0x5631f3250af0 2024-09-10T10:49:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4acffff640 1 -- 172.21.15.92:0/2995421501 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae4017a80 con 0x5631f3250af0 2024-09-10T10:49:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4acffff640 1 -- 172.21.15.92:0/2995421501 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f4ae4004750 con 0x5631f3250af0 2024-09-10T10:49:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4af9fde740 10 client.16290 fetch_fsmap finished waiting for FSMap version 59 2024-09-10T10:49:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4af9fde740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:49:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4af9fde740 20 client.16290 populate_metadata read hostname 'smithi092' 2024-09-10T10:49:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4af9fde740 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5631f326baf0 0x5631f326dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4af9fde740 4 client.16290 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:49:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4af9fde740 1 -- 172.21.15.92:0/2995421501 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631f31c2a20 con 0x5631f326baf0 2024-09-10T10:49:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.258+0000 7f4aeffff640 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5631f326baf0 0x5631f326dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.259+0000 7f4aeffff640 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5631f326baf0 0x5631f326dee0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b3cf1fd2fb0e71 server_cookie=e418c5969c48dd1c in_seq=0 out_seq=0 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.260+0000 7f4acffff640 10 client.16290 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.261+0000 7f4acffff640 1 -- 172.21.15.92:0/2995421501 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631f31c2a20 con 0x5631f326baf0 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.261+0000 7f4acffff640 10 client.16290 handle_command_reply: tid=0 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.261+0000 7f4af9fde740 1 client.16290 shutdown 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.261+0000 7f4af9fde740 1 -- 172.21.15.92:0/2995421501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f3250af0 msgr2=0x5631f3258b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.261+0000 7f4af9fde740 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f3250af0 0x5631f3258b60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4010010 tx=0x7f4ae4016360 comp rx=0 tx=0).stop 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4af9fde740 1 -- 172.21.15.92:0/2995421501 shutdown_connections 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4af9fde740 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5631f326baf0 0x5631f326dee0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4af9fde740 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f325bcb0 0x5631f32595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4af9fde740 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f32590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4af9fde740 1 --2- 172.21.15.92:0/2995421501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f3250af0 0x5631f3258b60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4af9fde740 1 -- 172.21.15.92:0/2995421501 >> 172.21.15.92:0/2995421501 conn(0x5631f324d060 msgr2=0x5631f3252d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4acffff640 0 client.16290 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4af9fde740 1 -- 172.21.15.92:0/2995421501 shutdown_connections 2024-09-10T10:49:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4af9fde740 1 -- 172.21.15.92:0/2995421501 wait complete. 2024-09-10T10:49:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.262+0000 7f4af9fde740 20 client.16290 trim_cache size 0 max 16384 2024-09-10T10:49:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.279+0000 7f4af9fde740 1 Processor -- start 2024-09-10T10:49:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4af9fde740 1 -- start start 2024-09-10T10:49:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3250af0 0x5631f325aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3251410 0x5631f3259090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4af9fde740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01ab580 con 0x5631f325bcb0 2024-09-10T10:49:26.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4af9fde740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01ad120 con 0x5631f3251410 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4af9fde740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01abc50 con 0x5631f3250af0 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4aeffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3251410 0x5631f3259090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4aeffff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3251410 0x5631f3259090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:36960/0 (socket says 172.21.15.92:36960) 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4af5703640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4aeffff640 1 -- 172.21.15.92:0/1948301984 learned_addr learned my addr 172.21.15.92:0/1948301984 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4af4f02640 1 --2- 172.21.15.92:0/1948301984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3250af0 0x5631f325aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4aeffff640 1 -- 172.21.15.92:0/1948301984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3250af0 msgr2=0x5631f325aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4aeffff640 1 --2- 172.21.15.92:0/1948301984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3250af0 0x5631f325aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4aeffff640 1 -- 172.21.15.92:0/1948301984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 msgr2=0x5631f32595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4aeffff640 1 --2- 172.21.15.92:0/1948301984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.280+0000 7f4aeffff640 1 -- 172.21.15.92:0/1948301984 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f32482d0 con 0x5631f3251410 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.281+0000 7f4aeffff640 1 --2- 172.21.15.92:0/1948301984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3251410 0x5631f3259090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4adc09fb50 tx=0x7f4adc015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5c54fafa2d33295 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.281+0000 7f4ada7fc640 1 -- 172.21.15.92:0/1948301984 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0bd070 con 0x5631f3251410 2024-09-10T10:49:26.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.281+0000 7f4ada7fc640 1 -- 172.21.15.92:0/1948301984 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4adc0a3ec0 con 0x5631f3251410 2024-09-10T10:49:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.281+0000 7f4ada7fc640 1 -- 172.21.15.92:0/1948301984 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0b7030 con 0x5631f3251410 2024-09-10T10:49:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.281+0000 7f4af9fde740 1 -- 172.21.15.92:0/1948301984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3251410 msgr2=0x5631f3259090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.281+0000 7f4af9fde740 1 --2- 172.21.15.92:0/1948301984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3251410 0x5631f3259090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4adc09fb50 tx=0x7f4adc015040 comp rx=0 tx=0).stop 2024-09-10T10:49:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.281+0000 7f4af9fde740 1 -- 172.21.15.92:0/1948301984 shutdown_connections 2024-09-10T10:49:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 --2- 172.21.15.92:0/1948301984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 --2- 172.21.15.92:0/1948301984 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3251410 0x5631f3259090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 --2- 172.21.15.92:0/1948301984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3250af0 0x5631f325aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 -- 172.21.15.92:0/1948301984 >> 172.21.15.92:0/1948301984 conn(0x5631f324d060 msgr2=0x5631f325a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 -- 172.21.15.92:0/1948301984 shutdown_connections 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 -- 172.21.15.92:0/1948301984 wait complete. 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 -- start start 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 Processor -- start 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f325ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32d44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01aca50 con 0x5631f325bcb0 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01ac320 con 0x5631f3250af0 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4af01a9580 con 0x5631f3251410 2024-09-10T10:49:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af9fde740 10 client.0 _ll_register_callbacks cb 0x7f4ae4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af5703640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32d44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af4f02640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f325ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4aeffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af5703640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32d44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46850/0 (socket says 172.21.15.92:46850) 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.282+0000 7f4af5703640 1 -- 172.21.15.92:0/995841640 learned_addr learned my addr 172.21.15.92:0/995841640 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.283+0000 7f4af5703640 1 -- 172.21.15.92:0/995841640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 msgr2=0x5631f325f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.283+0000 7f4af5703640 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.283+0000 7f4af5703640 1 -- 172.21.15.92:0/995841640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 msgr2=0x5631f325ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.283+0000 7f4af5703640 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f325ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.283+0000 7f4af5703640 1 -- 172.21.15.92:0/995841640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f325fb30 con 0x5631f325bcb0 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.283+0000 7f4aeffff640 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.283+0000 7f4af4f02640 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f325ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.283+0000 7f4af5703640 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32d44d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009cd0 tx=0x7f4ae802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1e508743f90c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.283+0000 7f4acffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:49:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.284+0000 7f4acffff640 1 -- 172.21.15.92:0/995841640 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8056060 con 0x5631f325bcb0 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.284+0000 7f4acffff640 1 -- 172.21.15.92:0/995841640 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7f4ae8004250 con 0x5631f325bcb0 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.284+0000 7f4af9fde740 1 -- 172.21.15.92:0/995841640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4adc0a3ec0 con 0x5631f325bcb0 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.284+0000 7f4acffff640 1 -- 172.21.15.92:0/995841640 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f4ae8031430 con 0x5631f325bcb0 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.284+0000 7f4af9fde740 10 client.16296 fetch_fsmap learned FSMap version 59 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.284+0000 7f4af9fde740 1 -- 172.21.15.92:0/995841640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x5631f32d5b50 con 0x5631f325bcb0 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4acffff640 1 -- 172.21.15.92:0/995841640 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4adc0a3ec0 con 0x5631f325bcb0 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4acffff640 1 -- 172.21.15.92:0/995841640 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f4ae8030070 con 0x5631f325bcb0 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4af9fde740 10 client.16296 fetch_fsmap finished waiting for FSMap version 59 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4af9fde740 10 client.16296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4af9fde740 20 client.16296 populate_metadata read hostname 'smithi092' 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4af9fde740 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5631f32d62e0 0x5631f32d8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4af9fde740 4 client.16296 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4af9fde740 1 -- 172.21.15.92:0/995841640 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5631f31bcd70 con 0x5631f32d62e0 2024-09-10T10:49:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4af4f02640 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5631f32d62e0 0x5631f32d8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4acffff640 10 client.16296 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.285+0000 7f4af4f02640 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5631f32d62e0 0x5631f32d8700 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be16cb7c9cba161 server_cookie=eca234d967f2583c in_seq=0 out_seq=0 2024-09-10T10:49:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4acffff640 1 -- 172.21.15.92:0/995841640 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631f31bcd70 con 0x5631f32d62e0 2024-09-10T10:49:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4acffff640 10 client.16296 handle_command_reply: tid=0 2024-09-10T10:49:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 client.16296 shutdown 2024-09-10T10:49:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 -- 172.21.15.92:0/995841640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 msgr2=0x5631f32d44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32d44d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009cd0 tx=0x7f4ae802a8e0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 -- 172.21.15.92:0/995841640 shutdown_connections 2024-09-10T10:49:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631f325bcb0 0x5631f32d44d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631f3251410 0x5631f325f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5631f32d62e0 0x5631f32d8700 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 --2- 172.21.15.92:0/995841640 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5631f3250af0 0x5631f325ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 -- 172.21.15.92:0/995841640 >> 172.21.15.92:0/995841640 conn(0x5631f324d060 msgr2=0x5631f325a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4acffff640 0 client.16296 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 -- 172.21.15.92:0/995841640 shutdown_connections 2024-09-10T10:49:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 1 -- 172.21.15.92:0/995841640 wait complete. 2024-09-10T10:49:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.295+0000 7f4af9fde740 20 client.16296 trim_cache size 0 max 16384 2024-09-10T10:49:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:49:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:49:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:49:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:49:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4ae00a2da0 msgr2=0x7f4ae00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4ae00a2da0 0x7f4ae00a5260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8004af0 tx=0x7f4ae8005d80 comp rx=0 tx=0).stop 2024-09-10T10:49:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 msgr2=0x7f4af01977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 0x7f4af01977c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009f20 tx=0x7f4adc00ee80 comp rx=0 tx=0).stop 2024-09-10T10:49:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 shutdown_connections 2024-09-10T10:49:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4af01069c0 0x7f4af019bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af0101350 0x7f4af01977c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4ae00a2da0 0x7f4ae00a5260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 --2- 172.21.15.92:0/3929675451 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4af01009b0 0x7f4af0197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 >> 172.21.15.92:0/3929675451 conn(0x7f4af0077990 msgr2=0x7f4af00fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.296+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 shutdown_connections 2024-09-10T10:49:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:26.297+0000 7f4af7166640 1 -- 172.21.15.92:0/3929675451 wait complete. 2024-09-10T10:49:28.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:27 smithi121 ceph-mon[35231]: pgmap v402: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 21 MiB/s wr, 1.90k op/s 2024-09-10T10:49:28.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:27 smithi097 ceph-mon[35213]: pgmap v402: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 21 MiB/s wr, 1.90k op/s 2024-09-10T10:49:28.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:27 smithi092 ceph-mon[30834]: pgmap v402: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 21 MiB/s wr, 1.90k op/s 2024-09-10T10:49:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 750.0 s, 1167.0 tps, lat 86.437 ms stddev 122.745 2024-09-10T10:49:30.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:29 smithi121 ceph-mon[35231]: pgmap v403: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 1.61k op/s 2024-09-10T10:49:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:29 smithi097 ceph-mon[35213]: pgmap v403: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 1.61k op/s 2024-09-10T10:49:30.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:29 smithi092 ceph-mon[30834]: pgmap v403: 97 pgs: 97 active+clean; 4.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 MiB/s wr, 1.61k op/s 2024-09-10T10:49:32.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:31 smithi121 ceph-mon[35231]: pgmap v404: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 MiB/s wr, 1.82k op/s 2024-09-10T10:49:32.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:31 smithi097 ceph-mon[35213]: pgmap v404: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 MiB/s wr, 1.82k op/s 2024-09-10T10:49:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:31 smithi092 ceph-mon[30834]: pgmap v404: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 21 MiB/s wr, 1.82k op/s 2024-09-10T10:49:33.153 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 755.0 s, 1492.0 tps, lat 66.956 ms stddev 71.314 2024-09-10T10:49:34.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:33 smithi121 ceph-mon[35231]: pgmap v405: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 19 MiB/s wr, 1.67k op/s 2024-09-10T10:49:34.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:33 smithi097 ceph-mon[35213]: pgmap v405: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 19 MiB/s wr, 1.67k op/s 2024-09-10T10:49:34.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:33 smithi092 ceph-mon[30834]: pgmap v405: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 19 MiB/s wr, 1.67k op/s 2024-09-10T10:49:36.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:35 smithi121 ceph-mon[35231]: pgmap v406: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 1.58k op/s 2024-09-10T10:49:36.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:35 smithi097 ceph-mon[35213]: pgmap v406: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 1.58k op/s 2024-09-10T10:49:36.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:35 smithi092 ceph-mon[30834]: pgmap v406: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 1.58k op/s 2024-09-10T10:49:38.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:37 smithi121 ceph-mon[35231]: pgmap v407: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 MiB/s wr, 1.83k op/s 2024-09-10T10:49:38.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:37 smithi097 ceph-mon[35213]: pgmap v407: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 MiB/s wr, 1.83k op/s 2024-09-10T10:49:38.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:37 smithi092 ceph-mon[30834]: pgmap v407: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 MiB/s wr, 1.83k op/s 2024-09-10T10:49:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 760.0 s, 1813.8 tps, lat 54.718 ms stddev 61.637 2024-09-10T10:49:39.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.436+0000 7fa631f5b640 1 -- 172.21.15.92:0/4274355296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6240052e0 msgr2=0x7fa624098030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:39.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.436+0000 7fa631f5b640 1 --2- 172.21.15.92:0/4274355296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6240052e0 0x7fa624098030 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa62c067960 tx=0x7fa62c096ca0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.437+0000 7fa631f5b640 1 -- 172.21.15.92:0/4274355296 shutdown_connections 2024-09-10T10:49:39.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.437+0000 7fa631f5b640 1 --2- 172.21.15.92:0/4274355296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6240052e0 0x7fa624098030 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.437+0000 7fa631f5b640 1 --2- 172.21.15.92:0/4274355296 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa624004740 0x7fa624004b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.437+0000 7fa631f5b640 1 --2- 172.21.15.92:0/4274355296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62409a560 0x7fa62409a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.437+0000 7fa631f5b640 1 -- 172.21.15.92:0/4274355296 >> 172.21.15.92:0/4274355296 conn(0x7fa62400a1e0 msgr2=0x7fa62400a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:39.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.439+0000 7fa631f5b640 1 -- 172.21.15.92:0/4274355296 shutdown_connections 2024-09-10T10:49:39.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.439+0000 7fa631f5b640 1 -- 172.21.15.92:0/4274355296 wait complete. 2024-09-10T10:49:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.439+0000 7fa631f5b640 1 Processor -- start 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa631f5b640 1 -- start start 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa631f5b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa624004740 0x7fa6241323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa631f5b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6240052e0 0x7fa624132920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa631f5b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62409a560 0x7fa624136c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa631f5b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240abf70 con 0x7fa624004740 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa631f5b640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240abdf0 con 0x7fa6240052e0 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa631f5b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240ac0f0 con 0x7fa62409a560 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa62bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6240052e0 0x7fa624132920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa62bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6240052e0 0x7fa624132920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:56546/0 (socket says 172.21.15.92:56546) 2024-09-10T10:49:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.440+0000 7fa62bfff640 1 -- 172.21.15.92:0/737254026 learned_addr learned my addr 172.21.15.92:0/737254026 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.441+0000 7fa62bfff640 1 -- 172.21.15.92:0/737254026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62409a560 msgr2=0x7fa624136c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:49:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.441+0000 7fa62bfff640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62409a560 0x7fa624136c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.441+0000 7fa62bfff640 1 -- 172.21.15.92:0/737254026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa624004740 msgr2=0x7fa6241323e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.441+0000 7fa62bfff640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa624004740 0x7fa6241323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.441+0000 7fa62bfff640 1 -- 172.21.15.92:0/737254026 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa624137300 con 0x7fa6240052e0 2024-09-10T10:49:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.441+0000 7fa62bfff640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6240052e0 0x7fa624132920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa62000d980 tx=0x7fa62000de40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.441+0000 7fa629ffb640 1 -- 172.21.15.92:0/737254026 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620017070 con 0x7fa6240052e0 2024-09-10T10:49:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.441+0000 7fa631f5b640 1 -- 172.21.15.92:0/737254026 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6241375f0 con 0x7fa6240052e0 2024-09-10T10:49:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.442+0000 7fa631f5b640 1 -- 172.21.15.92:0/737254026 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62409af20 con 0x7fa6240052e0 2024-09-10T10:49:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.442+0000 7fa629ffb640 1 -- 172.21.15.92:0/737254026 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa620009c30 con 0x7fa6240052e0 2024-09-10T10:49:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.442+0000 7fa629ffb640 1 -- 172.21.15.92:0/737254026 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62000f620 con 0x7fa6240052e0 2024-09-10T10:49:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.445+0000 7fa636035740 1 Processor -- start 2024-09-10T10:49:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa636035740 1 -- start start 2024-09-10T10:49:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa636035740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa636035740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa636035740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 0x5649722c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa636035740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56497221d2f0 con 0x5649722b8cc0 2024-09-10T10:49:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa636035740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5649721c5270 con 0x5649722c3e80 2024-09-10T10:49:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa636035740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5649722192b0 con 0x5649722b95e0 2024-09-10T10:49:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa630f59640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa630f59640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722c3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:56456/0 (socket says 172.21.15.92:56456) 2024-09-10T10:49:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa630f59640 1 -- 172.21.15.92:0/1572053950 learned_addr learned my addr 172.21.15.92:0/1572053950 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa629ffb640 1 -- 172.21.15.92:0/737254026 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa620010460 con 0x7fa6240052e0 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa63175a640 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.446+0000 7fa62bfff640 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 0x5649722c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa630f59640 1 -- 172.21.15.92:0/1572053950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 msgr2=0x5649722c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa630f59640 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 0x5649722c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa630f59640 1 -- 172.21.15.92:0/1572053950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 msgr2=0x5649722b90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa630f59640 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722b90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa630f59640 1 -- 172.21.15.92:0/1572053950 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649721c4340 con 0x5649722b95e0 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa62bfff640 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 0x5649722c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa63175a640 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:49:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa630f59640 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722c3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa618009c40 tx=0x7fa61800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c13729c9182e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa629ffb640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa61c0a2dc0 0x7fa61c0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa616ffd640 1 -- 172.21.15.92:0/1572053950 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618005020 con 0x5649722b95e0 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa616ffd640 1 -- 172.21.15.92:0/1572053950 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6180047a0 con 0x5649722b95e0 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa616ffd640 1 -- 172.21.15.92:0/1572053950 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618010760 con 0x5649722b95e0 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa63175a640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa61c0a2dc0 0x7fa61c0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.447+0000 7fa629ffb640 1 -- 172.21.15.92:0/737254026 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7fa6200cefe0 con 0x7fa6240052e0 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.448+0000 7fa636035740 1 -- 172.21.15.92:0/1572053950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 msgr2=0x5649722c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.448+0000 7fa636035740 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722c3940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa618009c40 tx=0x7fa61800e720 comp rx=0 tx=0).stop 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.448+0000 7fa63175a640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa61c0a2dc0 0x7fa61c0a5280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa62c051790 tx=0x7fa62c0a2040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.448+0000 7fa636035740 1 -- 172.21.15.92:0/1572053950 shutdown_connections 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.448+0000 7fa636035740 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 0x5649722c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.448+0000 7fa636035740 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722c3940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.448+0000 7fa636035740 1 --2- 172.21.15.92:0/1572053950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722b90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.448+0000 7fa636035740 1 -- 172.21.15.92:0/1572053950 >> 172.21.15.92:0/1572053950 conn(0x5649722b5230 msgr2=0x5649722b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.449+0000 7fa636035740 1 -- 172.21.15.92:0/1572053950 shutdown_connections 2024-09-10T10:49:39.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.449+0000 7fa636035740 1 -- 172.21.15.92:0/1572053950 wait complete. 2024-09-10T10:49:39.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.449+0000 7fa636035740 1 -- start start 2024-09-10T10:49:39.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.449+0000 7fa636035740 1 Processor -- start 2024-09-10T10:49:39.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa636035740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b8cc0 0x5649722c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa636035740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b95e0 0x5649722c1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa636035740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722c3e80 0x5649722c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa636035740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5649722c6a50 con 0x5649722b95e0 2024-09-10T10:49:39.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa636035740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5649721a6290 con 0x5649722b8cc0 2024-09-10T10:49:39.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa636035740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5649722c6bd0 con 0x5649722c3e80 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa636035740 10 client.0 _ll_register_callbacks cb 0x5649721d7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa630f59640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b8cc0 0x5649722c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa630f59640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b8cc0 0x5649722c0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:56560/0 (socket says 172.21.15.92:56560) 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa630f59640 1 -- 172.21.15.92:0/1282642072 learned_addr learned my addr 172.21.15.92:0/1282642072 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa63175a640 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722c3e80 0x5649722c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa62bfff640 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b95e0 0x5649722c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa630f59640 1 -- 172.21.15.92:0/1282642072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722c3e80 msgr2=0x5649722c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa630f59640 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722c3e80 0x5649722c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa630f59640 1 -- 172.21.15.92:0/1282642072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b95e0 msgr2=0x5649722c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa630f59640 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b95e0 0x5649722c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa630f59640 1 -- 172.21.15.92:0/1282642072 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564971f30210 con 0x5649722b8cc0 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.450+0000 7fa62bfff640 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b95e0 0x5649722c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:49:39.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa630f59640 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b8cc0 0x5649722c0d50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa618009c10 tx=0x7fa618004670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b75d21a9a94a5c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa60bfff640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa60bfff640 1 -- 172.21.15.92:0/1282642072 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618026020 con 0x5649722b8cc0 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa636035740 1 -- 172.21.15.92:0/1282642072 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6180047a0 con 0x5649722b8cc0 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa60bfff640 1 -- 172.21.15.92:0/1282642072 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7fa618005020 con 0x5649722b8cc0 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa60bfff640 1 -- 172.21.15.92:0/1282642072 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fa61801d040 con 0x5649722b8cc0 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa636035740 10 client.25796 fetch_fsmap learned FSMap version 60 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa636035740 1 -- 172.21.15.92:0/1282642072 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x564971ffc620 con 0x5649722b8cc0 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa60bfff640 1 -- 172.21.15.92:0/1282642072 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa618004cd0 con 0x5649722b8cc0 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.451+0000 7fa60bfff640 1 -- 172.21.15.92:0/1282642072 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 60) ==== 8370+0+0 (secure 0 0 0) 0x7fa618018430 con 0x5649722b8cc0 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.452+0000 7fa636035740 10 client.25796 fetch_fsmap finished waiting for FSMap version 60 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.452+0000 7fa636035740 10 client.25796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.452+0000 7fa636035740 20 client.25796 populate_metadata read hostname 'smithi092' 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.452+0000 7fa636035740 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5649722d4210 0x5649722d6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.452+0000 7fa636035740 4 client.25796 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.452+0000 7fa636035740 1 -- 172.21.15.92:0/1282642072 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa6180047a0 con 0x5649722d4210 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.452+0000 7fa62bfff640 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5649722d4210 0x5649722d6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.452+0000 7fa62bfff640 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5649722d4210 0x5649722d6670 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daa23f07b92ac111 server_cookie=2f3adc20c5a93849 in_seq=0 out_seq=0 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.452+0000 7fa60bfff640 10 client.25796 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa60bfff640 1 -- 172.21.15.92:0/1282642072 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa6180047a0 con 0x5649722d4210 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa60bfff640 10 client.25796 handle_command_reply: tid=0 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 client.25796 shutdown 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 -- 172.21.15.92:0/1282642072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b8cc0 msgr2=0x5649722c0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b8cc0 0x5649722c0d50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa618009c10 tx=0x7fa618004670 comp rx=0 tx=0).stop 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 -- 172.21.15.92:0/1282642072 shutdown_connections 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722c3e80 0x5649722c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b95e0 0x5649722c1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5649722d4210 0x5649722d6670 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 --2- 172.21.15.92:0/1282642072 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b8cc0 0x5649722c0d50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 -- 172.21.15.92:0/1282642072 >> 172.21.15.92:0/1282642072 conn(0x5649722b5230 msgr2=0x5649722baf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa60bfff640 0 client.25796 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 -- 172.21.15.92:0/1282642072 shutdown_connections 2024-09-10T10:49:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 1 -- 172.21.15.92:0/1282642072 wait complete. 2024-09-10T10:49:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.453+0000 7fa636035740 20 client.25796 trim_cache size 0 max 16384 2024-09-10T10:49:39.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.471+0000 7fa636035740 1 Processor -- start 2024-09-10T10:49:39.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa636035740 1 -- start start 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa636035740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b8cc0 0x5649722bb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa636035740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b95e0 0x5649722c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa636035740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722c3e80 0x5649722dbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa636035740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa61000e630 con 0x5649722c3e80 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa636035740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa6100101d0 con 0x5649722b95e0 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa636035740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa61000ed00 con 0x5649722b8cc0 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa63175a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722c3e80 0x5649722dbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa63175a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722c3e80 0x5649722dbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45340/0 (socket says 172.21.15.92:45340) 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa62bfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b95e0 0x5649722c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa63175a640 1 -- 172.21.15.92:0/1478501633 learned_addr learned my addr 172.21.15.92:0/1478501633 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.472+0000 7fa630f59640 1 --2- 172.21.15.92:0/1478501633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b8cc0 0x5649722bb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.473+0000 7fa63175a640 1 -- 172.21.15.92:0/1478501633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b8cc0 msgr2=0x5649722bb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.473+0000 7fa63175a640 1 --2- 172.21.15.92:0/1478501633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b8cc0 0x5649722bb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.473+0000 7fa63175a640 1 -- 172.21.15.92:0/1478501633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b95e0 msgr2=0x5649722c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:39.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.473+0000 7fa63175a640 1 --2- 172.21.15.92:0/1478501633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b95e0 0x5649722c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.473+0000 7fa63175a640 1 -- 172.21.15.92:0/1478501633 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649722b9410 con 0x5649722c3e80 2024-09-10T10:49:39.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.473+0000 7fa63175a640 1 --2- 172.21.15.92:0/1478501633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722c3e80 0x5649722dbf40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa62c051000 tx=0x7fa62c079040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d75f607e13ad30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:39.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.473+0000 7fa6167fc640 1 -- 172.21.15.92:0/1478501633 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62c062830 con 0x5649722c3e80 2024-09-10T10:49:39.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.473+0000 7fa6167fc640 1 -- 172.21.15.92:0/1478501633 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa62c0a0e10 con 0x5649722c3e80 2024-09-10T10:49:39.476 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.473+0000 7fa6167fc640 1 -- 172.21.15.92:0/1478501633 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62c097e20 con 0x5649722c3e80 2024-09-10T10:49:39.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 -- 172.21.15.92:0/1478501633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722c3e80 msgr2=0x5649722dbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:39.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 --2- 172.21.15.92:0/1478501633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722c3e80 0x5649722dbf40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa62c051000 tx=0x7fa62c079040 comp rx=0 tx=0).stop 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 -- 172.21.15.92:0/1478501633 shutdown_connections 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 --2- 172.21.15.92:0/1478501633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722c3e80 0x5649722dbf40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 --2- 172.21.15.92:0/1478501633 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722b95e0 0x5649722c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 --2- 172.21.15.92:0/1478501633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b8cc0 0x5649722bb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 -- 172.21.15.92:0/1478501633 >> 172.21.15.92:0/1478501633 conn(0x5649722b5230 msgr2=0x5649722bc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 -- 172.21.15.92:0/1478501633 shutdown_connections 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 -- 172.21.15.92:0/1478501633 wait complete. 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 -- start start 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.474+0000 7fa636035740 1 Processor -- start 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa636035740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa636035740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa636035740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 0x5649722cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa636035740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa61000fb00 con 0x5649722b8cc0 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa636035740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fa61000f3d0 con 0x5649722c3e80 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa636035740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa61000c630 con 0x5649722b95e0 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa636035740 10 client.0 _ll_register_callbacks cb 0x7fa618005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa630f59640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa630f59640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722be7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45356/0 (socket says 172.21.15.92:45356) 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa630f59640 1 -- 172.21.15.92:0/408823473 learned_addr learned my addr 172.21.15.92:0/408823473 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa63175a640 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 0x5649722cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa630f59640 1 -- 172.21.15.92:0/408823473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 msgr2=0x5649722cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa62bfff640 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa630f59640 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa630f59640 1 -- 172.21.15.92:0/408823473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 msgr2=0x5649722cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa630f59640 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 0x5649722cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa630f59640 1 -- 172.21.15.92:0/408823473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649722bcfc0 con 0x5649722b8cc0 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.475+0000 7fa62bfff640 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:49:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.476+0000 7fa630f59640 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722be7c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa61800eca0 tx=0x7fa618018740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69f9e2b9817574d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.476+0000 7fa60bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.476+0000 7fa60bfff640 1 -- 172.21.15.92:0/408823473 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618026040 con 0x5649722b8cc0 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.476+0000 7fa60bfff640 1 -- 172.21.15.92:0/408823473 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7fa618004bb0 con 0x5649722b8cc0 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.476+0000 7fa636035740 1 -- 172.21.15.92:0/408823473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa62c0a0e10 con 0x5649722b8cc0 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.476+0000 7fa60bfff640 1 -- 172.21.15.92:0/408823473 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fa618009670 con 0x5649722b8cc0 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.476+0000 7fa636035740 10 client.16311 fetch_fsmap learned FSMap version 60 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.476+0000 7fa636035740 1 -- 172.21.15.92:0/408823473 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) -- 0x56497233dfa0 con 0x5649722b8cc0 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.476+0000 7fa60bfff640 1 -- 172.21.15.92:0/408823473 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa618005450 con 0x5649722b8cc0 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.477+0000 7fa60bfff640 1 -- 172.21.15.92:0/408823473 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 60) ==== 8370+0+0 (secure 0 0 0) 0x7fa61803a030 con 0x5649722b8cc0 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.477+0000 7fa636035740 10 client.16311 fetch_fsmap finished waiting for FSMap version 60 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.477+0000 7fa636035740 10 client.16311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.477+0000 7fa636035740 20 client.16311 populate_metadata read hostname 'smithi092' 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.477+0000 7fa636035740 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56497233e780 0x564972340ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:39.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.477+0000 7fa636035740 4 client.16311 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:49:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.477+0000 7fa636035740 1 -- 172.21.15.92:0/408823473 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa62c0a0e10 con 0x56497233e780 2024-09-10T10:49:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.478+0000 7fa62bfff640 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56497233e780 0x564972340ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.478+0000 7fa62bfff640 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56497233e780 0x564972340ba0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a3f3d9832cd96a1 server_cookie=d2ebb46e1579daa3 in_seq=0 out_seq=0 2024-09-10T10:49:39.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.478+0000 7fa60bfff640 10 client.16311 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.485+0000 7fa60bfff640 1 -- 172.21.15.92:0/408823473 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa62c0a0e10 con 0x56497233e780 2024-09-10T10:49:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.485+0000 7fa60bfff640 10 client.16311 handle_command_reply: tid=0 2024-09-10T10:49:39.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.485+0000 7fa636035740 1 client.16311 shutdown 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 -- 172.21.15.92:0/408823473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 msgr2=0x5649722be7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722be7c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa61800eca0 tx=0x7fa618018740 comp rx=0 tx=0).stop 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 -- 172.21.15.92:0/408823473 shutdown_connections 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56497233e780 0x564972340ba0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa60bfff640 0 client.16311 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5649722c3e80 0x5649722cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5649722b95e0 0x5649722cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 --2- 172.21.15.92:0/408823473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649722b8cc0 0x5649722be7c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 -- 172.21.15.92:0/408823473 >> 172.21.15.92:0/408823473 conn(0x5649722b5230 msgr2=0x5649722b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:39.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 -- 172.21.15.92:0/408823473 shutdown_connections 2024-09-10T10:49:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 1 -- 172.21.15.92:0/408823473 wait complete. 2024-09-10T10:49:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.486+0000 7fa636035740 20 client.16311 trim_cache size 0 max 16384 2024-09-10T10:49:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:49:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:49:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:49:39.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:49:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 -- 172.21.15.92:0/737254026 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa61c0a2dc0 msgr2=0x7fa61c0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa61c0a2dc0 0x7fa61c0a5280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa62c051790 tx=0x7fa62c0a2040 comp rx=0 tx=0).stop 2024-09-10T10:49:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 -- 172.21.15.92:0/737254026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6240052e0 msgr2=0x7fa624132920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6240052e0 0x7fa624132920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa62000d980 tx=0x7fa62000de40 comp rx=0 tx=0).stop 2024-09-10T10:49:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 -- 172.21.15.92:0/737254026 shutdown_connections 2024-09-10T10:49:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa62409a560 0x7fa624136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fa61c0a2dc0 0x7fa61c0a5280 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fa6240052e0 0x7fa624132920 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 --2- 172.21.15.92:0/737254026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa624004740 0x7fa6241323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 -- 172.21.15.92:0/737254026 >> 172.21.15.92:0/737254026 conn(0x7fa62400a1e0 msgr2=0x7fa624091df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 -- 172.21.15.92:0/737254026 shutdown_connections 2024-09-10T10:49:39.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:39.487+0000 7fa631f5b640 1 -- 172.21.15.92:0/737254026 wait complete. 2024-09-10T10:49:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:39 smithi121 ceph-mon[35231]: pgmap v408: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 521 op/s 2024-09-10T10:49:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:39 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:49:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:39 smithi097 ceph-mon[35213]: pgmap v408: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 521 op/s 2024-09-10T10:49:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:39 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:49:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:39 smithi092 ceph-mon[30834]: pgmap v408: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 521 op/s 2024-09-10T10:49:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:39 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:49:42.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:41 smithi121 ceph-mon[35231]: pgmap v409: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.0 MiB/s wr, 740 op/s 2024-09-10T10:49:42.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:41 smithi097 ceph-mon[35213]: pgmap v409: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.0 MiB/s wr, 740 op/s 2024-09-10T10:49:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:41 smithi092 ceph-mon[30834]: pgmap v409: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.0 MiB/s wr, 740 op/s 2024-09-10T10:49:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 765.0 s, 1844.6 tps, lat 54.584 ms stddev 59.546 2024-09-10T10:49:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:43 smithi121 ceph-mon[35231]: pgmap v410: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.8 MiB/s wr, 615 op/s 2024-09-10T10:49:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:43 smithi097 ceph-mon[35213]: pgmap v410: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.8 MiB/s wr, 615 op/s 2024-09-10T10:49:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:43 smithi092 ceph-mon[30834]: pgmap v410: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.8 MiB/s wr, 615 op/s 2024-09-10T10:49:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:45 smithi121 ceph-mon[35231]: pgmap v411: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.3 MiB/s wr, 550 op/s 2024-09-10T10:49:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:45 smithi097 ceph-mon[35213]: pgmap v411: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.3 MiB/s wr, 550 op/s 2024-09-10T10:49:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:45 smithi092 ceph-mon[30834]: pgmap v411: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.3 MiB/s wr, 550 op/s 2024-09-10T10:49:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:47 smithi121 ceph-mon[35231]: pgmap v412: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.1 MiB/s wr, 848 op/s 2024-09-10T10:49:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:47 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:49:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:47 smithi097 ceph-mon[35213]: pgmap v412: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.1 MiB/s wr, 848 op/s 2024-09-10T10:49:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:47 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:49:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:47 smithi092 ceph-mon[30834]: pgmap v412: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.1 MiB/s wr, 848 op/s 2024-09-10T10:49:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:47 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:49:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 770.0 s, 1827.6 tps, lat 54.629 ms stddev 57.231 2024-09-10T10:49:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:49 smithi121 ceph-mon[35231]: pgmap v413: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-09-10T10:49:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:49 smithi097 ceph-mon[35213]: pgmap v413: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-09-10T10:49:50.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:49 smithi092 ceph-mon[30834]: pgmap v413: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.7 MiB/s wr, 600 op/s 2024-09-10T10:49:52.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:51 smithi121 ceph-mon[35231]: pgmap v414: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 794 op/s 2024-09-10T10:49:52.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:51 smithi097 ceph-mon[35213]: pgmap v414: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 794 op/s 2024-09-10T10:49:52.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:51 smithi092 ceph-mon[30834]: pgmap v414: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 794 op/s 2024-09-10T10:49:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.621+0000 7f2042074640 1 -- 172.21.15.92:0/532423045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f203c1013b0 msgr2=0x7f203c105870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.621+0000 7f2042074640 1 --2- 172.21.15.92:0/532423045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f203c1013b0 0x7f203c105870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f202c009860 tx=0x7f202c02a380 comp rx=0 tx=0).stop 2024-09-10T10:49:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.625+0000 7f2042074640 1 -- 172.21.15.92:0/532423045 shutdown_connections 2024-09-10T10:49:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.625+0000 7f2042074640 1 --2- 172.21.15.92:0/532423045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203c105f10 0x7f203c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.625+0000 7f2042074640 1 --2- 172.21.15.92:0/532423045 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f203c1013b0 0x7f203c105870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.625+0000 7f2042074640 1 --2- 172.21.15.92:0/532423045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f203c100a90 0x7f203c100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.625+0000 7f2042074640 1 -- 172.21.15.92:0/532423045 >> 172.21.15.92:0/532423045 conn(0x7f203c0fc6b0 msgr2=0x7f203c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.629+0000 7f2042074640 1 -- 172.21.15.92:0/532423045 shutdown_connections 2024-09-10T10:49:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.631+0000 7f2042074640 1 -- 172.21.15.92:0/532423045 wait complete. 2024-09-10T10:49:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.632+0000 7f2042074640 1 Processor -- start 2024-09-10T10:49:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.636+0000 7f2042074640 1 -- start start 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.636+0000 7f2042074640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f203c100a90 0x7f203c114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.636+0000 7f2042074640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f203c1013b0 0x7f203c10ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.636+0000 7f2042074640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203c105f10 0x7f203c10f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.636+0000 7f2042074640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f203c107890 con 0x7f203c100a90 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.636+0000 7f2042074640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f203c107710 con 0x7f203c1013b0 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.636+0000 7f2042074640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f203c107a10 con 0x7f203c105f10 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.637+0000 7f203bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203c105f10 0x7f203c10f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.637+0000 7f203affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f203c1013b0 0x7f203c10ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.637+0000 7f203affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f203c1013b0 0x7f203c10ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:54920/0 (socket says 172.21.15.92:54920) 2024-09-10T10:49:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.637+0000 7f203affd640 1 -- 172.21.15.92:0/1895822549 learned_addr learned my addr 172.21.15.92:0/1895822549 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.638+0000 7f203bfff640 1 -- 172.21.15.92:0/1895822549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f203c1013b0 msgr2=0x7f203c10ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.638+0000 7f203bfff640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f203c1013b0 0x7f203c10ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.638+0000 7f203bfff640 1 -- 172.21.15.92:0/1895822549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f203c100a90 msgr2=0x7f203c114dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:49:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.638+0000 7f203bfff640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f203c100a90 0x7f203c114dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.638+0000 7f203bfff640 1 -- 172.21.15.92:0/1895822549 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203c10fab0 con 0x7f203c105f10 2024-09-10T10:49:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.638+0000 7f203bfff640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203c105f10 0x7f203c10f380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f203400be00 tx=0x7f203400bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.639+0000 7f2038ff9640 1 -- 172.21.15.92:0/1895822549 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034019070 con 0x7f203c105f10 2024-09-10T10:49:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.639+0000 7f2042074640 1 -- 172.21.15.92:0/1895822549 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203c06bc10 con 0x7f203c105f10 2024-09-10T10:49:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.639+0000 7f2042074640 1 -- 172.21.15.92:0/1895822549 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203c06c160 con 0x7f203c105f10 2024-09-10T10:49:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.639+0000 7f2038ff9640 1 -- 172.21.15.92:0/1895822549 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2034014920 con 0x7f203c105f10 2024-09-10T10:49:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.639+0000 7f2038ff9640 1 -- 172.21.15.92:0/1895822549 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20340129c0 con 0x7f203c105f10 2024-09-10T10:49:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.645+0000 7f2038ff9640 1 -- 172.21.15.92:0/1895822549 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f203401c070 con 0x7f203c105f10 2024-09-10T10:49:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.646+0000 7f2044e16740 1 Processor -- start 2024-09-10T10:49:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.646+0000 7f2044e16740 1 -- start start 2024-09-10T10:49:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.646+0000 7f2044e16740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c70af0 0x562878c70ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f2044e16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c71410 0x562878c7b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f2044e16740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 0x562878c7e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f2044e16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562878bd52f0 con 0x562878c71410 2024-09-10T10:49:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f2044e16740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562878b7d270 con 0x562878c70af0 2024-09-10T10:49:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f2044e16740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562878bd12b0 con 0x562878c7bcb0 2024-09-10T10:49:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f2038ff9640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20240a2f80 0x7f20240a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f203affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c70af0 0x562878c70ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f203affd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c70af0 0x562878c70ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:54930/0 (socket says 172.21.15.92:54930) 2024-09-10T10:49:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f203affd640 1 -- 172.21.15.92:0/3058930283 learned_addr learned my addr 172.21.15.92:0/3058930283 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.647+0000 7f203affd640 1 --2- 172.21.15.92:0/3058930283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 0x562878c7e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.648+0000 7f203b7fe640 1 --2- 172.21.15.92:0/3058930283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c71410 0x562878c7b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.648+0000 7f203affd640 1 -- 172.21.15.92:0/3058930283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 msgr2=0x562878c7e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.648+0000 7f203affd640 1 --2- 172.21.15.92:0/3058930283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 0x562878c7e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.648+0000 7f203affd640 1 -- 172.21.15.92:0/3058930283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c71410 msgr2=0x562878c7b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.648+0000 7f203affd640 1 --2- 172.21.15.92:0/3058930283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c71410 0x562878c7b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.648+0000 7f2038ff9640 1 -- 172.21.15.92:0/1895822549 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7f20340cfa70 con 0x7f203c105f10 2024-09-10T10:49:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.648+0000 7f203affd640 1 -- 172.21.15.92:0/3058930283 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562878b7c340 con 0x562878c70af0 2024-09-10T10:49:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.648+0000 7f203bfff640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20240a2f80 0x7f20240a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.648+0000 7f203affd640 1 --2- 172.21.15.92:0/3058930283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c70af0 0x562878c70ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f202c0305c0 tx=0x7f202c005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2a2f71067c6ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.649+0000 7f2021ffb640 1 -- 172.21.15.92:0/3058930283 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c047070 con 0x562878c70af0 2024-09-10T10:49:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.649+0000 7f203bfff640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20240a2f80 0x7f20240a5440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f203409be30 tx=0x7f2034010000 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.649+0000 7f2021ffb640 1 -- 172.21.15.92:0/3058930283 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f202c0035f0 con 0x562878c70af0 2024-09-10T10:49:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.649+0000 7f2021ffb640 1 -- 172.21.15.92:0/3058930283 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c037040 con 0x562878c70af0 2024-09-10T10:49:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.650+0000 7f2044e16740 1 -- 172.21.15.92:0/3058930283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c70af0 msgr2=0x562878c70ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.650+0000 7f2044e16740 1 --2- 172.21.15.92:0/3058930283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c70af0 0x562878c70ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f202c0305c0 tx=0x7f202c005dc0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.650+0000 7f2044e16740 1 -- 172.21.15.92:0/3058930283 shutdown_connections 2024-09-10T10:49:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.650+0000 7f2044e16740 1 --2- 172.21.15.92:0/3058930283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 0x562878c7e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.650+0000 7f2044e16740 1 --2- 172.21.15.92:0/3058930283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c71410 0x562878c7b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.650+0000 7f2044e16740 1 --2- 172.21.15.92:0/3058930283 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c70af0 0x562878c70ed0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.650+0000 7f2044e16740 1 -- 172.21.15.92:0/3058930283 >> 172.21.15.92:0/3058930283 conn(0x562878c6d060 msgr2=0x562878c6d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.650+0000 7f2044e16740 1 -- 172.21.15.92:0/3058930283 shutdown_connections 2024-09-10T10:49:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.650+0000 7f2044e16740 1 -- 172.21.15.92:0/3058930283 wait complete. 2024-09-10T10:49:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.651+0000 7f2044e16740 1 -- start start 2024-09-10T10:49:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.651+0000 7f2044e16740 1 Processor -- start 2024-09-10T10:49:52.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.651+0000 7f2044e16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c78ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.651+0000 7f2044e16740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c71410 0x562878c790e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.651+0000 7f2044e16740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c7bcb0 0x562878c79620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.651+0000 7f2044e16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562878c7e880 con 0x562878c70af0 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.651+0000 7f2044e16740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x562878b5e290 con 0x562878c7bcb0 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.651+0000 7f2044e16740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562878c7ea00 con 0x562878c71410 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.651+0000 7f203affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c78ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c71410 0x562878c790e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c71410 0x562878c790e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:56110/0 (socket says 172.21.15.92:56110) 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203b7fe640 1 -- 172.21.15.92:0/3751011034 learned_addr learned my addr 172.21.15.92:0/3751011034 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f2044e16740 10 client.0 _ll_register_callbacks cb 0x562878b8f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203affd640 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c7bcb0 0x562878c79620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203b7fe640 1 -- 172.21.15.92:0/3751011034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c7bcb0 msgr2=0x562878c79620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203b7fe640 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c7bcb0 0x562878c79620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203b7fe640 1 -- 172.21.15.92:0/3751011034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 msgr2=0x562878c78ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:52.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203b7fe640 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c78ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203b7fe640 1 -- 172.21.15.92:0/3751011034 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628788e8210 con 0x562878c71410 2024-09-10T10:49:52.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f203b7fe640 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c71410 0x562878c790e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f203000ddf0 tx=0x7f203000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82db63d09780dd8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:52.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f201affd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:49:52.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.652+0000 7f201affd640 1 -- 172.21.15.92:0/3751011034 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030015070 con 0x562878c71410 2024-09-10T10:49:52.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.653+0000 7f201affd640 1 -- 172.21.15.92:0/3751011034 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7f2030011650 con 0x562878c71410 2024-09-10T10:49:52.655 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.653+0000 7f2044e16740 1 -- 172.21.15.92:0/3751011034 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f202c0035f0 con 0x562878c71410 2024-09-10T10:49:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.653+0000 7f201affd640 1 -- 172.21.15.92:0/3751011034 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f2030011850 con 0x562878c71410 2024-09-10T10:49:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.654+0000 7f2044e16740 10 client.25831 fetch_fsmap learned FSMap version 61 2024-09-10T10:49:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.654+0000 7f2044e16740 1 -- 172.21.15.92:0/3751011034 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5628789b4620 con 0x562878c71410 2024-09-10T10:49:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.654+0000 7f201affd640 1 -- 172.21.15.92:0/3751011034 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f203001a460 con 0x562878c71410 2024-09-10T10:49:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.654+0000 7f201affd640 1 -- 172.21.15.92:0/3751011034 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7f2030024420 con 0x562878c71410 2024-09-10T10:49:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.654+0000 7f2044e16740 10 client.25831 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T10:49:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.655+0000 7f2044e16740 10 client.25831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:49:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.655+0000 7f2044e16740 20 client.25831 populate_metadata read hostname 'smithi092' 2024-09-10T10:49:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.655+0000 7f2044e16740 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562878c8bd20 0x562878c8e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.655+0000 7f2044e16740 4 client.25831 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:49:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.655+0000 7f2044e16740 1 -- 172.21.15.92:0/3751011034 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f202c0035f0 con 0x562878c8bd20 2024-09-10T10:49:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.655+0000 7f203affd640 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562878c8bd20 0x562878c8e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.656+0000 7f201affd640 10 client.25831 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.656+0000 7f203affd640 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562878c8bd20 0x562878c8e150 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42a6e78bacbc9bca server_cookie=a49daa9bc3e3997e in_seq=0 out_seq=0 2024-09-10T10:49:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f201affd640 1 -- 172.21.15.92:0/3751011034 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f202c0035f0 con 0x562878c8bd20 2024-09-10T10:49:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f201affd640 10 client.25831 handle_command_reply: tid=0 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 client.25831 shutdown 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 -- 172.21.15.92:0/3751011034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c71410 msgr2=0x562878c790e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c71410 0x562878c790e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f203000ddf0 tx=0x7f203000f730 comp rx=0 tx=0).stop 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 -- 172.21.15.92:0/3751011034 shutdown_connections 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562878c8bd20 0x562878c8e150 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c7bcb0 0x562878c79620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c71410 0x562878c790e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 --2- 172.21.15.92:0/3751011034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c78ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 -- 172.21.15.92:0/3751011034 >> 172.21.15.92:0/3751011034 conn(0x562878c6d060 msgr2=0x562878c72dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f201affd640 0 client.25831 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 -- 172.21.15.92:0/3751011034 shutdown_connections 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 1 -- 172.21.15.92:0/3751011034 wait complete. 2024-09-10T10:49:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.658+0000 7f2044e16740 20 client.25831 trim_cache size 0 max 16384 2024-09-10T10:49:52.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.680+0000 7f2044e16740 1 Processor -- start 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.680+0000 7f2044e16740 1 -- start start 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f2044e16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c79450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f2044e16740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 0x562878c93ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c79450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c79450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54196/0 (socket says 172.21.15.92:54196) 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203affd640 1 -- 172.21.15.92:0/2988189345 learned_addr learned my addr 172.21.15.92:0/2988189345 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f2044e16740 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 0x562878c93ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f2044e16740 1 -- 172.21.15.92:0/2988189345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f202800e6b0 con 0x562878c70af0 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f2044e16740 1 -- 172.21.15.92:0/2988189345 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2028010220 con 0x562878c71410 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f2044e16740 1 -- 172.21.15.92:0/2988189345 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f202800ed80 con 0x562878c7bcb0 2024-09-10T10:49:52.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203b7fe640 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 0x562878c93ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203affd640 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 0x562878c93ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203affd640 1 -- 172.21.15.92:0/2988189345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 msgr2=0x562878c93ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203affd640 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 0x562878c93ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203affd640 1 -- 172.21.15.92:0/2988189345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 msgr2=0x562878c93ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203affd640 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 0x562878c93ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.681+0000 7f203affd640 1 -- 172.21.15.92:0/2988189345 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562878c71240 con 0x562878c70af0 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.682+0000 7f203affd640 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c79450 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f202c009830 tx=0x7f202c02a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7909f3fd14f361b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.682+0000 7f20217fa640 1 -- 172.21.15.92:0/2988189345 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c044020 con 0x562878c70af0 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.682+0000 7f20217fa640 1 -- 172.21.15.92:0/2988189345 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f202c048040 con 0x562878c70af0 2024-09-10T10:49:52.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.682+0000 7f20217fa640 1 -- 172.21.15.92:0/2988189345 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c047040 con 0x562878c70af0 2024-09-10T10:49:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.683+0000 7f2044e16740 1 -- 172.21.15.92:0/2988189345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 msgr2=0x562878c79450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.683+0000 7f2044e16740 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c79450 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f202c009830 tx=0x7f202c02a380 comp rx=0 tx=0).stop 2024-09-10T10:49:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.683+0000 7f2044e16740 1 -- 172.21.15.92:0/2988189345 shutdown_connections 2024-09-10T10:49:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.683+0000 7f2044e16740 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c7bcb0 0x562878c93ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.683+0000 7f2044e16740 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 0x562878c93ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.683+0000 7f2044e16740 1 --2- 172.21.15.92:0/2988189345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c70af0 0x562878c79450 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.683+0000 7f2044e16740 1 -- 172.21.15.92:0/2988189345 >> 172.21.15.92:0/2988189345 conn(0x562878c6d060 msgr2=0x562878c7ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.683+0000 7f2044e16740 1 -- 172.21.15.92:0/2988189345 shutdown_connections 2024-09-10T10:49:52.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.683+0000 7f2044e16740 1 -- 172.21.15.92:0/2988189345 wait complete. 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f2044e16740 1 -- start start 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f2044e16740 1 Processor -- start 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f2044e16740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c70af0 0x562878c7fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f2044e16740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 0x562878c7ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f2044e16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c7bcb0 0x562878c80510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f2044e16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f202800fb50 con 0x562878c7bcb0 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f2044e16740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f202800f450 con 0x562878c71410 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f2044e16740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f202800c6b0 con 0x562878c70af0 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f2044e16740 10 client.0 _ll_register_callbacks cb 0x7f203000d360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f203affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c70af0 0x562878c7fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.684+0000 7f203b7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 0x562878c7ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f203affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c70af0 0x562878c7fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:56130/0 (socket says 172.21.15.92:56130) 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f203affd640 1 -- 172.21.15.92:0/1018788734 learned_addr learned my addr 172.21.15.92:0/1018788734 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f203affd640 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c7bcb0 0x562878c80510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f203b7fe640 1 -- 172.21.15.92:0/1018788734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c70af0 msgr2=0x562878c7fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f203b7fe640 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c70af0 0x562878c7fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f203b7fe640 1 -- 172.21.15.92:0/1018788734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c7bcb0 msgr2=0x562878c80510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f203b7fe640 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c7bcb0 0x562878c80510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f203b7fe640 1 -- 172.21.15.92:0/1018788734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562878cf5a80 con 0x562878c71410 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f203b7fe640 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 0x562878c7ffd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2030024960 tx=0x7f20300116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff03bcc0a0afef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f201affd640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f201affd640 1 -- 172.21.15.92:0/1018788734 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030015030 con 0x562878c71410 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f201affd640 1 -- 172.21.15.92:0/1018788734 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7f2030011bf0 con 0x562878c71410 2024-09-10T10:49:52.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.685+0000 7f2044e16740 1 -- 172.21.15.92:0/1018788734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f202c048040 con 0x562878c71410 2024-09-10T10:49:52.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.686+0000 7f201affd640 1 -- 172.21.15.92:0/1018788734 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f2030011df0 con 0x562878c71410 2024-09-10T10:49:52.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f2044e16740 10 client.25820 fetch_fsmap learned FSMap version 61 2024-09-10T10:49:52.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f2044e16740 1 -- 172.21.15.92:0/1018788734 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x562878cf6d40 con 0x562878c71410 2024-09-10T10:49:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f201affd640 1 -- 172.21.15.92:0/1018788734 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f202c048040 con 0x562878c71410 2024-09-10T10:49:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f201affd640 1 -- 172.21.15.92:0/1018788734 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7f20300035f0 con 0x562878c71410 2024-09-10T10:49:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f2044e16740 10 client.25820 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T10:49:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f2044e16740 10 client.25820 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:49:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f2044e16740 20 client.25820 populate_metadata read hostname 'smithi092' 2024-09-10T10:49:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f2044e16740 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562878cf7510 0x562878cf9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:49:52.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f2044e16740 4 client.25820 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:49:52.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.687+0000 7f2044e16740 1 -- 172.21.15.92:0/1018788734 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562878be2a20 con 0x562878cf7510 2024-09-10T10:49:52.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.688+0000 7f203affd640 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562878cf7510 0x562878cf9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:49:52.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.688+0000 7f201affd640 10 client.25820 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:52.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.688+0000 7f203affd640 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562878cf7510 0x562878cf9930 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7051131df470be9 server_cookie=bcafc2db7b8774af in_seq=0 out_seq=0 2024-09-10T10:49:52.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.697+0000 7f201affd640 1 -- 172.21.15.92:0/1018788734 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562878be2a20 con 0x562878cf7510 2024-09-10T10:49:52.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.697+0000 7f201affd640 10 client.25820 handle_command_reply: tid=0 2024-09-10T10:49:52.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.697+0000 7f2044e16740 1 client.25820 shutdown 2024-09-10T10:49:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.697+0000 7f2044e16740 1 -- 172.21.15.92:0/1018788734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 msgr2=0x562878c7ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.697+0000 7f2044e16740 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 0x562878c7ffd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2030024960 tx=0x7f20300116c0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f2044e16740 1 -- 172.21.15.92:0/1018788734 shutdown_connections 2024-09-10T10:49:52.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f2044e16740 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562878c7bcb0 0x562878c80510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f2044e16740 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x562878cf7510 0x562878cf9930 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f2044e16740 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x562878c71410 0x562878c7ffd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f2044e16740 1 --2- 172.21.15.92:0/1018788734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562878c70af0 0x562878c7fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f201affd640 0 client.25820 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:49:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f2044e16740 1 -- 172.21.15.92:0/1018788734 >> 172.21.15.92:0/1018788734 conn(0x562878c6d060 msgr2=0x562878c7ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f2044e16740 1 -- 172.21.15.92:0/1018788734 shutdown_connections 2024-09-10T10:49:52.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f2044e16740 1 -- 172.21.15.92:0/1018788734 wait complete. 2024-09-10T10:49:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.698+0000 7f2044e16740 20 client.25820 trim_cache size 0 max 16384 2024-09-10T10:49:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:49:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:49:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:49:52.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:49:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 -- 172.21.15.92:0/1895822549 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20240a2f80 msgr2=0x7f20240a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20240a2f80 0x7f20240a5440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f203409be30 tx=0x7f2034010000 comp rx=0 tx=0).stop 2024-09-10T10:49:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 -- 172.21.15.92:0/1895822549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203c105f10 msgr2=0x7f203c10f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:49:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203c105f10 0x7f203c10f380 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f203400be00 tx=0x7f203400bef0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 -- 172.21.15.92:0/1895822549 shutdown_connections 2024-09-10T10:49:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f203c105f10 0x7f203c10f380 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f20240a2f80 0x7f20240a5440 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f203c1013b0 0x7f203c10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 --2- 172.21.15.92:0/1895822549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f203c100a90 0x7f203c114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:49:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 -- 172.21.15.92:0/1895822549 >> 172.21.15.92:0/1895822549 conn(0x7f203c0fc6b0 msgr2=0x7f203c1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:49:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 -- 172.21.15.92:0/1895822549 shutdown_connections 2024-09-10T10:49:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:49:52.699+0000 7f2042074640 1 -- 172.21.15.92:0/1895822549 wait complete. 2024-09-10T10:49:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 775.0 s, 1920.6 tps, lat 52.243 ms stddev 54.492 2024-09-10T10:49:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:53 smithi121 ceph-mon[35231]: pgmap v415: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 636 op/s 2024-09-10T10:49:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:53 smithi097 ceph-mon[35213]: pgmap v415: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 636 op/s 2024-09-10T10:49:54.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:53 smithi092 ceph-mon[30834]: pgmap v415: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.8 MiB/s wr, 636 op/s 2024-09-10T10:49:56.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:55 smithi121 ceph-mon[35231]: pgmap v416: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.1 MiB/s wr, 553 op/s 2024-09-10T10:49:56.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:55 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:49:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:55 smithi097 ceph-mon[35213]: pgmap v416: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.1 MiB/s wr, 553 op/s 2024-09-10T10:49:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:55 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:49:56.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:55 smithi092 ceph-mon[30834]: pgmap v416: 97 pgs: 97 active+clean; 4.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.1 MiB/s wr, 553 op/s 2024-09-10T10:49:56.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:55 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:49:57.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:56 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:49:57.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:56 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:49:57.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:56 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:49:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:56 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:49:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:56 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:49:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:56 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:49:57.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:56 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:49:57.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:56 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:49:57.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:56 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:49:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 780.0 s, 1640.2 tps, lat 60.218 ms stddev 72.146 2024-09-10T10:49:58.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:49:58 smithi097 ceph-mon[35213]: pgmap v417: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.6 MiB/s wr, 816 op/s 2024-09-10T10:49:58.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:49:58 smithi092 ceph-mon[30834]: pgmap v417: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.6 MiB/s wr, 816 op/s 2024-09-10T10:49:58.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:49:58 smithi121 ceph-mon[35231]: pgmap v417: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 7.6 MiB/s wr, 816 op/s 2024-09-10T10:50:00.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:00 smithi097 ceph-mon[35213]: pgmap v418: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.8 MiB/s wr, 518 op/s 2024-09-10T10:50:00.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:00 smithi097 ceph-mon[35213]: overall HEALTH_OK 2024-09-10T10:50:00.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:00 smithi092 ceph-mon[30834]: pgmap v418: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.8 MiB/s wr, 518 op/s 2024-09-10T10:50:00.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:00 smithi092 ceph-mon[30834]: overall HEALTH_OK 2024-09-10T10:50:00.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:00 smithi121 ceph-mon[35231]: pgmap v418: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.8 MiB/s wr, 518 op/s 2024-09-10T10:50:00.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:00 smithi121 ceph-mon[35231]: overall HEALTH_OK 2024-09-10T10:50:02.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:02 smithi097 ceph-mon[35213]: pgmap v419: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.4 MiB/s wr, 714 op/s 2024-09-10T10:50:02.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:02 smithi092 ceph-mon[30834]: pgmap v419: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.4 MiB/s wr, 714 op/s 2024-09-10T10:50:02.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:02 smithi121 ceph-mon[35231]: pgmap v419: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.4 MiB/s wr, 714 op/s 2024-09-10T10:50:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 785.0 s, 1207.8 tps, lat 83.881 ms stddev 126.104 2024-09-10T10:50:04.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:04 smithi097 ceph-mon[35213]: pgmap v420: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.4 MiB/s wr, 582 op/s 2024-09-10T10:50:04.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:04 smithi092 ceph-mon[30834]: pgmap v420: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.4 MiB/s wr, 582 op/s 2024-09-10T10:50:04.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:04 smithi121 ceph-mon[35231]: pgmap v420: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.4 MiB/s wr, 582 op/s 2024-09-10T10:50:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.824+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/3683279357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981069e0 msgr2=0x7fcf98106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.824+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/3683279357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981069e0 0x7fcf98106dc0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009930 tx=0x7fcf9402a420 comp rx=0 tx=0).stop 2024-09-10T10:50:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.824+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/3683279357 shutdown_connections 2024-09-10T10:50:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.824+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/3683279357 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf98101370 0x7fcf9810d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.824+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/3683279357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf981009d0 0x7fcf98100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.824+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/3683279357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981069e0 0x7fcf98106dc0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.824+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/3683279357 >> 172.21.15.92:0/3683279357 conn(0x7fcf980fc6f0 msgr2=0x7fcf980feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.824+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/3683279357 shutdown_connections 2024-09-10T10:50:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.824+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/3683279357 wait complete. 2024-09-10T10:50:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9fbe4640 1 Processor -- start 2024-09-10T10:50:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9fbe4640 1 -- start start 2024-09-10T10:50:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9fbe4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981009d0 0x7fcf9819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9fbe4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf98101370 0x7fcf9819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9fbe4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf981069e0 0x7fcf9819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9fbe4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810fd10 con 0x7fcf981009d0 2024-09-10T10:50:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9fbe4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810fb90 con 0x7fcf98101370 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9fbe4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810fe90 con 0x7fcf981069e0 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9d980640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981009d0 0x7fcf9819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9d980640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981009d0 0x7fcf9819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36338/0 (socket says 172.21.15.92:36338) 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9d980640 1 -- 172.21.15.92:0/28956355 learned_addr learned my addr 172.21.15.92:0/28956355 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9e181640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf981069e0 0x7fcf9819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.825+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf98101370 0x7fcf9819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9d980640 1 -- 172.21.15.92:0/28956355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf981069e0 msgr2=0x7fcf9819ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9d980640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf981069e0 0x7fcf9819ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9d980640 1 -- 172.21.15.92:0/28956355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf98101370 msgr2=0x7fcf9819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9d980640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf98101370 0x7fcf9819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9d980640 1 -- 172.21.15.92:0/28956355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9819f560 con 0x7fcf981009d0 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf98101370 0x7fcf9819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9e181640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf981069e0 0x7fcf9819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9d980640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981009d0 0x7fcf9819a570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcf9402a940 tx=0x7fcf94003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf8effd640 1 -- 172.21.15.92:0/28956355 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9403f070 con 0x7fcf981009d0 2024-09-10T10:50:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/28956355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9819f7f0 con 0x7fcf981009d0 2024-09-10T10:50:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf8effd640 1 -- 172.21.15.92:0/28956355 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf94031c90 con 0x7fcf981009d0 2024-09-10T10:50:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf8effd640 1 -- 172.21.15.92:0/28956355 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94035030 con 0x7fcf981009d0 2024-09-10T10:50:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.826+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/28956355 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf981a70e0 con 0x7fcf981009d0 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.829+0000 7fcfa2a56740 1 Processor -- start 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcfa2a56740 1 -- start start 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf8effd640 1 -- 172.21.15.92:0/28956355 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fcf94042070 con 0x7fcf981009d0 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5baf0 0x56520bf5bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf66770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf66cb0 0x56520bf690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56520bec02f0 con 0x56520bf5c410 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56520be68270 con 0x56520bf5baf0 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56520bebc2b0 con 0x56520bf66cb0 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d980640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf66770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d980640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf66770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36350/0 (socket says 172.21.15.92:36350) 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d980640 1 -- 172.21.15.92:0/1342759703 learned_addr learned my addr 172.21.15.92:0/1342759703 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf66cb0 0x56520bf690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9e181640 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5baf0 0x56520bf5bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d17f640 1 -- 172.21.15.92:0/1342759703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5baf0 msgr2=0x56520bf5bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5baf0 0x56520bf5bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d17f640 1 -- 172.21.15.92:0/1342759703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 msgr2=0x56520bf66770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf66770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d17f640 1 -- 172.21.15.92:0/1342759703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520be67340 con 0x56520bf66cb0 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.830+0000 7fcf9d980640 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf66770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.831+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf66cb0 0x56520bf690a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009fa0 tx=0x7fcf880118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=252b969f0cad9063 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.831+0000 7fcf8effd640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcf840a2da0 0x7fcf840a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.831+0000 7fcf9e181640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcf840a2da0 0x7fcf840a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.831+0000 7fcf83fff640 1 -- 172.21.15.92:0/1342759703 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88004030 con 0x56520bf66cb0 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.831+0000 7fcf83fff640 1 -- 172.21.15.92:0/1342759703 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf88005500 con 0x56520bf66cb0 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.831+0000 7fcf83fff640 1 -- 172.21.15.92:0/1342759703 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88004dd0 con 0x56520bf66cb0 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.831+0000 7fcf8effd640 1 -- 172.21.15.92:0/28956355 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7fcf940efae0 con 0x7fcf981009d0 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1342759703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf66cb0 msgr2=0x56520bf690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcf9e181640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcf840a2da0 0x7fcf840a5260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcf90005fd0 tx=0x7fcf90009600 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf66cb0 0x56520bf690a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009fa0 tx=0x7fcf880118d0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1342759703 shutdown_connections 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf66cb0 0x56520bf690a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf66770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1342759703 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5baf0 0x56520bf5bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1342759703 >> 172.21.15.92:0/1342759703 conn(0x56520bf58060 msgr2=0x56520bf58440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1342759703 shutdown_connections 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1342759703 wait complete. 2024-09-10T10:50:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 -- start start 2024-09-10T10:50:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.832+0000 7fcfa2a56740 1 Processor -- start 2024-09-10T10:50:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf63b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf64050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf64590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56520bf69880 con 0x56520bf66cb0 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56520be49290 con 0x56520bf5c410 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56520bf69a00 con 0x56520bf5baf0 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcfa2a56740 10 client.0 _ll_register_callbacks cb 0x56520be7a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d17f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf64050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d17f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf64050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:47028/0 (socket says 172.21.15.92:47028) 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d17f640 1 -- 172.21.15.92:0/414363287 learned_addr learned my addr 172.21.15.92:0/414363287 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d980640 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf63b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9e181640 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf64590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d17f640 1 -- 172.21.15.92:0/414363287 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 msgr2=0x56520bf63b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf63b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d17f640 1 -- 172.21.15.92:0/414363287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 msgr2=0x56520bf64590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf64590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d17f640 1 -- 172.21.15.92:0/414363287 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520bbd3210 con 0x56520bf5c410 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.833+0000 7fcf9d980640 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf63b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.834+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf64050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf88005020 tx=0x7fcf88005050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f835737f19913072 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.834+0000 7fcf817fa640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.834+0000 7fcf817fa640 1 -- 172.21.15.92:0/414363287 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88027070 con 0x56520bf5c410 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.834+0000 7fcfa2a56740 1 -- 172.21.15.92:0/414363287 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf88005500 con 0x56520bf5c410 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.834+0000 7fcf817fa640 1 -- 172.21.15.92:0/414363287 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7fcf880046c0 con 0x56520bf5c410 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.834+0000 7fcf817fa640 1 -- 172.21.15.92:0/414363287 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fcf88032050 con 0x56520bf5c410 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.834+0000 7fcfa2a56740 10 client.25832 fetch_fsmap learned FSMap version 61 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.834+0000 7fcfa2a56740 1 -- 172.21.15.92:0/414363287 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x56520bc9f620 con 0x56520bf5c410 2024-09-10T10:50:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.835+0000 7fcf817fa640 1 -- 172.21.15.92:0/414363287 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf88005500 con 0x56520bf5c410 2024-09-10T10:50:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.835+0000 7fcf817fa640 1 -- 172.21.15.92:0/414363287 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7fcf88022460 con 0x56520bf5c410 2024-09-10T10:50:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.835+0000 7fcfa2a56740 10 client.25832 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T10:50:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.835+0000 7fcfa2a56740 10 client.25832 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.835+0000 7fcfa2a56740 20 client.25832 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:05.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.835+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56520bf76f30 0x56520bf79390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.835+0000 7fcfa2a56740 4 client.25832 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.835+0000 7fcfa2a56740 1 -- 172.21.15.92:0/414363287 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56520becda20 con 0x56520bf76f30 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.836+0000 7fcf9d980640 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56520bf76f30 0x56520bf79390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.836+0000 7fcf9d980640 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56520bf76f30 0x56520bf79390 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43fce4158fd23b0d server_cookie=f4416da9960b3c2d in_seq=0 out_seq=0 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.836+0000 7fcf817fa640 10 client.25832 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcf817fa640 1 -- 172.21.15.92:0/414363287 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56520becda20 con 0x56520bf76f30 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcf817fa640 10 client.25832 handle_command_reply: tid=0 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 client.25832 shutdown 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 -- 172.21.15.92:0/414363287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 msgr2=0x56520bf64050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf64050 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcf88005020 tx=0x7fcf88005050 comp rx=0 tx=0).stop 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 -- 172.21.15.92:0/414363287 shutdown_connections 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf64590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.845 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56520bf76f30 0x56520bf79390 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf64050 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/414363287 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf63b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 -- 172.21.15.92:0/414363287 >> 172.21.15.92:0/414363287 conn(0x56520bf58060 msgr2=0x56520bf5ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcf817fa640 0 client.25832 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 -- 172.21.15.92:0/414363287 shutdown_connections 2024-09-10T10:50:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.837+0000 7fcfa2a56740 1 -- 172.21.15.92:0/414363287 wait complete. 2024-09-10T10:50:05.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.838+0000 7fcfa2a56740 20 client.25832 trim_cache size 0 max 16384 2024-09-10T10:50:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcfa2a56740 1 Processor -- start 2024-09-10T10:50:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcfa2a56740 1 -- start start 2024-09-10T10:50:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf65a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf66cb0 0x56520bf7ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981af920 con 0x56520bf5c410 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981b1490 con 0x56520bf66cb0 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981afff0 con 0x56520bf5baf0 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcf9d17f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf65a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcf9d17f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf65a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36362/0 (socket says 172.21.15.92:36362) 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcf9d17f640 1 -- 172.21.15.92:0/2574205739 learned_addr learned my addr 172.21.15.92:0/2574205739 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcf9d980640 1 --2- 172.21.15.92:0/2574205739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.853+0000 7fcf9e181640 1 --2- 172.21.15.92:0/2574205739 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf66cb0 0x56520bf7ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.854+0000 7fcf9d17f640 1 -- 172.21.15.92:0/2574205739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 msgr2=0x56520bf643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.854+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/2574205739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.854+0000 7fcf9d17f640 1 -- 172.21.15.92:0/2574205739 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf66cb0 msgr2=0x56520bf7ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.854+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/2574205739 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf66cb0 0x56520bf7ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.854+0000 7fcf9d17f640 1 -- 172.21.15.92:0/2574205739 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520bf5c240 con 0x56520bf5c410 2024-09-10T10:50:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.854+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/2574205739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf65a80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcf88004a70 tx=0x7fcf88004aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e438f1091bed7ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.854+0000 7fcf837fe640 1 -- 172.21.15.92:0/2574205739 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8802f020 con 0x56520bf5c410 2024-09-10T10:50:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.854+0000 7fcf837fe640 1 -- 172.21.15.92:0/2574205739 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf88005480 con 0x56520bf5c410 2024-09-10T10:50:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.854+0000 7fcf837fe640 1 -- 172.21.15.92:0/2574205739 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88027040 con 0x56520bf5c410 2024-09-10T10:50:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 -- 172.21.15.92:0/2574205739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 msgr2=0x56520bf65a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/2574205739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf65a80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fcf88004a70 tx=0x7fcf88004aa0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 -- 172.21.15.92:0/2574205739 shutdown_connections 2024-09-10T10:50:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/2574205739 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf66cb0 0x56520bf7ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/2574205739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf5c410 0x56520bf65a80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/2574205739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 -- 172.21.15.92:0/2574205739 >> 172.21.15.92:0/2574205739 conn(0x56520bf58060 msgr2=0x56520bf65370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 -- 172.21.15.92:0/2574205739 shutdown_connections 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 -- 172.21.15.92:0/2574205739 wait complete. 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 -- start start 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.855+0000 7fcfa2a56740 1 Processor -- start 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf67090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcfa2a56740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf67b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981b0dc0 con 0x56520bf66cb0 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981b06c0 con 0x56520bf5c410 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcfa2a56740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981ad920 con 0x56520bf5baf0 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcfa2a56740 10 client.0 _ll_register_callbacks cb 0x7fcf940f3500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9e181640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf67b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9e181640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf67b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36364/0 (socket says 172.21.15.92:36364) 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9e181640 1 -- 172.21.15.92:0/1173777304 learned_addr learned my addr 172.21.15.92:0/1173777304 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9d980640 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf67090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9e181640 1 -- 172.21.15.92:0/1173777304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 msgr2=0x56520bf67090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9e181640 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf67090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9e181640 1 -- 172.21.15.92:0/1173777304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 msgr2=0x56520bf675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9e181640 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9e181640 1 -- 172.21.15.92:0/1173777304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520bf6dcc0 con 0x56520bf66cb0 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9d17f640 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf9e181640 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf67b10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcf9001d670 tx=0x7fcf90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14262ed15d398b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf817fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf817fa640 1 -- 172.21.15.92:0/1173777304 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9001c6b0 con 0x56520bf66cb0 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcf817fa640 1 -- 172.21.15.92:0/1173777304 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8455+0+0 (secure 0 0 0) 0x7fcf9001c850 con 0x56520bf66cb0 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.856+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1173777304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf88005480 con 0x56520bf66cb0 2024-09-10T10:50:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcf817fa640 1 -- 172.21.15.92:0/1173777304 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fcf9001ca50 con 0x56520bf66cb0 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcfa2a56740 10 client.16344 fetch_fsmap learned FSMap version 61 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1173777304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x56520bf6eff0 con 0x56520bf66cb0 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcf817fa640 1 -- 172.21.15.92:0/1173777304 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf88005480 con 0x56520bf66cb0 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcf817fa640 1 -- 172.21.15.92:0/1173777304 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7fcf9001a040 con 0x56520bf66cb0 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcfa2a56740 10 client.16344 fetch_fsmap finished waiting for FSMap version 61 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcfa2a56740 10 client.16344 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcfa2a56740 20 client.16344 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56520bfe1c30 0x56520bfe4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcfa2a56740 4 client.16344 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1173777304 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56520bf58d10 con 0x56520bfe1c30 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.857+0000 7fcf9d980640 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56520bfe1c30 0x56520bfe4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.858+0000 7fcf817fa640 10 client.16344 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.858+0000 7fcf9d980640 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56520bfe1c30 0x56520bfe4020 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65ec05553cf5fc1 server_cookie=1d01efc06042c5b in_seq=0 out_seq=0 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.965+0000 7fcf817fa640 1 -- 172.21.15.92:0/1173777304 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56520bf58d10 con 0x56520bfe1c30 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.965+0000 7fcf817fa640 10 client.16344 handle_command_reply: tid=0 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.965+0000 7fcfa2a56740 1 client.16344 shutdown 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1173777304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 msgr2=0x56520bf67b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf67b10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcf9001d670 tx=0x7fcf90004a40 comp rx=0 tx=0).stop 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1173777304 shutdown_connections 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56520bf66cb0 0x56520bf67b10 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56520bfe1c30 0x56520bfe4020 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcf817fa640 0 client.16344 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56520bf5c410 0x56520bf675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 --2- 172.21.15.92:0/1173777304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56520bf5baf0 0x56520bf67090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1173777304 >> 172.21.15.92:0/1173777304 conn(0x56520bf58060 msgr2=0x56520bf65b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1173777304 shutdown_connections 2024-09-10T10:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 1 -- 172.21.15.92:0/1173777304 wait complete. 2024-09-10T10:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.966+0000 7fcfa2a56740 20 client.16344 trim_cache size 0 max 16384 2024-09-10T10:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:50:05.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:50:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcf840a2da0 msgr2=0x7fcf840a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcf840a2da0 0x7fcf840a5260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcf90005fd0 tx=0x7fcf90009600 comp rx=0 tx=0).stop 2024-09-10T10:50:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981009d0 msgr2=0x7fcf9819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981009d0 0x7fcf9819a570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fcf9402a940 tx=0x7fcf94003b90 comp rx=0 tx=0).stop 2024-09-10T10:50:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/28956355 shutdown_connections 2024-09-10T10:50:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf981069e0 0x7fcf9819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fcf840a2da0 0x7fcf840a5260 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fcf98101370 0x7fcf9819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 --2- 172.21.15.92:0/28956355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf981009d0 0x7fcf9819a570 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/28956355 >> 172.21.15.92:0/28956355 conn(0x7fcf980fc6f0 msgr2=0x7fcf980fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/28956355 shutdown_connections 2024-09-10T10:50:05.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:05.967+0000 7fcf9fbe4640 1 -- 172.21.15.92:0/28956355 wait complete. 2024-09-10T10:50:06.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:06 smithi092 ceph-mon[30834]: pgmap v421: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.0 MiB/s wr, 521 op/s 2024-09-10T10:50:06.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:06 smithi121 ceph-mon[35231]: pgmap v421: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.0 MiB/s wr, 521 op/s 2024-09-10T10:50:06.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:06 smithi097 ceph-mon[35213]: pgmap v421: 97 pgs: 97 active+clean; 4.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.0 MiB/s wr, 521 op/s 2024-09-10T10:50:07.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:07 smithi092 ceph-mon[30834]: osdmap e100: 12 total, 12 up, 12 in 2024-09-10T10:50:07.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:07 smithi121 ceph-mon[35231]: osdmap e100: 12 total, 12 up, 12 in 2024-09-10T10:50:07.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:07 smithi097 ceph-mon[35213]: osdmap e100: 12 total, 12 up, 12 in 2024-09-10T10:50:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 790.0 s, 1531.0 tps, lat 65.367 ms stddev 94.788 2024-09-10T10:50:08.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:08 smithi092 ceph-mon[30834]: pgmap v423: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 28 MiB/s wr, 1.99k op/s 2024-09-10T10:50:08.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:08 smithi121 ceph-mon[35231]: pgmap v423: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 28 MiB/s wr, 1.99k op/s 2024-09-10T10:50:08.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:08 smithi097 ceph-mon[35213]: pgmap v423: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 28 MiB/s wr, 1.99k op/s 2024-09-10T10:50:10.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:10 smithi092 ceph-mon[30834]: pgmap v424: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 28 MiB/s wr, 1.99k op/s 2024-09-10T10:50:10.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:10 smithi121 ceph-mon[35231]: pgmap v424: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 28 MiB/s wr, 1.99k op/s 2024-09-10T10:50:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:10 smithi097 ceph-mon[35213]: pgmap v424: 97 pgs: 97 active+clean; 4.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 28 MiB/s wr, 1.99k op/s 2024-09-10T10:50:12.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:12 smithi092 ceph-mon[30834]: pgmap v425: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 27 MiB/s wr, 1.99k op/s 2024-09-10T10:50:12.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:12 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:50:12.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:12 smithi121 ceph-mon[35231]: pgmap v425: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 27 MiB/s wr, 1.99k op/s 2024-09-10T10:50:12.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:12 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:50:12.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:12 smithi097 ceph-mon[35213]: pgmap v425: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 27 MiB/s wr, 1.99k op/s 2024-09-10T10:50:12.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:12 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:50:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 795.0 s, 1711.8 tps, lat 57.766 ms stddev 65.835 2024-09-10T10:50:14.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:14 smithi092 ceph-mon[30834]: pgmap v426: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 27 MiB/s wr, 2.03k op/s 2024-09-10T10:50:14.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:14 smithi121 ceph-mon[35231]: pgmap v426: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 27 MiB/s wr, 2.03k op/s 2024-09-10T10:50:14.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:14 smithi097 ceph-mon[35213]: pgmap v426: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 27 MiB/s wr, 2.03k op/s 2024-09-10T10:50:15.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:15 smithi121 ceph-mon[35231]: osdmap e101: 12 total, 12 up, 12 in 2024-09-10T10:50:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:15 smithi097 ceph-mon[35213]: osdmap e101: 12 total, 12 up, 12 in 2024-09-10T10:50:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:15 smithi092 ceph-mon[30834]: osdmap e101: 12 total, 12 up, 12 in 2024-09-10T10:50:16.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:16 smithi121 ceph-mon[35231]: pgmap v428: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-09-10T10:50:16.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:16 smithi097 ceph-mon[35213]: pgmap v428: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-09-10T10:50:16.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:16 smithi092 ceph-mon[30834]: pgmap v428: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-09-10T10:50:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 800.0 s, 2096.0 tps, lat 48.207 ms stddev 51.473 2024-09-10T10:50:18.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:18 smithi121 ceph-mon[35231]: pgmap v429: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 723 op/s 2024-09-10T10:50:18.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:18 smithi097 ceph-mon[35213]: pgmap v429: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 723 op/s 2024-09-10T10:50:18.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:18 smithi092 ceph-mon[30834]: pgmap v429: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.6 MiB/s wr, 723 op/s 2024-09-10T10:50:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.096+0000 7f47e88a6640 1 -- 172.21.15.92:0/1616099542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e41091f0 msgr2=0x7f47e4110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.096+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1616099542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e41091f0 0x7f47e4110250 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009cd0 tx=0x7f47dc02a8f0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.097+0000 7f47e88a6640 1 -- 172.21.15.92:0/1616099542 shutdown_connections 2024-09-10T10:50:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.097+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1616099542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47e411b140 0x7f47e411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.097+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1616099542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e41095d0 0x7f47e4109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.097+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1616099542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e41091f0 0x7f47e4110250 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.097+0000 7f47e88a6640 1 -- 172.21.15.92:0/1616099542 >> 172.21.15.92:0/1616099542 conn(0x7f47e406ce00 msgr2=0x7f47e406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.097+0000 7f47e88a6640 1 -- 172.21.15.92:0/1616099542 shutdown_connections 2024-09-10T10:50:19.099 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.097+0000 7f47e88a6640 1 -- 172.21.15.92:0/1616099542 wait complete. 2024-09-10T10:50:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.097+0000 7f47e88a6640 1 Processor -- start 2024-09-10T10:50:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.097+0000 7f47e88a6640 1 -- start start 2024-09-10T10:50:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e88a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47e41091f0 0x7f47e4118640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e88a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e41095d0 0x7f47e4118b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e88a6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e411b140 0x7f47e41118a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e88a6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4120d30 con 0x7f47e41095d0 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e88a6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4120bb0 con 0x7f47e411b140 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e88a6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47e4120eb0 con 0x7f47e41091f0 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e2d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e411b140 0x7f47e41118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47e41091f0 0x7f47e4118640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e2d9d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e411b140 0x7f47e41118a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:59330/0 (socket says 172.21.15.92:59330) 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e2d9d640 1 -- 172.21.15.92:0/1810153439 learned_addr learned my addr 172.21.15.92:0/1810153439 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e41095d0 0x7f47e4118b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e2d9d640 1 -- 172.21.15.92:0/1810153439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47e41091f0 msgr2=0x7f47e4118640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e2d9d640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47e41091f0 0x7f47e4118640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e2d9d640 1 -- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e41095d0 msgr2=0x7f47e4118b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e2d9d640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e41095d0 0x7f47e4118b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.098+0000 7f47e2d9d640 1 -- 172.21.15.92:0/1810153439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e4112160 con 0x7f47e411b140 2024-09-10T10:50:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.099+0000 7f47e2d9d640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e411b140 0x7f47e41118a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f47d400c970 tx=0x7f47d400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.099+0000 7f47d37fe640 1 -- 172.21.15.92:0/1810153439 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d4007bb0 con 0x7f47e411b140 2024-09-10T10:50:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.099+0000 7f47d37fe640 1 -- 172.21.15.92:0/1810153439 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d4007d50 con 0x7f47e411b140 2024-09-10T10:50:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.099+0000 7f47d37fe640 1 -- 172.21.15.92:0/1810153439 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d400f450 con 0x7f47e411b140 2024-09-10T10:50:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.099+0000 7f47e88a6640 1 -- 172.21.15.92:0/1810153439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e4112450 con 0x7f47e411b140 2024-09-10T10:50:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.099+0000 7f47e88a6640 1 -- 172.21.15.92:0/1810153439 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e41163a0 con 0x7f47e411b140 2024-09-10T10:50:19.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.102+0000 7f47eb63b740 1 Processor -- start 2024-09-10T10:50:19.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.104+0000 7f47d37fe640 1 -- 172.21.15.92:0/1810153439 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f47d4004f60 con 0x7f47e411b140 2024-09-10T10:50:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.104+0000 7f47eb63b740 1 -- start start 2024-09-10T10:50:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 0x5602e20cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47eb63b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5602e20342f0 con 0x5602e20cfaf0 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47eb63b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5602e1fdc270 con 0x5602e20d0410 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47eb63b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5602e20302b0 con 0x5602e20dacb0 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47e1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 0x5602e20cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47e259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47e1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 0x5602e20cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55994/0 (socket says 172.21.15.92:55994) 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47e1d9b640 1 -- 172.21.15.92:0/3751555458 learned_addr learned my addr 172.21.15.92:0/3751555458 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/3751555458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47d37fe640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f47cc0a2e20 0x7f47cc0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47e1d9b640 1 -- 172.21.15.92:0/3751555458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 msgr2=0x5602e20da770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/3751555458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20da770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47e1d9b640 1 -- 172.21.15.92:0/3751555458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 msgr2=0x5602e20cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.105+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/3751555458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 0x5602e20cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.106+0000 7f47e1d9b640 1 -- 172.21.15.92:0/3751555458 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e1fdb340 con 0x5602e20dacb0 2024-09-10T10:50:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.106+0000 7f47d37fe640 1 -- 172.21.15.92:0/1810153439 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7f47d40cf0e0 con 0x7f47e411b140 2024-09-10T10:50:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.106+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/3751555458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20dd0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47d8006aa0 tx=0x7f47d8006a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4977ac0b79d0539 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.106+0000 7f47e2d9d640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f47cc0a2e20 0x7f47cc0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.106+0000 7f47d0ff9640 1 -- 172.21.15.92:0/3751555458 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8018430 con 0x5602e20dacb0 2024-09-10T10:50:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.106+0000 7f47d0ff9640 1 -- 172.21.15.92:0/3751555458 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d800ae10 con 0x5602e20dacb0 2024-09-10T10:50:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.106+0000 7f47d0ff9640 1 -- 172.21.15.92:0/3751555458 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8017850 con 0x5602e20dacb0 2024-09-10T10:50:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 -- 172.21.15.92:0/3751555458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 msgr2=0x5602e20dd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47e2d9d640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f47cc0a2e20 0x7f47cc0a52e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f47d40cc870 tx=0x7f47d400a470 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3751555458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20dd0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47d8006aa0 tx=0x7f47d8006a30 comp rx=0 tx=0).stop 2024-09-10T10:50:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 -- 172.21.15.92:0/3751555458 shutdown_connections 2024-09-10T10:50:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3751555458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20dd0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3751555458 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3751555458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 0x5602e20cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 -- 172.21.15.92:0/3751555458 >> 172.21.15.92:0/3751555458 conn(0x5602e20cc060 msgr2=0x5602e20cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 -- 172.21.15.92:0/3751555458 shutdown_connections 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 -- 172.21.15.92:0/3751555458 wait complete. 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.107+0000 7f47eb63b740 1 -- start start 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47eb63b740 1 Processor -- start 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20cfaf0 0x5602e20d7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20dacb0 0x5602e20d8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47eb63b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5602e20dd880 con 0x5602e20dacb0 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47eb63b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5602e1fbd290 con 0x5602e20d0410 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47eb63b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5602e20dda00 con 0x5602e20cfaf0 2024-09-10T10:50:19.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47eb63b740 10 client.0 _ll_register_callbacks cb 0x5602e1fee140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20dacb0 0x5602e20d8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20dacb0 0x5602e20d8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56002/0 (socket says 172.21.15.92:56002) 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 -- 172.21.15.92:0/1089550701 learned_addr learned my addr 172.21.15.92:0/1089550701 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20cfaf0 0x5602e20d7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e259c640 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 -- 172.21.15.92:0/1089550701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20cfaf0 msgr2=0x5602e20d7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20cfaf0 0x5602e20d7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 -- 172.21.15.92:0/1089550701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 msgr2=0x5602e20d8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 -- 172.21.15.92:0/1089550701 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e1d47210 con 0x5602e20dacb0 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20dacb0 0x5602e20d8670 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f47d8001eb0 tx=0x7f47d800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7205bb47e47fb804 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.108+0000 7f47c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.109+0000 7f47c9ffb640 1 -- 172.21.15.92:0/1089550701 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8017cb0 con 0x5602e20dacb0 2024-09-10T10:50:19.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.109+0000 7f47eb63b740 1 -- 172.21.15.92:0/1089550701 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47d800ae10 con 0x5602e20dacb0 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.109+0000 7f47c9ffb640 1 -- 172.21.15.92:0/1089550701 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7f47d8026440 con 0x5602e20dacb0 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.109+0000 7f47c9ffb640 1 -- 172.21.15.92:0/1089550701 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f47d8034050 con 0x5602e20dacb0 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.109+0000 7f47eb63b740 10 client.16353 fetch_fsmap learned FSMap version 62 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.109+0000 7f47eb63b740 1 -- 172.21.15.92:0/1089550701 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5602e1e13620 con 0x5602e20dacb0 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.110+0000 7f47c9ffb640 1 -- 172.21.15.92:0/1089550701 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d800ae10 con 0x5602e20dacb0 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.110+0000 7f47c9ffb640 1 -- 172.21.15.92:0/1089550701 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f47d8015040 con 0x5602e20dacb0 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.110+0000 7f47eb63b740 10 client.16353 fetch_fsmap finished waiting for FSMap version 62 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.110+0000 7f47eb63b740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.110+0000 7f47eb63b740 20 client.16353 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.110+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5602e20eaba0 0x5602e20ecf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.110+0000 7f47eb63b740 4 client.16353 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.110+0000 7f47eb63b740 1 -- 172.21.15.92:0/1089550701 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602e2041a20 con 0x5602e20eaba0 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.110+0000 7f47e259c640 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5602e20eaba0 0x5602e20ecf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47c9ffb640 10 client.16353 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47e259c640 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5602e20eaba0 0x5602e20ecf90 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=790f6fabe49d1024 server_cookie=361a1b437f8026ce in_seq=0 out_seq=0 2024-09-10T10:50:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47c9ffb640 1 -- 172.21.15.92:0/1089550701 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602e2041a20 con 0x5602e20eaba0 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47c9ffb640 10 client.16353 handle_command_reply: tid=0 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 client.16353 shutdown 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 -- 172.21.15.92:0/1089550701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20dacb0 msgr2=0x5602e20d8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20dacb0 0x5602e20d8670 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f47d8001eb0 tx=0x7f47d800f040 comp rx=0 tx=0).stop 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 -- 172.21.15.92:0/1089550701 shutdown_connections 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20dacb0 0x5602e20d8670 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5602e20eaba0 0x5602e20ecf90 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47c9ffb640 0 client.16353 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1089550701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20cfaf0 0x5602e20d7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 -- 172.21.15.92:0/1089550701 >> 172.21.15.92:0/1089550701 conn(0x5602e20cc060 msgr2=0x5602e20d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 -- 172.21.15.92:0/1089550701 shutdown_connections 2024-09-10T10:50:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.111+0000 7f47eb63b740 1 -- 172.21.15.92:0/1089550701 wait complete. 2024-09-10T10:50:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.112+0000 7f47eb63b740 20 client.16353 trim_cache size 0 max 16384 2024-09-10T10:50:19.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47eb63b740 1 Processor -- start 2024-09-10T10:50:19.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47eb63b740 1 -- start start 2024-09-10T10:50:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 0x5602e20d9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20f2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47eb63b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41c4dc0 con 0x5602e20cfaf0 2024-09-10T10:50:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47eb63b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41c6900 con 0x5602e20d0410 2024-09-10T10:50:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47eb63b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41c5490 con 0x5602e20dacb0 2024-09-10T10:50:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47e259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47e259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:59360/0 (socket says 172.21.15.92:59360) 2024-09-10T10:50:19.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.130+0000 7f47e259c640 1 -- 172.21.15.92:0/1977566350 learned_addr learned my addr 172.21.15.92:0/1977566350 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.132+0000 7f47e259c640 1 -- 172.21.15.92:0/1977566350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 msgr2=0x5602e20f2560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:50:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.132+0000 7f47e259c640 1 --2- 172.21.15.92:0/1977566350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20f2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.132+0000 7f47e259c640 1 -- 172.21.15.92:0/1977566350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 msgr2=0x5602e20d9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.132+0000 7f47e259c640 1 --2- 172.21.15.92:0/1977566350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 0x5602e20d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.132+0000 7f47e259c640 1 -- 172.21.15.92:0/1977566350 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602e20da740 con 0x5602e20d0410 2024-09-10T10:50:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.132+0000 7f47e259c640 1 --2- 172.21.15.92:0/1977566350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d84a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009a60 tx=0x7f47dc0093a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=856fbdeec08776 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.132+0000 7f47cbfff640 1 -- 172.21.15.92:0/1977566350 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc003cb0 con 0x5602e20d0410 2024-09-10T10:50:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.132+0000 7f47cbfff640 1 -- 172.21.15.92:0/1977566350 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47dc036040 con 0x5602e20d0410 2024-09-10T10:50:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.132+0000 7f47cbfff640 1 -- 172.21.15.92:0/1977566350 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc004830 con 0x5602e20d0410 2024-09-10T10:50:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 -- 172.21.15.92:0/1977566350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 msgr2=0x5602e20d84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1977566350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d84a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009a60 tx=0x7f47dc0093a0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 -- 172.21.15.92:0/1977566350 shutdown_connections 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1977566350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1977566350 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20d0410 0x5602e20d84a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 --2- 172.21.15.92:0/1977566350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20cfaf0 0x5602e20d9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 -- 172.21.15.92:0/1977566350 >> 172.21.15.92:0/1977566350 conn(0x5602e20cc060 msgr2=0x5602e20d6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 -- 172.21.15.92:0/1977566350 shutdown_connections 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 -- 172.21.15.92:0/1977566350 wait complete. 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.133+0000 7f47eb63b740 1 -- start start 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47eb63b740 1 Processor -- start 2024-09-10T10:50:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20cfaf0 0x5602e20e3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20d0410 0x5602e20de550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47eb63b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20dea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20d0410 0x5602e20de550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20d0410 0x5602e20de550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56018/0 (socket says 172.21.15.92:56018) 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e259c640 1 -- 172.21.15.92:0/3789382210 learned_addr learned my addr 172.21.15.92:0/3789382210 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41c6230 con 0x5602e20d0410 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41c5b60 con 0x5602e20cfaf0 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47e41c2dc0 con 0x5602e20dacb0 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20cfaf0 0x5602e20e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47eb63b740 10 client.0 _ll_register_callbacks cb 0x7f47d800a7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e259c640 1 -- 172.21.15.92:0/3789382210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 msgr2=0x5602e20dea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e259c640 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20dea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e259c640 1 -- 172.21.15.92:0/3789382210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20cfaf0 msgr2=0x5602e20e3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e259c640 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20cfaf0 0x5602e20e3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e259c640 1 -- 172.21.15.92:0/3789382210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602e20df0d0 con 0x5602e20d0410 2024-09-10T10:50:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.134+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20cfaf0 0x5602e20e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.135+0000 7f47e259c640 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20d0410 0x5602e20de550 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009bf0 tx=0x7f47dc02a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff850056ebaa698 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.135+0000 7f47c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:50:19.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.135+0000 7f47c9ffb640 1 -- 172.21.15.92:0/3789382210 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc004b40 con 0x5602e20d0410 2024-09-10T10:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.135+0000 7f47c9ffb640 1 -- 172.21.15.92:0/3789382210 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7f47dc004ce0 con 0x5602e20d0410 2024-09-10T10:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.135+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47dc036040 con 0x5602e20d0410 2024-09-10T10:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.135+0000 7f47c9ffb640 1 -- 172.21.15.92:0/3789382210 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f47dc003cb0 con 0x5602e20d0410 2024-09-10T10:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.135+0000 7f47eb63b740 10 client.16356 fetch_fsmap learned FSMap version 62 2024-09-10T10:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.135+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5602e2155390 con 0x5602e20d0410 2024-09-10T10:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.135+0000 7f47c9ffb640 1 -- 172.21.15.92:0/3789382210 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47dc036040 con 0x5602e20d0410 2024-09-10T10:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47c9ffb640 1 -- 172.21.15.92:0/3789382210 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f47dc045070 con 0x5602e20d0410 2024-09-10T10:50:19.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47eb63b740 10 client.16356 fetch_fsmap finished waiting for FSMap version 62 2024-09-10T10:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47eb63b740 10 client.16356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47eb63b740 20 client.16356 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5602e2155a00 0x5602e2157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47eb63b740 4 client.16356 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602e203bd70 con 0x5602e2155a00 2024-09-10T10:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5602e2155a00 0x5602e2157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47c9ffb640 10 client.16356 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.136+0000 7f47e1d9b640 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5602e2155a00 0x5602e2157e20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13cc2d233457fe0 server_cookie=fd4bd9de886dabc5 in_seq=0 out_seq=0 2024-09-10T10:50:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.145+0000 7f47c9ffb640 1 -- 172.21.15.92:0/3789382210 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602e203bd70 con 0x5602e2155a00 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47c9ffb640 10 client.16356 handle_command_reply: tid=0 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 client.16356 shutdown 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20d0410 msgr2=0x5602e20de550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20d0410 0x5602e20de550 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009bf0 tx=0x7f47dc02a8f0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 shutdown_connections 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602e20dacb0 0x5602e20dea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602e20d0410 0x5602e20de550 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5602e2155a00 0x5602e2157e20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 --2- 172.21.15.92:0/3789382210 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5602e20cfaf0 0x5602e20e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 >> 172.21.15.92:0/3789382210 conn(0x5602e20cc060 msgr2=0x5602e20d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47c9ffb640 0 client.16356 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 shutdown_connections 2024-09-10T10:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 1 -- 172.21.15.92:0/3789382210 wait complete. 2024-09-10T10:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.146+0000 7f47eb63b740 20 client.16356 trim_cache size 0 max 16384 2024-09-10T10:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:50:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:50:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 -- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f47cc0a2e20 msgr2=0x7f47cc0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f47cc0a2e20 0x7f47cc0a52e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f47d40cc870 tx=0x7f47d400a470 comp rx=0 tx=0).stop 2024-09-10T10:50:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 -- 172.21.15.92:0/1810153439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e411b140 msgr2=0x7f47e41118a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e411b140 0x7f47e41118a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f47d400c970 tx=0x7f47d400ce30 comp rx=0 tx=0).stop 2024-09-10T10:50:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 -- 172.21.15.92:0/1810153439 shutdown_connections 2024-09-10T10:50:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f47cc0a2e20 0x7f47cc0a52e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f47e411b140 0x7f47e41118a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47e41095d0 0x7f47e4118b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 --2- 172.21.15.92:0/1810153439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47e41091f0 0x7f47e4118640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 -- 172.21.15.92:0/1810153439 >> 172.21.15.92:0/1810153439 conn(0x7f47e406ce00 msgr2=0x7f47e411b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 -- 172.21.15.92:0/1810153439 shutdown_connections 2024-09-10T10:50:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:19.147+0000 7f47e88a6640 1 -- 172.21.15.92:0/1810153439 wait complete. 2024-09-10T10:50:20.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:20 smithi121 ceph-mon[35231]: pgmap v430: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.5 MiB/s wr, 722 op/s 2024-09-10T10:50:20.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:20 smithi097 ceph-mon[35213]: pgmap v430: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.5 MiB/s wr, 722 op/s 2024-09-10T10:50:20.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:20 smithi092 ceph-mon[30834]: pgmap v430: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.5 MiB/s wr, 722 op/s 2024-09-10T10:50:21.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:21 smithi121 ceph-mon[35231]: pgmap v431: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.0 MiB/s wr, 767 op/s 2024-09-10T10:50:21.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:21 smithi097 ceph-mon[35213]: pgmap v431: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.0 MiB/s wr, 767 op/s 2024-09-10T10:50:21.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:21 smithi092 ceph-mon[30834]: pgmap v431: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.0 MiB/s wr, 767 op/s 2024-09-10T10:50:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 805.0 s, 1551.4 tps, lat 64.234 ms stddev 68.304 2024-09-10T10:50:24.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:23 smithi121 ceph-mon[35231]: pgmap v432: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.8 MiB/s wr, 736 op/s 2024-09-10T10:50:24.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:23 smithi097 ceph-mon[35213]: pgmap v432: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.8 MiB/s wr, 736 op/s 2024-09-10T10:50:24.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:23 smithi092 ceph-mon[30834]: pgmap v432: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.8 MiB/s wr, 736 op/s 2024-09-10T10:50:26.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:25 smithi121 ceph-mon[35231]: pgmap v433: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.7 MiB/s wr, 724 op/s 2024-09-10T10:50:26.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:25 smithi097 ceph-mon[35213]: pgmap v433: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.7 MiB/s wr, 724 op/s 2024-09-10T10:50:26.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:25 smithi092 ceph-mon[30834]: pgmap v433: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.7 MiB/s wr, 724 op/s 2024-09-10T10:50:28.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:27 smithi121 ceph-mon[35231]: pgmap v434: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 1.83k op/s 2024-09-10T10:50:28.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:27 smithi097 ceph-mon[35213]: pgmap v434: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 1.83k op/s 2024-09-10T10:50:28.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:27 smithi092 ceph-mon[30834]: pgmap v434: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 1.83k op/s 2024-09-10T10:50:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 810.0 s, 1160.0 tps, lat 85.527 ms stddev 157.468 2024-09-10T10:50:30.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:29 smithi121 ceph-mon[35231]: pgmap v435: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 17 MiB/s wr, 1.52k op/s 2024-09-10T10:50:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:29 smithi097 ceph-mon[35213]: pgmap v435: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 17 MiB/s wr, 1.52k op/s 2024-09-10T10:50:30.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:29 smithi092 ceph-mon[30834]: pgmap v435: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 17 MiB/s wr, 1.52k op/s 2024-09-10T10:50:32.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:31 smithi121 ceph-mon[35231]: pgmap v436: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 18 MiB/s wr, 1.65k op/s 2024-09-10T10:50:32.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:31 smithi097 ceph-mon[35213]: pgmap v436: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 18 MiB/s wr, 1.65k op/s 2024-09-10T10:50:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:31 smithi092 ceph-mon[30834]: pgmap v436: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 18 MiB/s wr, 1.65k op/s 2024-09-10T10:50:32.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.260+0000 7fdb5f52a640 1 -- 172.21.15.92:0/1588181808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb58101450 msgr2=0x7fdb5810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:32.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.260+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/1588181808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb58101450 0x7fdb5810df40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009900 tx=0x7fdb5402a410 comp rx=0 tx=0).stop 2024-09-10T10:50:32.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.260+0000 7fdb5f52a640 1 -- 172.21.15.92:0/1588181808 shutdown_connections 2024-09-10T10:50:32.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.260+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/1588181808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb5810e480 0x7fdb58110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.260+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/1588181808 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb58101450 0x7fdb5810df40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.260+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/1588181808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb58100b30 0x7fdb58100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.263 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.260+0000 7fdb5f52a640 1 -- 172.21.15.92:0/1588181808 >> 172.21.15.92:0/1588181808 conn(0x7fdb580fc6b0 msgr2=0x7fdb580fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:32.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.260+0000 7fdb5f52a640 1 -- 172.21.15.92:0/1588181808 shutdown_connections 2024-09-10T10:50:32.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.260+0000 7fdb5f52a640 1 -- 172.21.15.92:0/1588181808 wait complete. 2024-09-10T10:50:32.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.261+0000 7fdb5f52a640 1 Processor -- start 2024-09-10T10:50:32.264 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.261+0000 7fdb5f52a640 1 -- start start 2024-09-10T10:50:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5f52a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb58100b30 0x7fdb5819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5f52a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb58101450 0x7fdb5819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5f52a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb5810e480 0x7fdb581a3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5f52a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5810acf0 con 0x7fdb58101450 2024-09-10T10:50:32.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5f52a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5810ab70 con 0x7fdb5810e480 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5f52a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5810ae70 con 0x7fdb58100b30 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5cac5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb58101450 0x7fdb5819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5cac5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb58101450 0x7fdb5819ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47886/0 (socket says 172.21.15.92:47886) 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5dac7640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb5810e480 0x7fdb581a3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5cac5640 1 -- 172.21.15.92:0/2586640762 learned_addr learned my addr 172.21.15.92:0/2586640762 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb58100b30 0x7fdb5819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5cac5640 1 -- 172.21.15.92:0/2586640762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb58100b30 msgr2=0x7fdb5819e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb58100b30 0x7fdb5819e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5cac5640 1 -- 172.21.15.92:0/2586640762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb5810e480 msgr2=0x7fdb581a3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb5810e480 0x7fdb581a3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5cac5640 1 -- 172.21.15.92:0/2586640762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb581a3990 con 0x7fdb58101450 2024-09-10T10:50:32.267 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb58101450 0x7fdb5819ef10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdb54006010 tx=0x7fdb54004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb4e7fc640 1 -- 172.21.15.92:0/2586640762 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5403f030 con 0x7fdb58101450 2024-09-10T10:50:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.262+0000 7fdb5f52a640 1 -- 172.21.15.92:0/2586640762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb581a3c20 con 0x7fdb58101450 2024-09-10T10:50:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.263+0000 7fdb4e7fc640 1 -- 172.21.15.92:0/2586640762 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb54004440 con 0x7fdb58101450 2024-09-10T10:50:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.263+0000 7fdb4e7fc640 1 -- 172.21.15.92:0/2586640762 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54035070 con 0x7fdb58101450 2024-09-10T10:50:32.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.263+0000 7fdb5f52a640 1 -- 172.21.15.92:0/2586640762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb581ab510 con 0x7fdb58101450 2024-09-10T10:50:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.266+0000 7fdb622c7740 1 Processor -- start 2024-09-10T10:50:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.266+0000 7fdb622c7740 1 -- start start 2024-09-10T10:50:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x558454537ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454542770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454542cb0 0x5584545450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb622c7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55845449c2f0 con 0x558454537af0 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb622c7740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558454444270 con 0x558454542cb0 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb622c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5584544982b0 con 0x558454538410 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb5dac7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x558454537ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb5dac7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x558454537ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47902/0 (socket says 172.21.15.92:47902) 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb5dac7640 1 -- 172.21.15.92:0/62594681 learned_addr learned my addr 172.21.15.92:0/62594681 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.267+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/62594681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454542770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.268+0000 7fdb5dac7640 1 -- 172.21.15.92:0/62594681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 msgr2=0x558454542770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.268+0000 7fdb5dac7640 1 --2- 172.21.15.92:0/62594681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454542770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.268+0000 7fdb5dac7640 1 -- 172.21.15.92:0/62594681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454542cb0 msgr2=0x5584545450a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:50:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.268+0000 7fdb5dac7640 1 --2- 172.21.15.92:0/62594681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454542cb0 0x5584545450a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.268+0000 7fdb4e7fc640 1 -- 172.21.15.92:0/2586640762 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fdb54042030 con 0x7fdb58101450 2024-09-10T10:50:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.268+0000 7fdb5dac7640 1 -- 172.21.15.92:0/62594681 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558454443340 con 0x558454537af0 2024-09-10T10:50:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.268+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/62594681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454542770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.268+0000 7fdb5dac7640 1 --2- 172.21.15.92:0/62594681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x558454537ed0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009f30 tx=0x7fdb500118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a8caf90eaa79fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.268+0000 7fdb437fe640 1 -- 172.21.15.92:0/62594681 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50004d20 con 0x558454537af0 2024-09-10T10:50:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.269+0000 7fdb4e7fc640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdb440a2e20 0x7fdb440a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.269+0000 7fdb437fe640 1 -- 172.21.15.92:0/62594681 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb50004050 con 0x558454537af0 2024-09-10T10:50:32.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.269+0000 7fdb4e7fc640 1 -- 172.21.15.92:0/2586640762 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7fdb540ef6e0 con 0x7fdb58101450 2024-09-10T10:50:32.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.269+0000 7fdb437fe640 1 -- 172.21.15.92:0/62594681 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50005260 con 0x558454537af0 2024-09-10T10:50:32.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.269+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdb440a2e20 0x7fdb440a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 -- 172.21.15.92:0/62594681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 msgr2=0x558454537ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 --2- 172.21.15.92:0/62594681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x558454537ed0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009f30 tx=0x7fdb500118d0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 -- 172.21.15.92:0/62594681 shutdown_connections 2024-09-10T10:50:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 --2- 172.21.15.92:0/62594681 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454542cb0 0x5584545450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 --2- 172.21.15.92:0/62594681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454542770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 --2- 172.21.15.92:0/62594681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x558454537ed0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 -- 172.21.15.92:0/62594681 >> 172.21.15.92:0/62594681 conn(0x558454534060 msgr2=0x558454534440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdb440a2e20 0x7fdb440a52e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x558454534ec0 tx=0x7fdb48005f90 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:32.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 -- 172.21.15.92:0/62594681 shutdown_connections 2024-09-10T10:50:32.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 -- 172.21.15.92:0/62594681 wait complete. 2024-09-10T10:50:32.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 -- start start 2024-09-10T10:50:32.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.270+0000 7fdb622c7740 1 Processor -- start 2024-09-10T10:50:32.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845453faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454540030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454542cb0 0x558454540570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb622c7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558454545920 con 0x558454537af0 2024-09-10T10:50:32.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb622c7740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x558454425290 con 0x558454542cb0 2024-09-10T10:50:32.277 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb622c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558454545aa0 con 0x558454538410 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5d2c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845453faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5d2c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845453faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47916/0 (socket says 172.21.15.92:47916) 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5d2c6640 1 -- 172.21.15.92:0/2752711405 learned_addr learned my addr 172.21.15.92:0/2752711405 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454540030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5dac7640 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454542cb0 0x558454540570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb622c7740 10 client.0 _ll_register_callbacks cb 0x558454456140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5cac5640 1 -- 172.21.15.92:0/2752711405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454542cb0 msgr2=0x558454540570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454542cb0 0x558454540570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5cac5640 1 -- 172.21.15.92:0/2752711405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 msgr2=0x55845453faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845453faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.278 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5cac5640 1 -- 172.21.15.92:0/2752711405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584541af210 con 0x558454538410 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.271+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845453faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.272+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454540030 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ece70 tx=0x7fdb540bb830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e3b98291c4d215 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.272+0000 7fdb40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.272+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2752711405 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54049040 con 0x558454538410 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.272+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2752711405 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7fdb540b8360 con 0x558454538410 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.272+0000 7fdb622c7740 1 -- 172.21.15.92:0/2752711405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb50004050 con 0x558454538410 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.272+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2752711405 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fdb540d9050 con 0x558454538410 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.272+0000 7fdb622c7740 10 client.25879 fetch_fsmap learned FSMap version 62 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.272+0000 7fdb622c7740 1 -- 172.21.15.92:0/2752711405 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55845427b620 con 0x558454538410 2024-09-10T10:50:32.279 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.274+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2752711405 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb50004050 con 0x558454538410 2024-09-10T10:50:32.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.274+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2752711405 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fdb54031bd0 con 0x558454538410 2024-09-10T10:50:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.274+0000 7fdb622c7740 10 client.25879 fetch_fsmap finished waiting for FSMap version 62 2024-09-10T10:50:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.274+0000 7fdb622c7740 10 client.25879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.274+0000 7fdb622c7740 20 client.25879 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.274+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558454552b70 0x558454554f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.274+0000 7fdb622c7740 4 client.25879 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.274+0000 7fdb622c7740 1 -- 172.21.15.92:0/2752711405 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584544a9a20 con 0x558454552b70 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.275+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558454552b70 0x558454554f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.275+0000 7fdb40ff9640 10 client.25879 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.276+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558454552b70 0x558454554f80 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a43f18a3c3dbc12 server_cookie=ed113e25d9cd2e4b in_seq=0 out_seq=0 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.276+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2752711405 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584544a9a20 con 0x558454552b70 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.276+0000 7fdb40ff9640 10 client.25879 handle_command_reply: tid=0 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.276+0000 7fdb622c7740 1 client.25879 shutdown 2024-09-10T10:50:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.276+0000 7fdb622c7740 1 -- 172.21.15.92:0/2752711405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 msgr2=0x558454540030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.276+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454540030 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ece70 tx=0x7fdb540bb830 comp rx=0 tx=0).stop 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb622c7740 1 -- 172.21.15.92:0/2752711405 shutdown_connections 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558454552b70 0x558454554f80 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454542cb0 0x558454540570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb40ff9640 0 client.25879 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454538410 0x558454540030 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2752711405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845453faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb622c7740 1 -- 172.21.15.92:0/2752711405 >> 172.21.15.92:0/2752711405 conn(0x558454534060 msgr2=0x558454539d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb622c7740 1 -- 172.21.15.92:0/2752711405 shutdown_connections 2024-09-10T10:50:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb622c7740 1 -- 172.21.15.92:0/2752711405 wait complete. 2024-09-10T10:50:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.277+0000 7fdb622c7740 20 client.25879 trim_cache size 0 max 16384 2024-09-10T10:50:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.303+0000 7fdb622c7740 1 Processor -- start 2024-09-10T10:50:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.304+0000 7fdb622c7740 1 -- start start 2024-09-10T10:50:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.305+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454537af0 0x5584545403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.305+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454538410 0x5584545330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.305+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 0x55845455a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.305+0000 7fdb622c7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb581b3d30 con 0x558454538410 2024-09-10T10:50:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.305+0000 7fdb622c7740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdb581b5870 con 0x558454537af0 2024-09-10T10:50:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.305+0000 7fdb622c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdb581b4400 con 0x558454542cb0 2024-09-10T10:50:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.305+0000 7fdb5d2c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454537af0 0x5584545403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.305+0000 7fdb5d2c6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454537af0 0x5584545403a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:44666/0 (socket says 172.21.15.92:44666) 2024-09-10T10:50:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.305+0000 7fdb5d2c6640 1 -- 172.21.15.92:0/1232133679 learned_addr learned my addr 172.21.15.92:0/1232133679 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.306+0000 7fdb5dac7640 1 --2- 172.21.15.92:0/1232133679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 0x55845455a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.306+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/1232133679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454538410 0x5584545330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.307+0000 7fdb5cac5640 1 -- 172.21.15.92:0/1232133679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 msgr2=0x55845455a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.307+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/1232133679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 0x55845455a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.307+0000 7fdb5cac5640 1 -- 172.21.15.92:0/1232133679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454537af0 msgr2=0x5584545403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.307+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/1232133679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454537af0 0x5584545403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.307+0000 7fdb5cac5640 1 -- 172.21.15.92:0/1232133679 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558454538240 con 0x558454538410 2024-09-10T10:50:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.307+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/1232133679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454538410 0x5584545330b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdb540bb9f0 tx=0x7fdb540bbe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b08bfc30ac0d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.307+0000 7fdb42ffd640 1 -- 172.21.15.92:0/1232133679 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54049070 con 0x558454538410 2024-09-10T10:50:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.308+0000 7fdb42ffd640 1 -- 172.21.15.92:0/1232133679 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5409f020 con 0x558454538410 2024-09-10T10:50:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.309+0000 7fdb622c7740 1 -- 172.21.15.92:0/1232133679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454538410 msgr2=0x5584545330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.309+0000 7fdb622c7740 1 --2- 172.21.15.92:0/1232133679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454538410 0x5584545330b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdb540bb9f0 tx=0x7fdb540bbe70 comp rx=0 tx=0).stop 2024-09-10T10:50:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.312+0000 7fdb622c7740 1 -- 172.21.15.92:0/1232133679 shutdown_connections 2024-09-10T10:50:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.312+0000 7fdb622c7740 1 --2- 172.21.15.92:0/1232133679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 0x55845455a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.312+0000 7fdb622c7740 1 --2- 172.21.15.92:0/1232133679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454538410 0x5584545330b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.312+0000 7fdb622c7740 1 --2- 172.21.15.92:0/1232133679 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454537af0 0x5584545403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.312+0000 7fdb622c7740 1 -- 172.21.15.92:0/1232133679 >> 172.21.15.92:0/1232133679 conn(0x558454534060 msgr2=0x5584545329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.318+0000 7fdb622c7740 1 -- 172.21.15.92:0/1232133679 shutdown_connections 2024-09-10T10:50:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.319+0000 7fdb622c7740 1 -- 172.21.15.92:0/1232133679 wait complete. 2024-09-10T10:50:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.320+0000 7fdb622c7740 1 -- start start 2024-09-10T10:50:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.320+0000 7fdb622c7740 1 Processor -- start 2024-09-10T10:50:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845454b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454538410 0x5584545465e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb622c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 0x558454546b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb622c7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb581b51a0 con 0x558454537af0 2024-09-10T10:50:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb622c7740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdb581b4ad0 con 0x558454538410 2024-09-10T10:50:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb622c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdb581b1d30 con 0x558454542cb0 2024-09-10T10:50:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb622c7740 10 client.0 _ll_register_callbacks cb 0x7fdb5403b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb5d2c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845454b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb5d2c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845454b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47940/0 (socket says 172.21.15.92:47940) 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb5d2c6640 1 -- 172.21.15.92:0/2140903766 learned_addr learned my addr 172.21.15.92:0/2140903766 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb5dac7640 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 0x558454546b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.321+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454538410 0x5584545465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.322+0000 7fdb5d2c6640 1 -- 172.21.15.92:0/2140903766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 msgr2=0x558454546b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.322+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 0x558454546b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.322+0000 7fdb5d2c6640 1 -- 172.21.15.92:0/2140903766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454538410 msgr2=0x5584545465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.322+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454538410 0x5584545465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.322+0000 7fdb5d2c6640 1 -- 172.21.15.92:0/2140903766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558454547110 con 0x558454537af0 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.322+0000 7fdb5d2c6640 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845454b2c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdb4801ea10 tx=0x7fdb480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd914bc7a5cb160c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.322+0000 7fdb40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:50:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.327+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2140903766 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4804c060 con 0x558454537af0 2024-09-10T10:50:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.327+0000 7fdb622c7740 1 -- 172.21.15.92:0/2140903766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb5409f020 con 0x558454537af0 2024-09-10T10:50:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.327+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2140903766 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7fdb48018030 con 0x558454537af0 2024-09-10T10:50:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.328+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2140903766 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fdb4800f620 con 0x558454537af0 2024-09-10T10:50:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.329+0000 7fdb622c7740 10 client.16374 fetch_fsmap learned FSMap version 62 2024-09-10T10:50:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.329+0000 7fdb622c7740 1 -- 172.21.15.92:0/2140903766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5584545b5a50 con 0x558454537af0 2024-09-10T10:50:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.329+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2140903766 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5409f020 con 0x558454537af0 2024-09-10T10:50:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.330+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2140903766 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fdb480479f0 con 0x558454537af0 2024-09-10T10:50:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.331+0000 7fdb622c7740 10 client.16374 fetch_fsmap finished waiting for FSMap version 62 2024-09-10T10:50:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.331+0000 7fdb622c7740 10 client.16374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.331+0000 7fdb622c7740 20 client.16374 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.331+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558454552b70 0x5584545b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.332+0000 7fdb622c7740 4 client.16374 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:50:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.332+0000 7fdb622c7740 1 -- 172.21.15.92:0/2140903766 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584544a3d70 con 0x558454552b70 2024-09-10T10:50:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.333+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558454552b70 0x5584545b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.343+0000 7fdb5cac5640 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558454552b70 0x5584545b81c0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a4e68999a321bb0 server_cookie=bd9c8a43ea039357 in_seq=0 out_seq=0 2024-09-10T10:50:32.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.343+0000 7fdb40ff9640 10 client.16374 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:32.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.388+0000 7fdb40ff9640 1 -- 172.21.15.92:0/2140903766 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584544a3d70 con 0x558454552b70 2024-09-10T10:50:32.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.388+0000 7fdb40ff9640 10 client.16374 handle_command_reply: tid=0 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.388+0000 7fdb622c7740 1 client.16374 shutdown 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 -- 172.21.15.92:0/2140903766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 msgr2=0x55845454b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845454b2c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdb4801ea10 tx=0x7fdb480046c0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 -- 172.21.15.92:0/2140903766 shutdown_connections 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558454542cb0 0x558454546b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x558454552b70 0x5584545b81c0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x558454538410 0x5584545465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 --2- 172.21.15.92:0/2140903766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558454537af0 0x55845454b2c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 -- 172.21.15.92:0/2140903766 >> 172.21.15.92:0/2140903766 conn(0x558454534060 msgr2=0x5584545329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:32.391 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb40ff9640 0 client.16374 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 -- 172.21.15.92:0/2140903766 shutdown_connections 2024-09-10T10:50:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 1 -- 172.21.15.92:0/2140903766 wait complete. 2024-09-10T10:50:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.389+0000 7fdb622c7740 20 client.16374 trim_cache size 0 max 16384 2024-09-10T10:50:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:50:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:50:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:50:32.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:50:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 -- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdb440a2e20 msgr2=0x7fdb440a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdb440a2e20 0x7fdb440a52e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x558454534ec0 tx=0x7fdb48005f90 comp rx=0 tx=0).stop 2024-09-10T10:50:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 -- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb58101450 msgr2=0x7fdb5819ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb58101450 0x7fdb5819ef10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdb54006010 tx=0x7fdb54004040 comp rx=0 tx=0).stop 2024-09-10T10:50:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 -- 172.21.15.92:0/2586640762 shutdown_connections 2024-09-10T10:50:32.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdb440a2e20 0x7fdb440a52e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdb5810e480 0x7fdb581a3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb58101450 0x7fdb5819ef10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 --2- 172.21.15.92:0/2586640762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdb58100b30 0x7fdb5819e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 -- 172.21.15.92:0/2586640762 >> 172.21.15.92:0/2586640762 conn(0x7fdb580fc6b0 msgr2=0x7fdb580fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 -- 172.21.15.92:0/2586640762 shutdown_connections 2024-09-10T10:50:32.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:32.390+0000 7fdb5f52a640 1 -- 172.21.15.92:0/2586640762 wait complete. 2024-09-10T10:50:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 815.0 s, 1885.0 tps, lat 53.497 ms stddev 68.274 2024-09-10T10:50:34.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:33 smithi121 ceph-mon[35231]: pgmap v437: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.63k op/s 2024-09-10T10:50:34.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:33 smithi097 ceph-mon[35213]: pgmap v437: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.63k op/s 2024-09-10T10:50:34.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:33 smithi092 ceph-mon[30834]: pgmap v437: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.63k op/s 2024-09-10T10:50:36.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:35 smithi121 ceph-mon[35231]: pgmap v438: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 1.56k op/s 2024-09-10T10:50:36.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:35 smithi097 ceph-mon[35213]: pgmap v438: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 1.56k op/s 2024-09-10T10:50:36.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:35 smithi092 ceph-mon[30834]: pgmap v438: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 1.56k op/s 2024-09-10T10:50:38.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:37 smithi121 ceph-mon[35231]: pgmap v439: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 MiB/s wr, 2.42k op/s 2024-09-10T10:50:38.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:37 smithi097 ceph-mon[35213]: pgmap v439: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 MiB/s wr, 2.42k op/s 2024-09-10T10:50:38.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:37 smithi092 ceph-mon[30834]: pgmap v439: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 25 MiB/s wr, 2.42k op/s 2024-09-10T10:50:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 820.0 s, 1442.0 tps, lat 68.853 ms stddev 103.311 2024-09-10T10:50:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:39 smithi121 ceph-mon[35231]: pgmap v440: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-09-10T10:50:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:39 smithi097 ceph-mon[35213]: pgmap v440: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-09-10T10:50:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:39 smithi092 ceph-mon[30834]: pgmap v440: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-09-10T10:50:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:41 smithi121 ceph-mon[35231]: pgmap v441: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 1.44k op/s 2024-09-10T10:50:42.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:41 smithi097 ceph-mon[35213]: pgmap v441: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 1.44k op/s 2024-09-10T10:50:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:41 smithi092 ceph-mon[30834]: pgmap v441: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 MiB/s wr, 1.44k op/s 2024-09-10T10:50:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 825.0 s, 1796.8 tps, lat 56.339 ms stddev 74.197 2024-09-10T10:50:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:43 smithi121 ceph-mon[35231]: pgmap v442: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 14 MiB/s wr, 1.50k op/s 2024-09-10T10:50:44.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:43 smithi097 ceph-mon[35213]: pgmap v442: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 14 MiB/s wr, 1.50k op/s 2024-09-10T10:50:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:43 smithi092 ceph-mon[30834]: pgmap v442: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 14 MiB/s wr, 1.50k op/s 2024-09-10T10:50:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.573+0000 7f6c2359e640 1 -- 172.21.15.92:0/812398779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 msgr2=0x7f6c1c0a4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.573+0000 7f6c2359e640 1 --2- 172.21.15.92:0/812398779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 0x7f6c1c0a4c00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c24067960 tx=0x7f6c2408e4d0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.578+0000 7f6c2359e640 1 -- 172.21.15.92:0/812398779 shutdown_connections 2024-09-10T10:50:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.578+0000 7f6c2359e640 1 --2- 172.21.15.92:0/812398779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c1c0b7540 0x7f6c1c0b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.578+0000 7f6c2359e640 1 --2- 172.21.15.92:0/812398779 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1c0a5140 0x7f6c1c0b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.578+0000 7f6c2359e640 1 --2- 172.21.15.92:0/812398779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 0x7f6c1c0a4c00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.578+0000 7f6c2359e640 1 -- 172.21.15.92:0/812398779 >> 172.21.15.92:0/812398779 conn(0x7f6c1c01a110 msgr2=0x7f6c1c01a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.583+0000 7f6c2359e640 1 -- 172.21.15.92:0/812398779 shutdown_connections 2024-09-10T10:50:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.586+0000 7f6c2359e640 1 -- 172.21.15.92:0/812398779 wait complete. 2024-09-10T10:50:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.587+0000 7f6c2359e640 1 Processor -- start 2024-09-10T10:50:45.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.592+0000 7f6c2359e640 1 -- start start 2024-09-10T10:50:45.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.592+0000 7f6c2359e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 0x7f6c1c0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.592+0000 7f6c2359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c1c0a5140 0x7f6c1c0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.592+0000 7f6c2359e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1c0b7540 0x7f6c1c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.592+0000 7f6c2359e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c0bcf40 con 0x7f6c1c0a5140 2024-09-10T10:50:45.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.592+0000 7f6c2359e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c0bcdc0 con 0x7f6c1c0b7540 2024-09-10T10:50:45.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.592+0000 7f6c2359e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c0bd0c0 con 0x7f6c1c0a4820 2024-09-10T10:50:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.597+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 0x7f6c1c0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.597+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 0x7f6c1c0b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:57074/0 (socket says 172.21.15.92:57074) 2024-09-10T10:50:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.597+0000 7f6c2259c640 1 -- 172.21.15.92:0/1338987542 learned_addr learned my addr 172.21.15.92:0/1338987542 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.597+0000 7f6c22d9d640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1c0b7540 0x7f6c1c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.598+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c1c0a5140 0x7f6c1c0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.598+0000 7f6c2259c640 1 -- 172.21.15.92:0/1338987542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1c0b7540 msgr2=0x7f6c1c0aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.598+0000 7f6c2259c640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1c0b7540 0x7f6c1c0aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.598+0000 7f6c2259c640 1 -- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c1c0a5140 msgr2=0x7f6c1c0ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.598+0000 7f6c2259c640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c1c0a5140 0x7f6c1c0ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.598+0000 7f6c2259c640 1 -- 172.21.15.92:0/1338987542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c0af2a0 con 0x7f6c1c0a4820 2024-09-10T10:50:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.601+0000 7f6c2259c640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 0x7f6c1c0b5650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c24051790 tx=0x7f6c2406aa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.605+0000 7f6c137fe640 1 -- 172.21.15.92:0/1338987542 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240a7070 con 0x7f6c1c0a4820 2024-09-10T10:50:45.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.605+0000 7f6c137fe640 1 -- 172.21.15.92:0/1338987542 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c2409c040 con 0x7f6c1c0a4820 2024-09-10T10:50:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.605+0000 7f6c137fe640 1 -- 172.21.15.92:0/1338987542 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240967d0 con 0x7f6c1c0a4820 2024-09-10T10:50:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.606+0000 7f6c2359e640 1 -- 172.21.15.92:0/1338987542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c0af530 con 0x7f6c1c0a4820 2024-09-10T10:50:45.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.606+0000 7f6c2359e640 1 -- 172.21.15.92:0/1338987542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c0b3410 con 0x7f6c1c0a4820 2024-09-10T10:50:45.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.612+0000 7f6c2b878740 1 Processor -- start 2024-09-10T10:50:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.615+0000 7f6c2b878740 1 -- start start 2024-09-10T10:50:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.615+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 0x5580f29ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.615+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29ff5e0 0x5580f2a09940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.615+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f2a0c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.615+0000 7f6c2b878740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5580f29632f0 con 0x5580f29ff5e0 2024-09-10T10:50:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.615+0000 7f6c2b878740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5580f290b270 con 0x5580f29fecc0 2024-09-10T10:50:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.615+0000 7f6c2b878740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5580f295f2b0 con 0x5580f2a09e80 2024-09-10T10:50:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.615+0000 7f6c21d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f2a0c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.618+0000 7f6c21d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f2a0c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:57086/0 (socket says 172.21.15.92:57086) 2024-09-10T10:50:45.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.618+0000 7f6c21d9b640 1 -- 172.21.15.92:0/1614938763 learned_addr learned my addr 172.21.15.92:0/1614938763 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.620+0000 7f6c21d9b640 1 -- 172.21.15.92:0/1614938763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 msgr2=0x5580f29ff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.620+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/1614938763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 0x5580f29ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.620+0000 7f6c21d9b640 1 -- 172.21.15.92:0/1614938763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29ff5e0 msgr2=0x5580f2a09940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.620+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/1614938763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29ff5e0 0x5580f2a09940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.620+0000 7f6c21d9b640 1 -- 172.21.15.92:0/1614938763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580f290a340 con 0x5580f2a09e80 2024-09-10T10:50:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.620+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/1614938763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f2a0c270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800cb90 tx=0x7f6c1800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2a0f3585f101a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:45.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.620+0000 7f6c137fe640 1 -- 172.21.15.92:0/1338987542 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6c240a2af0 con 0x7f6c1c0a4820 2024-09-10T10:50:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.622+0000 7f6c137fe640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c0c0a2f00 0x7f6c0c0a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.622+0000 7f6c137fe640 1 -- 172.21.15.92:0/1338987542 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7f6c24153270 con 0x7f6c1c0a4820 2024-09-10T10:50:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.622+0000 7f6c10ff9640 1 -- 172.21.15.92:0/1614938763 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18010630 con 0x5580f2a09e80 2024-09-10T10:50:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.623+0000 7f6c10ff9640 1 -- 172.21.15.92:0/1614938763 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c18010cb0 con 0x5580f2a09e80 2024-09-10T10:50:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.623+0000 7f6c10ff9640 1 -- 172.21.15.92:0/1614938763 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1801ac60 con 0x5580f2a09e80 2024-09-10T10:50:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.623+0000 7f6c22d9d640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c0c0a2f00 0x7f6c0c0a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.624+0000 7f6c2b878740 1 -- 172.21.15.92:0/1614938763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 msgr2=0x5580f2a0c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.624+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1614938763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f2a0c270 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800cb90 tx=0x7f6c1800e720 comp rx=0 tx=0).stop 2024-09-10T10:50:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.624+0000 7f6c22d9d640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c0c0a2f00 0x7f6c0c0a53c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009bb0 tx=0x7f6c14009750 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:45.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.626+0000 7f6c2b878740 1 -- 172.21.15.92:0/1614938763 shutdown_connections 2024-09-10T10:50:45.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.626+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1614938763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f2a0c270 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.626+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1614938763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29ff5e0 0x5580f2a09940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.626+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1614938763 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 0x5580f29ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.626+0000 7f6c2b878740 1 -- 172.21.15.92:0/1614938763 >> 172.21.15.92:0/1614938763 conn(0x5580f29fb230 msgr2=0x5580f29fb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.629+0000 7f6c2b878740 1 -- 172.21.15.92:0/1614938763 shutdown_connections 2024-09-10T10:50:45.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.629+0000 7f6c2b878740 1 -- 172.21.15.92:0/1614938763 wait complete. 2024-09-10T10:50:45.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.630+0000 7f6c2b878740 1 -- start start 2024-09-10T10:50:45.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.630+0000 7f6c2b878740 1 Processor -- start 2024-09-10T10:50:45.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 0x5580f2a06e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29ff5e0 0x5580f2a07360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f2a09e80 0x5580f2a078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2b878740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5580f2a0ca50 con 0x5580f2a09e80 2024-09-10T10:50:45.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2b878740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x5580f28ec290 con 0x5580f29fecc0 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2b878740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5580f2a0cbd0 con 0x5580f29ff5e0 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2b878740 10 client.0 _ll_register_callbacks cb 0x5580f291d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 0x5580f2a06e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 0x5580f2a06e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:41536/0 (socket says 172.21.15.92:41536) 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c2259c640 1 -- 172.21.15.92:0/1639365175 learned_addr learned my addr 172.21.15.92:0/1639365175 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.631+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29ff5e0 0x5580f2a07360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.632+0000 7f6c21d9b640 1 -- 172.21.15.92:0/1639365175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 msgr2=0x5580f2a06e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.632+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 0x5580f2a06e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.632+0000 7f6c21d9b640 1 -- 172.21.15.92:0/1639365175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f2a09e80 msgr2=0x5580f2a078a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.632+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f2a09e80 0x5580f2a078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.632+0000 7f6c21d9b640 1 -- 172.21.15.92:0/1639365175 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580f2676210 con 0x5580f29ff5e0 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.632+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29ff5e0 0x5580f2a07360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6c180058c0 tx=0x7f6c1800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a070b1320b428037 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:45.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.633+0000 7f6c09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:50:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.633+0000 7f6c09ffb640 1 -- 172.21.15.92:0/1639365175 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18010e60 con 0x5580f29ff5e0 2024-09-10T10:50:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.633+0000 7f6c09ffb640 1 -- 172.21.15.92:0/1639365175 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7f6c18005240 con 0x5580f29ff5e0 2024-09-10T10:50:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.633+0000 7f6c2b878740 1 -- 172.21.15.92:0/1639365175 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c18010cb0 con 0x5580f29ff5e0 2024-09-10T10:50:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c09ffb640 1 -- 172.21.15.92:0/1639365175 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f6c1801a410 con 0x5580f29ff5e0 2024-09-10T10:50:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c2b878740 10 client.25894 fetch_fsmap learned FSMap version 62 2024-09-10T10:50:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c2b878740 1 -- 172.21.15.92:0/1639365175 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5580f2742620 con 0x5580f29ff5e0 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c09ffb640 1 -- 172.21.15.92:0/1639365175 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c18010cb0 con 0x5580f29ff5e0 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c09ffb640 1 -- 172.21.15.92:0/1639365175 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f6c180046c0 con 0x5580f29ff5e0 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c2b878740 10 client.25894 fetch_fsmap finished waiting for FSMap version 62 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c2b878740 10 client.25894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c2b878740 20 client.25894 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5580f2a3c230 0x5580f2a3e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c2b878740 4 client.25894 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.635+0000 7f6c2b878740 1 -- 172.21.15.92:0/1639365175 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580f2970a20 con 0x5580f2a3c230 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.636+0000 7f6c2259c640 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5580f2a3c230 0x5580f2a3e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.636+0000 7f6c2259c640 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5580f2a3c230 0x5580f2a3e640 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e91609f3a77a3c1c server_cookie=cf571491feb60d5f in_seq=0 out_seq=0 2024-09-10T10:50:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.637+0000 7f6c09ffb640 10 client.25894 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.637+0000 7f6c09ffb640 1 -- 172.21.15.92:0/1639365175 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5580f2970a20 con 0x5580f2a3c230 2024-09-10T10:50:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.637+0000 7f6c09ffb640 10 client.25894 handle_command_reply: tid=0 2024-09-10T10:50:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.637+0000 7f6c2b878740 1 client.25894 shutdown 2024-09-10T10:50:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.638+0000 7f6c2b878740 1 -- 172.21.15.92:0/1639365175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29ff5e0 msgr2=0x5580f2a07360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.638+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29ff5e0 0x5580f2a07360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6c180058c0 tx=0x7f6c1800c8d0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.638+0000 7f6c2b878740 1 -- 172.21.15.92:0/1639365175 shutdown_connections 2024-09-10T10:50:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.638+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f2a09e80 0x5580f2a078a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.638+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29ff5e0 0x5580f2a07360 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.638+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5580f2a3c230 0x5580f2a3e640 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.638+0000 7f6c2b878740 1 --2- 172.21.15.92:0/1639365175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29fecc0 0x5580f2a06e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.638+0000 7f6c2b878740 1 -- 172.21.15.92:0/1639365175 >> 172.21.15.92:0/1639365175 conn(0x5580f29fb230 msgr2=0x5580f2a00f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.638+0000 7f6c09ffb640 0 client.25894 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.639+0000 7f6c2b878740 1 -- 172.21.15.92:0/1639365175 shutdown_connections 2024-09-10T10:50:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.639+0000 7f6c2b878740 1 -- 172.21.15.92:0/1639365175 wait complete. 2024-09-10T10:50:45.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.639+0000 7f6c2b878740 20 client.25894 trim_cache size 0 max 16384 2024-09-10T10:50:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.660+0000 7f6c2b878740 1 Processor -- start 2024-09-10T10:50:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.660+0000 7f6c2b878740 1 -- start start 2024-09-10T10:50:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29fecc0 0x5580f2a3e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 0x5580f2a076d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f29fa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2b878740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00d470 con 0x5580f29fecc0 2024-09-10T10:50:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2b878740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00efb0 con 0x5580f29ff5e0 2024-09-10T10:50:45.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2b878740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00db40 con 0x5580f2a09e80 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29fecc0 0x5580f2a3e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c21d9b640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 0x5580f2a076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29fecc0 0x5580f2a3e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39842/0 (socket says 172.21.15.92:39842) 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2259c640 1 -- 172.21.15.92:0/2297522626 learned_addr learned my addr 172.21.15.92:0/2297522626 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c22d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f29fa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2259c640 1 -- 172.21.15.92:0/2297522626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 msgr2=0x5580f29fa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2259c640 1 --2- 172.21.15.92:0/2297522626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f29fa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2259c640 1 -- 172.21.15.92:0/2297522626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 msgr2=0x5580f2a076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2259c640 1 --2- 172.21.15.92:0/2297522626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 0x5580f2a076d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2259c640 1 -- 172.21.15.92:0/2297522626 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580f29ff410 con 0x5580f29fecc0 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/2297522626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 0x5580f2a076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.661+0000 7f6c2259c640 1 --2- 172.21.15.92:0/2297522626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29fecc0 0x5580f2a3e620 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6c24051500 tx=0x7f6c24068f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c895221ecb94d68d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:45.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.662+0000 7f6c0bfff640 1 -- 172.21.15.92:0/2297522626 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2411d8b0 con 0x5580f29fecc0 2024-09-10T10:50:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.662+0000 7f6c0bfff640 1 -- 172.21.15.92:0/2297522626 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c2411fe70 con 0x5580f29fecc0 2024-09-10T10:50:45.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.662+0000 7f6c0bfff640 1 -- 172.21.15.92:0/2297522626 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2411bec0 con 0x5580f29fecc0 2024-09-10T10:50:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.662+0000 7f6c2b878740 1 -- 172.21.15.92:0/2297522626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29fecc0 msgr2=0x5580f2a3e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.662+0000 7f6c2b878740 1 --2- 172.21.15.92:0/2297522626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29fecc0 0x5580f2a3e620 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6c24051500 tx=0x7f6c24068f60 comp rx=0 tx=0).stop 2024-09-10T10:50:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.663+0000 7f6c2b878740 1 -- 172.21.15.92:0/2297522626 shutdown_connections 2024-09-10T10:50:45.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.663+0000 7f6c2b878740 1 --2- 172.21.15.92:0/2297522626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f2a09e80 0x5580f29fa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.663+0000 7f6c2b878740 1 --2- 172.21.15.92:0/2297522626 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 0x5580f2a076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.663+0000 7f6c2b878740 1 --2- 172.21.15.92:0/2297522626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f29fecc0 0x5580f2a3e620 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.663+0000 7f6c2b878740 1 -- 172.21.15.92:0/2297522626 >> 172.21.15.92:0/2297522626 conn(0x5580f29fb230 msgr2=0x5580f29f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.663+0000 7f6c2b878740 1 -- 172.21.15.92:0/2297522626 shutdown_connections 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.663+0000 7f6c2b878740 1 -- 172.21.15.92:0/2297522626 wait complete. 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.663+0000 7f6c2b878740 1 -- start start 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.663+0000 7f6c2b878740 1 Processor -- start 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29fecc0 0x5580f2a11e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 0x5580f2a123d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2b878740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f2a09e80 0x5580f2a034b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2b878740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00e8e0 con 0x5580f2a09e80 2024-09-10T10:50:45.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2b878740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00e210 con 0x5580f29ff5e0 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2b878740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c00b470 con 0x5580f29fecc0 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2b878740 10 client.0 _ll_register_callbacks cb 0x7f6c18014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29fecc0 0x5580f2a11e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29fecc0 0x5580f2a11e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:57116/0 (socket says 172.21.15.92:57116) 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2259c640 1 -- 172.21.15.92:0/3249262173 learned_addr learned my addr 172.21.15.92:0/3249262173 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c22d9d640 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f2a09e80 0x5580f2a034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 0x5580f2a123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2259c640 1 -- 172.21.15.92:0/3249262173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 msgr2=0x5580f2a123d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2259c640 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 0x5580f2a123d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2259c640 1 -- 172.21.15.92:0/3249262173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f2a09e80 msgr2=0x5580f2a034b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2259c640 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f2a09e80 0x5580f2a034b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.664+0000 7f6c2259c640 1 -- 172.21.15.92:0/3249262173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580f2a039f0 con 0x5580f29fecc0 2024-09-10T10:50:45.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2259c640 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29fecc0 0x5580f2a11e90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c24067b40 tx=0x7f6c24068160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5e63c61c57716a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c09ffb640 1 -- 172.21.15.92:0/3249262173 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2411d8b0 con 0x5580f29fecc0 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c09ffb640 1 -- 172.21.15.92:0/3249262173 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7f6c2413e0b0 con 0x5580f29fecc0 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2b878740 1 -- 172.21.15.92:0/3249262173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c2411fe70 con 0x5580f29fecc0 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c09ffb640 1 -- 172.21.15.92:0/3249262173 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f6c2411f770 con 0x5580f29fecc0 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2b878740 10 client.25900 fetch_fsmap learned FSMap version 62 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2b878740 1 -- 172.21.15.92:0/3249262173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5580f2aa66f0 con 0x5580f29fecc0 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c09ffb640 1 -- 172.21.15.92:0/3249262173 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c2411fe70 con 0x5580f29fecc0 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c09ffb640 1 -- 172.21.15.92:0/3249262173 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f6c2411e750 con 0x5580f29fecc0 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2b878740 10 client.25900 fetch_fsmap finished waiting for FSMap version 62 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2b878740 10 client.25900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2b878740 20 client.25900 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:45.670 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2b878740 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5580f2aa6b80 0x5580f2aa8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2b878740 4 client.25900 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:50:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.665+0000 7f6c2b878740 1 -- 172.21.15.92:0/3249262173 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5580f296ad70 con 0x5580f2aa6b80 2024-09-10T10:50:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.666+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5580f2aa6b80 0x5580f2aa8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.666+0000 7f6c09ffb640 10 client.25900 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:45.671 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.666+0000 7f6c21d9b640 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5580f2aa6b80 0x5580f2aa8f70 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c06b168a6b8722a server_cookie=f741bde61d31663e in_seq=0 out_seq=0 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c09ffb640 1 -- 172.21.15.92:0/3249262173 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5580f296ad70 con 0x5580f2aa6b80 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c09ffb640 10 client.25900 handle_command_reply: tid=0 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 client.25900 shutdown 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 -- 172.21.15.92:0/3249262173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29fecc0 msgr2=0x5580f2a11e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29fecc0 0x5580f2a11e90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c24067b40 tx=0x7f6c24068160 comp rx=0 tx=0).stop 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 -- 172.21.15.92:0/3249262173 shutdown_connections 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5580f2a09e80 0x5580f2a034b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x5580f2aa6b80 0x5580f2aa8f70 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c09ffb640 0 client.25900 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x5580f29ff5e0 0x5580f2a123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 --2- 172.21.15.92:0/3249262173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5580f29fecc0 0x5580f2a11e90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 -- 172.21.15.92:0/3249262173 >> 172.21.15.92:0/3249262173 conn(0x5580f29fb230 msgr2=0x5580f29fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:45.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 -- 172.21.15.92:0/3249262173 shutdown_connections 2024-09-10T10:50:45.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 1 -- 172.21.15.92:0/3249262173 wait complete. 2024-09-10T10:50:45.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.676+0000 7f6c2b878740 20 client.25900 trim_cache size 0 max 16384 2024-09-10T10:50:45.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:50:45.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:50:45.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:50:45.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.677+0000 7f6c2359e640 1 -- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c0c0a2f00 msgr2=0x7f6c0c0a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.677+0000 7f6c2359e640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c0c0a2f00 0x7f6c0c0a53c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009bb0 tx=0x7f6c14009750 comp rx=0 tx=0).stop 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.677+0000 7f6c2359e640 1 -- 172.21.15.92:0/1338987542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 msgr2=0x7f6c1c0b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.677+0000 7f6c2359e640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 0x7f6c1c0b5650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c24051790 tx=0x7f6c2406aa70 comp rx=0 tx=0).stop 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.678+0000 7f6c2359e640 1 -- 172.21.15.92:0/1338987542 shutdown_connections 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.678+0000 7f6c2359e640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f6c0c0a2f00 0x7f6c0c0a53c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.678+0000 7f6c2359e640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6c1c0b7540 0x7f6c1c0aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.678+0000 7f6c2359e640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c1c0a5140 0x7f6c1c0ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.678+0000 7f6c2359e640 1 --2- 172.21.15.92:0/1338987542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c1c0a4820 0x7f6c1c0b5650 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.678+0000 7f6c2359e640 1 -- 172.21.15.92:0/1338987542 >> 172.21.15.92:0/1338987542 conn(0x7f6c1c01a110 msgr2=0x7f6c1c0a1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:45.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.678+0000 7f6c2359e640 1 -- 172.21.15.92:0/1338987542 shutdown_connections 2024-09-10T10:50:45.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:45.678+0000 7f6c2359e640 1 -- 172.21.15.92:0/1338987542 wait complete. 2024-09-10T10:50:46.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:45 smithi121 ceph-mon[35231]: pgmap v443: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 12 MiB/s wr, 1.28k op/s 2024-09-10T10:50:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:45 smithi097 ceph-mon[35213]: pgmap v443: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 12 MiB/s wr, 1.28k op/s 2024-09-10T10:50:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:45 smithi092 ceph-mon[30834]: pgmap v443: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 12 MiB/s wr, 1.28k op/s 2024-09-10T10:50:48.034 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:47 smithi092 ceph-mon[30834]: pgmap v444: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 20 MiB/s wr, 2.25k op/s 2024-09-10T10:50:48.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:47 smithi121 ceph-mon[35231]: pgmap v444: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 20 MiB/s wr, 2.25k op/s 2024-09-10T10:50:48.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:47 smithi097 ceph-mon[35213]: pgmap v444: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 20 MiB/s wr, 2.25k op/s 2024-09-10T10:50:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 830.0 s, 2141.2 tps, lat 46.265 ms stddev 61.302 2024-09-10T10:50:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:49 smithi121 ceph-mon[35231]: pgmap v445: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 1.40k op/s 2024-09-10T10:50:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:49 smithi097 ceph-mon[35213]: pgmap v445: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 1.40k op/s 2024-09-10T10:50:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:49 smithi092 ceph-mon[30834]: pgmap v445: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 1.40k op/s 2024-09-10T10:50:52.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:51 smithi121 ceph-mon[35231]: pgmap v446: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 16 MiB/s wr, 1.77k op/s 2024-09-10T10:50:52.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:51 smithi097 ceph-mon[35213]: pgmap v446: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 16 MiB/s wr, 1.77k op/s 2024-09-10T10:50:52.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:51 smithi092 ceph-mon[30834]: pgmap v446: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 16 MiB/s wr, 1.77k op/s 2024-09-10T10:50:53.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:52 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:50:53.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:52 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:50:53.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:52 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:50:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 835.0 s, 1642.8 tps, lat 61.305 ms stddev 82.365 2024-09-10T10:50:54.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:53 smithi121 ceph-mon[35231]: pgmap v447: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 1.76k op/s 2024-09-10T10:50:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:53 smithi097 ceph-mon[35213]: pgmap v447: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 1.76k op/s 2024-09-10T10:50:54.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:53 smithi092 ceph-mon[30834]: pgmap v447: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 1.76k op/s 2024-09-10T10:50:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:55 smithi097 ceph-mon[35213]: pgmap v448: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 1.57k op/s 2024-09-10T10:50:56.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:55 smithi092 ceph-mon[30834]: pgmap v448: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 1.57k op/s 2024-09-10T10:50:56.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:55 smithi121 ceph-mon[35231]: pgmap v448: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 14 MiB/s wr, 1.57k op/s 2024-09-10T10:50:57.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:56 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:50:57.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:56 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:50:57.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:56 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:50:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:57 smithi097 ceph-mon[35213]: pgmap v449: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 24 MiB/s wr, 2.54k op/s 2024-09-10T10:50:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:57 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:50:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:57 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:50:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:57 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:50:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:57 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:50:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:57 smithi092 ceph-mon[30834]: pgmap v449: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 24 MiB/s wr, 2.54k op/s 2024-09-10T10:50:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:57 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:50:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:57 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:50:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:57 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:50:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:57 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:50:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 840.0 s, 1768.8 tps, lat 56.505 ms stddev 86.326 2024-09-10T10:50:58.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:57 smithi121 ceph-mon[35231]: pgmap v449: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 24 MiB/s wr, 2.54k op/s 2024-09-10T10:50:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:57 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:50:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:57 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:50:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:57 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:50:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:57 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:50:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.874+0000 7f105868d640 1 -- 172.21.15.92:0/660007146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501008b0 msgr2=0x7f1050100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.874+0000 7f105868d640 1 --2- 172.21.15.92:0/660007146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501008b0 0x7f1050100c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1044009900 tx=0x7f104402a3f0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.874+0000 7f105868d640 1 -- 172.21.15.92:0/660007146 shutdown_connections 2024-09-10T10:50:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.874+0000 7f105868d640 1 --2- 172.21.15.92:0/660007146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f105010e3d0 0x7f10501107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.874+0000 7f105868d640 1 --2- 172.21.15.92:0/660007146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10501011d0 0x7f105010de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.874+0000 7f105868d640 1 --2- 172.21.15.92:0/660007146 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501008b0 0x7f1050100c90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.874+0000 7f105868d640 1 -- 172.21.15.92:0/660007146 >> 172.21.15.92:0/660007146 conn(0x7f10500fc6b0 msgr2=0x7f10500fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.874+0000 7f105868d640 1 -- 172.21.15.92:0/660007146 shutdown_connections 2024-09-10T10:50:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.874+0000 7f105868d640 1 -- 172.21.15.92:0/660007146 wait complete. 2024-09-10T10:50:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f105868d640 1 Processor -- start 2024-09-10T10:50:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f105868d640 1 -- start start 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f105868d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10501008b0 0x7f105019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f105868d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501011d0 0x7f105019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f105868d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f105010e3d0 0x7f105019ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f105868d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f10501140b0 con 0x7f10501008b0 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f105868d640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1050113f30 con 0x7f10501011d0 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f105868d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1050114230 con 0x7f105010e3d0 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f1055c28640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501011d0 0x7f105019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f1055c28640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501011d0 0x7f105019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:53906/0 (socket says 172.21.15.92:53906) 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f1055c28640 1 -- 172.21.15.92:0/3111164822 learned_addr learned my addr 172.21.15.92:0/3111164822 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.875+0000 7f1056429640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10501008b0 0x7f105019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f1056c2a640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f105010e3d0 0x7f105019ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f1055c28640 1 -- 172.21.15.92:0/3111164822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f105010e3d0 msgr2=0x7f105019ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f1055c28640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f105010e3d0 0x7f105019ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f1055c28640 1 -- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10501008b0 msgr2=0x7f105019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f1055c28640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10501008b0 0x7f105019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f1055c28640 1 -- 172.21.15.92:0/3111164822 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105019f570 con 0x7f10501011d0 2024-09-10T10:50:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f1055c28640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501011d0 0x7f105019aac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f104c00e9f0 tx=0x7f104c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f10437fe640 1 -- 172.21.15.92:0/3111164822 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c00cd80 con 0x7f10501011d0 2024-09-10T10:50:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f10437fe640 1 -- 172.21.15.92:0/3111164822 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f104c010910 con 0x7f10501011d0 2024-09-10T10:50:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f10437fe640 1 -- 172.21.15.92:0/3111164822 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c018990 con 0x7f10501011d0 2024-09-10T10:50:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f105868d640 1 -- 172.21.15.92:0/3111164822 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105019f860 con 0x7f10501011d0 2024-09-10T10:50:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.876+0000 7f105868d640 1 -- 172.21.15.92:0/3111164822 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10501a70f0 con 0x7f10501011d0 2024-09-10T10:50:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.880+0000 7f105b42b740 1 Processor -- start 2024-09-10T10:50:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.886+0000 7f10437fe640 1 -- 172.21.15.92:0/3111164822 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f104c010ac0 con 0x7f10501011d0 2024-09-10T10:50:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.887+0000 7f10437fe640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f103c0a2f80 0x7f103c0a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.887+0000 7f10437fe640 1 -- 172.21.15.92:0/3111164822 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7f104c0cf8d0 con 0x7f10501011d0 2024-09-10T10:50:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.888+0000 7f105b42b740 1 -- start start 2024-09-10T10:50:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.888+0000 7f105b42b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f1f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.888+0000 7f105b42b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f203770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.889+0000 7f105b42b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 0x55840f2060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.889+0000 7f105b42b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55840f15d2f0 con 0x55840f203cb0 2024-09-10T10:50:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.889+0000 7f105b42b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55840f105270 con 0x55840f1f8af0 2024-09-10T10:50:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.889+0000 7f105b42b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55840f1592b0 con 0x55840f1f9410 2024-09-10T10:50:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.891+0000 7f1055c28640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f203770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.894+0000 7f1055c28640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f203770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:40362/0 (socket says 172.21.15.92:40362) 2024-09-10T10:50:58.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.894+0000 7f1055c28640 1 -- 172.21.15.92:0/1312149050 learned_addr learned my addr 172.21.15.92:0/1312149050 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:58.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.895+0000 7f1056c2a640 1 --2- 172.21.15.92:0/1312149050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 0x55840f2060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.895+0000 7f1056c2a640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f103c0a2f80 0x7f103c0a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.898+0000 7f1056429640 1 --2- 172.21.15.92:0/1312149050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f1f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.901+0000 7f1055c28640 1 -- 172.21.15.92:0/1312149050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 msgr2=0x55840f1f8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.901+0000 7f1055c28640 1 --2- 172.21.15.92:0/1312149050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f1f8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.901+0000 7f1055c28640 1 -- 172.21.15.92:0/1312149050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 msgr2=0x55840f2060a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.901+0000 7f1055c28640 1 --2- 172.21.15.92:0/1312149050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 0x55840f2060a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.901+0000 7f1055c28640 1 -- 172.21.15.92:0/1312149050 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840f104340 con 0x55840f1f9410 2024-09-10T10:50:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.906+0000 7f1055c28640 1 --2- 172.21.15.92:0/1312149050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f203770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f104c0a4510 tx=0x7f104c09ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4c3f3e746776227 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:58.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.909+0000 7f1040ff9640 1 -- 172.21.15.92:0/1312149050 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c098440 con 0x55840f1f9410 2024-09-10T10:50:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.909+0000 7f1040ff9640 1 -- 172.21.15.92:0/1312149050 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f104c0cd280 con 0x55840f1f9410 2024-09-10T10:50:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.910+0000 7f105b42b740 1 -- 172.21.15.92:0/1312149050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 msgr2=0x55840f203770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:58.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.910+0000 7f105b42b740 1 --2- 172.21.15.92:0/1312149050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f203770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f104c0a4510 tx=0x7f104c09ba40 comp rx=0 tx=0).stop 2024-09-10T10:50:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.919+0000 7f1056c2a640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f103c0a2f80 0x7f103c0a5440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55840f1f63e0 tx=0x7f1048009500 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.921+0000 7f105b42b740 1 -- 172.21.15.92:0/1312149050 shutdown_connections 2024-09-10T10:50:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.921+0000 7f105b42b740 1 --2- 172.21.15.92:0/1312149050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 0x55840f2060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.921+0000 7f105b42b740 1 --2- 172.21.15.92:0/1312149050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f203770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.921+0000 7f105b42b740 1 --2- 172.21.15.92:0/1312149050 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f1f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.921+0000 7f105b42b740 1 -- 172.21.15.92:0/1312149050 >> 172.21.15.92:0/1312149050 conn(0x55840f1f5060 msgr2=0x55840f1f5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.930+0000 7f105b42b740 1 -- 172.21.15.92:0/1312149050 shutdown_connections 2024-09-10T10:50:58.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.933+0000 7f105b42b740 1 -- 172.21.15.92:0/1312149050 wait complete. 2024-09-10T10:50:58.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.933+0000 7f105b42b740 1 -- start start 2024-09-10T10:50:58.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.933+0000 7f105b42b740 1 Processor -- start 2024-09-10T10:50:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.937+0000 7f105b42b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f200bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.937+0000 7f105b42b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f201110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.937+0000 7f105b42b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 0x55840f201650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.937+0000 7f105b42b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55840f2068d0 con 0x55840f203cb0 2024-09-10T10:50:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.937+0000 7f105b42b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55840f0e6290 con 0x55840f1f8af0 2024-09-10T10:50:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.937+0000 7f105b42b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55840f206a50 con 0x55840f1f9410 2024-09-10T10:50:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.937+0000 7f105b42b740 10 client.0 _ll_register_callbacks cb 0x55840f117140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.939+0000 7f1056429640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f200bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.939+0000 7f1056429640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f200bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:53930/0 (socket says 172.21.15.92:53930) 2024-09-10T10:50:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.939+0000 7f1056429640 1 -- 172.21.15.92:0/2918595495 learned_addr learned my addr 172.21.15.92:0/2918595495 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.941+0000 7f1056c2a640 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 0x55840f201650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.943+0000 7f1055c28640 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f201110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.944+0000 7f1056429640 1 -- 172.21.15.92:0/2918595495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 msgr2=0x55840f201110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.944+0000 7f1056429640 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f201110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.944+0000 7f1056429640 1 -- 172.21.15.92:0/2918595495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 msgr2=0x55840f201650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.944+0000 7f1056429640 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 0x55840f201650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.944+0000 7f1056429640 1 -- 172.21.15.92:0/2918595495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840ee70210 con 0x55840f1f8af0 2024-09-10T10:50:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.946+0000 7f1056429640 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f200bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f104402a910 tx=0x7f10440317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4789520472ab52c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.946+0000 7f1039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:50:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.946+0000 7f1039ffb640 1 -- 172.21.15.92:0/2918595495 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044040070 con 0x55840f1f8af0 2024-09-10T10:50:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.946+0000 7f1039ffb640 1 -- 172.21.15.92:0/2918595495 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7f1044004250 con 0x55840f1f8af0 2024-09-10T10:50:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.946+0000 7f105b42b740 1 -- 172.21.15.92:0/2918595495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f104c0cd280 con 0x55840f1f8af0 2024-09-10T10:50:58.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.949+0000 7f1039ffb640 1 -- 172.21.15.92:0/2918595495 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f1044035040 con 0x55840f1f8af0 2024-09-10T10:50:58.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.953+0000 7f105b42b740 10 client.25892 fetch_fsmap learned FSMap version 64 2024-09-10T10:50:58.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.953+0000 7f105b42b740 1 -- 172.21.15.92:0/2918595495 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55840ef3c620 con 0x55840f1f8af0 2024-09-10T10:50:58.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.957+0000 7f1039ffb640 1 -- 172.21.15.92:0/2918595495 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f104c0cd280 con 0x55840f1f8af0 2024-09-10T10:50:58.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.957+0000 7f1039ffb640 1 -- 172.21.15.92:0/2918595495 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 64) ==== 8374+0+0 (secure 0 0 0) 0x7f1044004bb0 con 0x55840f1f8af0 2024-09-10T10:50:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.958+0000 7f105b42b740 10 client.25892 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T10:50:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.958+0000 7f105b42b740 10 client.25892 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.958+0000 7f105b42b740 20 client.25892 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.958+0000 7f105b42b740 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55840f22d5a0 0x55840f22f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.958+0000 7f105b42b740 4 client.25892 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:50:58.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.958+0000 7f105b42b740 1 -- 172.21.15.92:0/2918595495 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55840f16aa20 con 0x55840f22d5a0 2024-09-10T10:50:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.959+0000 7f1055c28640 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55840f22d5a0 0x55840f22f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.961+0000 7f1055c28640 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55840f22d5a0 0x55840f22f9b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=127f2b3a6be1c309 server_cookie=1080d2f2312f2288 in_seq=0 out_seq=0 2024-09-10T10:50:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.964+0000 7f1039ffb640 10 client.25892 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.964+0000 7f1039ffb640 1 -- 172.21.15.92:0/2918595495 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55840f16aa20 con 0x55840f22d5a0 2024-09-10T10:50:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.964+0000 7f1039ffb640 10 client.25892 handle_command_reply: tid=0 2024-09-10T10:50:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.964+0000 7f105b42b740 1 client.25892 shutdown 2024-09-10T10:50:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.965+0000 7f105b42b740 1 -- 172.21.15.92:0/2918595495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 msgr2=0x55840f200bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.965+0000 7f105b42b740 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f200bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f104402a910 tx=0x7f10440317e0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.965+0000 7f105b42b740 1 -- 172.21.15.92:0/2918595495 shutdown_connections 2024-09-10T10:50:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.965+0000 7f105b42b740 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f203cb0 0x55840f201650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.965+0000 7f105b42b740 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1f9410 0x55840f201110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.965+0000 7f105b42b740 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55840f22d5a0 0x55840f22f9b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.965+0000 7f105b42b740 1 --2- 172.21.15.92:0/2918595495 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f8af0 0x55840f200bd0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f104402a910 tx=0x7f10440317e0 comp rx=0 tx=0).stop 2024-09-10T10:50:58.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.965+0000 7f105b42b740 1 -- 172.21.15.92:0/2918595495 >> 172.21.15.92:0/2918595495 conn(0x55840f1f5060 msgr2=0x55840f1fad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.966+0000 7f1039ffb640 0 client.25892 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.966+0000 7f105b42b740 1 -- 172.21.15.92:0/2918595495 shutdown_connections 2024-09-10T10:50:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.966+0000 7f105b42b740 1 -- 172.21.15.92:0/2918595495 wait complete. 2024-09-10T10:50:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.966+0000 7f105b42b740 20 client.25892 trim_cache size 0 max 16384 2024-09-10T10:50:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.995+0000 7f105b42b740 1 Processor -- start 2024-09-10T10:50:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f105b42b740 1 -- start start 2024-09-10T10:50:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f105b42b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f9410 0x55840f201450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f105b42b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f203cb0 0x55840f202b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f105b42b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1ffca0 0x55840f235280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f105b42b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f105006ffe0 con 0x55840f1ffca0 2024-09-10T10:50:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f105b42b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1050071bb0 con 0x55840f1f9410 2024-09-10T10:50:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f105b42b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10500706b0 con 0x55840f203cb0 2024-09-10T10:50:59.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056c2a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1ffca0 0x55840f235280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056c2a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1ffca0 0x55840f235280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57322/0 (socket says 172.21.15.92:57322) 2024-09-10T10:50:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056c2a640 1 -- 172.21.15.92:0/96183527 learned_addr learned my addr 172.21.15.92:0/96183527 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056429640 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f9410 0x55840f201450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1055c28640 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f203cb0 0x55840f202b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056c2a640 1 -- 172.21.15.92:0/96183527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f203cb0 msgr2=0x55840f202b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056c2a640 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f203cb0 0x55840f202b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056c2a640 1 -- 172.21.15.92:0/96183527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f9410 msgr2=0x55840f201450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056c2a640 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f9410 0x55840f201450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056c2a640 1 -- 172.21.15.92:0/96183527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840f1f8920 con 0x55840f1ffca0 2024-09-10T10:50:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056429640 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f9410 0x55840f201450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:50:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.996+0000 7f1056c2a640 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1ffca0 0x55840f235280 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f10480039f0 tx=0x7f10480099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e480dcba7e36f9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f103bfff640 1 -- 172.21.15.92:0/96183527 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104800dd30 con 0x55840f1ffca0 2024-09-10T10:50:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f103bfff640 1 -- 172.21.15.92:0/96183527 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1048004040 con 0x55840f1ffca0 2024-09-10T10:50:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f103bfff640 1 -- 172.21.15.92:0/96183527 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048005280 con 0x55840f1ffca0 2024-09-10T10:50:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f105b42b740 1 -- 172.21.15.92:0/96183527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1ffca0 msgr2=0x55840f235280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f105b42b740 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1ffca0 0x55840f235280 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f10480039f0 tx=0x7f10480099c0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f105b42b740 1 -- 172.21.15.92:0/96183527 shutdown_connections 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f105b42b740 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1ffca0 0x55840f235280 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f105b42b740 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f203cb0 0x55840f202b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f105b42b740 1 --2- 172.21.15.92:0/96183527 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f1f9410 0x55840f201450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f105b42b740 1 -- 172.21.15.92:0/96183527 >> 172.21.15.92:0/96183527 conn(0x55840f1f5060 msgr2=0x55840f202430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f105b42b740 1 -- 172.21.15.92:0/96183527 shutdown_connections 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.997+0000 7f105b42b740 1 -- 172.21.15.92:0/96183527 wait complete. 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f105b42b740 1 -- start start 2024-09-10T10:50:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f105b42b740 1 Processor -- start 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f105b42b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1f9410 0x55840f2103c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f105b42b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1ffca0 0x55840f210900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f105b42b740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f203cb0 0x55840f210e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f105b42b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f10500714e0 con 0x55840f1f9410 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f105b42b740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f1050070d80 con 0x55840f203cb0 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f105b42b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f105006dfe0 con 0x55840f1ffca0 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f105b42b740 10 client.0 _ll_register_callbacks cb 0x7f104c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1056429640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1f9410 0x55840f2103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1056429640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1f9410 0x55840f2103c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57330/0 (socket says 172.21.15.92:57330) 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1056429640 1 -- 172.21.15.92:0/853579725 learned_addr learned my addr 172.21.15.92:0/853579725 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1055c28640 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1ffca0 0x55840f210900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1056c2a640 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f203cb0 0x55840f210e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1056429640 1 -- 172.21.15.92:0/853579725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1ffca0 msgr2=0x55840f210900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1056429640 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1ffca0 0x55840f210900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1056429640 1 -- 172.21.15.92:0/853579725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f203cb0 msgr2=0x55840f210e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1056429640 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f203cb0 0x55840f210e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.998+0000 7f1056429640 1 -- 172.21.15.92:0/853579725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840f1f02d0 con 0x55840f1f9410 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f1056429640 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1f9410 0x55840f2103c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f104402a910 tx=0x7f1044000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3a4be893b33e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f1039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f1039ffb640 1 -- 172.21.15.92:0/853579725 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044053070 con 0x55840f1f9410 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f1039ffb640 1 -- 172.21.15.92:0/853579725 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8455+0+0 (secure 0 0 0) 0x7f1044003cc0 con 0x55840f1f9410 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f105b42b740 1 -- 172.21.15.92:0/853579725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1048004040 con 0x55840f1f9410 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f1039ffb640 1 -- 172.21.15.92:0/853579725 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f1044040040 con 0x55840f1f9410 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f105b42b740 10 client.16404 fetch_fsmap learned FSMap version 64 2024-09-10T10:50:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f105b42b740 1 -- 172.21.15.92:0/853579725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) -- 0x55840f298420 con 0x55840f1f9410 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f1039ffb640 1 -- 172.21.15.92:0/853579725 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1048004040 con 0x55840f1f9410 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f1039ffb640 1 -- 172.21.15.92:0/853579725 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 64) ==== 8374+0+0 (secure 0 0 0) 0x7f10440046c0 con 0x55840f1f9410 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f105b42b740 10 client.16404 fetch_fsmap finished waiting for FSMap version 64 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f105b42b740 10 client.16404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f105b42b740 20 client.16404 populate_metadata read hostname 'smithi092' 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f105b42b740 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55840f298c30 0x55840f29b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f105b42b740 4 client.16404 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:58.999+0000 7f105b42b740 1 -- 172.21.15.92:0/853579725 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55840f164d70 con 0x55840f298c30 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.000+0000 7f1055c28640 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55840f298c30 0x55840f29b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.001+0000 7f1039ffb640 10 client.16404 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.001+0000 7f1055c28640 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55840f298c30 0x55840f29b050 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3998d31eda36a257 server_cookie=8b6bd1aaf97776fc in_seq=0 out_seq=0 2024-09-10T10:50:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.011+0000 7f1039ffb640 1 -- 172.21.15.92:0/853579725 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55840f164d70 con 0x55840f298c30 2024-09-10T10:50:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.011+0000 7f1039ffb640 10 client.16404 handle_command_reply: tid=0 2024-09-10T10:50:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.011+0000 7f105b42b740 1 client.16404 shutdown 2024-09-10T10:50:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 -- 172.21.15.92:0/853579725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1f9410 msgr2=0x55840f2103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1f9410 0x55840f2103c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f104402a910 tx=0x7f1044000bc0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 -- 172.21.15.92:0/853579725 shutdown_connections 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55840f298c30 0x55840f29b050 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f1039ffb640 0 client.16404 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55840f203cb0 0x55840f210e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55840f1ffca0 0x55840f210900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 --2- 172.21.15.92:0/853579725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55840f1f9410 0x55840f2103c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 -- 172.21.15.92:0/853579725 >> 172.21.15.92:0/853579725 conn(0x55840f1f5060 msgr2=0x55840f1f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 -- 172.21.15.92:0/853579725 shutdown_connections 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 1 -- 172.21.15.92:0/853579725 wait complete. 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105b42b740 20 client.16404 trim_cache size 0 max 16384 2024-09-10T10:50:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:50:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:50:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:50:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:50:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105868d640 1 -- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f103c0a2f80 msgr2=0x7f103c0a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105868d640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f103c0a2f80 0x7f103c0a5440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55840f1f63e0 tx=0x7f1048009500 comp rx=0 tx=0).stop 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105868d640 1 -- 172.21.15.92:0/3111164822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501011d0 msgr2=0x7f105019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.012+0000 7f105868d640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501011d0 0x7f105019aac0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f104c00e9f0 tx=0x7f104c00eeb0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.013+0000 7f105868d640 1 -- 172.21.15.92:0/3111164822 shutdown_connections 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.013+0000 7f105868d640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f105010e3d0 0x7f105019ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.013+0000 7f105868d640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f103c0a2f80 0x7f103c0a5440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.013+0000 7f105868d640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f10501011d0 0x7f105019aac0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.013+0000 7f105868d640 1 --2- 172.21.15.92:0/3111164822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10501008b0 0x7f105019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.013+0000 7f105868d640 1 -- 172.21.15.92:0/3111164822 >> 172.21.15.92:0/3111164822 conn(0x7f10500fc6b0 msgr2=0x7f10500feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.013+0000 7f105868d640 1 -- 172.21.15.92:0/3111164822 shutdown_connections 2024-09-10T10:50:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:50:59.013+0000 7f105868d640 1 -- 172.21.15.92:0/3111164822 wait complete. 2024-09-10T10:51:00.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:50:59 smithi097 ceph-mon[35213]: pgmap v450: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 15 MiB/s wr, 1.58k op/s 2024-09-10T10:51:00.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:50:59 smithi092 ceph-mon[30834]: pgmap v450: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 15 MiB/s wr, 1.58k op/s 2024-09-10T10:51:00.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:50:59 smithi121 ceph-mon[35231]: pgmap v450: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 15 MiB/s wr, 1.58k op/s 2024-09-10T10:51:02.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:01 smithi097 ceph-mon[35213]: pgmap v451: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 2.11k op/s 2024-09-10T10:51:02.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:01 smithi092 ceph-mon[30834]: pgmap v451: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 2.11k op/s 2024-09-10T10:51:02.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:01 smithi121 ceph-mon[35231]: pgmap v451: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 22 MiB/s wr, 2.11k op/s 2024-09-10T10:51:03.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 845.0 s, 957.0 tps, lat 101.648 ms stddev 145.461 2024-09-10T10:51:04.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:03 smithi097 ceph-mon[35213]: pgmap v452: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 22 MiB/s wr, 2.04k op/s 2024-09-10T10:51:04.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:03 smithi092 ceph-mon[30834]: pgmap v452: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 22 MiB/s wr, 2.04k op/s 2024-09-10T10:51:04.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:03 smithi121 ceph-mon[35231]: pgmap v452: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 22 MiB/s wr, 2.04k op/s 2024-09-10T10:51:05.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:04 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:05.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:04 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:05.319 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:04 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:06.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:05 smithi092 ceph-mon[30834]: pgmap v453: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 20 MiB/s wr, 1.81k op/s 2024-09-10T10:51:06.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:05 smithi121 ceph-mon[35231]: pgmap v453: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 20 MiB/s wr, 1.81k op/s 2024-09-10T10:51:06.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:05 smithi097 ceph-mon[35213]: pgmap v453: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 20 MiB/s wr, 1.81k op/s 2024-09-10T10:51:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:07 smithi092 ceph-mon[30834]: pgmap v454: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 28 MiB/s wr, 2.55k op/s 2024-09-10T10:51:08.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:07 smithi092 ceph-mon[30834]: osdmap e102: 12 total, 12 up, 12 in 2024-09-10T10:51:08.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 850.0 s, 1928.8 tps, lat 52.588 ms stddev 85.560 2024-09-10T10:51:08.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:07 smithi121 ceph-mon[35231]: pgmap v454: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 28 MiB/s wr, 2.55k op/s 2024-09-10T10:51:08.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:07 smithi121 ceph-mon[35231]: osdmap e102: 12 total, 12 up, 12 in 2024-09-10T10:51:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:07 smithi097 ceph-mon[35213]: pgmap v454: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 28 MiB/s wr, 2.55k op/s 2024-09-10T10:51:08.320 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:07 smithi097 ceph-mon[35213]: osdmap e102: 12 total, 12 up, 12 in 2024-09-10T10:51:10.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:10 smithi121 ceph-mon[35231]: pgmap v456: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 22 MiB/s wr, 1.90k op/s 2024-09-10T10:51:10.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:10 smithi097 ceph-mon[35213]: pgmap v456: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 22 MiB/s wr, 1.90k op/s 2024-09-10T10:51:10.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:10 smithi092 ceph-mon[30834]: pgmap v456: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 22 MiB/s wr, 1.90k op/s 2024-09-10T10:51:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.312+0000 7fb282af1640 1 -- 172.21.15.92:0/1714686646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c101ac0 msgr2=0x7fb27c101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.312+0000 7fb282af1640 1 --2- 172.21.15.92:0/1714686646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c101ac0 0x7fb27c101f20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb268009930 tx=0x7fb26802a420 comp rx=0 tx=0).stop 2024-09-10T10:51:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 -- 172.21.15.92:0/1714686646 shutdown_connections 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 --2- 172.21.15.92:0/1714686646 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb27c102460 0x7fb27c10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 --2- 172.21.15.92:0/1714686646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c101ac0 0x7fb27c101f20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 --2- 172.21.15.92:0/1714686646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c107ad0 0x7fb27c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 -- 172.21.15.92:0/1714686646 >> 172.21.15.92:0/1714686646 conn(0x7fb27c0fd820 msgr2=0x7fb27c0ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 -- 172.21.15.92:0/1714686646 shutdown_connections 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 -- 172.21.15.92:0/1714686646 wait complete. 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 Processor -- start 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 -- start start 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c101ac0 0x7fb27c1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c102460 0x7fb27c198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb27c107ad0 0x7fb27c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c111ed0 con 0x7fb27c102460 2024-09-10T10:51:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c111d50 con 0x7fb27c107ad0 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.313+0000 7fb282af1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c112050 con 0x7fb27c101ac0 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb27bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c102460 0x7fb27c198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb28088d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c101ac0 0x7fb27c1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb27bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c102460 0x7fb27c198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47984/0 (socket says 172.21.15.92:47984) 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb27bfff640 1 -- 172.21.15.92:0/221491983 learned_addr learned my addr 172.21.15.92:0/221491983 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb28108e640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb27c107ad0 0x7fb27c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb27bfff640 1 -- 172.21.15.92:0/221491983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c101ac0 msgr2=0x7fb27c1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb27bfff640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c101ac0 0x7fb27c1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb27bfff640 1 -- 172.21.15.92:0/221491983 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb27c107ad0 msgr2=0x7fb27c19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb27bfff640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb27c107ad0 0x7fb27c19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb27bfff640 1 -- 172.21.15.92:0/221491983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c19d2b0 con 0x7fb27c102460 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb27bfff640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c102460 0x7fb27c198800 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb268009230 tx=0x7fb268004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb279ffb640 1 -- 172.21.15.92:0/221491983 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26803f030 con 0x7fb27c102460 2024-09-10T10:51:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb282af1640 1 -- 172.21.15.92:0/221491983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27c19d540 con 0x7fb27c102460 2024-09-10T10:51:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb279ffb640 1 -- 172.21.15.92:0/221491983 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb268003ad0 con 0x7fb27c102460 2024-09-10T10:51:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.314+0000 7fb279ffb640 1 -- 172.21.15.92:0/221491983 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268035070 con 0x7fb27c102460 2024-09-10T10:51:12.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.315+0000 7fb282af1640 1 -- 172.21.15.92:0/221491983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27c1a4e30 con 0x7fb27c102460 2024-09-10T10:51:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.318+0000 7fb285890740 1 Processor -- start 2024-09-10T10:51:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.318+0000 7fb285890740 1 -- start start 2024-09-10T10:51:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.318+0000 7fb285890740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a28ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.318+0000 7fb285890740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a33770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.318+0000 7fb285890740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 0x55c539a3a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.318+0000 7fb285890740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c53998d2f0 con 0x55c539a28af0 2024-09-10T10:51:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.318+0000 7fb285890740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55c539935270 con 0x55c539a380c0 2024-09-10T10:51:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.318+0000 7fb285890740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c5399892b0 con 0x55c539a29410 2024-09-10T10:51:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28108e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a28ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28108e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a28ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47990/0 (socket says 172.21.15.92:47990) 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28108e640 1 -- 172.21.15.92:0/4189600349 learned_addr learned my addr 172.21.15.92:0/4189600349 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28088d640 1 --2- 172.21.15.92:0/4189600349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a33770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28108e640 1 -- 172.21.15.92:0/4189600349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 msgr2=0x55c539a33770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28108e640 1 --2- 172.21.15.92:0/4189600349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a33770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28108e640 1 -- 172.21.15.92:0/4189600349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 msgr2=0x55c539a3a4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28108e640 1 --2- 172.21.15.92:0/4189600349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 0x55c539a3a4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28108e640 1 -- 172.21.15.92:0/4189600349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c539934340 con 0x55c539a28af0 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb279ffb640 1 -- 172.21.15.92:0/221491983 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb268042030 con 0x7fb27c102460 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb28108e640 1 --2- 172.21.15.92:0/4189600349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a28ed0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb274009fd0 tx=0x7fb2740118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d767adf752015d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb266ffd640 1 -- 172.21.15.92:0/4189600349 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274004d20 con 0x55c539a28af0 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb266ffd640 1 -- 172.21.15.92:0/4189600349 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb274004050 con 0x55c539a28af0 2024-09-10T10:51:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.319+0000 7fb266ffd640 1 -- 172.21.15.92:0/4189600349 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274005260 con 0x55c539a28af0 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb279ffb640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb26c0a2da0 0x7fb26c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb28088d640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb26c0a2da0 0x7fb26c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb279ffb640 1 -- 172.21.15.92:0/221491983 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8499+0+0 (secure 0 0 0) 0x7fb2680ef7c0 con 0x7fb27c102460 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb285890740 1 -- 172.21.15.92:0/4189600349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 msgr2=0x55c539a28ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb285890740 1 --2- 172.21.15.92:0/4189600349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a28ed0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb274009fd0 tx=0x7fb2740118d0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb285890740 1 -- 172.21.15.92:0/4189600349 shutdown_connections 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb285890740 1 --2- 172.21.15.92:0/4189600349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 0x55c539a3a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb285890740 1 --2- 172.21.15.92:0/4189600349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a33770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb285890740 1 --2- 172.21.15.92:0/4189600349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a28ed0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb285890740 1 -- 172.21.15.92:0/4189600349 >> 172.21.15.92:0/4189600349 conn(0x55c539a25060 msgr2=0x55c539a25440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb285890740 1 -- 172.21.15.92:0/4189600349 shutdown_connections 2024-09-10T10:51:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb285890740 1 -- 172.21.15.92:0/4189600349 wait complete. 2024-09-10T10:51:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.320+0000 7fb28088d640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb26c0a2da0 0x7fb26c0a5260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55c539a25ec0 tx=0x7fb27000a2d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb285890740 1 -- start start 2024-09-10T10:51:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb285890740 1 Processor -- start 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb285890740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a2ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb285890740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a2d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb285890740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 0x55c539a31700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb285890740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c539a33f50 con 0x55c539a28af0 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb285890740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55c539916290 con 0x55c539a380c0 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb285890740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c539a340d0 con 0x55c539a29410 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb285890740 10 client.0 _ll_register_callbacks cb 0x55c539947140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb28088d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a2ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb28088d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a2ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48006/0 (socket says 172.21.15.92:48006) 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb28088d640 1 -- 172.21.15.92:0/3333211089 learned_addr learned my addr 172.21.15.92:0/3333211089 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb27bfff640 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a2d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb28108e640 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 0x55c539a31700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb28088d640 1 -- 172.21.15.92:0/3333211089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 msgr2=0x55c539a2d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb28088d640 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a2d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb28088d640 1 -- 172.21.15.92:0/3333211089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 msgr2=0x55c539a31700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb28088d640 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 0x55c539a31700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.321+0000 7fb28088d640 1 -- 172.21.15.92:0/3333211089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5396a0210 con 0x55c539a28af0 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb27bfff640 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a2d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb28108e640 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 0x55c539a31700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb28088d640 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a2ce70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb27001cc10 tx=0x7fb270004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c2b144d4fefcf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb25bfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb25bfff640 1 -- 172.21.15.92:0/3333211089 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27002c060 con 0x55c539a28af0 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb25bfff640 1 -- 172.21.15.92:0/3333211089 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8499+0+0 (secure 0 0 0) 0x7fb270016030 con 0x55c539a28af0 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb285890740 1 -- 172.21.15.92:0/3333211089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb274004050 con 0x55c539a28af0 2024-09-10T10:51:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb25bfff640 1 -- 172.21.15.92:0/3333211089 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fb27001cd00 con 0x55c539a28af0 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb285890740 10 client.16416 fetch_fsmap learned FSMap version 65 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.322+0000 7fb285890740 1 -- 172.21.15.92:0/3333211089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55c53976c620 con 0x55c539a28af0 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.323+0000 7fb25bfff640 1 -- 172.21.15.92:0/3333211089 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb274004050 con 0x55c539a28af0 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.323+0000 7fb25bfff640 1 -- 172.21.15.92:0/3333211089 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 65) ==== 8378+0+0 (secure 0 0 0) 0x7fb27001a8d0 con 0x55c539a28af0 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.323+0000 7fb285890740 10 client.16416 fetch_fsmap finished waiting for FSMap version 65 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.323+0000 7fb285890740 10 client.16416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.323+0000 7fb285890740 20 client.16416 populate_metadata read hostname 'smithi092' 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.323+0000 7fb285890740 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c539a4c4d0 0x55c539a4e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.323+0000 7fb285890740 4 client.16416 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.323+0000 7fb285890740 1 -- 172.21.15.92:0/3333211089 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c53999aa20 con 0x55c539a4c4d0 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.323+0000 7fb27bfff640 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c539a4c4d0 0x55c539a4e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.324+0000 7fb27bfff640 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c539a4c4d0 0x55c539a4e940 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ce9fce2f80d9eb4 server_cookie=dc5c68927c3ca45f in_seq=0 out_seq=0 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.324+0000 7fb25bfff640 10 client.16416 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.324+0000 7fb25bfff640 1 -- 172.21.15.92:0/3333211089 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c53999aa20 con 0x55c539a4c4d0 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.324+0000 7fb25bfff640 10 client.16416 handle_command_reply: tid=0 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.324+0000 7fb285890740 1 client.16416 shutdown 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 -- 172.21.15.92:0/3333211089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 msgr2=0x55c539a2ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a2ce70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb27001cc10 tx=0x7fb270004730 comp rx=0 tx=0).stop 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 -- 172.21.15.92:0/3333211089 shutdown_connections 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c539a4c4d0 0x55c539a4e940 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a380c0 0x55c539a31700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb25bfff640 0 client.16416 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a2d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 --2- 172.21.15.92:0/3333211089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a28af0 0x55c539a2ce70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 -- 172.21.15.92:0/3333211089 >> 172.21.15.92:0/3333211089 conn(0x55c539a25060 msgr2=0x55c539a2ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 -- 172.21.15.92:0/3333211089 shutdown_connections 2024-09-10T10:51:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 1 -- 172.21.15.92:0/3333211089 wait complete. 2024-09-10T10:51:12.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.325+0000 7fb285890740 20 client.16416 trim_cache size 0 max 16384 2024-09-10T10:51:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.346+0000 7fb285890740 1 Processor -- start 2024-09-10T10:51:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.346+0000 7fb285890740 1 -- start start 2024-09-10T10:51:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.347+0000 7fb285890740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a28af0 0x55c539a24470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.347+0000 7fb285890740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a29410 0x55c539a2b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.347+0000 7fb285890740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 0x55c539a2baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.349+0000 7fb285890740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c1ab590 con 0x55c539a380c0 2024-09-10T10:51:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.349+0000 7fb285890740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c1ad160 con 0x55c539a29410 2024-09-10T10:51:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.349+0000 7fb285890740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c1abc60 con 0x55c539a28af0 2024-09-10T10:51:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.350+0000 7fb28088d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a28af0 0x55c539a24470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.354+0000 7fb28088d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a28af0 0x55c539a24470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:42208/0 (socket says 172.21.15.92:42208) 2024-09-10T10:51:12.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.354+0000 7fb28088d640 1 -- 172.21.15.92:0/1247873999 learned_addr learned my addr 172.21.15.92:0/1247873999 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:12.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.354+0000 7fb27bfff640 1 --2- 172.21.15.92:0/1247873999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a29410 0x55c539a2b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.356+0000 7fb28108e640 1 --2- 172.21.15.92:0/1247873999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 0x55c539a2baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.357+0000 7fb28108e640 1 -- 172.21.15.92:0/1247873999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a28af0 msgr2=0x55c539a24470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:12.358 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.357+0000 7fb28108e640 1 --2- 172.21.15.92:0/1247873999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a28af0 0x55c539a24470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.357+0000 7fb28108e640 1 -- 172.21.15.92:0/1247873999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a29410 msgr2=0x55c539a2b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:12.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.357+0000 7fb28108e640 1 --2- 172.21.15.92:0/1247873999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a29410 0x55c539a2b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.357+0000 7fb28108e640 1 -- 172.21.15.92:0/1247873999 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c539a28920 con 0x55c539a380c0 2024-09-10T10:51:12.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.358+0000 7fb28108e640 1 --2- 172.21.15.92:0/1247873999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 0x55c539a2baa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb274000f80 tx=0x7fb274009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743e295969227fda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:12.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.360+0000 7fb2667fc640 1 -- 172.21.15.92:0/1247873999 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274003db0 con 0x55c539a380c0 2024-09-10T10:51:12.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.361+0000 7fb2667fc640 1 -- 172.21.15.92:0/1247873999 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb274004050 con 0x55c539a380c0 2024-09-10T10:51:12.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.361+0000 7fb2667fc640 1 -- 172.21.15.92:0/1247873999 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740052a0 con 0x55c539a380c0 2024-09-10T10:51:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.362+0000 7fb285890740 1 -- 172.21.15.92:0/1247873999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 msgr2=0x55c539a2baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:12.363 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.362+0000 7fb285890740 1 --2- 172.21.15.92:0/1247873999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 0x55c539a2baa0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb274000f80 tx=0x7fb274009d30 comp rx=0 tx=0).stop 2024-09-10T10:51:12.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.364+0000 7fb285890740 1 -- 172.21.15.92:0/1247873999 shutdown_connections 2024-09-10T10:51:12.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.364+0000 7fb285890740 1 --2- 172.21.15.92:0/1247873999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 0x55c539a2baa0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.364+0000 7fb285890740 1 --2- 172.21.15.92:0/1247873999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a29410 0x55c539a2b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.364+0000 7fb285890740 1 --2- 172.21.15.92:0/1247873999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a28af0 0x55c539a24470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.364+0000 7fb285890740 1 -- 172.21.15.92:0/1247873999 >> 172.21.15.92:0/1247873999 conn(0x55c539a25060 msgr2=0x55c539a33030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.367+0000 7fb285890740 1 -- 172.21.15.92:0/1247873999 shutdown_connections 2024-09-10T10:51:12.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.368+0000 7fb285890740 1 -- 172.21.15.92:0/1247873999 wait complete. 2024-09-10T10:51:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.368+0000 7fb285890740 1 -- start start 2024-09-10T10:51:12.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.369+0000 7fb285890740 1 Processor -- start 2024-09-10T10:51:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.370+0000 7fb285890740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a28af0 0x55c539a48bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.370+0000 7fb285890740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a49100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.370+0000 7fb285890740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 0x55c539a36a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.370+0000 7fb285890740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c1aca90 con 0x55c539a380c0 2024-09-10T10:51:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.370+0000 7fb285890740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c1ac330 con 0x55c539a28af0 2024-09-10T10:51:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.370+0000 7fb285890740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c1a9590 con 0x55c539a29410 2024-09-10T10:51:12.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.370+0000 7fb285890740 10 client.0 _ll_register_callbacks cb 0x7fb27000a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:51:12.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.371+0000 7fb28088d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a28af0 0x55c539a48bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.371+0000 7fb28088d640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a28af0 0x55c539a48bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:44004/0 (socket says 172.21.15.92:44004) 2024-09-10T10:51:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.371+0000 7fb28088d640 1 -- 172.21.15.92:0/537580409 learned_addr learned my addr 172.21.15.92:0/537580409 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.372+0000 7fb28088d640 1 -- 172.21.15.92:0/537580409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 msgr2=0x55c539a49100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T10:51:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.372+0000 7fb28088d640 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a49100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.372+0000 7fb28088d640 1 -- 172.21.15.92:0/537580409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 msgr2=0x55c539a36a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.372+0000 7fb28088d640 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 0x55c539a36a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.372+0000 7fb28088d640 1 -- 172.21.15.92:0/537580409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c539a37220 con 0x55c539a28af0 2024-09-10T10:51:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.373+0000 7fb28088d640 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a28af0 0x55c539a48bc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb27001cc10 tx=0x7fb27000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b3793ea4ec532b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.373+0000 7fb25bfff640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:51:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.373+0000 7fb25bfff640 1 -- 172.21.15.92:0/537580409 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27000fd80 con 0x55c539a28af0 2024-09-10T10:51:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.373+0000 7fb25bfff640 1 -- 172.21.15.92:0/537580409 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8499+0+0 (secure 0 0 0) 0x7fb27001a3a0 con 0x55c539a28af0 2024-09-10T10:51:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.373+0000 7fb285890740 1 -- 172.21.15.92:0/537580409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb274004050 con 0x55c539a28af0 2024-09-10T10:51:12.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.374+0000 7fb25bfff640 1 -- 172.21.15.92:0/537580409 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fb270049050 con 0x55c539a28af0 2024-09-10T10:51:12.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.375+0000 7fb285890740 10 client.25910 fetch_fsmap learned FSMap version 65 2024-09-10T10:51:12.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.375+0000 7fb285890740 1 -- 172.21.15.92:0/537580409 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55c539ab6eb0 con 0x55c539a28af0 2024-09-10T10:51:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.377+0000 7fb25bfff640 1 -- 172.21.15.92:0/537580409 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb27001aa80 con 0x55c539a28af0 2024-09-10T10:51:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.377+0000 7fb25bfff640 1 -- 172.21.15.92:0/537580409 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 65) ==== 8378+0+0 (secure 0 0 0) 0x7fb27002fa50 con 0x55c539a28af0 2024-09-10T10:51:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.378+0000 7fb285890740 10 client.25910 fetch_fsmap finished waiting for FSMap version 65 2024-09-10T10:51:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.378+0000 7fb285890740 10 client.25910 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:51:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.378+0000 7fb285890740 20 client.25910 populate_metadata read hostname 'smithi092' 2024-09-10T10:51:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.378+0000 7fb285890740 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c539ab76e0 0x55c539ab9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.378+0000 7fb285890740 4 client.25910 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:51:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.378+0000 7fb285890740 1 -- 172.21.15.92:0/537580409 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fb274004050 con 0x55c539ab76e0 2024-09-10T10:51:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.378+0000 7fb27bfff640 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c539ab76e0 0x55c539ab9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:12.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.379+0000 7fb25bfff640 10 client.25910 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.379+0000 7fb27bfff640 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c539ab76e0 0x55c539ab9b60 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52e6e2ba9cc4550b server_cookie=9b687688e0dcc98e in_seq=0 out_seq=0 2024-09-10T10:51:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb25bfff640 1 -- 172.21.15.92:0/537580409 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb274004050 con 0x55c539ab76e0 2024-09-10T10:51:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb25bfff640 10 client.25910 handle_command_reply: tid=0 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb285890740 1 client.25910 shutdown 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb285890740 1 -- 172.21.15.92:0/537580409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a28af0 msgr2=0x55c539a48bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb285890740 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a28af0 0x55c539a48bc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb27001cc10 tx=0x7fb27000fa00 comp rx=0 tx=0).stop 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb285890740 1 -- 172.21.15.92:0/537580409 shutdown_connections 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb285890740 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c539a380c0 0x55c539a36a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb285890740 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c539a29410 0x55c539a49100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb285890740 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55c539ab76e0 0x55c539ab9b60 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb285890740 1 --2- 172.21.15.92:0/537580409 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55c539a28af0 0x55c539a48bc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb25bfff640 0 client.25910 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.398+0000 7fb285890740 1 -- 172.21.15.92:0/537580409 >> 172.21.15.92:0/537580409 conn(0x55c539a25060 msgr2=0x55c539a325f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb285890740 1 -- 172.21.15.92:0/537580409 shutdown_connections 2024-09-10T10:51:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb285890740 1 -- 172.21.15.92:0/537580409 wait complete. 2024-09-10T10:51:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb285890740 20 client.25910 trim_cache size 0 max 16384 2024-09-10T10:51:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:51:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:51:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:51:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 -- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb26c0a2da0 msgr2=0x7fb26c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb26c0a2da0 0x7fb26c0a5260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55c539a25ec0 tx=0x7fb27000a2d0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 -- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c102460 msgr2=0x7fb27c198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c102460 0x7fb27c198800 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb268009230 tx=0x7fb268004270 comp rx=0 tx=0).stop 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 -- 172.21.15.92:0/221491983 shutdown_connections 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb26c0a2da0 0x7fb26c0a5260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb27c107ad0 0x7fb27c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb27c102460 0x7fb27c198800 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 --2- 172.21.15.92:0/221491983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb27c101ac0 0x7fb27c1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.399+0000 7fb282af1640 1 -- 172.21.15.92:0/221491983 >> 172.21.15.92:0/221491983 conn(0x7fb27c0fd820 msgr2=0x7fb27c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.400+0000 7fb282af1640 1 -- 172.21.15.92:0/221491983 shutdown_connections 2024-09-10T10:51:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:12.400+0000 7fb282af1640 1 -- 172.21.15.92:0/221491983 wait complete. 2024-09-10T10:51:12.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:12 smithi121 ceph-mon[35231]: pgmap v457: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 21 MiB/s wr, 1.86k op/s 2024-09-10T10:51:12.819 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:12 smithi097 ceph-mon[35213]: pgmap v457: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 21 MiB/s wr, 1.86k op/s 2024-09-10T10:51:12.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:12 smithi092 ceph-mon[30834]: pgmap v457: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 21 MiB/s wr, 1.86k op/s 2024-09-10T10:51:13.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 855.0 s, 1665.4 tps, lat 60.545 ms stddev 67.518 2024-09-10T10:51:14.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:14 smithi121 ceph-mon[35231]: pgmap v458: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 21 MiB/s wr, 1.92k op/s 2024-09-10T10:51:14.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:14 smithi097 ceph-mon[35213]: pgmap v458: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 21 MiB/s wr, 1.92k op/s 2024-09-10T10:51:14.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:14 smithi092 ceph-mon[30834]: pgmap v458: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 21 MiB/s wr, 1.92k op/s 2024-09-10T10:51:15.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:15 smithi121 ceph-mon[35231]: osdmap e103: 12 total, 12 up, 12 in 2024-09-10T10:51:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:15 smithi097 ceph-mon[35213]: osdmap e103: 12 total, 12 up, 12 in 2024-09-10T10:51:15.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:15 smithi092 ceph-mon[30834]: osdmap e103: 12 total, 12 up, 12 in 2024-09-10T10:51:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:16 smithi121 ceph-mon[35231]: pgmap v460: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2024-09-10T10:51:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:16 smithi097 ceph-mon[35213]: pgmap v460: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2024-09-10T10:51:16.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:16 smithi092 ceph-mon[30834]: pgmap v460: 97 pgs: 97 active+clean; 4.4 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2024-09-10T10:51:17.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:17 smithi097 ceph-mon[35213]: pgmap v461: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 19 MiB/s wr, 1.88k op/s 2024-09-10T10:51:17.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:17 smithi092 ceph-mon[30834]: pgmap v461: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 19 MiB/s wr, 1.88k op/s 2024-09-10T10:51:18.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:17 smithi121 ceph-mon[35231]: pgmap v461: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 19 MiB/s wr, 1.88k op/s 2024-09-10T10:51:18.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 860.0 s, 1422.4 tps, lat 70.009 ms stddev 94.606 2024-09-10T10:51:20.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:19 smithi121 ceph-mon[35231]: pgmap v462: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 19 MiB/s wr, 1.85k op/s 2024-09-10T10:51:20.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:19 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:20.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:19 smithi097 ceph-mon[35213]: pgmap v462: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 19 MiB/s wr, 1.85k op/s 2024-09-10T10:51:20.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:19 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:20.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:19 smithi092 ceph-mon[30834]: pgmap v462: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 19 MiB/s wr, 1.85k op/s 2024-09-10T10:51:20.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:19 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:22.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:21 smithi121 ceph-mon[35231]: pgmap v463: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 1.53k op/s 2024-09-10T10:51:22.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:21 smithi097 ceph-mon[35213]: pgmap v463: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 1.53k op/s 2024-09-10T10:51:22.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:21 smithi092 ceph-mon[30834]: pgmap v463: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 1.53k op/s 2024-09-10T10:51:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 865.0 s, 1503.6 tps, lat 66.935 ms stddev 81.974 2024-09-10T10:51:24.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:23 smithi121 ceph-mon[35231]: pgmap v464: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 1.33k op/s 2024-09-10T10:51:24.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:23 smithi097 ceph-mon[35213]: pgmap v464: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 1.33k op/s 2024-09-10T10:51:24.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:23 smithi092 ceph-mon[30834]: pgmap v464: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 12 MiB/s wr, 1.33k op/s 2024-09-10T10:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.618+0000 7fd1534dd640 1 -- 172.21.15.92:0/3455565195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c1013b0 msgr2=0x7fd14c105870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.618+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3455565195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c1013b0 0x7fd14c105870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd148009900 tx=0x7fd14802a420 comp rx=0 tx=0).stop 2024-09-10T10:51:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.625+0000 7fd1534dd640 1 -- 172.21.15.92:0/3455565195 shutdown_connections 2024-09-10T10:51:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.625+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3455565195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd14c105f10 0x7fd14c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.625+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3455565195 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c1013b0 0x7fd14c105870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.625+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3455565195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14c100a90 0x7fd14c100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.625+0000 7fd1534dd640 1 -- 172.21.15.92:0/3455565195 >> 172.21.15.92:0/3455565195 conn(0x7fd14c0fc6b0 msgr2=0x7fd14c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.628+0000 7fd1534dd640 1 -- 172.21.15.92:0/3455565195 shutdown_connections 2024-09-10T10:51:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.630+0000 7fd1534dd640 1 -- 172.21.15.92:0/3455565195 wait complete. 2024-09-10T10:51:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.631+0000 7fd1534dd640 1 Processor -- start 2024-09-10T10:51:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.631+0000 7fd1534dd640 1 -- start start 2024-09-10T10:51:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.631+0000 7fd1534dd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14c100a90 0x7fd14c114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.631+0000 7fd1534dd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c1013b0 0x7fd14c10ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.631+0000 7fd1534dd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd14c105f10 0x7fd14c10f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.631+0000 7fd151279640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14c100a90 0x7fd14c114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd151279640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14c100a90 0x7fd14c114e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:34478/0 (socket says 172.21.15.92:34478) 2024-09-10T10:51:25.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd151279640 1 -- 172.21.15.92:0/3535370705 learned_addr learned my addr 172.21.15.92:0/3535370705 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd150a78640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c1013b0 0x7fd14c10ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c107870 con 0x7fd14c105f10 2024-09-10T10:51:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1076f0 con 0x7fd14c1013b0 2024-09-10T10:51:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1079f0 con 0x7fd14c100a90 2024-09-10T10:51:25.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd151a7a640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd14c105f10 0x7fd14c10f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd151279640 1 -- 172.21.15.92:0/3535370705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c1013b0 msgr2=0x7fd14c10ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd151279640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c1013b0 0x7fd14c10ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd151279640 1 -- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd14c105f10 msgr2=0x7fd14c10f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd151279640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd14c105f10 0x7fd14c10f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd151279640 1 -- 172.21.15.92:0/3535370705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14c10fb10 con 0x7fd14c100a90 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.632+0000 7fd151279640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14c100a90 0x7fd14c114e00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c890 tx=0x7fd13c00cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.633+0000 7fd1427fc640 1 -- 172.21.15.92:0/3535370705 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c004220 con 0x7fd14c100a90 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.633+0000 7fd1427fc640 1 -- 172.21.15.92:0/3535370705 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd13c0043c0 con 0x7fd14c100a90 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.633+0000 7fd1427fc640 1 -- 172.21.15.92:0/3535370705 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0049e0 con 0x7fd14c100a90 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.633+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14c1b3870 con 0x7fd14c100a90 2024-09-10T10:51:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.633+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd14c1b3c80 con 0x7fd14c100a90 2024-09-10T10:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.637+0000 7fd1427fc640 1 -- 172.21.15.92:0/3535370705 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd13c0079b0 con 0x7fd14c100a90 2024-09-10T10:51:25.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.638+0000 7fd1427fc640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd1380a2f50 0x7fd1380a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.638+0000 7fd1427fc640 1 -- 172.21.15.92:0/3535370705 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8455+0+0 (secure 0 0 0) 0x7fd13c0cf310 con 0x7fd14c100a90 2024-09-10T10:51:25.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.638+0000 7fd150a78640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd1380a2f50 0x7fd1380a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.640+0000 7fd150a78640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd1380a2f50 0x7fd1380a5410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd148005ab0 tx=0x7fd14802a920 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.655+0000 7fd15627a740 1 Processor -- start 2024-09-10T10:51:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd15627a740 1 -- start start 2024-09-10T10:51:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd15627a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 0x56457aec8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd15627a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 0x56457aed3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd15627a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd15627a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56457ae2d2f0 con 0x56457aed3cb0 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd15627a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56457add5270 con 0x56457aec9410 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd15627a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56457ae292b0 con 0x56457aec8af0 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151a7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151a7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57946/0 (socket says 172.21.15.92:57946) 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151a7a640 1 -- 172.21.15.92:0/1344058273 learned_addr learned my addr 172.21.15.92:0/1344058273 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151279640 1 --2- 172.21.15.92:0/1344058273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 0x56457aec8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd150a78640 1 --2- 172.21.15.92:0/1344058273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 0x56457aed3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151a7a640 1 -- 172.21.15.92:0/1344058273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 msgr2=0x56457aec8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151a7a640 1 --2- 172.21.15.92:0/1344058273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 0x56457aec8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151a7a640 1 -- 172.21.15.92:0/1344058273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 msgr2=0x56457aed3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151a7a640 1 --2- 172.21.15.92:0/1344058273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 0x56457aed3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151a7a640 1 -- 172.21.15.92:0/1344058273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56457add4340 con 0x56457aed3cb0 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.656+0000 7fd151a7a640 1 --2- 172.21.15.92:0/1344058273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed60a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd14400a430 tx=0x7fd144009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a65ccbe195f127 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.657+0000 7fd1377fe640 1 -- 172.21.15.92:0/1344058273 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144013790 con 0x56457aed3cb0 2024-09-10T10:51:25.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.657+0000 7fd1377fe640 1 -- 172.21.15.92:0/1344058273 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd144019070 con 0x56457aed3cb0 2024-09-10T10:51:25.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.657+0000 7fd1377fe640 1 -- 172.21.15.92:0/1344058273 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144014de0 con 0x56457aed3cb0 2024-09-10T10:51:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.657+0000 7fd15627a740 1 -- 172.21.15.92:0/1344058273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 msgr2=0x56457aed60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.657+0000 7fd15627a740 1 --2- 172.21.15.92:0/1344058273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed60a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd14400a430 tx=0x7fd144009650 comp rx=0 tx=0).stop 2024-09-10T10:51:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.658+0000 7fd15627a740 1 -- 172.21.15.92:0/1344058273 shutdown_connections 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.658+0000 7fd15627a740 1 --2- 172.21.15.92:0/1344058273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed60a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.658+0000 7fd15627a740 1 --2- 172.21.15.92:0/1344058273 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 0x56457aed3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.658+0000 7fd15627a740 1 --2- 172.21.15.92:0/1344058273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 0x56457aec8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.658+0000 7fd15627a740 1 -- 172.21.15.92:0/1344058273 >> 172.21.15.92:0/1344058273 conn(0x56457aec5060 msgr2=0x56457aec5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.658+0000 7fd15627a740 1 -- 172.21.15.92:0/1344058273 shutdown_connections 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.658+0000 7fd15627a740 1 -- 172.21.15.92:0/1344058273 wait complete. 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.658+0000 7fd15627a740 1 -- start start 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.658+0000 7fd15627a740 1 Processor -- start 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.659+0000 7fd15627a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.659+0000 7fd15627a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec9410 0x56457aed10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.659+0000 7fd151279640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.659+0000 7fd151279640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:52630/0 (socket says 172.21.15.92:52630) 2024-09-10T10:51:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd151279640 1 -- 172.21.15.92:0/326952166 learned_addr learned my addr 172.21.15.92:0/326952166 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd15627a740 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd150a78640 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec9410 0x56457aed10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56457aed6880 con 0x56457aed3cb0 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x56457adb6290 con 0x56457aec8af0 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd151a7a640 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56457aed6a00 con 0x56457aec9410 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd15627a740 10 client.0 _ll_register_callbacks cb 0x56457ade7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd151279640 1 -- 172.21.15.92:0/326952166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec9410 msgr2=0x56457aed10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd151279640 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec9410 0x56457aed10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd151279640 1 -- 172.21.15.92:0/326952166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 msgr2=0x56457aed1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd151279640 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.660+0000 7fd151279640 1 -- 172.21.15.92:0/326952166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56457ab40210 con 0x56457aec8af0 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.661+0000 7fd151279640 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed0b90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0cd0a0 tx=0x7fd13c09b280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f4b116e35bb8f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.661+0000 7fd134ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.661+0000 7fd134ff9640 1 -- 172.21.15.92:0/326952166 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0b3070 con 0x56457aec8af0 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.661+0000 7fd134ff9640 1 -- 172.21.15.92:0/326952166 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8455+0+0 (secure 0 0 0) 0x7fd13c0a4050 con 0x56457aec8af0 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.661+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd144019070 con 0x56457aec8af0 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.661+0000 7fd134ff9640 1 -- 172.21.15.92:0/326952166 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fd13c01d070 con 0x56457aec8af0 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.661+0000 7fd15627a740 10 client.25922 fetch_fsmap learned FSMap version 66 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.661+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56457ac0c620 con 0x56457aec8af0 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.661+0000 7fd134ff9640 1 -- 172.21.15.92:0/326952166 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd144019070 con 0x56457aec8af0 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd134ff9640 1 -- 172.21.15.92:0/326952166 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fd13c09cba0 con 0x56457aec8af0 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd15627a740 10 client.25922 fetch_fsmap finished waiting for FSMap version 66 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd15627a740 10 client.25922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd15627a740 20 client.25922 populate_metadata read hostname 'smithi092' 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd15627a740 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56457aee3bd0 0x56457aee6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd15627a740 4 client.25922 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:51:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56457ae3aa20 con 0x56457aee3bd0 2024-09-10T10:51:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd150a78640 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56457aee3bd0 0x56457aee6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd134ff9640 10 client.25922 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:25.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.662+0000 7fd150a78640 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56457aee3bd0 0x56457aee6000 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f2be1f577505317 server_cookie=cf0fbd31686069b1 in_seq=0 out_seq=0 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.663+0000 7fd134ff9640 1 -- 172.21.15.92:0/326952166 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56457ae3aa20 con 0x56457aee3bd0 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.663+0000 7fd134ff9640 10 client.25922 handle_command_reply: tid=0 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.663+0000 7fd15627a740 1 client.25922 shutdown 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.663+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 msgr2=0x56457aed0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.663+0000 7fd15627a740 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed0b90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0cd0a0 tx=0x7fd13c09b280 comp rx=0 tx=0).stop 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 shutdown_connections 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd15627a740 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd15627a740 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec9410 0x56457aed10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd15627a740 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56457aee3bd0 0x56457aee6000 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd15627a740 1 --2- 172.21.15.92:0/326952166 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed0b90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 >> 172.21.15.92:0/326952166 conn(0x56457aec5060 msgr2=0x56457aecad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:25.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd134ff9640 0 client.25922 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:25.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 shutdown_connections 2024-09-10T10:51:25.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd15627a740 1 -- 172.21.15.92:0/326952166 wait complete. 2024-09-10T10:51:25.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.664+0000 7fd15627a740 20 client.25922 trim_cache size 0 max 16384 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd15627a740 1 Processor -- start 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd15627a740 1 -- start start 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd15627a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd15627a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aec9410 0x56457aed2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd15627a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aed3cb0 0x56457aeeb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd15627a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1bc560 con 0x56457aec9410 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd15627a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1be130 con 0x56457aec8af0 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd15627a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1bcc30 con 0x56457aed3cb0 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd150a78640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aec9410 0x56457aed2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd150a78640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aec9410 0x56457aed2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57958/0 (socket says 172.21.15.92:57958) 2024-09-10T10:51:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd150a78640 1 -- 172.21.15.92:0/379547915 learned_addr learned my addr 172.21.15.92:0/379547915 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd151279640 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.680+0000 7fd151a7a640 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aed3cb0 0x56457aeeb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd150a78640 1 -- 172.21.15.92:0/379547915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aed3cb0 msgr2=0x56457aeeb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd150a78640 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aed3cb0 0x56457aeeb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd150a78640 1 -- 172.21.15.92:0/379547915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 msgr2=0x56457aed1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd150a78640 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd150a78640 1 -- 172.21.15.92:0/379547915 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56457aec9c90 con 0x56457aec9410 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd151a7a640 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aed3cb0 0x56457aeeb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd150a78640 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aec9410 0x56457aed2b00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd148054fd0 tx=0x7fd148040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34b48ee5a17e58b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd136ffd640 1 -- 172.21.15.92:0/379547915 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148035040 con 0x56457aec9410 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd136ffd640 1 -- 172.21.15.92:0/379547915 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd148031a20 con 0x56457aec9410 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.681+0000 7fd136ffd640 1 -- 172.21.15.92:0/379547915 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148054940 con 0x56457aec9410 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 -- 172.21.15.92:0/379547915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aec9410 msgr2=0x56457aed2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aec9410 0x56457aed2b00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd148054fd0 tx=0x7fd148040000 comp rx=0 tx=0).stop 2024-09-10T10:51:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 -- 172.21.15.92:0/379547915 shutdown_connections 2024-09-10T10:51:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aed3cb0 0x56457aeeb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aec9410 0x56457aed2b00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 --2- 172.21.15.92:0/379547915 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec8af0 0x56457aed1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 -- 172.21.15.92:0/379547915 >> 172.21.15.92:0/379547915 conn(0x56457aec5060 msgr2=0x56457aed23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 -- 172.21.15.92:0/379547915 shutdown_connections 2024-09-10T10:51:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 -- 172.21.15.92:0/379547915 wait complete. 2024-09-10T10:51:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 -- start start 2024-09-10T10:51:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.682+0000 7fd15627a740 1 Processor -- start 2024-09-10T10:51:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd15627a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 0x56457aedc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd15627a740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 0x56457aed7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd15627a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd15627a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1bda60 con 0x56457aed3cb0 2024-09-10T10:51:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd15627a740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1bd300 con 0x56457aec9410 2024-09-10T10:51:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd15627a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1ba560 con 0x56457aec8af0 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd151a7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd150a78640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 0x56457aed7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd151a7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57960/0 (socket says 172.21.15.92:57960) 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd151279640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 0x56457aedc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd151a7a640 1 -- 172.21.15.92:0/3892156175 learned_addr learned my addr 172.21.15.92:0/3892156175 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd15627a740 10 client.0 _ll_register_callbacks cb 0x7fd13c0058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd150a78640 1 -- 172.21.15.92:0/3892156175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 msgr2=0x56457aedc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd150a78640 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 0x56457aedc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd150a78640 1 -- 172.21.15.92:0/3892156175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 msgr2=0x56457aed7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd150a78640 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd150a78640 1 -- 172.21.15.92:0/3892156175 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56457aed8600 con 0x56457aec9410 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd151279640 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 0x56457aedc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:51:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd150a78640 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 0x56457aed7800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x56457aed6820 tx=0x7fd148000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e0906094cd7e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd134ff9640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.683+0000 7fd134ff9640 1 -- 172.21.15.92:0/3892156175 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148062060 con 0x56457aec9410 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.684+0000 7fd134ff9640 1 -- 172.21.15.92:0/3892156175 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8455+0+0 (secure 0 0 0) 0x7fd148031bd0 con 0x56457aec9410 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.684+0000 7fd15627a740 1 -- 172.21.15.92:0/3892156175 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd148031a20 con 0x56457aec9410 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.684+0000 7fd134ff9640 1 -- 172.21.15.92:0/3892156175 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fd148035070 con 0x56457aec9410 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.684+0000 7fd15627a740 10 client.25928 fetch_fsmap learned FSMap version 66 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.684+0000 7fd15627a740 1 -- 172.21.15.92:0/3892156175 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56457af4e990 con 0x56457aec9410 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.684+0000 7fd134ff9640 1 -- 172.21.15.92:0/3892156175 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd148031a20 con 0x56457aec9410 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.684+0000 7fd134ff9640 1 -- 172.21.15.92:0/3892156175 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fd148067470 con 0x56457aec9410 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.685+0000 7fd15627a740 10 client.25928 fetch_fsmap finished waiting for FSMap version 66 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.685+0000 7fd15627a740 10 client.25928 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:51:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.685+0000 7fd15627a740 20 client.25928 populate_metadata read hostname 'smithi092' 2024-09-10T10:51:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.685+0000 7fd15627a740 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56457af4f110 0x56457af51530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.685+0000 7fd15627a740 4 client.25928 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:51:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.685+0000 7fd15627a740 1 -- 172.21.15.92:0/3892156175 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56457ae34d70 con 0x56457af4f110 2024-09-10T10:51:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.685+0000 7fd151279640 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56457af4f110 0x56457af51530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.686+0000 7fd134ff9640 10 client.25928 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.686+0000 7fd151279640 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56457af4f110 0x56457af51530 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf3ed5f68faa61d3 server_cookie=e5e26f32525e7864 in_seq=0 out_seq=0 2024-09-10T10:51:25.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.694+0000 7fd134ff9640 1 -- 172.21.15.92:0/3892156175 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56457ae34d70 con 0x56457af4f110 2024-09-10T10:51:25.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.694+0000 7fd134ff9640 10 client.25928 handle_command_reply: tid=0 2024-09-10T10:51:25.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.694+0000 7fd15627a740 1 client.25928 shutdown 2024-09-10T10:51:25.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 -- 172.21.15.92:0/3892156175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 msgr2=0x56457aed7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:25.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 0x56457aed7800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x56457aed6820 tx=0x7fd148000bc0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 -- 172.21.15.92:0/3892156175 shutdown_connections 2024-09-10T10:51:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56457aed3cb0 0x56457aed7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x56457af4f110 0x56457af51530 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x56457aec9410 0x56457aed7800 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 --2- 172.21.15.92:0/3892156175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56457aec8af0 0x56457aedc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd134ff9640 0 client.25928 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 -- 172.21.15.92:0/3892156175 >> 172.21.15.92:0/3892156175 conn(0x56457aec5060 msgr2=0x56457aecad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 -- 172.21.15.92:0/3892156175 shutdown_connections 2024-09-10T10:51:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 1 -- 172.21.15.92:0/3892156175 wait complete. 2024-09-10T10:51:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd15627a740 20 client.25928 trim_cache size 0 max 16384 2024-09-10T10:51:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:51:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:51:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:51:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:51:25.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd1380a2f50 msgr2=0x7fd1380a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:25.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd1380a2f50 0x7fd1380a5410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd148005ab0 tx=0x7fd14802a920 comp rx=0 tx=0).stop 2024-09-10T10:51:25.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14c100a90 msgr2=0x7fd14c114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:25.701 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14c100a90 0x7fd14c114e00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c890 tx=0x7fd13c00cd50 comp rx=0 tx=0).stop 2024-09-10T10:51:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 shutdown_connections 2024-09-10T10:51:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd14c105f10 0x7fd14c10f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd1380a2f50 0x7fd1380a5410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd14c1013b0 0x7fd14c10ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 --2- 172.21.15.92:0/3535370705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd14c100a90 0x7fd14c114e00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.695+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 >> 172.21.15.92:0/3535370705 conn(0x7fd14c0fc6b0 msgr2=0x7fd14c1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.696+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 shutdown_connections 2024-09-10T10:51:25.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:25.696+0000 7fd1534dd640 1 -- 172.21.15.92:0/3535370705 wait complete. 2024-09-10T10:51:26.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:25 smithi121 ceph-mon[35231]: pgmap v465: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 1.31k op/s 2024-09-10T10:51:26.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:25 smithi097 ceph-mon[35213]: pgmap v465: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 1.31k op/s 2024-09-10T10:51:26.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:25 smithi092 ceph-mon[30834]: pgmap v465: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 11 MiB/s wr, 1.31k op/s 2024-09-10T10:51:28.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:27 smithi121 ceph-mon[35231]: pgmap v466: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 17 MiB/s wr, 1.93k op/s 2024-09-10T10:51:28.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:27 smithi097 ceph-mon[35213]: pgmap v466: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 17 MiB/s wr, 1.93k op/s 2024-09-10T10:51:28.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:27 smithi092 ceph-mon[30834]: pgmap v466: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 17 MiB/s wr, 1.93k op/s 2024-09-10T10:51:28.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 870.0 s, 1554.0 tps, lat 64.061 ms stddev 72.747 2024-09-10T10:51:30.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:29 smithi121 ceph-mon[35231]: pgmap v467: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-10T10:51:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:29 smithi097 ceph-mon[35213]: pgmap v467: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-10T10:51:30.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:29 smithi092 ceph-mon[30834]: pgmap v467: 97 pgs: 97 active+clean; 4.5 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-10T10:51:32.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:31 smithi121 ceph-mon[35231]: pgmap v468: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 1.42k op/s 2024-09-10T10:51:32.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:31 smithi097 ceph-mon[35213]: pgmap v468: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 1.42k op/s 2024-09-10T10:51:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:31 smithi092 ceph-mon[30834]: pgmap v468: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 1.42k op/s 2024-09-10T10:51:33.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 875.0 s, 1763.6 tps, lat 57.076 ms stddev 61.423 2024-09-10T10:51:34.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:33 smithi121 ceph-mon[35231]: pgmap v469: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 1.28k op/s 2024-09-10T10:51:34.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:33 smithi097 ceph-mon[35213]: pgmap v469: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 1.28k op/s 2024-09-10T10:51:34.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:33 smithi092 ceph-mon[30834]: pgmap v469: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 1.28k op/s 2024-09-10T10:51:36.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:35 smithi121 ceph-mon[35231]: pgmap v470: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.7 MiB/s wr, 1.10k op/s 2024-09-10T10:51:36.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:35 smithi097 ceph-mon[35213]: pgmap v470: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.7 MiB/s wr, 1.10k op/s 2024-09-10T10:51:36.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:35 smithi092 ceph-mon[30834]: pgmap v470: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.7 MiB/s wr, 1.10k op/s 2024-09-10T10:51:38.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:37 smithi121 ceph-mon[35231]: pgmap v471: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 2.01k op/s 2024-09-10T10:51:38.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:37 smithi097 ceph-mon[35213]: pgmap v471: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 2.01k op/s 2024-09-10T10:51:38.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:37 smithi092 ceph-mon[30834]: pgmap v471: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 20 MiB/s wr, 2.01k op/s 2024-09-10T10:51:38.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 880.0 s, 1119.6 tps, lat 88.049 ms stddev 109.894 2024-09-10T10:51:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.836+0000 7f5b34f62640 1 -- 172.21.15.92:0/895674791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b301007e0 msgr2=0x7f5b30100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:38.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.836+0000 7f5b34f62640 1 --2- 172.21.15.92:0/895674791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b301007e0 0x7f5b30100c40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f5b24013150 tx=0x7f5b240327a0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.838+0000 7f5b34f62640 1 -- 172.21.15.92:0/895674791 shutdown_connections 2024-09-10T10:51:38.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.838+0000 7f5b34f62640 1 --2- 172.21.15.92:0/895674791 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b30101180 0x7f5b3006a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.838+0000 7f5b34f62640 1 --2- 172.21.15.92:0/895674791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b301007e0 0x7f5b30100c40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.838+0000 7f5b34f62640 1 --2- 172.21.15.92:0/895674791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b301067f0 0x7f5b30106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.838+0000 7f5b34f62640 1 -- 172.21.15.92:0/895674791 >> 172.21.15.92:0/895674791 conn(0x7f5b300fc4e0 msgr2=0x7f5b300fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:38.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.839+0000 7f5b34f62640 1 -- 172.21.15.92:0/895674791 shutdown_connections 2024-09-10T10:51:38.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.839+0000 7f5b34f62640 1 -- 172.21.15.92:0/895674791 wait complete. 2024-09-10T10:51:38.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.840+0000 7f5b34f62640 1 Processor -- start 2024-09-10T10:51:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.840+0000 7f5b34f62640 1 -- start start 2024-09-10T10:51:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.840+0000 7f5b34f62640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b301007e0 0x7f5b300739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.840+0000 7f5b34f62640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b30101180 0x7f5b3006cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.840+0000 7f5b34f62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b301067f0 0x7f5b3006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.840+0000 7f5b34f62640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3010fbf0 con 0x7f5b301067f0 2024-09-10T10:51:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.840+0000 7f5b34f62640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3010fa70 con 0x7f5b301007e0 2024-09-10T10:51:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.840+0000 7f5b34f62640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3010fd70 con 0x7f5b30101180 2024-09-10T10:51:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.841+0000 7f5b2f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b301007e0 0x7f5b300739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.841+0000 7f5b2f7fe640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b301007e0 0x7f5b300739f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:40070/0 (socket says 172.21.15.92:40070) 2024-09-10T10:51:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.841+0000 7f5b2f7fe640 1 -- 172.21.15.92:0/1506339993 learned_addr learned my addr 172.21.15.92:0/1506339993 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.841+0000 7f5b2f7fe640 1 -- 172.21.15.92:0/1506339993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b30101180 msgr2=0x7f5b3006cae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T10:51:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.841+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b30101180 0x7f5b3006cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.841+0000 7f5b2f7fe640 1 -- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b301067f0 msgr2=0x7f5b3006d020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:51:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.841+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b301067f0 0x7f5b3006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.841+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b301067f0 0x7f5b3006d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.841+0000 7f5b2f7fe640 1 -- 172.21.15.92:0/1506339993 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3006d660 con 0x7f5b301007e0 2024-09-10T10:51:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.842+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b301067f0 0x7f5b3006d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:51:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.842+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b301007e0 0x7f5b300739f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800ba50 tx=0x7f5b2800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.842+0000 7f5b2cff9640 1 -- 172.21.15.92:0/1506339993 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28019070 con 0x7f5b301007e0 2024-09-10T10:51:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.842+0000 7f5b2cff9640 1 -- 172.21.15.92:0/1506339993 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b2800cc10 con 0x7f5b301007e0 2024-09-10T10:51:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.842+0000 7f5b2cff9640 1 -- 172.21.15.92:0/1506339993 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b280076f0 con 0x7f5b301007e0 2024-09-10T10:51:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.842+0000 7f5b34f62640 1 -- 172.21.15.92:0/1506339993 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b30071580 con 0x7f5b301007e0 2024-09-10T10:51:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.842+0000 7f5b34f62640 1 -- 172.21.15.92:0/1506339993 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b30071a80 con 0x7f5b301007e0 2024-09-10T10:51:38.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.846+0000 7f5b2cff9640 1 -- 172.21.15.92:0/1506339993 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5b2801c070 con 0x7f5b301007e0 2024-09-10T10:51:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.847+0000 7f5b2cff9640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f5b180a2d70 0x7f5b180a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.847+0000 7f5b2cff9640 1 -- 172.21.15.92:0/1506339993 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8455+0+0 (secure 0 0 0) 0x7f5b280ce980 con 0x7f5b301007e0 2024-09-10T10:51:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.848+0000 7f5b2effd640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f5b180a2d70 0x7f5b180a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.848+0000 7f5b3903d740 1 Processor -- start 2024-09-10T10:51:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b3903d740 1 -- start start 2024-09-10T10:51:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 0x55999f5ee940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 0x55999f5f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b3903d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55999f5482f0 con 0x55999f5e3cc0 2024-09-10T10:51:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b3903d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55999f4f0270 con 0x55999f5eee80 2024-09-10T10:51:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b3903d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55999f5442b0 con 0x55999f5e45e0 2024-09-10T10:51:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b2f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b2f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5e40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45914/0 (socket says 172.21.15.92:45914) 2024-09-10T10:51:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b2f7fe640 1 -- 172.21.15.92:0/2991874540 learned_addr learned my addr 172.21.15.92:0/2991874540 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/2991874540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 0x55999f5f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.849+0000 7f5b2effd640 1 --2- 172.21.15.92:0/2991874540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 0x55999f5ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.850+0000 7f5b2effd640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f5b180a2d70 0x7f5b180a5230 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011ed0 tx=0x7f5b24000bc0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.850+0000 7f5b2ffff640 1 -- 172.21.15.92:0/2991874540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 msgr2=0x55999f5ee940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.850+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/2991874540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 0x55999f5ee940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.850+0000 7f5b2ffff640 1 -- 172.21.15.92:0/2991874540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 msgr2=0x55999f5e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.850+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/2991874540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.850+0000 7f5b2ffff640 1 -- 172.21.15.92:0/2991874540 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999f4ef340 con 0x55999f5eee80 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.850+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/2991874540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 0x55999f5f1270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000a850 tx=0x7f5b2000ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e7015a5677b7ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.850+0000 7f5b15ffb640 1 -- 172.21.15.92:0/2991874540 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b20015070 con 0x55999f5eee80 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.850+0000 7f5b15ffb640 1 -- 172.21.15.92:0/2991874540 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b2000cb40 con 0x55999f5eee80 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b15ffb640 1 -- 172.21.15.92:0/2991874540 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b200185c0 con 0x55999f5eee80 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b3903d740 1 -- 172.21.15.92:0/2991874540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 msgr2=0x55999f5f1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b3903d740 1 --2- 172.21.15.92:0/2991874540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 0x55999f5f1270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000a850 tx=0x7f5b2000ad10 comp rx=0 tx=0).stop 2024-09-10T10:51:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b3903d740 1 -- 172.21.15.92:0/2991874540 shutdown_connections 2024-09-10T10:51:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b3903d740 1 --2- 172.21.15.92:0/2991874540 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 0x55999f5f1270 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b3903d740 1 --2- 172.21.15.92:0/2991874540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 0x55999f5ee940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b3903d740 1 --2- 172.21.15.92:0/2991874540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b3903d740 1 -- 172.21.15.92:0/2991874540 >> 172.21.15.92:0/2991874540 conn(0x55999f5e0230 msgr2=0x55999f5e0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b3903d740 1 -- 172.21.15.92:0/2991874540 shutdown_connections 2024-09-10T10:51:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.851+0000 7f5b3903d740 1 -- 172.21.15.92:0/2991874540 wait complete. 2024-09-10T10:51:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.852+0000 7f5b3903d740 1 -- start start 2024-09-10T10:51:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.852+0000 7f5b3903d740 1 Processor -- start 2024-09-10T10:51:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5ebc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5ec1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5eee80 0x55999f5ec710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b3903d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55999f5f1af0 con 0x55999f5e3cc0 2024-09-10T10:51:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b3903d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55999f4d1290 con 0x55999f5e45e0 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b3903d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55999f5f1c70 con 0x55999f5eee80 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b3903d740 10 client.0 _ll_register_callbacks cb 0x55999f502140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5ec1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5ec1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:40090/0 (socket says 172.21.15.92:40090) 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.854+0000 7f5b2effd640 1 -- 172.21.15.92:0/3118486172 learned_addr learned my addr 172.21.15.92:0/3118486172 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5eee80 0x55999f5ec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b2effd640 1 -- 172.21.15.92:0/3118486172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5eee80 msgr2=0x55999f5ec710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b2effd640 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5eee80 0x55999f5ec710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b2effd640 1 -- 172.21.15.92:0/3118486172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 msgr2=0x55999f5ebc90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b2effd640 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5ebc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b2effd640 1 -- 172.21.15.92:0/3118486172 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55999f25b210 con 0x55999f5e45e0 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b2effd640 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5ec1d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5b24013150 tx=0x7f5b24011a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=208608517d007f12 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b0effd640 10 client.0 ms_handle_connect on v2:172.21.15.97:3300/0 2024-09-10T10:51:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b0effd640 1 -- 172.21.15.92:0/3118486172 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24004c50 con 0x55999f5e45e0 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b3903d740 1 -- 172.21.15.92:0/3118486172 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b2000cb40 con 0x55999f5e45e0 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.855+0000 7f5b0effd640 1 -- 172.21.15.92:0/3118486172 <== mon.2 v2:172.21.15.97:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8455+0+0 (secure 0 0 0) 0x7f5b24004020 con 0x55999f5e45e0 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b0effd640 1 -- 172.21.15.92:0/3118486172 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f5b24004220 con 0x55999f5e45e0 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b3903d740 10 client.25937 fetch_fsmap learned FSMap version 66 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b3903d740 1 -- 172.21.15.92:0/3118486172 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55999f327620 con 0x55999f5e45e0 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b0effd640 1 -- 172.21.15.92:0/3118486172 <== mon.2 v2:172.21.15.97:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b2000cb40 con 0x55999f5e45e0 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b0effd640 1 -- 172.21.15.92:0/3118486172 <== mon.2 v2:172.21.15.97:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f5b24004ed0 con 0x55999f5e45e0 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b3903d740 10 client.25937 fetch_fsmap finished waiting for FSMap version 66 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b3903d740 10 client.25937 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b3903d740 20 client.25937 populate_metadata read hostname 'smithi092' 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55999f5ff2d0 0x55999f601790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b3903d740 4 client.25937 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.856+0000 7f5b3903d740 1 -- 172.21.15.92:0/3118486172 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55999f555a20 con 0x55999f5ff2d0 2024-09-10T10:51:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.857+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55999f5ff2d0 0x55999f601790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.857+0000 7f5b0effd640 10 client.25937 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:38.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.857+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55999f5ff2d0 0x55999f601790 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc1ac94414f62be server_cookie=3e09c39deded289b in_seq=0 out_seq=0 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.858+0000 7f5b0effd640 1 -- 172.21.15.92:0/3118486172 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55999f555a20 con 0x55999f5ff2d0 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.858+0000 7f5b0effd640 10 client.25937 handle_command_reply: tid=0 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.858+0000 7f5b3903d740 1 client.25937 shutdown 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.859+0000 7f5b3903d740 1 -- 172.21.15.92:0/3118486172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 msgr2=0x55999f5ec1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.859+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5ec1d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5b24013150 tx=0x7f5b24011a70 comp rx=0 tx=0).stop 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b3903d740 1 -- 172.21.15.92:0/3118486172 shutdown_connections 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5eee80 0x55999f5ec710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55999f5ff2d0 0x55999f601790 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5ec1d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3118486172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5ebc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b0effd640 0 client.25937 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b3903d740 1 -- 172.21.15.92:0/3118486172 >> 172.21.15.92:0/3118486172 conn(0x55999f5e0230 msgr2=0x55999f5e5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:38.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b3903d740 1 -- 172.21.15.92:0/3118486172 shutdown_connections 2024-09-10T10:51:38.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b3903d740 1 -- 172.21.15.92:0/3118486172 wait complete. 2024-09-10T10:51:38.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.860+0000 7f5b3903d740 20 client.25937 trim_cache size 0 max 16384 2024-09-10T10:51:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.894+0000 7f5b3903d740 1 Processor -- start 2024-09-10T10:51:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.899+0000 7f5b3903d740 1 -- start start 2024-09-10T10:51:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.899+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5ec540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.899+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 0x55999f6070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.899+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 0x55999f6075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.900+0000 7f5b3903d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3019cc80 con 0x55999f5e3cc0 2024-09-10T10:51:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.900+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 0x55999f6070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.900+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 0x55999f6070a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:53468/0 (socket says 172.21.15.92:53468) 2024-09-10T10:51:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.900+0000 7f5b2effd640 1 -- 172.21.15.92:0/3147305987 learned_addr learned my addr 172.21.15.92:0/3147305987 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.900+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/3147305987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 0x55999f6075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.900+0000 7f5b3903d740 1 -- 172.21.15.92:0/3147305987 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3019e850 con 0x55999f5eee80 2024-09-10T10:51:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.900+0000 7f5b3903d740 1 -- 172.21.15.92:0/3147305987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3019d350 con 0x55999f5e45e0 2024-09-10T10:51:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.902+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/3147305987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5ec540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.903+0000 7f5b2f7fe640 1 -- 172.21.15.92:0/3147305987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 msgr2=0x55999f6070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.903+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/3147305987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 0x55999f6070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.903+0000 7f5b2f7fe640 1 -- 172.21.15.92:0/3147305987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 msgr2=0x55999f6075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.903+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/3147305987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 0x55999f6075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.903+0000 7f5b2f7fe640 1 -- 172.21.15.92:0/3147305987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999f5de7b0 con 0x55999f5e3cc0 2024-09-10T10:51:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.903+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/3147305987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5ec540 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5b280979c0 tx=0x7f5b28009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9620a6d41d441a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.906+0000 7f5b157fa640 1 -- 172.21.15.92:0/3147305987 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28099090 con 0x55999f5e3cc0 2024-09-10T10:51:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.906+0000 7f5b157fa640 1 -- 172.21.15.92:0/3147305987 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b280992f0 con 0x55999f5e3cc0 2024-09-10T10:51:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.907+0000 7f5b3903d740 1 -- 172.21.15.92:0/3147305987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 msgr2=0x55999f5ec540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.907+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3147305987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5ec540 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5b280979c0 tx=0x7f5b28009470 comp rx=0 tx=0).stop 2024-09-10T10:51:38.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.914+0000 7f5b3903d740 1 -- 172.21.15.92:0/3147305987 shutdown_connections 2024-09-10T10:51:38.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.914+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3147305987 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5eee80 0x55999f6075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.914+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3147305987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e45e0 0x55999f6070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.914+0000 7f5b3903d740 1 --2- 172.21.15.92:0/3147305987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5e3cc0 0x55999f5ec540 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.914+0000 7f5b3903d740 1 -- 172.21.15.92:0/3147305987 >> 172.21.15.92:0/3147305987 conn(0x55999f5e0230 msgr2=0x55999f5ead60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:38.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.917+0000 7f5b3903d740 1 -- 172.21.15.92:0/3147305987 shutdown_connections 2024-09-10T10:51:38.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.921+0000 7f5b3903d740 1 -- 172.21.15.92:0/3147305987 wait complete. 2024-09-10T10:51:38.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.921+0000 7f5b3903d740 1 -- start start 2024-09-10T10:51:38.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.921+0000 7f5b3903d740 1 Processor -- start 2024-09-10T10:51:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e3cc0 0x55999f5eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5eb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b3903d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5eee80 0x55999f5f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b3903d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3019e180 con 0x55999f5eee80 2024-09-10T10:51:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b3903d740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3019da20 con 0x55999f5e45e0 2024-09-10T10:51:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b3903d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3019ac80 con 0x55999f5e3cc0 2024-09-10T10:51:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b3903d740 10 client.0 _ll_register_callbacks cb 0x7f5b240115f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:51:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5eb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b2effd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5eb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:40108/0 (socket says 172.21.15.92:40108) 2024-09-10T10:51:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.925+0000 7f5b2effd640 1 -- 172.21.15.92:0/566521023 learned_addr learned my addr 172.21.15.92:0/566521023 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:38.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.926+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5eee80 0x55999f5f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.928+0000 7f5b2ffff640 1 -- 172.21.15.92:0/566521023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e3cc0 msgr2=0x55999f5eb090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:51:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.928+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e3cc0 0x55999f5eb090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.928+0000 7f5b2ffff640 1 -- 172.21.15.92:0/566521023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 msgr2=0x55999f5eb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:38.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.928+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5eb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.928+0000 7f5b2ffff640 1 -- 172.21.15.92:0/566521023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55999f5f6490 con 0x55999f5eee80 2024-09-10T10:51:38.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.930+0000 7f5b2effd640 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5eb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:51:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.937+0000 7f5b2ffff640 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5eee80 0x55999f5f5f50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5b20011c30 tx=0x7f5b20011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1431710f234cedf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:38.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.937+0000 7f5b0effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:51:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.943+0000 7f5b0effd640 1 -- 172.21.15.92:0/566521023 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b20015040 con 0x55999f5eee80 2024-09-10T10:51:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.943+0000 7f5b3903d740 1 -- 172.21.15.92:0/566521023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b280992f0 con 0x55999f5eee80 2024-09-10T10:51:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.943+0000 7f5b0effd640 1 -- 172.21.15.92:0/566521023 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8455+0+0 (secure 0 0 0) 0x7f5b20004250 con 0x55999f5eee80 2024-09-10T10:51:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.944+0000 7f5b0effd640 1 -- 172.21.15.92:0/566521023 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f5b20004450 con 0x55999f5eee80 2024-09-10T10:51:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.945+0000 7f5b3903d740 10 client.16446 fetch_fsmap learned FSMap version 66 2024-09-10T10:51:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.945+0000 7f5b3903d740 1 -- 172.21.15.92:0/566521023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55999f5f77a0 con 0x55999f5eee80 2024-09-10T10:51:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.951+0000 7f5b0effd640 1 -- 172.21.15.92:0/566521023 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b280992f0 con 0x55999f5eee80 2024-09-10T10:51:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.952+0000 7f5b0effd640 1 -- 172.21.15.92:0/566521023 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f5b20003a00 con 0x55999f5eee80 2024-09-10T10:51:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.953+0000 7f5b3903d740 10 client.16446 fetch_fsmap finished waiting for FSMap version 66 2024-09-10T10:51:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.953+0000 7f5b3903d740 10 client.16446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:51:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.953+0000 7f5b3903d740 20 client.16446 populate_metadata read hostname 'smithi092' 2024-09-10T10:51:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.953+0000 7f5b3903d740 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55999f66a070 0x55999f66c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.953+0000 7f5b3903d740 4 client.16446 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:51:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.953+0000 7f5b3903d740 1 -- 172.21.15.92:0/566521023 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55999f54fd70 con 0x55999f66a070 2024-09-10T10:51:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.963+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55999f66a070 0x55999f66c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.963+0000 7f5b2f7fe640 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55999f66a070 0x55999f66c460 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52b87ec052328098 server_cookie=8b3efe35fc4d77fc in_seq=0 out_seq=0 2024-09-10T10:51:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.963+0000 7f5b0effd640 10 client.16446 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.997+0000 7f5b0effd640 1 -- 172.21.15.92:0/566521023 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55999f54fd70 con 0x55999f66a070 2024-09-10T10:51:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.997+0000 7f5b0effd640 10 client.16446 handle_command_reply: tid=0 2024-09-10T10:51:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.997+0000 7f5b3903d740 1 client.16446 shutdown 2024-09-10T10:51:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 -- 172.21.15.92:0/566521023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5eee80 msgr2=0x55999f5f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5eee80 0x55999f5f5f50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5b20011c30 tx=0x7f5b20011cc0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 -- 172.21.15.92:0/566521023 shutdown_connections 2024-09-10T10:51:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55999f5eee80 0x55999f5f5f50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55999f66a070 0x55999f66c460 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55999f5e45e0 0x55999f5eb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 --2- 172.21.15.92:0/566521023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55999f5e3cc0 0x55999f5eb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 -- 172.21.15.92:0/566521023 >> 172.21.15.92:0/566521023 conn(0x55999f5e0230 msgr2=0x55999f5dea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b0effd640 0 client.16446 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 -- 172.21.15.92:0/566521023 shutdown_connections 2024-09-10T10:51:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 1 -- 172.21.15.92:0/566521023 wait complete. 2024-09-10T10:51:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:38.998+0000 7f5b3903d740 20 client.16446 trim_cache size 0 max 16384 2024-09-10T10:51:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:51:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:51:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:51:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:51:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 -- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f5b180a2d70 msgr2=0x7f5b180a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f5b180a2d70 0x7f5b180a5230 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011ed0 tx=0x7f5b24000bc0 comp rx=0 tx=0).stop 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 -- 172.21.15.92:0/1506339993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b301007e0 msgr2=0x7f5b300739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b301007e0 0x7f5b300739f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800ba50 tx=0x7f5b2800bf10 comp rx=0 tx=0).stop 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 -- 172.21.15.92:0/1506339993 shutdown_connections 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b301067f0 0x7f5b3006d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b30101180 0x7f5b3006cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f5b180a2d70 0x7f5b180a5230 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 --2- 172.21.15.92:0/1506339993 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f5b301007e0 0x7f5b300739f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 -- 172.21.15.92:0/1506339993 >> 172.21.15.92:0/1506339993 conn(0x7f5b300fc4e0 msgr2=0x7f5b301042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 -- 172.21.15.92:0/1506339993 shutdown_connections 2024-09-10T10:51:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:39.000+0000 7f5b34f62640 1 -- 172.21.15.92:0/1506339993 wait complete. 2024-09-10T10:51:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:39 smithi121 ceph-mon[35231]: pgmap v472: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-09-10T10:51:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:39 smithi097 ceph-mon[35213]: pgmap v472: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-09-10T10:51:40.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:39 smithi092 ceph-mon[30834]: pgmap v472: 97 pgs: 97 active+clean; 4.6 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-09-10T10:51:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:41 smithi121 ceph-mon[35231]: pgmap v473: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2024-09-10T10:51:42.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:41 smithi097 ceph-mon[35213]: pgmap v473: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2024-09-10T10:51:42.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:41 smithi092 ceph-mon[30834]: pgmap v473: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2024-09-10T10:51:43.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 885.0 s, 1665.4 tps, lat 60.601 ms stddev 72.337 2024-09-10T10:51:44.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:43 smithi121 ceph-mon[35231]: pgmap v474: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 18 MiB/s wr, 1.38k op/s 2024-09-10T10:51:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:43 smithi097 ceph-mon[35213]: pgmap v474: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 18 MiB/s wr, 1.38k op/s 2024-09-10T10:51:44.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:43 smithi092 ceph-mon[30834]: pgmap v474: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 18 MiB/s wr, 1.38k op/s 2024-09-10T10:51:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:45 smithi121 ceph-mon[35231]: pgmap v475: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 MiB/s wr, 1.30k op/s 2024-09-10T10:51:46.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:45 smithi097 ceph-mon[35213]: pgmap v475: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 MiB/s wr, 1.30k op/s 2024-09-10T10:51:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:45 smithi092 ceph-mon[30834]: pgmap v475: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 18 MiB/s wr, 1.30k op/s 2024-09-10T10:51:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:46 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:46 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:47.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:46 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:47 smithi121 ceph-mon[35231]: pgmap v476: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 28 MiB/s wr, 1.95k op/s 2024-09-10T10:51:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:47 smithi097 ceph-mon[35213]: pgmap v476: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 28 MiB/s wr, 1.95k op/s 2024-09-10T10:51:48.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:47 smithi092 ceph-mon[30834]: pgmap v476: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 28 MiB/s wr, 1.95k op/s 2024-09-10T10:51:48.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 890.0 s, 1426.0 tps, lat 70.340 ms stddev 96.967 2024-09-10T10:51:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:49 smithi121 ceph-mon[35231]: pgmap v477: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 1.04k op/s 2024-09-10T10:51:50.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:49 smithi097 ceph-mon[35213]: pgmap v477: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 1.04k op/s 2024-09-10T10:51:50.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:49 smithi092 ceph-mon[30834]: pgmap v477: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 17 MiB/s wr, 1.04k op/s 2024-09-10T10:51:52.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:51 smithi097 ceph-mon[35213]: pgmap v478: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 21 MiB/s wr, 1.25k op/s 2024-09-10T10:51:52.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:51 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:52.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:51 smithi092 ceph-mon[30834]: pgmap v478: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 21 MiB/s wr, 1.25k op/s 2024-09-10T10:51:52.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:51 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:52.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.116+0000 7f7fd3023640 1 -- 172.21.15.92:0/1823512207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc105ec0 msgr2=0x7f7fcc106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:52.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.116+0000 7f7fd3023640 1 --2- 172.21.15.92:0/1823512207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc105ec0 0x7f7fcc106370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009900 tx=0x7f7fc002a490 comp rx=0 tx=0).stop 2024-09-10T10:51:52.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.116+0000 7f7fd3023640 1 -- 172.21.15.92:0/1823512207 shutdown_connections 2024-09-10T10:51:52.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.117+0000 7f7fd3023640 1 --2- 172.21.15.92:0/1823512207 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc105ec0 0x7f7fcc106370 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.117+0000 7f7fd3023640 1 --2- 172.21.15.92:0/1823512207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fcc1013b0 0x7f7fcc105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.117+0000 7f7fd3023640 1 --2- 172.21.15.92:0/1823512207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fcc100a90 0x7f7fcc100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.117+0000 7f7fd3023640 1 -- 172.21.15.92:0/1823512207 >> 172.21.15.92:0/1823512207 conn(0x7f7fcc0fc6f0 msgr2=0x7f7fcc0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:52.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.117+0000 7f7fd3023640 1 -- 172.21.15.92:0/1823512207 shutdown_connections 2024-09-10T10:51:52.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.117+0000 7f7fd3023640 1 -- 172.21.15.92:0/1823512207 wait complete. 2024-09-10T10:51:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.117+0000 7f7fd3023640 1 Processor -- start 2024-09-10T10:51:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.117+0000 7f7fd3023640 1 -- start start 2024-09-10T10:51:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd3023640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fcc100a90 0x7f7fcc1a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd3023640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc1013b0 0x7f7fcc1a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd3023640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fcc105ec0 0x7f7fcc19e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd3023640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc118520 con 0x7f7fcc105ec0 2024-09-10T10:51:52.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd3023640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1183a0 con 0x7f7fcc1013b0 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd3023640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1186a0 con 0x7f7fcc100a90 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd15c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fcc105ec0 0x7f7fcc19e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc1013b0 0x7f7fcc1a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc1013b0 0x7f7fcc1a4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:55426/0 (socket says 172.21.15.92:55426) 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3070891229 learned_addr learned my addr 172.21.15.92:0/3070891229 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fcc100a90 0x7f7fcc1a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd15c0640 1 -- 172.21.15.92:0/3070891229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fcc100a90 msgr2=0x7f7fcc1a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd15c0640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fcc100a90 0x7f7fcc1a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd15c0640 1 -- 172.21.15.92:0/3070891229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc1013b0 msgr2=0x7f7fcc1a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd15c0640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc1013b0 0x7f7fcc1a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd15c0640 1 -- 172.21.15.92:0/3070891229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc19efb0 con 0x7f7fcc105ec0 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc1013b0 0x7f7fcc1a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fd15c0640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fcc105ec0 0x7f7fcc19e6f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7fc002a9b0 tx=0x7f7fc0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:52.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.118+0000 7f7fc9ffb640 1 -- 172.21.15.92:0/3070891229 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc003f070 con 0x7f7fcc105ec0 2024-09-10T10:51:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.119+0000 7f7fd3023640 1 -- 172.21.15.92:0/3070891229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc19f240 con 0x7f7fcc105ec0 2024-09-10T10:51:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.119+0000 7f7fc9ffb640 1 -- 172.21.15.92:0/3070891229 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fc0031c20 con 0x7f7fcc105ec0 2024-09-10T10:51:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.119+0000 7f7fd3023640 1 -- 172.21.15.92:0/3070891229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc1ab5b0 con 0x7f7fcc105ec0 2024-09-10T10:51:52.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.119+0000 7f7fc9ffb640 1 -- 172.21.15.92:0/3070891229 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0049060 con 0x7f7fcc105ec0 2024-09-10T10:51:52.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.122+0000 7f7fc9ffb640 1 -- 172.21.15.92:0/3070891229 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7fc0042070 con 0x7f7fcc105ec0 2024-09-10T10:51:52.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.123+0000 7f7fc9ffb640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7fb40a2da0 0x7f7fb40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.123+0000 7f7fc9ffb640 1 -- 172.21.15.92:0/3070891229 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8455+0+0 (secure 0 0 0) 0x7f7fc00ef970 con 0x7f7fcc105ec0 2024-09-10T10:51:52.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7fb40a2da0 0x7f7fb40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd5dbd740 1 Processor -- start 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd5dbd740 1 -- start start 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5de1410 0x55dac5deb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5debcb0 0x55dac5dee0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dac5d452f0 con 0x55dac5de0af0 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dac5ced270 con 0x55dac5debcb0 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dac5d412b0 con 0x55dac5de1410 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.124+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7fb40a2da0 0x7f7fb40a5260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4005fd0 tx=0x7f7fc4009500 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5de1410 0x55dac5deb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5de1410 0x55dac5deb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:35806/0 (socket says 172.21.15.92:35806) 2024-09-10T10:51:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fd0dbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fcbfff640 1 -- 172.21.15.92:0/413955999 learned_addr learned my addr 172.21.15.92:0/413955999 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fd15c0640 1 --2- 172.21.15.92:0/413955999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5debcb0 0x55dac5dee0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fcbfff640 1 -- 172.21.15.92:0/413955999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5debcb0 msgr2=0x55dac5dee0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/413955999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5debcb0 0x55dac5dee0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fcbfff640 1 -- 172.21.15.92:0/413955999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 msgr2=0x55dac5de0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/413955999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fcbfff640 1 -- 172.21.15.92:0/413955999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac5cec340 con 0x55dac5de1410 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/413955999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5de1410 0x55dac5deb770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc010500 tx=0x7f7fbc0109c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4674db1e2a0ffa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fb2ffd640 1 -- 172.21.15.92:0/413955999 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc011760 con 0x55dac5de1410 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fb2ffd640 1 -- 172.21.15.92:0/413955999 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fbc011de0 con 0x55dac5de1410 2024-09-10T10:51:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.125+0000 7f7fb2ffd640 1 -- 172.21.15.92:0/413955999 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0193d0 con 0x55dac5de1410 2024-09-10T10:51:52.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/413955999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5de1410 msgr2=0x55dac5deb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:52.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/413955999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5de1410 0x55dac5deb770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc010500 tx=0x7f7fbc0109c0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/413955999 shutdown_connections 2024-09-10T10:51:52.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/413955999 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5debcb0 0x55dac5dee0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/413955999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5de1410 0x55dac5deb770 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/413955999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/413955999 >> 172.21.15.92:0/413955999 conn(0x55dac5ddd060 msgr2=0x55dac5ddd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/413955999 shutdown_connections 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/413955999 wait complete. 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.126+0000 7f7fd5dbd740 1 -- start start 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd5dbd740 1 Processor -- start 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5de95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dac5dee880 con 0x55dac5de0af0 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55dac5cce290 con 0x55dac5de1410 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dac5deea00 con 0x55dac5debcb0 2024-09-10T10:51:52.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd5dbd740 10 client.0 _ll_register_callbacks cb 0x55dac5cff140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd0dbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd0dbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42974/0 (socket says 172.21.15.92:42974) 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd0dbf640 1 -- 172.21.15.92:0/3304297358 learned_addr learned my addr 172.21.15.92:0/3304297358 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd15c0640 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5de95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd0dbf640 1 -- 172.21.15.92:0/3304297358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 msgr2=0x55dac5de95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5de95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd0dbf640 1 -- 172.21.15.92:0/3304297358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 msgr2=0x55dac5de9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.127+0000 7f7fd0dbf640 1 -- 172.21.15.92:0/3304297358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac5a58210 con 0x55dac5de0af0 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de8b30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40042f0 tx=0x7f7fc4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf6f850ca79110e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fabfff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-10T10:51:52.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fabfff640 1 -- 172.21.15.92:0/3304297358 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc401eb40 con 0x55dac5de0af0 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3304297358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fbc011de0 con 0x55dac5de0af0 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fabfff640 1 -- 172.21.15.92:0/3304297358 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8455+0+0 (secure 0 0 0) 0x7f7fc401ece0 con 0x55dac5de0af0 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fabfff640 1 -- 172.21.15.92:0/3304297358 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f7fc401b440 con 0x55dac5de0af0 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd5dbd740 10 client.16458 fetch_fsmap learned FSMap version 68 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3304297358 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x55dac5b24620 con 0x55dac5de0af0 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fabfff640 1 -- 172.21.15.92:0/3304297358 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fbc011de0 con 0x55dac5de0af0 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fabfff640 1 -- 172.21.15.92:0/3304297358 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 68) ==== 8398+0+0 (secure 0 0 0) 0x7f7fc4028560 con 0x55dac5de0af0 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd5dbd740 10 client.16458 fetch_fsmap finished waiting for FSMap version 68 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd5dbd740 10 client.16458 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd5dbd740 20 client.16458 populate_metadata read hostname 'smithi092' 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dac5dfbca0 0x55dac5dfe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd5dbd740 4 client.16458 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:51:52.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.128+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3304297358 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dac5d52a20 con 0x55dac5dfbca0 2024-09-10T10:51:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.129+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dac5dfbca0 0x55dac5dfe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.130+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dac5dfbca0 0x55dac5dfe0f0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3921aba2be90c405 server_cookie=f85af80e5740fdd in_seq=0 out_seq=0 2024-09-10T10:51:52.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.130+0000 7f7fabfff640 10 client.16458 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.130+0000 7f7fabfff640 1 -- 172.21.15.92:0/3304297358 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dac5d52a20 con 0x55dac5dfbca0 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.130+0000 7f7fabfff640 10 client.16458 handle_command_reply: tid=0 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.130+0000 7f7fd5dbd740 1 client.16458 shutdown 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.131+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3304297358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 msgr2=0x55dac5de8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.131+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de8b30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40042f0 tx=0x7f7fc4004ab0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.131+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3304297358 shutdown_connections 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.131+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5de95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.131+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dac5dfbca0 0x55dac5dfe0f0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.131+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.131+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3304297358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de8b30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.131+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3304297358 >> 172.21.15.92:0/3304297358 conn(0x55dac5ddd060 msgr2=0x55dac5ddc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.132+0000 7f7fabfff640 0 client.16458 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.132+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3304297358 shutdown_connections 2024-09-10T10:51:52.136 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.132+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3304297358 wait complete. 2024-09-10T10:51:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.132+0000 7f7fd5dbd740 20 client.16458 trim_cache size 0 max 16384 2024-09-10T10:51:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.151+0000 7f7fd5dbd740 1 Processor -- start 2024-09-10T10:51:52.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.151+0000 7f7fd5dbd740 1 -- start start 2024-09-10T10:51:52.153 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.151+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.151+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.151+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5deaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.151+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1b3cd0 con 0x55dac5de0af0 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.151+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1b5960 con 0x55dac5de1410 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.151+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1b4460 con 0x55dac5debcb0 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:55452/0 (socket says 172.21.15.92:55452) 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3334980027 learned_addr learned my addr 172.21.15.92:0/3334980027 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/3334980027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fd15c0640 1 --2- 172.21.15.92:0/3334980027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5deaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3334980027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 msgr2=0x55dac5deaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/3334980027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5deaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3334980027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 msgr2=0x55dac5de3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/3334980027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fcbfff640 1 -- 172.21.15.92:0/3334980027 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac5ddce90 con 0x55dac5de1410 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.152+0000 7f7fcbfff640 1 --2- 172.21.15.92:0/3334980027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de93e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc010500 tx=0x7f7fbc00e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d22ce1e9baff6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.153+0000 7f7fb27fc640 1 -- 172.21.15.92:0/3334980027 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc02b070 con 0x55dac5de1410 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.153+0000 7f7fb27fc640 1 -- 172.21.15.92:0/3334980027 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fbc00bb90 con 0x55dac5de1410 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.153+0000 7f7fb27fc640 1 -- 172.21.15.92:0/3334980027 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc005620 con 0x55dac5de1410 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3334980027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 msgr2=0x55dac5de93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3334980027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de93e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc010500 tx=0x7f7fbc00e350 comp rx=0 tx=0).stop 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3334980027 shutdown_connections 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3334980027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5deaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3334980027 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de93e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/3334980027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3334980027 >> 172.21.15.92:0/3334980027 conn(0x55dac5ddd060 msgr2=0x55dac5dea390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3334980027 shutdown_connections 2024-09-10T10:51:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/3334980027 wait complete. 2024-09-10T10:51:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.154+0000 7f7fd5dbd740 1 -- start start 2024-09-10T10:51:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd5dbd740 1 Processor -- start 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd5dbd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5df2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1b5290 con 0x55dac5de0af0 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1b4b30 con 0x55dac5de1410 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd5dbd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc1b1cd0 con 0x55dac5debcb0 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd5dbd740 10 client.0 _ll_register_callbacks cb 0x7f7fc4003b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd0dbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd0dbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42994/0 (socket says 172.21.15.92:42994) 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd15c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5df2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fcbfff640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:55458/0 (socket says 172.21.15.92:55458) 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd0dbf640 1 -- 172.21.15.92:0/2656138990 learned_addr learned my addr 172.21.15.92:0/2656138990 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd15c0640 1 -- 172.21.15.92:0/2656138990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 msgr2=0x55dac5de5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.155+0000 7f7fd15c0640 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd15c0640 1 -- 172.21.15.92:0/2656138990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 msgr2=0x55dac5de5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd15c0640 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd15c0640 1 -- 172.21.15.92:0/2656138990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac5dd82d0 con 0x55dac5debcb0 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd15c0640 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5df2c90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00ed100 tx=0x7f7fc0005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=526c329a312cc9a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fabfff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fabfff640 1 -- 172.21.15.92:0/2656138990 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00c4b40 con 0x55dac5debcb0 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fabfff640 1 -- 172.21.15.92:0/2656138990 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8455+0+0 (secure 0 0 0) 0x7f7fc00ed380 con 0x55dac5debcb0 2024-09-10T10:51:52.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/2656138990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fbc00bb90 con 0x55dac5debcb0 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fabfff640 1 -- 172.21.15.92:0/2656138990 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f7fc00b85f0 con 0x55dac5debcb0 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd5dbd740 10 client.25969 fetch_fsmap learned FSMap version 68 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/2656138990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x55dac5df44d0 con 0x55dac5debcb0 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fabfff640 1 -- 172.21.15.92:0/2656138990 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fbc00bb90 con 0x55dac5debcb0 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fabfff640 1 -- 172.21.15.92:0/2656138990 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 68) ==== 8398+0+0 (secure 0 0 0) 0x7f7fc00bb460 con 0x55dac5debcb0 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd5dbd740 10 client.25969 fetch_fsmap finished waiting for FSMap version 68 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd5dbd740 10 client.25969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd5dbd740 20 client.25969 populate_metadata read hostname 'smithi092' 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dac5e66c00 0x55dac5e69020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd5dbd740 4 client.25969 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.156+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/2656138990 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dac5d4cd70 con 0x55dac5e66c00 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.157+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dac5e66c00 0x55dac5e69020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:51:52.162 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.157+0000 7f7fabfff640 10 client.25969 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:52.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.157+0000 7f7fd0dbf640 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dac5e66c00 0x55dac5e69020 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dacf9fdf7ee93c server_cookie=38673eec230bf305 in_seq=0 out_seq=0 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.169+0000 7f7fabfff640 1 -- 172.21.15.92:0/2656138990 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dac5d4cd70 con 0x55dac5e66c00 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.169+0000 7f7fabfff640 10 client.25969 handle_command_reply: tid=0 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 client.25969 shutdown 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/2656138990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 msgr2=0x55dac5df2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5df2c90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00ed100 tx=0x7f7fc0005d50 comp rx=0 tx=0).stop 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/2656138990 shutdown_connections 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dac5debcb0 0x55dac5df2c90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55dac5e66c00 0x55dac5e69020 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55dac5de1410 0x55dac5de5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 --2- 172.21.15.92:0/2656138990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dac5de0af0 0x55dac5de5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/2656138990 >> 172.21.15.92:0/2656138990 conn(0x55dac5ddd060 msgr2=0x55dac5ddc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fabfff640 0 client.25969 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:51:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/2656138990 shutdown_connections 2024-09-10T10:51:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 1 -- 172.21.15.92:0/2656138990 wait complete. 2024-09-10T10:51:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.170+0000 7f7fd5dbd740 20 client.25969 trim_cache size 0 max 16384 2024-09-10T10:51:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:51:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:51:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:51:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:51:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 -- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7fb40a2da0 msgr2=0x7f7fb40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7fb40a2da0 0x7f7fb40a5260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4005fd0 tx=0x7f7fc4009500 comp rx=0 tx=0).stop 2024-09-10T10:51:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 -- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fcc105ec0 msgr2=0x7f7fcc19e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:51:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fcc105ec0 0x7f7fcc19e6f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7fc002a9b0 tx=0x7f7fc0003b90 comp rx=0 tx=0).stop 2024-09-10T10:51:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 -- 172.21.15.92:0/3070891229 shutdown_connections 2024-09-10T10:51:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7fcc105ec0 0x7f7fcc19e6f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f7fb40a2da0 0x7f7fb40a5260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f7fcc1013b0 0x7f7fcc1a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 --2- 172.21.15.92:0/3070891229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7fcc100a90 0x7f7fcc1a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:51:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 -- 172.21.15.92:0/3070891229 >> 172.21.15.92:0/3070891229 conn(0x7f7fcc0fc6f0 msgr2=0x7f7fcc103800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:51:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 -- 172.21.15.92:0/3070891229 shutdown_connections 2024-09-10T10:51:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:51:52.171+0000 7f7fd3023640 1 -- 172.21.15.92:0/3070891229 wait complete. 2024-09-10T10:51:52.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:51 smithi121 ceph-mon[35231]: pgmap v478: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 21 MiB/s wr, 1.25k op/s 2024-09-10T10:51:52.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:51 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:51:53.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 895.0 s, 1757.4 tps, lat 56.712 ms stddev 63.886 2024-09-10T10:51:54.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:53 smithi097 ceph-mon[35213]: pgmap v479: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 1.12k op/s 2024-09-10T10:51:54.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:53 smithi092 ceph-mon[30834]: pgmap v479: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 1.12k op/s 2024-09-10T10:51:54.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:53 smithi121 ceph-mon[35231]: pgmap v479: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 1.12k op/s 2024-09-10T10:51:56.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:55 smithi097 ceph-mon[35213]: pgmap v480: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-10T10:51:56.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:55 smithi092 ceph-mon[30834]: pgmap v480: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-10T10:51:56.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:55 smithi121 ceph-mon[35231]: pgmap v480: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-10T10:51:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:57 smithi097 ceph-mon[35213]: pgmap v481: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 21 MiB/s wr, 1.29k op/s 2024-09-10T10:51:58.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:57 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:51:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:57 smithi092 ceph-mon[30834]: pgmap v481: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 21 MiB/s wr, 1.29k op/s 2024-09-10T10:51:58.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:57 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:51:58.152 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 900.0 s, 1373.0 tps, lat 72.453 ms stddev 82.038 2024-09-10T10:51:58.290 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:57 smithi121 ceph-mon[35231]: pgmap v481: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 21 MiB/s wr, 1.29k op/s 2024-09-10T10:51:58.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:57 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T10:51:58.353 INFO:teuthology.orchestra.run.smithi092.stdout:transaction type: 2024-09-10T10:51:58.353 INFO:teuthology.orchestra.run.smithi092.stdout:scaling factor: 32 2024-09-10T10:51:58.353 INFO:teuthology.orchestra.run.smithi092.stdout:query mode: simple 2024-09-10T10:51:58.353 INFO:teuthology.orchestra.run.smithi092.stdout:number of clients: 100 2024-09-10T10:51:58.353 INFO:teuthology.orchestra.run.smithi092.stdout:number of threads: 4 2024-09-10T10:51:58.353 INFO:teuthology.orchestra.run.smithi092.stdout:duration: 900 s 2024-09-10T10:51:58.353 INFO:teuthology.orchestra.run.smithi092.stdout:number of transactions actually processed: 2087935 2024-09-10T10:51:58.353 INFO:teuthology.orchestra.run.smithi092.stdout:latency average = 43.104 ms 2024-09-10T10:51:58.354 INFO:teuthology.orchestra.run.smithi092.stdout:latency stddev = 90.520 ms 2024-09-10T10:51:58.354 INFO:teuthology.orchestra.run.smithi092.stdout:tps = 2319.410156 (including connections establishing) 2024-09-10T10:51:58.354 INFO:teuthology.orchestra.run.smithi092.stdout:tps = 2319.416649 (excluding connections establishing) 2024-09-10T10:51:58.370 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-10T10:51:59.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:58 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:51:59.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:58 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:51:59.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:51:58 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:51:59.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:58 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:51:59.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:58 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:51:59.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:51:58 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:51:59.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:58 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T10:51:59.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:58 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T10:51:59.291 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:51:58 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' 2024-09-10T10:52:00.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:00 smithi121 ceph-mon[35231]: pgmap v482: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 12 MiB/s wr, 637 op/s 2024-09-10T10:52:00.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:00 smithi097 ceph-mon[35213]: pgmap v482: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 12 MiB/s wr, 637 op/s 2024-09-10T10:52:00.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:00 smithi092 ceph-mon[30834]: pgmap v482: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 12 MiB/s wr, 637 op/s 2024-09-10T10:52:02.412 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:02 smithi092 ceph-mon[30834]: pgmap v483: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 16 MiB/s wr, 975 op/s 2024-09-10T10:52:02.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:02 smithi092 ceph-mon[30834]: osdmap e104: 12 total, 12 up, 12 in 2024-09-10T10:52:02.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:02 smithi121 ceph-mon[35231]: pgmap v483: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 16 MiB/s wr, 975 op/s 2024-09-10T10:52:02.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:02 smithi121 ceph-mon[35231]: osdmap e104: 12 total, 12 up, 12 in 2024-09-10T10:52:02.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:02 smithi097 ceph-mon[35213]: pgmap v483: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 16 MiB/s wr, 975 op/s 2024-09-10T10:52:02.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:02 smithi097 ceph-mon[35213]: osdmap e104: 12 total, 12 up, 12 in 2024-09-10T10:52:04.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:04 smithi121 ceph-mon[35231]: pgmap v485: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 19 MiB/s wr, 1.55k op/s 2024-09-10T10:52:04.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:04 smithi097 ceph-mon[35213]: pgmap v485: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 19 MiB/s wr, 1.55k op/s 2024-09-10T10:52:04.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:04 smithi092 ceph-mon[30834]: pgmap v485: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 19 MiB/s wr, 1.55k op/s 2024-09-10T10:52:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.342+0000 7f083b952640 1 -- 172.21.15.92:0/3653474675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08341091f0 msgr2=0x7f0834110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.342+0000 7f083b952640 1 --2- 172.21.15.92:0/3653474675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08341091f0 0x7f0834110250 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0828009890 tx=0x7f082802a3b0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.343+0000 7f083b952640 1 -- 172.21.15.92:0/3653474675 shutdown_connections 2024-09-10T10:52:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.343+0000 7f083b952640 1 --2- 172.21.15.92:0/3653474675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083411b140 0x7f083411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.343+0000 7f083b952640 1 --2- 172.21.15.92:0/3653474675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08341095d0 0x7f0834109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.343+0000 7f083b952640 1 --2- 172.21.15.92:0/3653474675 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f08341091f0 0x7f0834110250 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.343+0000 7f083b952640 1 -- 172.21.15.92:0/3653474675 >> 172.21.15.92:0/3653474675 conn(0x7f083406ce00 msgr2=0x7f083406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:05.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.345+0000 7f083b952640 1 -- 172.21.15.92:0/3653474675 shutdown_connections 2024-09-10T10:52:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.350+0000 7f083b952640 1 -- 172.21.15.92:0/3653474675 wait complete. 2024-09-10T10:52:05.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.350+0000 7f083b952640 1 Processor -- start 2024-09-10T10:52:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f083b952640 1 -- start start 2024-09-10T10:52:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f083b952640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08341091f0 0x7f083411a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f083b952640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08341095d0 0x7f0834114870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f083b952640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f083411b140 0x7f0834114db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f083b952640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0834111330 con 0x7f08341095d0 2024-09-10T10:52:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f083b952640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f08341111b0 con 0x7f083411b140 2024-09-10T10:52:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f083b952640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08341114b0 con 0x7f08341091f0 2024-09-10T10:52:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f08396ee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08341091f0 0x7f083411a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f08396ee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08341091f0 0x7f083411a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:43962/0 (socket says 172.21.15.92:43962) 2024-09-10T10:52:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f08396ee640 1 -- 172.21.15.92:0/3581902524 learned_addr learned my addr 172.21.15.92:0/3581902524 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:05.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.351+0000 7f0839eef640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f083411b140 0x7f0834114db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.352+0000 7f0839eef640 1 -- 172.21.15.92:0/3581902524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08341091f0 msgr2=0x7f083411a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.352+0000 7f0839eef640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08341091f0 0x7f083411a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.352+0000 7f0839eef640 1 -- 172.21.15.92:0/3581902524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08341095d0 msgr2=0x7f0834114870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T10:52:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.352+0000 7f0839eef640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08341095d0 0x7f0834114870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.352+0000 7f0839eef640 1 -- 172.21.15.92:0/3581902524 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08341154e0 con 0x7f083411b140 2024-09-10T10:52:05.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.353+0000 7f0839eef640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f083411b140 0x7f0834114db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f082c005fd0 tx=0x7f082c00ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.358+0000 7f08327fc640 1 -- 172.21.15.92:0/3581902524 <== mon.2 v2:172.21.15.97:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c00ccc0 con 0x7f083411b140 2024-09-10T10:52:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.358+0000 7f08327fc640 1 -- 172.21.15.92:0/3581902524 <== mon.2 v2:172.21.15.97:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f082c0035f0 con 0x7f083411b140 2024-09-10T10:52:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.358+0000 7f08327fc640 1 -- 172.21.15.92:0/3581902524 <== mon.2 v2:172.21.15.97:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c00ce60 con 0x7f083411b140 2024-09-10T10:52:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.359+0000 7f083b952640 1 -- 172.21.15.92:0/3581902524 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08341bc030 con 0x7f083411b140 2024-09-10T10:52:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.359+0000 7f083b952640 1 -- 172.21.15.92:0/3581902524 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08341bc440 con 0x7f083411b140 2024-09-10T10:52:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.365+0000 7f08327fc640 1 -- 172.21.15.92:0/3581902524 <== mon.2 v2:172.21.15.97:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f082c0037a0 con 0x7f083411b140 2024-09-10T10:52:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.366+0000 7f08327fc640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f081c0a2fd0 0x7f081c0a5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.366+0000 7f08396ee640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f081c0a2fd0 0x7f081c0a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.367+0000 7f08327fc640 1 -- 172.21.15.92:0/3581902524 <== mon.2 v2:172.21.15.97:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7f082c0cf590 con 0x7f083411b140 2024-09-10T10:52:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.367+0000 7f08396ee640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f081c0a2fd0 0x7f081c0a5490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f08280095f0 tx=0x7f0828005850 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.375+0000 7f083e7bf740 1 Processor -- start 2024-09-10T10:52:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.375+0000 7f083e7bf740 1 -- start start 2024-09-10T10:52:05.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.376+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fce5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.376+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fcf0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.376+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fcf0cb0 0x55d29fcf30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.376+0000 7f08396ee640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fce5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.376+0000 7f08396ee640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fce5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:45360/0 (socket says 172.21.15.92:45360) 2024-09-10T10:52:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.376+0000 7f0839eef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fcf0cb0 0x55d29fcf30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.376+0000 7f0839eef640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fcf0cb0 0x55d29fcf30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56078/0 (socket says 172.21.15.92:56078) 2024-09-10T10:52:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.377+0000 7f08396ee640 1 -- 172.21.15.92:0/75358280 learned_addr learned my addr 172.21.15.92:0/75358280 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.377+0000 7f083e7bf740 1 -- 172.21.15.92:0/75358280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d29fc4a2f0 con 0x55d29fcf0cb0 2024-09-10T10:52:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.377+0000 7f083e7bf740 1 -- 172.21.15.92:0/75358280 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d29fbf2270 con 0x55d29fce5af0 2024-09-10T10:52:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.377+0000 7f083e7bf740 1 -- 172.21.15.92:0/75358280 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d29fc462b0 con 0x55d29fce6410 2024-09-10T10:52:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.378+0000 7f0838eed640 1 --2- 172.21.15.92:0/75358280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fcf0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.380+0000 7f0839eef640 1 -- 172.21.15.92:0/75358280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 msgr2=0x55d29fcf0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:52:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.380+0000 7f0839eef640 1 --2- 172.21.15.92:0/75358280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fcf0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.380+0000 7f0839eef640 1 -- 172.21.15.92:0/75358280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 msgr2=0x55d29fce5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:52:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.380+0000 7f0839eef640 1 --2- 172.21.15.92:0/75358280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fce5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.380+0000 7f0839eef640 1 -- 172.21.15.92:0/75358280 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29fbf1340 con 0x55d29fcf0cb0 2024-09-10T10:52:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.382+0000 7f0839eef640 1 --2- 172.21.15.92:0/75358280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fcf0cb0 0x55d29fcf30a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f082c0ccc90 tx=0x7f082c09b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371c93bb8ddc6287 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.387+0000 7f081b7fe640 1 -- 172.21.15.92:0/75358280 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0b3020 con 0x55d29fcf0cb0 2024-09-10T10:52:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.387+0000 7f081b7fe640 1 -- 172.21.15.92:0/75358280 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f082c09ba60 con 0x55d29fcf0cb0 2024-09-10T10:52:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.387+0000 7f081b7fe640 1 -- 172.21.15.92:0/75358280 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0ccf10 con 0x55d29fcf0cb0 2024-09-10T10:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.389+0000 7f083e7bf740 1 -- 172.21.15.92:0/75358280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fcf0cb0 msgr2=0x55d29fcf30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.389+0000 7f083e7bf740 1 --2- 172.21.15.92:0/75358280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fcf0cb0 0x55d29fcf30a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f082c0ccc90 tx=0x7f082c09b480 comp rx=0 tx=0).stop 2024-09-10T10:52:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.393+0000 7f083e7bf740 1 -- 172.21.15.92:0/75358280 shutdown_connections 2024-09-10T10:52:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.393+0000 7f083e7bf740 1 --2- 172.21.15.92:0/75358280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fcf0cb0 0x55d29fcf30a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.393+0000 7f083e7bf740 1 --2- 172.21.15.92:0/75358280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fcf0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.393+0000 7f083e7bf740 1 --2- 172.21.15.92:0/75358280 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fce5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.393+0000 7f083e7bf740 1 -- 172.21.15.92:0/75358280 >> 172.21.15.92:0/75358280 conn(0x55d29fce2060 msgr2=0x55d29fce2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.401+0000 7f083e7bf740 1 -- 172.21.15.92:0/75358280 shutdown_connections 2024-09-10T10:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.405+0000 7f083e7bf740 1 -- 172.21.15.92:0/75358280 wait complete. 2024-09-10T10:52:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.405+0000 7f083e7bf740 1 -- start start 2024-09-10T10:52:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.405+0000 7f083e7bf740 1 Processor -- start 2024-09-10T10:52:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.406+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fcedc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.406+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce6410 0x55d29fcee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.406+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fcee700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.407+0000 7f08396ee640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fcedc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.407+0000 7f08396ee640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fcedc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.97:3300/0 says I am v2:172.21.15.92:45368/0 (socket says 172.21.15.92:45368) 2024-09-10T10:52:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.407+0000 7f08396ee640 1 -- 172.21.15.92:0/1897109202 learned_addr learned my addr 172.21.15.92:0/1897109202 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.407+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d29fcf3880 con 0x55d29fce6410 2024-09-10T10:52:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.407+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x55d29fbd3290 con 0x55d29fce5af0 2024-09-10T10:52:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.407+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d29fcf3a00 con 0x55d29fcf0cb0 2024-09-10T10:52:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.407+0000 7f083e7bf740 10 client.0 _ll_register_callbacks cb 0x55d29fc04140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:52:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.408+0000 7f0839eef640 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fcee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.412+0000 7f0838eed640 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce6410 0x55d29fcee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.413+0000 7f0839eef640 1 -- 172.21.15.92:0/1897109202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 msgr2=0x55d29fcedc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.413+0000 7f0839eef640 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fcedc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.413+0000 7f0839eef640 1 -- 172.21.15.92:0/1897109202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce6410 msgr2=0x55d29fcee1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.413+0000 7f0839eef640 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce6410 0x55d29fcee1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.413+0000 7f0839eef640 1 -- 172.21.15.92:0/1897109202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29f95d210 con 0x55d29fcf0cb0 2024-09-10T10:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.415+0000 7f0839eef640 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fcee700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55d29fce8690 tx=0x7f082c0cd140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849e241ac23252bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.415+0000 7f0818ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.415+0000 7f0818ff9640 1 -- 172.21.15.92:0/1897109202 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0b3030 con 0x55d29fcf0cb0 2024-09-10T10:52:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.415+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f082c09ba60 con 0x55d29fcf0cb0 2024-09-10T10:52:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.416+0000 7f0818ff9640 1 -- 172.21.15.92:0/1897109202 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7f082c0ba400 con 0x55d29fcf0cb0 2024-09-10T10:52:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.416+0000 7f0818ff9640 1 -- 172.21.15.92:0/1897109202 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f082c0ba050 con 0x55d29fcf0cb0 2024-09-10T10:52:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.417+0000 7f083e7bf740 10 client.25975 fetch_fsmap learned FSMap version 68 2024-09-10T10:52:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.417+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x55d29fa29620 con 0x55d29fcf0cb0 2024-09-10T10:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.420+0000 7f0818ff9640 1 -- 172.21.15.92:0/1897109202 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f082c0a46d0 con 0x55d29fcf0cb0 2024-09-10T10:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.420+0000 7f0818ff9640 1 -- 172.21.15.92:0/1897109202 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 68) ==== 8398+0+0 (secure 0 0 0) 0x7f082c0977b0 con 0x55d29fcf0cb0 2024-09-10T10:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.421+0000 7f083e7bf740 10 client.25975 fetch_fsmap finished waiting for FSMap version 68 2024-09-10T10:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.421+0000 7f083e7bf740 10 client.25975 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.421+0000 7f083e7bf740 20 client.25975 populate_metadata read hostname 'smithi092' 2024-09-10T10:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.421+0000 7f083e7bf740 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d29fd00b60 0x55d29fd02f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.421+0000 7f083e7bf740 4 client.25975 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T10:52:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.421+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f082c09ba60 con 0x55d29fd00b60 2024-09-10T10:52:05.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.422+0000 7f08396ee640 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d29fd00b60 0x55d29fd02f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.428+0000 7f08396ee640 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d29fd00b60 0x55d29fd02f50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76b8ee99f38f888a server_cookie=625419c2757f652e in_seq=0 out_seq=0 2024-09-10T10:52:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.428+0000 7f0818ff9640 10 client.25975 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:52:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.429+0000 7f0818ff9640 1 -- 172.21.15.92:0/1897109202 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f082c09ba60 con 0x55d29fd00b60 2024-09-10T10:52:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.429+0000 7f0818ff9640 10 client.25975 handle_command_reply: tid=0 2024-09-10T10:52:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.429+0000 7f083e7bf740 1 client.25975 shutdown 2024-09-10T10:52:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.439+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 msgr2=0x55d29fcee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.439+0000 7f083e7bf740 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fcee700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55d29fce8690 tx=0x7f082c0cd140 comp rx=0 tx=0).stop 2024-09-10T10:52:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.445+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 shutdown_connections 2024-09-10T10:52:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.445+0000 7f083e7bf740 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fcee700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.445+0000 7f083e7bf740 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce6410 0x55d29fcee1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.445+0000 7f083e7bf740 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d29fd00b60 0x55d29fd02f50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.445+0000 7f083e7bf740 1 --2- 172.21.15.92:0/1897109202 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce5af0 0x55d29fcedc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.445+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 >> 172.21.15.92:0/1897109202 conn(0x55d29fce2060 msgr2=0x55d29fce7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.445+0000 7f0818ff9640 0 client.25975 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:52:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.448+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 shutdown_connections 2024-09-10T10:52:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.448+0000 7f083e7bf740 1 -- 172.21.15.92:0/1897109202 wait complete. 2024-09-10T10:52:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.452+0000 7f083e7bf740 20 client.25975 trim_cache size 0 max 16384 2024-09-10T10:52:05.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.491+0000 7f083e7bf740 1 Processor -- start 2024-09-10T10:52:05.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.493+0000 7f083e7bf740 1 -- start start 2024-09-10T10:52:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 0x55d29fcee530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce6410 0x55d29fce10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fd05b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f083e7bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08341c4f30 con 0x55d29fce5af0 2024-09-10T10:52:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f083e7bf740 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f08341c6bc0 con 0x55d29fce6410 2024-09-10T10:52:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f083e7bf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08341c56c0 con 0x55d29fcf0cb0 2024-09-10T10:52:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f0839eef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fd05b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f0839eef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fd05b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:44002/0 (socket says 172.21.15.92:44002) 2024-09-10T10:52:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f0839eef640 1 -- 172.21.15.92:0/3183198995 learned_addr learned my addr 172.21.15.92:0/3183198995 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:05.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f08396ee640 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 0x55d29fcee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.494+0000 7f0838eed640 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce6410 0x55d29fce10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.495+0000 7f0839eef640 1 -- 172.21.15.92:0/3183198995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce6410 msgr2=0x55d29fce10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:52:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.495+0000 7f0839eef640 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce6410 0x55d29fce10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.495+0000 7f0839eef640 1 -- 172.21.15.92:0/3183198995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 msgr2=0x55d29fcee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:52:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.495+0000 7f0839eef640 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 0x55d29fcee530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.495+0000 7f0839eef640 1 -- 172.21.15.92:0/3183198995 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d29fcdd2d0 con 0x55d29fcf0cb0 2024-09-10T10:52:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.495+0000 7f08396ee640 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 0x55d29fcee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T10:52:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.495+0000 7f0838eed640 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce6410 0x55d29fce10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:52:05.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.497+0000 7f0839eef640 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fd05b90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f082c098430 tx=0x7f082c0cd230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b756c8866bcaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.501+0000 7f081affd640 1 -- 172.21.15.92:0/3183198995 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0b3070 con 0x55d29fcf0cb0 2024-09-10T10:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.501+0000 7f081affd640 1 -- 172.21.15.92:0/3183198995 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f082c0a46d0 con 0x55d29fcf0cb0 2024-09-10T10:52:05.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.501+0000 7f081affd640 1 -- 172.21.15.92:0/3183198995 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0979f0 con 0x55d29fcf0cb0 2024-09-10T10:52:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.502+0000 7f083e7bf740 1 -- 172.21.15.92:0/3183198995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 msgr2=0x55d29fd05b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.502+0000 7f083e7bf740 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fd05b90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f082c098430 tx=0x7f082c0cd230 comp rx=0 tx=0).stop 2024-09-10T10:52:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.506+0000 7f083e7bf740 1 -- 172.21.15.92:0/3183198995 shutdown_connections 2024-09-10T10:52:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.506+0000 7f083e7bf740 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fcf0cb0 0x55d29fd05b90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.506+0000 7f083e7bf740 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fce6410 0x55d29fce10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.506+0000 7f083e7bf740 1 --2- 172.21.15.92:0/3183198995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 0x55d29fcee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.506+0000 7f083e7bf740 1 -- 172.21.15.92:0/3183198995 >> 172.21.15.92:0/3183198995 conn(0x55d29fce2060 msgr2=0x55d29fce09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.512+0000 7f083e7bf740 1 -- 172.21.15.92:0/3183198995 shutdown_connections 2024-09-10T10:52:05.517 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.516+0000 7f083e7bf740 1 -- 172.21.15.92:0/3183198995 wait complete. 2024-09-10T10:52:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.516+0000 7f083e7bf740 1 -- start start 2024-09-10T10:52:05.518 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.516+0000 7f083e7bf740 1 Processor -- start 2024-09-10T10:52:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.517+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 0x55d29fd05fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.517+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fd03300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.519 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.517+0000 7f083e7bf740 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fcf0cb0 0x55d29fd03840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.517+0000 7f083e7bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08341c64f0 con 0x55d29fce5af0 2024-09-10T10:52:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f0838eed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fd03300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f0838eed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fd03300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.92:44016/0 (socket says 172.21.15.92:44016) 2024-09-10T10:52:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f0838eed640 1 -- 172.21.15.92:0/4211355014 learned_addr learned my addr 172.21.15.92:0/4211355014 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f0839eef640 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fcf0cb0 0x55d29fd03840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f08341c5d90 con 0x55d29fcf0cb0 2024-09-10T10:52:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08341c2f50 con 0x55d29fce6410 2024-09-10T10:52:05.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f083e7bf740 10 client.0 _ll_register_callbacks cb 0x7f082c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T10:52:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f0838eed640 1 -- 172.21.15.92:0/4211355014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fcf0cb0 msgr2=0x55d29fd03840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T10:52:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f0838eed640 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fcf0cb0 0x55d29fd03840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f0838eed640 1 -- 172.21.15.92:0/4211355014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 msgr2=0x55d29fd05fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T10:52:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f0838eed640 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 0x55d29fd05fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:05.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.518+0000 7f0838eed640 1 -- 172.21.15.92:0/4211355014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d29fceea70 con 0x55d29fce6410 2024-09-10T10:52:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.523+0000 7f0838eed640 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fd03300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0834116030 tx=0x7f0824010eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8bd3011364caad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.526+0000 7f0818ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-10T10:52:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.529+0000 7f0818ff9640 1 -- 172.21.15.92:0/4211355014 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082401e060 con 0x55d29fce6410 2024-09-10T10:52:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.530+0000 7f0818ff9640 1 -- 172.21.15.92:0/4211355014 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7f082400ebb0 con 0x55d29fce6410 2024-09-10T10:52:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.530+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f082c0a46d0 con 0x55d29fce6410 2024-09-10T10:52:05.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.538+0000 7f0818ff9640 1 -- 172.21.15.92:0/4211355014 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f082400edb0 con 0x55d29fce6410 2024-09-10T10:52:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.543+0000 7f083e7bf740 10 client.25981 fetch_fsmap learned FSMap version 68 2024-09-10T10:52:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.543+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) -- 0x55d29fd6b000 con 0x55d29fce6410 2024-09-10T10:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.548+0000 7f0818ff9640 1 -- 172.21.15.92:0/4211355014 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f082c0a46d0 con 0x55d29fce6410 2024-09-10T10:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.548+0000 7f0818ff9640 1 -- 172.21.15.92:0/4211355014 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 68) ==== 8398+0+0 (secure 0 0 0) 0x7f082400b4c0 con 0x55d29fce6410 2024-09-10T10:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.548+0000 7f083e7bf740 10 client.25981 fetch_fsmap finished waiting for FSMap version 68 2024-09-10T10:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.548+0000 7f083e7bf740 10 client.25981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-10T10:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.548+0000 7f083e7bf740 20 client.25981 populate_metadata read hostname 'smithi092' 2024-09-10T10:52:05.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.548+0000 7f083e7bf740 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d29fd6b7d0 0x55d29fd6dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.548+0000 7f083e7bf740 4 client.25981 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T10:52:05.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.548+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 --> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d29fc57a20 con 0x55d29fd6b7d0 2024-09-10T10:52:05.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.551+0000 7f08396ee640 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d29fd6b7d0 0x55d29fd6dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.552+0000 7f0818ff9640 10 client.25981 ms_handle_connect on v2:172.21.15.121:6838/3692560393 2024-09-10T10:52:05.557 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:05.552+0000 7f08396ee640 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d29fd6b7d0 0x55d29fd6dbf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a17770334af33a8e server_cookie=bdb772ffb6e30dcb in_seq=0 out_seq=0 2024-09-10T10:52:06.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:06 smithi121 ceph-mon[35231]: pgmap v486: 97 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 75 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 20 MiB/s wr, 1.58k op/s 2024-09-10T10:52:06.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:06 smithi097 ceph-mon[35213]: pgmap v486: 97 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 75 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 20 MiB/s wr, 1.58k op/s 2024-09-10T10:52:06.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:06 smithi092 ceph-mon[30834]: pgmap v486: 97 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 75 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 20 MiB/s wr, 1.58k op/s 2024-09-10T10:52:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f0818ff9640 1 -- 172.21.15.92:0/4211355014 <== mds.0 v2:172.21.15.121:6838/3692560393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d29fc57a20 con 0x55d29fd6b7d0 2024-09-10T10:52:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f0818ff9640 10 client.25981 handle_command_reply: tid=0 2024-09-10T10:52:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f083e7bf740 1 client.25981 shutdown 2024-09-10T10:52:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 msgr2=0x55d29fd03300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f083e7bf740 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fd03300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0834116030 tx=0x7f0824010eb0 comp rx=0 tx=0).stop 2024-09-10T10:52:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 shutdown_connections 2024-09-10T10:52:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f083e7bf740 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.121:6838/3692560393,v1:172.21.15.121:6839/3692560393] conn(0x55d29fd6b7d0 0x55d29fd6dbf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f083e7bf740 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x55d29fcf0cb0 0x55d29fd03840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f083e7bf740 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d29fce6410 0x55d29fd03300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f083e7bf740 1 --2- 172.21.15.92:0/4211355014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d29fce5af0 0x55d29fd05fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 >> 172.21.15.92:0/4211355014 conn(0x55d29fce2060 msgr2=0x55d29fce11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.982+0000 7f0818ff9640 0 client.25981 ms_handle_reset on v2:172.21.15.121:6838/3692560393 2024-09-10T10:52:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.983+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 shutdown_connections 2024-09-10T10:52:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.983+0000 7f083e7bf740 1 -- 172.21.15.92:0/4211355014 wait complete. 2024-09-10T10:52:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.983+0000 7f083e7bf740 20 client.25981 trim_cache size 0 max 16384 2024-09-10T10:52:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-09-10T10:52:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-09-10T10:52:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-09-10T10:52:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-09-10T10:52:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 -- 172.21.15.92:0/3581902524 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f081c0a2fd0 msgr2=0x7f081c0a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f081c0a2fd0 0x7f081c0a5490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f08280095f0 tx=0x7f0828005850 comp rx=0 tx=0).stop 2024-09-10T10:52:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 -- 172.21.15.92:0/3581902524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f083411b140 msgr2=0x7f0834114db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f083411b140 0x7f0834114db0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f082c005fd0 tx=0x7f082c00ed20 comp rx=0 tx=0).stop 2024-09-10T10:52:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 -- 172.21.15.92:0/3581902524 shutdown_connections 2024-09-10T10:52:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f081c0a2fd0 0x7f081c0a5490 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f083411b140 0x7f0834114db0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08341095d0 0x7f0834114870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 --2- 172.21.15.92:0/3581902524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08341091f0 0x7f083411a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 -- 172.21.15.92:0/3581902524 >> 172.21.15.92:0/3581902524 conn(0x7f083406ce00 msgr2=0x7f08340707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.984+0000 7f083b952640 1 -- 172.21.15.92:0/3581902524 shutdown_connections 2024-09-10T10:52:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-09-10T10:52:06.985+0000 7f083b952640 1 -- 172.21.15.92:0/3581902524 wait complete. 2024-09-10T10:52:08.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:08 smithi092 ceph-mon[30834]: pgmap v487: 97 pgs: 17 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 47 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 17 MiB/s wr, 1.69k op/s 2024-09-10T10:52:08.479 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-10T10:52:08.540 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:08 smithi121 ceph-mon[35231]: pgmap v487: 97 pgs: 17 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 47 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 17 MiB/s wr, 1.69k op/s 2024-09-10T10:52:08.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:08 smithi097 ceph-mon[35213]: pgmap v487: 97 pgs: 17 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 47 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 17 MiB/s wr, 1.69k op/s 2024-09-10T10:52:08.582 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/: 2024-09-10T10:52:08.582 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.582 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:52:08.582 INFO:teuthology.orchestra.run.smithi092.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 .. 2024-09-10T10:52:08.582 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 data 2024-09-10T10:52:08.582 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.582 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data: 2024-09-10T10:52:08.582 INFO:teuthology.orchestra.run.smithi092.stdout:total 36 2024-09-10T10:52:08.582 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 . 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 .. 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 10:36 base 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 10 10:36 current_logfiles 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 10 10:36 global 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 log 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_commit_ts 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_dynshmem 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 10 10:36 pg_hba.conf 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 10 10:36 pg_ident.conf 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:52 pg_logical 2024-09-10T10:52:08.583 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 pg_multixact 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_notify 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_replslot 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_serial 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_snapshots 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:52 pg_stat 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:52 pg_stat_tmp 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:52 pg_subtrans 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_tblspc 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pg_twophase 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 PG_VERSION 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 10 10:52 pg_wal 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:42 pg_xact 2024-09-10T10:52:08.584 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 10 10:36 postgresql.auto.conf 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 10 10:36 postgresql.conf 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 10 10:36 postmaster.opts 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base: 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 10:36 . 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 1 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 13493 2024-09-10T10:52:08.585 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 10 10:40 13494 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 pgsql_tmp 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 . 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 10:36 .. 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 112 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 113 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 1247 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1247_fsm 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1247_vm 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 10:36 1249 2024-09-10T10:52:08.586 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1249_fsm 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1249_vm 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 10:36 1255 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1255_fsm 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1255_vm 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 10:36 1259 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1259_fsm 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1259_vm 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 10:36 13344 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13344_fsm 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13344_vm 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13346 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13348 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349 2024-09-10T10:52:08.587 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13349_fsm 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349_vm 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13351 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13353 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13354_fsm 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354_vm 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13356 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13358 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13359_fsm 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359_vm 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13361 2024-09-10T10:52:08.588 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13363 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1417 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1418 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 174 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 175 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2187 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2224 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2328 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2336 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2337 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2579 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2600 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2600_fsm 2024-09-10T10:52:08.589 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2600_vm 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2601_fsm 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601_vm 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2602 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2602_fsm 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2602_vm 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2603 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2603_fsm 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2603_vm 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2604 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2605 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2605_fsm 2024-09-10T10:52:08.590 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2605_vm 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2606_fsm 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606_vm 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2607 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2607_fsm 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2607_vm 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 10:36 2608 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2608_fsm 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2608_vm 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 10:36 2609 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2609_fsm 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2609_vm 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2610 2024-09-10T10:52:08.591 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2610_fsm 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2610_vm 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2611 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2612_fsm 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612_vm 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2613 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2615_fsm 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615_vm 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2616 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2616_fsm 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2616_vm 2024-09-10T10:52:08.592 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 10:36 2617 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2617_fsm 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2617_vm 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 10:36 2618 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2618_fsm 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2618_vm 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 10:36 2619 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2619_fsm 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2619_vm 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2620 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2650 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2651 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2652 2024-09-10T10:52:08.593 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2653 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2654 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2655 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2656 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2657 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 10:36 2658 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 2659 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2660 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2661 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2662 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2663 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2664 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2665 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2666 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2667 2024-09-10T10:52:08.594 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2668 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2669 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2670 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 10:36 2673 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 10:36 2674 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 10:36 2675 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2678 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2679 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2680 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2681 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2682 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2683 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2684 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2685 2024-09-10T10:52:08.595 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2686 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2687 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2688 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2689 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 10:36 2690 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 10:36 2691 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2692 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2693 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2696 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2699 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2701 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2702 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2703 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2704 2024-09-10T10:52:08.596 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2753 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2753_fsm 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2753_vm 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2754 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2755 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2756 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2757 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2830 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2831 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2832 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2833 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2834 2024-09-10T10:52:08.597 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2835 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2836 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2837 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 10:36 2838 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2838_fsm 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2838_vm 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2839 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840_fsm 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2840_vm 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2841 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2995 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2996 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3079_fsm 2024-09-10T10:52:08.598 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079_vm 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3080 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3081 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3085 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3118 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3119 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 10:36 3164 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3256 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3257 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3258 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3350 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3351 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3379 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3380 2024-09-10T10:52:08.599 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3381 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3394 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3394_fsm 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3394_vm 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3395 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3429 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3430 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3431 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3433 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3439 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3440 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3455 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 10:36 3456 2024-09-10T10:52:08.600 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3456_fsm 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3456_vm 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3466 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3467 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3468 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3501 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3502 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3503 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3534 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3541_fsm 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541_vm 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3542 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3574 2024-09-10T10:52:08.601 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3575 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3576 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3596 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3597 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3598 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3599 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3600_fsm 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600_vm 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3601_fsm 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601_vm 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3602_fsm 2024-09-10T10:52:08.602 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602_vm 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603_fsm 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3603_vm 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3604 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3605 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3606 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3607 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3608 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 3609 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3712 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3764_fsm 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764_vm 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3766 2024-09-10T10:52:08.603 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3767 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3997 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4143 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4144 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4145 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4146 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4147 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4148 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4149 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4150 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4151 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4152 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4153 2024-09-10T10:52:08.604 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4154 2024-09-10T10:52:08.605 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4155 2024-09-10T10:52:08.605 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4156 2024-09-10T10:52:08.605 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4157 2024-09-10T10:52:08.605 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4158 2024-09-10T10:52:08.605 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4159 2024-09-10T10:52:08.605 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4160 2024-09-10T10:52:08.605 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4161 2024-09-10T10:52:08.605 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4162 2024-09-10T10:52:08.606 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4163 2024-09-10T10:52:08.606 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4164 2024-09-10T10:52:08.606 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4165 2024-09-10T10:52:08.606 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4166 2024-09-10T10:52:08.606 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4167 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4168 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4169 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4170 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4171 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4172 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4173 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4174 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 5002 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 548 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 549 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6102 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6104 2024-09-10T10:52:08.607 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6106 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6110 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6111 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6112 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6113 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6117 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 826 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 827 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 828 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 10:36 pg_filenode.map 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 PG_VERSION 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-10T10:52:08.608 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 10 10:36 . 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 10:36 .. 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 112 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 113 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 1247 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1247_fsm 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1247_vm 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 10:36 1249 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1249_fsm 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1249_vm 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 10:36 1255 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1255_fsm 2024-09-10T10:52:08.609 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1255_vm 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 10:36 1259 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1259_fsm 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1259_vm 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 10:36 13344 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13344_fsm 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13344_vm 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13346 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13348 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13349_fsm 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349_vm 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13351 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13353 2024-09-10T10:52:08.610 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13354_fsm 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354_vm 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13356 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13358 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13359_fsm 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359_vm 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13361 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13363 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1417 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1418 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 174 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 175 2024-09-10T10:52:08.611 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2187 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2224 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2328 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2336 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2337 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2579 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2600 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2600_fsm 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2600_vm 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2601_fsm 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601_vm 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2602 2024-09-10T10:52:08.612 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2602_fsm 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2602_vm 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2603 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2603_fsm 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2603_vm 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2604 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2605 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2605_fsm 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2605_vm 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2606_fsm 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2606_vm 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2607 2024-09-10T10:52:08.613 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2607_fsm 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2607_vm 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 10:36 2608 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2608_fsm 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2608_vm 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 10:36 2609 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2609_fsm 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2609_vm 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2610 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2610_fsm 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2610_vm 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2611 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612 2024-09-10T10:52:08.614 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2612_fsm 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612_vm 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2613 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2615_fsm 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615_vm 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2616 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2616_fsm 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2616_vm 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 10:36 2617 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2617_fsm 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2617_vm 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 10:36 2618 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2618_fsm 2024-09-10T10:52:08.615 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2618_vm 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 10 10:36 2619 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2619_fsm 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2619_vm 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2620 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2650 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2651 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2652 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2653 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2654 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2655 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2656 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2657 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 10:36 2658 2024-09-10T10:52:08.616 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:36 2659 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2660 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2661 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2662 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2663 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2664 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2665 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2666 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2667 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2668 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2669 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2670 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 10:36 2673 2024-09-10T10:52:08.617 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 10:36 2674 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 10:36 2675 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2678 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2679 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2680 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2681 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2682 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2683 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2684 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2685 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2686 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2687 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2688 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2689 2024-09-10T10:52:08.618 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 10:36 2690 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 10:36 2691 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2692 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2693 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2696 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2699 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2701 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2702 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2703 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2704 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2753 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2753_fsm 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2753_vm 2024-09-10T10:52:08.619 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2754 2024-09-10T10:52:08.620 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2755 2024-09-10T10:52:08.620 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2756 2024-09-10T10:52:08.620 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2757 2024-09-10T10:52:08.620 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2830 2024-09-10T10:52:08.620 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2831 2024-09-10T10:52:08.620 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2832 2024-09-10T10:52:08.620 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2833 2024-09-10T10:52:08.620 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2834 2024-09-10T10:52:08.620 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2835 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2836 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2837 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 10:36 2838 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2838_fsm 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2838_vm 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2839 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840_fsm 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2840_vm 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2841 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2995 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2996 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079 2024-09-10T10:52:08.621 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3079_fsm 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079_vm 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3080 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3081 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3085 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3118 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3119 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 10:36 3164 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3256 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3257 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3258 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3350 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3351 2024-09-10T10:52:08.622 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3379 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3380 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3381 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3394 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3394_fsm 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3394_vm 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3395 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3429 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3430 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3431 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3433 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3439 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3440 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3455 2024-09-10T10:52:08.623 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 10:36 3456 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3456_fsm 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3456_vm 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3466 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3467 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3468 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3501 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3502 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3503 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3534 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3541_fsm 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541_vm 2024-09-10T10:52:08.624 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3542 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3574 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3575 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3576 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3596 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3597 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3598 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3599 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3600_fsm 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600_vm 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3601_fsm 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601_vm 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602 2024-09-10T10:52:08.625 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3602_fsm 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602_vm 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603_fsm 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3603_vm 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3604 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3605 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3606 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3607 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3608 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 3609 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3712 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764 2024-09-10T10:52:08.626 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3764_fsm 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764_vm 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3766 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3767 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3997 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4143 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4144 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4145 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4146 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4147 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4148 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4149 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4150 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4151 2024-09-10T10:52:08.627 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4152 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4153 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4154 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4155 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4156 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4157 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4158 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4159 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4160 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4161 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4162 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4163 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4164 2024-09-10T10:52:08.628 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4165 2024-09-10T10:52:08.629 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4166 2024-09-10T10:52:08.629 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4167 2024-09-10T10:52:08.629 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4168 2024-09-10T10:52:08.629 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4169 2024-09-10T10:52:08.629 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4170 2024-09-10T10:52:08.629 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4171 2024-09-10T10:52:08.629 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4172 2024-09-10T10:52:08.662 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4173 2024-09-10T10:52:08.662 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4174 2024-09-10T10:52:08.662 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 5002 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 548 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 549 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6102 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6104 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6106 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6110 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6111 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6112 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6113 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6117 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 826 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 827 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 828 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 10:36 pg_filenode.map 2024-09-10T10:52:08.663 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 PG_VERSION 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:total 622094 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 10 10:40 . 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 10:36 .. 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 112 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 113 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:37 1247 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1247_fsm 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:37 1247_vm 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 10 10:37 1249 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:37 1249_fsm 2024-09-10T10:52:08.664 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:37 1249_vm 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 10 10:36 1255 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1255_fsm 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1255_vm 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 10 10:52 1259 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1259_fsm 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:37 1259_vm 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 10 10:36 13344 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13344_fsm 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13344_vm 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13346 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13348 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349 2024-09-10T10:52:08.665 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13349_fsm 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13349_vm 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13351 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13353 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13354_fsm 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13354_vm 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13356 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13358 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 13359_fsm 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13359_vm 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 13361 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 13363 2024-09-10T10:52:08.666 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1417 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 1418 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 444178432 Sep 10 10:52 16396 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 10 10:51 16396_fsm 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:40 16396_vm 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1310720 Sep 10 10:52 16397 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:51 16397_fsm 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:51 16397_vm 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1802240 Sep 10 10:51 16399 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:52 16399_fsm 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:52 16399_vm 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:51 16400 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 10:51 16402 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 10 10:52 16404 2024-09-10T10:52:08.667 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 109338624 Sep 10 10:52 16406 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:51 16406_fsm 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:50 16406_vm 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 174 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 175 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2187 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2224 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2328 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2336 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2337 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:37 2579 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2600 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2600_fsm 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2600_vm 2024-09-10T10:52:08.668 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2601_fsm 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2601_vm 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2602 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2602_fsm 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2602_vm 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2603 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2603_fsm 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2603_vm 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2604 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2605 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2605_fsm 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2605_vm 2024-09-10T10:52:08.669 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:37 2606 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2606_fsm 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:37 2606_vm 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2607 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2607_fsm 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2607_vm 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 10 10:37 2608 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2608_fsm 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:37 2608_vm 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 10 10:36 2609 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2609_fsm 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2609_vm 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:37 2610 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2610_fsm 2024-09-10T10:52:08.670 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:37 2610_vm 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2611 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2612_fsm 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2612_vm 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2613 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2615_fsm 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2615_vm 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2616 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2616_fsm 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2616_vm 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 10 10:36 2617 2024-09-10T10:52:08.671 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2617_fsm 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2617_vm 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 10 10:36 2618 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2618_fsm 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2618_vm 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Sep 10 10:52 2619 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:39 2619_fsm 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:37 2619_vm 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2620 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2650 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2651 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2652 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2653 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2654 2024-09-10T10:52:08.672 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2655 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2656 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2657 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 10 10:37 2658 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 10 10:37 2659 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2660 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2661 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:37 2662 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:37 2663 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:37 2664 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:37 2665 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:37 2666 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:37 2667 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2668 2024-09-10T10:52:08.673 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2669 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2670 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 10 10:37 2673 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 10 10:37 2674 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 10 10:36 2675 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:37 2678 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:37 2679 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2680 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2681 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2682 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2683 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2684 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2685 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2686 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2687 2024-09-10T10:52:08.674 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 2688 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 10 10:36 2689 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 10 10:36 2690 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 10 10:36 2691 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2692 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2693 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:50 2696 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2699 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2701 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2702 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:37 2703 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:37 2704 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2753 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2753_fsm 2024-09-10T10:52:08.675 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2753_vm 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2754 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2755 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2756 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 2757 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2830 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2831 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2832 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2833 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2834 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2835 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2836 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2837 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 10 10:36 2838 2024-09-10T10:52:08.676 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2838_fsm 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2838_vm 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2839 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2840_fsm 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2840_vm 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2841 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2995 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2996 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3079_fsm 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3079_vm 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3080 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3081 2024-09-10T10:52:08.677 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:36 3085 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3118 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3119 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 10 10:36 3164 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3256 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3257 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3258 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3350 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3351 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3379 2024-09-10T10:52:08.678 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3380 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3381 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3394 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3394_fsm 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3394_vm 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3395 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3429 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3430 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3431 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3433 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3439 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3440 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 10 10:37 3455 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 10 10:36 3456 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3456_fsm 2024-09-10T10:52:08.679 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3456_vm 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3466 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3467 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3468 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3501 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3502 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3503 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3534 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3541_fsm 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3541_vm 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3542 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3574 2024-09-10T10:52:08.680 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3575 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3576 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3596 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3597 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3598 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3599 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3600_fsm 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3600_vm 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3601_fsm 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3601_vm 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3602_fsm 2024-09-10T10:52:08.681 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3602_vm 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3603_fsm 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3603_vm 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3604 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3605 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3606 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3607 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3608 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 10 10:36 3609 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3712 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 3764_fsm 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3764_vm 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3766 2024-09-10T10:52:08.682 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 3767 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3997 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4143 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4144 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4145 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4146 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4147 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4148 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4149 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4150 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4151 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4152 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4153 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4154 2024-09-10T10:52:08.683 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4155 2024-09-10T10:52:08.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4156 2024-09-10T10:52:08.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4157 2024-09-10T10:52:08.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4158 2024-09-10T10:52:08.684 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4159 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4160 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4161 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4162 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4163 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4164 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4165 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4166 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4167 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4168 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4169 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4170 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4171 2024-09-10T10:52:08.685 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4172 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4173 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4174 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 5002 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 548 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 549 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6102 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6104 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6106 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6110 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6111 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6112 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6113 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6117 2024-09-10T10:52:08.686 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 826 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 827 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 828 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 10:36 pg_filenode.map 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 10 10:36 pg_internal.init 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:36 PG_VERSION 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 10 10:36 .. 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/global: 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:total 560 2024-09-10T10:52:08.687 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 10 10:36 . 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1213 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1213_fsm 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1213_vm 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1214 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1214_fsm 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1214_vm 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 1232 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 1233 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1260 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1260_fsm 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1260_vm 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1261 2024-09-10T10:52:08.688 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1261_fsm 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1261_vm 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1262 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 1262_fsm 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 1262_vm 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2396 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 10 10:36 2396_fsm 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2396_vm 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2397 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2671 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2672 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2676 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2677 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2694 2024-09-10T10:52:08.689 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2695 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2697 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 10 10:36 2698 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2846 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2847 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2964 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2965 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 2966 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 2967 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 3592 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 3593 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4060 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4061 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4175 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4176 2024-09-10T10:52:08.690 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4177 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4178 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4181 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4182 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4183 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4184 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 4185 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 4186 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6000 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6001 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6002 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 6100 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6114 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 6115 2024-09-10T10:52:08.691 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:52 pg_control 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 10 10:36 pg_filenode.map 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 10 10:36 pg_internal.init 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/log: 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:total 2 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1118 Sep 10 10:52 postgresql-Tue.log 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.692 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:total 1 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:52 . 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 mappings 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 10 10:52 replorigin_checkpoint 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 snapshots 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.693 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:52 .. 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:52 .. 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 . 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 members 2024-09-10T10:52:08.694 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 offsets 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 .. 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:36 0000 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:36 . 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:36 .. 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 10 10:39 0000 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.695 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-10T10:52:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.696 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-10T10:52:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.696 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.697 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.697 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.697 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-10T10:52:08.697 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.697 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.697 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:total 15 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 10 10:52 . 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 10 10:52 db_0.stat 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 10 10:52 db_13494.stat 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 10 10:52 global.stat 2024-09-10T10:52:08.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:52 . 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:total 224 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 10 10:52 . 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 229376 Sep 10 10:52 001F 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.699 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:total 1048576 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 10 10:52 . 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:52 0000000100000000000000B7 2024-09-10T10:52:08.700 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:43 0000000100000000000000B8 2024-09-10T10:52:08.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:45 0000000100000000000000B9 2024-09-10T10:52:08.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:43 0000000100000000000000BA 2024-09-10T10:52:08.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:45 0000000100000000000000BB 2024-09-10T10:52:08.701 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:45 0000000100000000000000BC 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:44 0000000100000000000000BD 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:42 0000000100000000000000BE 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000BF 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:46 0000000100000000000000C0 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000C1 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:50 0000000100000000000000C2 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:48 0000000100000000000000C3 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:46 0000000100000000000000C4 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:48 0000000100000000000000C5 2024-09-10T10:52:08.704 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:49 0000000100000000000000C6 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000C7 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:46 0000000100000000000000C8 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000C9 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000CA 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:50 0000000100000000000000CB 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:46 0000000100000000000000CC 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000CD 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000CE 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:48 0000000100000000000000CF 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:49 0000000100000000000000D0 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:50 0000000100000000000000D1 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:46 0000000100000000000000D2 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000D3 2024-09-10T10:52:08.705 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000D4 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:48 0000000100000000000000D5 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000D6 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:48 0000000100000000000000D7 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:46 0000000100000000000000D8 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:50 0000000100000000000000D9 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000DA 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:46 0000000100000000000000DB 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000DC 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000DD 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000DE 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000DF 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000E0 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:46 0000000100000000000000E1 2024-09-10T10:52:08.706 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000E2 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:49 0000000100000000000000E3 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000E4 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000E5 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000E6 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:47 0000000100000000000000E7 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000E8 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000E9 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000EA 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000EB 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000EC 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000ED 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000EE 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000EF 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000F0 2024-09-10T10:52:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000F1 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000F2 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000F3 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000F4 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000F5 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 10 10:51 0000000100000000000000F6 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 archive_status 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 10 10:36 . 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 Sep 10 10:52 .. 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-10T10:52:08.708 INFO:teuthology.orchestra.run.smithi092.stdout:total 512 2024-09-10T10:52:08.709 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 10 10:42 . 2024-09-10T10:52:08.709 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 10 10:52 .. 2024-09-10T10:52:08.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 10 10:42 0000 2024-09-10T10:52:08.709 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Sep 10 10:52 0001 2024-09-10T10:52:08.709 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-10T10:52:08.721 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:52:08.729 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-10T10:52:08.753 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-10T10:52:08.753 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T10:52:08.753 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:52:08.753 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-10T10:52:08.807 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-10T10:52:08.875 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 -- 172.21.15.92:0/1079699581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 msgr2=0x7fc2f4100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 --2- 172.21.15.92:0/1079699581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 0x7fc2f4100e30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009930 tx=0x7fc2e402a420 comp rx=0 tx=0).stop 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 -- 172.21.15.92:0/1079699581 shutdown_connections 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 --2- 172.21.15.92:0/1079699581 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f4101370 0x7fc2f410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 --2- 172.21.15.92:0/1079699581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 0x7fc2f4100e30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 --2- 172.21.15.92:0/1079699581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f41069e0 0x7fc2f4106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 -- 172.21.15.92:0/1079699581 >> 172.21.15.92:0/1079699581 conn(0x7fc2f40fc6b0 msgr2=0x7fc2f40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 -- 172.21.15.92:0/1079699581 shutdown_connections 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 -- 172.21.15.92:0/1079699581 wait complete. 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 Processor -- start 2024-09-10T10:52:09.019 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.015+0000 7fc2faba6640 1 -- start start 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2faba6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 0x7fc2f4196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2faba6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f4101370 0x7fc2f41974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2faba6640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f41069e0 0x7fc2f4197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2faba6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4110e20 con 0x7fc2f41009d0 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2faba6640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4110ca0 con 0x7fc2f41069e0 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2faba6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4110fa0 con 0x7fc2f4101370 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f8942640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 0x7fc2f4196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f8942640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 0x7fc2f4196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56106/0 (socket says 172.21.15.92:56106) 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f8942640 1 -- 172.21.15.92:0/2316002165 learned_addr learned my addr 172.21.15.92:0/2316002165 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f3fff640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f4101370 0x7fc2f41974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f9143640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f41069e0 0x7fc2f4197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f8942640 1 -- 172.21.15.92:0/2316002165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f4101370 msgr2=0x7fc2f41974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f8942640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f4101370 0x7fc2f41974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.020 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f8942640 1 -- 172.21.15.92:0/2316002165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f41069e0 msgr2=0x7fc2f4197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f8942640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f41069e0 0x7fc2f4197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f8942640 1 -- 172.21.15.92:0/2316002165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f41a6800 con 0x7fc2f41009d0 2024-09-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f9143640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f41069e0 0x7fc2f4197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f8942640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 0x7fc2f4196f90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e9f0 tx=0x7fc2dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f1ffb640 1 -- 172.21.15.92:0/2316002165 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00cd80 con 0x7fc2f41009d0 2024-09-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f1ffb640 1 -- 172.21.15.92:0/2316002165 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2dc005500 con 0x7fc2f41009d0 2024-09-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2f1ffb640 1 -- 172.21.15.92:0/2316002165 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc010690 con 0x7fc2f41009d0 2024-09-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.016+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f41a6af0 con 0x7fc2f41009d0 2024-09-10T10:52:09.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.017+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f41a6fc0 con 0x7fc2f41009d0 2024-09-10T10:52:09.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.018+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f4100e30 con 0x7fc2f41009d0 2024-09-10T10:52:09.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.019+0000 7fc2f1ffb640 1 -- 172.21.15.92:0/2316002165 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc2dc0046c0 con 0x7fc2f41009d0 2024-09-10T10:52:09.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.019+0000 7fc2f1ffb640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc2e00a2da0 0x7fc2e00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.020+0000 7fc2f3fff640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc2e00a2da0 0x7fc2e00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.020+0000 7fc2f1ffb640 1 -- 172.21.15.92:0/2316002165 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7fc2dc0cf8a0 con 0x7fc2f41009d0 2024-09-10T10:52:09.023 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.020+0000 7fc2f3fff640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc2e00a2da0 0x7fc2e00a5260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009900 tx=0x7fc2e40058d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:09.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.024+0000 7fc2f1ffb640 1 -- 172.21.15.92:0/2316002165 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2dc09c4d0 con 0x7fc2f41009d0 2024-09-10T10:52:09.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.210+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 --> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fc2f40fd500 con 0x7fc2e00a2da0 2024-09-10T10:52:09.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.217+0000 7fc2f1ffb640 1 -- 172.21.15.92:0/2316002165 <== mgr.15234 v2:172.21.15.92:6800/3516468262 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fc2f40fd500 con 0x7fc2e00a2da0 2024-09-10T10:52:09.219 INFO:teuthology.orchestra.run.smithi092.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T10:36:39", "first": "2024-09-10T10:37:00", "last": "2024-09-10T10:52:00", "last_pruned": "2024-09-10T10:52:00", "created_count": 16, "pruned_count": 10, "active": true} 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc2e00a2da0 msgr2=0x7fc2e00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc2e00a2da0 0x7fc2e00a5260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009900 tx=0x7fc2e40058d0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 msgr2=0x7fc2f4196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 0x7fc2f4196f90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e9f0 tx=0x7fc2dc00edf0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 shutdown_connections 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc2e00a2da0 0x7fc2e00a5260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc2f41069e0 0x7fc2f4197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f4101370 0x7fc2f41974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 --2- 172.21.15.92:0/2316002165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2f41009d0 0x7fc2f4196f90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 >> 172.21.15.92:0/2316002165 conn(0x7fc2f40fc6b0 msgr2=0x7fc2f40fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 shutdown_connections 2024-09-10T10:52:09.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.219+0000 7fc2faba6640 1 -- 172.21.15.92:0/2316002165 wait complete. 2024-09-10T10:52:09.232 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.332+0000 7effb3d98640 1 -- 172.21.15.92:0/2651499499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 msgr2=0x7effac10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.332+0000 7effb3d98640 1 --2- 172.21.15.92:0/2651499499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 0x7effac10d880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7effa4009cd0 tx=0x7effa402a8e0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.332+0000 7effb3d98640 1 -- 172.21.15.92:0/2651499499 shutdown_connections 2024-09-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.332+0000 7effb3d98640 1 --2- 172.21.15.92:0/2651499499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 0x7effac10d880 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.332+0000 7effb3d98640 1 --2- 172.21.15.92:0/2651499499 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effac1009b0 0x7effac100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.332+0000 7effb3d98640 1 --2- 172.21.15.92:0/2651499499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effac1069c0 0x7effac106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.332+0000 7effb3d98640 1 -- 172.21.15.92:0/2651499499 >> 172.21.15.92:0/2651499499 conn(0x7effac077990 msgr2=0x7effac0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:09.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.332+0000 7effb3d98640 1 -- 172.21.15.92:0/2651499499 shutdown_connections 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.332+0000 7effb3d98640 1 -- 172.21.15.92:0/2651499499 wait complete. 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb3d98640 1 Processor -- start 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb3d98640 1 -- start start 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb3d98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effac1009b0 0x7effac198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb3d98640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 0x7effac1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb3d98640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effac1069c0 0x7effac19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb3d98640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7effac110e00 con 0x7effac101350 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb3d98640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7effac110c80 con 0x7effac1069c0 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb3d98640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7effac110f80 con 0x7effac1009b0 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb1333640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 0x7effac1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb1333640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 0x7effac1988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56128/0 (socket says 172.21.15.92:56128) 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb1333640 1 -- 172.21.15.92:0/3767348542 learned_addr learned my addr 172.21.15.92:0/3767348542 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:09.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb1333640 1 -- 172.21.15.92:0/3767348542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effac1009b0 msgr2=0x7effac198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb2335640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effac1069c0 0x7effac19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb1b34640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effac1009b0 0x7effac198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb1333640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effac1009b0 0x7effac198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb1333640 1 -- 172.21.15.92:0/3767348542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effac1069c0 msgr2=0x7effac19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb1333640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effac1069c0 0x7effac19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb1333640 1 -- 172.21.15.92:0/3767348542 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac19d350 con 0x7effac101350 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.333+0000 7effb2335640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effac1069c0 0x7effac19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.334+0000 7effb1333640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 0x7effac1988a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c890 tx=0x7eff9c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.334+0000 7effa2ffd640 1 -- 172.21.15.92:0/3767348542 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c004220 con 0x7effac101350 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.334+0000 7effa2ffd640 1 -- 172.21.15.92:0/3767348542 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff9c0043c0 con 0x7effac101350 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.334+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effac19d640 con 0x7effac101350 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.334+0000 7effa2ffd640 1 -- 172.21.15.92:0/3767348542 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0049e0 con 0x7effac101350 2024-09-10T10:52:09.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.334+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effac1a4ed0 con 0x7effac101350 2024-09-10T10:52:09.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.335+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effac100e10 con 0x7effac101350 2024-09-10T10:52:09.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.336+0000 7effa2ffd640 1 -- 172.21.15.92:0/3767348542 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7eff9c0079b0 con 0x7effac101350 2024-09-10T10:52:09.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.337+0000 7effa2ffd640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7eff980a2e20 0x7eff980a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.337+0000 7effb1b34640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7eff980a2e20 0x7eff980a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.337+0000 7effa2ffd640 1 -- 172.21.15.92:0/3767348542 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7eff9c0cf4d0 con 0x7effac101350 2024-09-10T10:52:09.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.337+0000 7effb1b34640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7eff980a2e20 0x7eff980a52e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7effa80058c0 tx=0x7effa8005be0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:09.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.341+0000 7effa2ffd640 1 -- 172.21.15.92:0/3767348542 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff9c014030 con 0x7effac101350 2024-09-10T10:52:09.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.530+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 --> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7effac1035f0 con 0x7eff980a2e20 2024-09-10T10:52:09.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.537+0000 7effa2ffd640 1 -- 172.21.15.92:0/3767348542 <== mgr.15234 v2:172.21.15.92:6800/3516468262 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7effac1035f0 con 0x7eff980a2e20 2024-09-10T10:52:09.539 INFO:teuthology.orchestra.run.smithi092.stdout:/ 1m 6m3h 2024-09-10T10:52:09.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7eff980a2e20 msgr2=0x7eff980a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7eff980a2e20 0x7eff980a52e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7effa80058c0 tx=0x7effa8005be0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 msgr2=0x7effac1988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 0x7effac1988a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c890 tx=0x7eff9c00cd50 comp rx=0 tx=0).stop 2024-09-10T10:52:09.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 shutdown_connections 2024-09-10T10:52:09.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7eff980a2e20 0x7eff980a52e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7effac1069c0 0x7effac19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effac101350 0x7effac1988a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 --2- 172.21.15.92:0/3767348542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effac1009b0 0x7effac198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 >> 172.21.15.92:0/3767348542 conn(0x7effac077990 msgr2=0x7effac0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:09.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 shutdown_connections 2024-09-10T10:52:09.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.539+0000 7effb3d98640 1 -- 172.21.15.92:0/3767348542 wait complete. 2024-09-10T10:52:09.551 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T10:52:09.562 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T10:52:09.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 -- 172.21.15.92:0/753072349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c1009a0 msgr2=0x7f9a7c100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/753072349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c1009a0 0x7f9a7c100e00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009930 tx=0x7f9a6c02a420 comp rx=0 tx=0).stop 2024-09-10T10:52:09.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 -- 172.21.15.92:0/753072349 shutdown_connections 2024-09-10T10:52:09.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/753072349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a7c101340 0x7f9a7c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/753072349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c1009a0 0x7f9a7c100e00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/753072349 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a7c1069b0 0x7f9a7c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 -- 172.21.15.92:0/753072349 >> 172.21.15.92:0/753072349 conn(0x7f9a7c0fc6c0 msgr2=0x7f9a7c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 -- 172.21.15.92:0/753072349 shutdown_connections 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 -- 172.21.15.92:0/753072349 wait complete. 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 Processor -- start 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 -- start start 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a7c1009a0 0x7f9a7c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.724+0000 7f9a83ec9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c101340 0x7f9a7c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a83ec9640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a7c1069b0 0x7f9a7c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a83ec9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c111ee0 con 0x7f9a7c101340 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a83ec9640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c111d60 con 0x7f9a7c1069b0 2024-09-10T10:52:09.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a83ec9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c112060 con 0x7f9a7c1009a0 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81464640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c101340 0x7f9a7c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81464640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c101340 0x7f9a7c198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56158/0 (socket says 172.21.15.92:56158) 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81464640 1 -- 172.21.15.92:0/743592603 learned_addr learned my addr 172.21.15.92:0/743592603 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81c65640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a7c1009a0 0x7f9a7c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a82466640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a7c1069b0 0x7f9a7c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81464640 1 -- 172.21.15.92:0/743592603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a7c1009a0 msgr2=0x7f9a7c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81464640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a7c1009a0 0x7f9a7c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81464640 1 -- 172.21.15.92:0/743592603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a7c1069b0 msgr2=0x7f9a7c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81464640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a7c1069b0 0x7f9a7c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81464640 1 -- 172.21.15.92:0/743592603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c19d3d0 con 0x7f9a7c101340 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a81464640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c101340 0x7f9a7c198920 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009230 tx=0x7f9a6c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a72ffd640 1 -- 172.21.15.92:0/743592603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c03f030 con 0x7f9a7c101340 2024-09-10T10:52:09.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a72ffd640 1 -- 172.21.15.92:0/743592603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a6c003ad0 con 0x7f9a7c101340 2024-09-10T10:52:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c19d660 con 0x7f9a7c101340 2024-09-10T10:52:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a72ffd640 1 -- 172.21.15.92:0/743592603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c035070 con 0x7f9a7c101340 2024-09-10T10:52:09.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.725+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c1a4f50 con 0x7f9a7c101340 2024-09-10T10:52:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.726+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c100e00 con 0x7f9a7c101340 2024-09-10T10:52:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.727+0000 7f9a72ffd640 1 -- 172.21.15.92:0/743592603 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f9a6c042030 con 0x7f9a7c101340 2024-09-10T10:52:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.728+0000 7f9a72ffd640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9a680a2d00 0x7f9a680a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.728+0000 7f9a81c65640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9a680a2d00 0x7f9a680a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.728+0000 7f9a72ffd640 1 -- 172.21.15.92:0/743592603 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7f9a6c0efd70 con 0x7f9a7c101340 2024-09-10T10:52:09.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.729+0000 7f9a81c65640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9a680a2d00 0x7f9a680a51c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800bb60 tx=0x7f9a7800b390 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:09.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.731+0000 7f9a72ffd640 1 -- 172.21.15.92:0/743592603 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a6c0bc9a0 con 0x7f9a7c101340 2024-09-10T10:52:09.903 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.901+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a7c199730 con 0x7f9a7c101340 2024-09-10T10:52:09.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.903+0000 7f9a72ffd640 1 -- 172.21.15.92:0/743592603 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+23132 (secure 0 0 0) 0x7f9a7c199730 con 0x7f9a7c101340 2024-09-10T10:52:09.905 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:09.905 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":104,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:52:01.148077+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:34:41.056656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:34:43.485327+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2834815615":"2024-09-11T10:36:38.391872+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/3275925367":"2024-09-11T10:36:38.391872+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/88974791":"2024-09-11T10:36:38.391872+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1498104734":"2024-09-11T10:36:38.391872+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1058999410":"2024-09-11T10:36:38.391872+0000","172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/2834815615":"2024-09-11T10:36:38.391872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9a680a2d00 msgr2=0x7f9a680a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9a680a2d00 0x7f9a680a51c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800bb60 tx=0x7f9a7800b390 comp rx=0 tx=0).stop 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c101340 msgr2=0x7f9a7c198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c101340 0x7f9a7c198920 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009230 tx=0x7f9a6c004270 comp rx=0 tx=0).stop 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 shutdown_connections 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f9a680a2d00 0x7f9a680a51c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f9a7c1069b0 0x7f9a7c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a7c101340 0x7f9a7c198920 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 --2- 172.21.15.92:0/743592603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a7c1009a0 0x7f9a7c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 >> 172.21.15.92:0/743592603 conn(0x7f9a7c0fc6c0 msgr2=0x7f9a7c0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:09.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 shutdown_connections 2024-09-10T10:52:09.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:09.905+0000 7f9a83ec9640 1 -- 172.21.15.92:0/743592603 wait complete. 2024-09-10T10:52:09.918 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T10:30:06.350576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T10:34:41.056656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T10:34:43.485327+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T10:52:09.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T10:52:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.020+0000 7f2a4ef86640 1 -- 172.21.15.92:0/1938581863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48105f80 msgr2=0x7f2a4810dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.020+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/1938581863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48105f80 0x7f2a4810dad0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009ca0 tx=0x7f2a4002a8c0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.020+0000 7f2a4ef86640 1 -- 172.21.15.92:0/1938581863 shutdown_connections 2024-09-10T10:52:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.020+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/1938581863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48105f80 0x7f2a4810dad0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.024 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.020+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/1938581863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a48101d00 0x7f2a48105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.020+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/1938581863 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48101350 0x7f2a48101730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.020+0000 7f2a4ef86640 1 -- 172.21.15.92:0/1938581863 >> 172.21.15.92:0/1938581863 conn(0x7f2a48077170 msgr2=0x7f2a480fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.020+0000 7f2a4ef86640 1 -- 172.21.15.92:0/1938581863 shutdown_connections 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.020+0000 7f2a4ef86640 1 -- 172.21.15.92:0/1938581863 wait complete. 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4ef86640 1 Processor -- start 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4ef86640 1 -- start start 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4ef86640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48101350 0x7f2a48199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4ef86640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48105f80 0x7f2a48199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4ef86640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a48199f10 0x7f2a481a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4ef86640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a48111030 con 0x7f2a48101350 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4ef86640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2a48110eb0 con 0x7f2a48105f80 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4ef86640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2a481111b0 con 0x7f2a48199f10 2024-09-10T10:52:10.025 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4cd22640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48101350 0x7f2a48199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4cd22640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48101350 0x7f2a48199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56162/0 (socket says 172.21.15.92:56162) 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4cd22640 1 -- 172.21.15.92:0/2835051945 learned_addr learned my addr 172.21.15.92:0/2835051945 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4d523640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a48199f10 0x7f2a481a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4cd22640 1 -- 172.21.15.92:0/2835051945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a48199f10 msgr2=0x7f2a481a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4cd22640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a48199f10 0x7f2a481a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a47fff640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48105f80 0x7f2a48199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4cd22640 1 -- 172.21.15.92:0/2835051945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48105f80 msgr2=0x7f2a48199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4cd22640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48105f80 0x7f2a48199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4cd22640 1 -- 172.21.15.92:0/2835051945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a481a4c90 con 0x7f2a48101350 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.021+0000 7f2a4d523640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a48199f10 0x7f2a481a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.022+0000 7f2a4cd22640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48101350 0x7f2a48199440 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00c890 tx=0x7f2a3c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.022+0000 7f2a45ffb640 1 -- 172.21.15.92:0/2835051945 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c004220 con 0x7f2a48101350 2024-09-10T10:52:10.026 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.022+0000 7f2a45ffb640 1 -- 172.21.15.92:0/2835051945 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a3c0043c0 con 0x7f2a48101350 2024-09-10T10:52:10.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.022+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a481a4f80 con 0x7f2a48101350 2024-09-10T10:52:10.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.022+0000 7f2a45ffb640 1 -- 172.21.15.92:0/2835051945 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0049e0 con 0x7f2a48101350 2024-09-10T10:52:10.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.022+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a481a5440 con 0x7f2a48101350 2024-09-10T10:52:10.027 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.023+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a48101730 con 0x7f2a48101350 2024-09-10T10:52:10.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.024+0000 7f2a45ffb640 1 -- 172.21.15.92:0/2835051945 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2a3c0079b0 con 0x7f2a48101350 2024-09-10T10:52:10.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.025+0000 7f2a45ffb640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2a380a2d00 0x7f2a380a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.025+0000 7f2a47fff640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2a380a2d00 0x7f2a380a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.025+0000 7f2a45ffb640 1 -- 172.21.15.92:0/2835051945 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7f2a3c0cf550 con 0x7f2a48101350 2024-09-10T10:52:10.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.025+0000 7f2a47fff640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2a380a2d00 0x7f2a380a51c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005d80 tx=0x7f2a34005c90 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:10.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.029+0000 7f2a45ffb640 1 -- 172.21.15.92:0/2835051945 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a3c014030 con 0x7f2a48101350 2024-09-10T10:52:10.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.195+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a48109130 con 0x7f2a48101350 2024-09-10T10:52:10.196 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.195+0000 7f2a45ffb640 1 -- 172.21.15.92:0/2835051945 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) ==== 93+0+10 (secure 0 0 0) 0x7f2a3c09c180 con 0x7f2a48101350 2024-09-10T10:52:10.197 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-09-10T10:52:10.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2a380a2d00 msgr2=0x7f2a380a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2a380a2d00 0x7f2a380a51c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005d80 tx=0x7f2a34005c90 comp rx=0 tx=0).stop 2024-09-10T10:52:10.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48101350 msgr2=0x7f2a48199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48101350 0x7f2a48199440 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00c890 tx=0x7f2a3c00cd50 comp rx=0 tx=0).stop 2024-09-10T10:52:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 shutdown_connections 2024-09-10T10:52:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a48199f10 0x7f2a481a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2a380a2d00 0x7f2a380a51c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2a48105f80 0x7f2a48199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 --2- 172.21.15.92:0/2835051945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a48101350 0x7f2a48199440 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 >> 172.21.15.92:0/2835051945 conn(0x7f2a48077170 msgr2=0x7f2a48104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 shutdown_connections 2024-09-10T10:52:10.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.197+0000 7f2a4ef86640 1 -- 172.21.15.92:0/2835051945 wait complete. 2024-09-10T10:52:10.210 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T10:52:10.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.312+0000 7f2b777d8640 1 -- 172.21.15.92:0/3059199934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 msgr2=0x7f2b7010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.312+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3059199934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 0x7f2b7010e530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009ca0 tx=0x7f2b6002a950 comp rx=0 tx=0).stop 2024-09-10T10:52:10.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.312+0000 7f2b777d8640 1 -- 172.21.15.92:0/3059199934 shutdown_connections 2024-09-10T10:52:10.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.312+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3059199934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 0x7f2b7010e530 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.312+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3059199934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b70103610 0x7f2b7010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.312+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3059199934 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b70102cf0 0x7f2b701030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.312+0000 7f2b777d8640 1 -- 172.21.15.92:0/3059199934 >> 172.21.15.92:0/3059199934 conn(0x7f2b700779d0 msgr2=0x7f2b700fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:10.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 -- 172.21.15.92:0/3059199934 shutdown_connections 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 -- 172.21.15.92:0/3059199934 wait complete. 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 Processor -- start 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 -- start start 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b70102cf0 0x7f2b701983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b70103610 0x7f2b701988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 0x7f2b7019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70111e70 con 0x7f2b7010c0c0 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70111cf0 con 0x7f2b70102cf0 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b777d8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70111ff0 con 0x7f2b70103610 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.313+0000 7f2b75d75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 0x7f2b7019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b75d75640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 0x7f2b7019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56180/0 (socket says 172.21.15.92:56180) 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b75d75640 1 -- 172.21.15.92:0/3124619956 learned_addr learned my addr 172.21.15.92:0/3124619956 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:10.317 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b74d73640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b70103610 0x7f2b701988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b75574640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b70102cf0 0x7f2b701983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b75d75640 1 -- 172.21.15.92:0/3124619956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b70103610 msgr2=0x7f2b701988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b75d75640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b70103610 0x7f2b701988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b75d75640 1 -- 172.21.15.92:0/3124619956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b70102cf0 msgr2=0x7f2b701983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b75d75640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b70102cf0 0x7f2b701983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b75d75640 1 -- 172.21.15.92:0/3124619956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7019d390 con 0x7f2b7010c0c0 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b75d75640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 0x7f2b7019cc60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2b6002ae70 tx=0x7f2b6002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b6e7fc640 1 -- 172.21.15.92:0/3124619956 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60034040 con 0x7f2b7010c0c0 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b6e7fc640 1 -- 172.21.15.92:0/3124619956 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b60030920 con 0x7f2b7010c0c0 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7019d620 con 0x7f2b7010c0c0 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b6e7fc640 1 -- 172.21.15.92:0/3124619956 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60045480 con 0x7f2b7010c0c0 2024-09-10T10:52:10.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.314+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b701a4f10 con 0x7f2b7010c0c0 2024-09-10T10:52:10.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.315+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b701030d0 con 0x7f2b7010c0c0 2024-09-10T10:52:10.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.316+0000 7f2b6e7fc640 1 -- 172.21.15.92:0/3124619956 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2b60037020 con 0x7f2b7010c0c0 2024-09-10T10:52:10.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.317+0000 7f2b6e7fc640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2b580a2d80 0x7f2b580a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.317+0000 7f2b75574640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2b580a2d80 0x7f2b580a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.317+0000 7f2b6e7fc640 1 -- 172.21.15.92:0/3124619956 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7f2b600f02c0 con 0x7f2b7010c0c0 2024-09-10T10:52:10.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.317+0000 7f2b75574640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2b580a2d80 0x7f2b580a5240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b680058c0 tx=0x7f2b6800a2d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:10.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.320+0000 7f2b6e7fc640 1 -- 172.21.15.92:0/3124619956 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b600811b0 con 0x7f2b7010c0c0 2024-09-10T10:52:10.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.488+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2b701071a0 con 0x7f2b7010c0c0 2024-09-10T10:52:10.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.489+0000 7f2b6e7fc640 1 -- 172.21.15.92:0/3124619956 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) ==== 104+0+11 (secure 0 0 0) 0x7f2b600bd000 con 0x7f2b7010c0c0 2024-09-10T10:52:10.491 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 32 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2b580a2d80 msgr2=0x7f2b580a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2b580a2d80 0x7f2b580a5240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b680058c0 tx=0x7f2b6800a2d0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 msgr2=0x7f2b7019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 0x7f2b7019cc60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2b6002ae70 tx=0x7f2b6002f5d0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 shutdown_connections 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b7010c0c0 0x7f2b7019cc60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b70103610 0x7f2b701988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f2b580a2d80 0x7f2b580a5240 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 --2- 172.21.15.92:0/3124619956 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2b70102cf0 0x7f2b701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 >> 172.21.15.92:0/3124619956 conn(0x7f2b700779d0 msgr2=0x7f2b700fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:10.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 shutdown_connections 2024-09-10T10:52:10.494 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.491+0000 7f2b777d8640 1 -- 172.21.15.92:0/3124619956 wait complete. 2024-09-10T10:52:10.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:10 smithi092 ceph-mon[30834]: pgmap v488: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 19 MiB/s wr, 1.85k op/s 2024-09-10T10:52:10.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:10 smithi092 ceph-mon[30834]: from='client.16482 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:10.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:10 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/743592603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:52:10.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T10:52:10.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:10 smithi121 ceph-mon[35231]: pgmap v488: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 19 MiB/s wr, 1.85k op/s 2024-09-10T10:52:10.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:10 smithi121 ceph-mon[35231]: from='client.16482 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:10.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:10 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/743592603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:52:10.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:10 smithi097 ceph-mon[35213]: pgmap v488: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 19 MiB/s wr, 1.85k op/s 2024-09-10T10:52:10.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:10 smithi097 ceph-mon[35213]: from='client.16482 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:10.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:10 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/743592603' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:52:10.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 -- 172.21.15.92:0/4221089433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9781035a0 msgr2=0x7fb97810ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.607 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 --2- 172.21.15.92:0/4221089433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9781035a0 0x7fb97810ba80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb974009900 tx=0x7fb97402a480 comp rx=0 tx=0).stop 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 -- 172.21.15.92:0/4221089433 shutdown_connections 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 --2- 172.21.15.92:0/4221089433 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb97810c0d0 0x7fb97810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 --2- 172.21.15.92:0/4221089433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9781035a0 0x7fb97810ba80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 --2- 172.21.15.92:0/4221089433 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb978102c80 0x7fb978103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 -- 172.21.15.92:0/4221089433 >> 172.21.15.92:0/4221089433 conn(0x7fb9780fc690 msgr2=0x7fb9780feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 -- 172.21.15.92:0/4221089433 shutdown_connections 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 -- 172.21.15.92:0/4221089433 wait complete. 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.604+0000 7fb97f99f640 1 Processor -- start 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97f99f640 1 -- start start 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97f99f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb978102c80 0x7fb9781008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97f99f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9781035a0 0x7fb978100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97f99f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97810c0d0 0x7fb978101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97f99f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb978111eb0 con 0x7fb97810c0d0 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97f99f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb978111d30 con 0x7fb9781035a0 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97f99f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb978112030 con 0x7fb978102c80 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97df3c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97810c0d0 0x7fb978101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97df3c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97810c0d0 0x7fb978101350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56206/0 (socket says 172.21.15.92:56206) 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97df3c640 1 -- 172.21.15.92:0/3703027564 learned_addr learned my addr 172.21.15.92:0/3703027564 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97cf3a640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9781035a0 0x7fb978100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97d73b640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb978102c80 0x7fb9781008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97df3c640 1 -- 172.21.15.92:0/3703027564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb978102c80 msgr2=0x7fb9781008d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97df3c640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb978102c80 0x7fb9781008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97df3c640 1 -- 172.21.15.92:0/3703027564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9781035a0 msgr2=0x7fb978100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97df3c640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9781035a0 0x7fb978100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97df3c640 1 -- 172.21.15.92:0/3703027564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9781a68c0 con 0x7fb97810c0d0 2024-09-10T10:52:10.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb97df3c640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97810c0d0 0x7fb978101350 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb97000cce0 tx=0x7fb97000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:10.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.605+0000 7fb96e7fc640 1 -- 172.21.15.92:0/3703027564 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97000f450 con 0x7fb97810c0d0 2024-09-10T10:52:10.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.606+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9781a6bb0 con 0x7fb97810c0d0 2024-09-10T10:52:10.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.606+0000 7fb96e7fc640 1 -- 172.21.15.92:0/3703027564 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb97000fad0 con 0x7fb97810c0d0 2024-09-10T10:52:10.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.606+0000 7fb96e7fc640 1 -- 172.21.15.92:0/3703027564 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970018c10 con 0x7fb97810c0d0 2024-09-10T10:52:10.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.606+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9781a70b0 con 0x7fb97810c0d0 2024-09-10T10:52:10.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.606+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb978103060 con 0x7fb97810c0d0 2024-09-10T10:52:10.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.608+0000 7fb96e7fc640 1 -- 172.21.15.92:0/3703027564 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb97000f5f0 con 0x7fb97810c0d0 2024-09-10T10:52:10.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.609+0000 7fb96e7fc640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb9640a2d00 0x7fb9640a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.609+0000 7fb97d73b640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb9640a2d00 0x7fb9640a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.609+0000 7fb96e7fc640 1 -- 172.21.15.92:0/3703027564 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7fb9700cfb80 con 0x7fb97810c0d0 2024-09-10T10:52:10.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.609+0000 7fb97d73b640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb9640a2d00 0x7fb9640a51c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb9680058c0 tx=0x7fb968005c60 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:10.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.612+0000 7fb96e7fc640 1 -- 172.21.15.92:0/3703027564 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb970014030 con 0x7fb97810c0d0 2024-09-10T10:52:10.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.779+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb9781071a0 con 0x7fb97810c0d0 2024-09-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.779+0000 7fb96e7fc640 1 -- 172.21.15.92:0/3703027564 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) ==== 100+0+11 (secure 0 0 0) 0x7fb97009c840 con 0x7fb97810c0d0 2024-09-10T10:52:10.781 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 64 2024-09-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb9640a2d00 msgr2=0x7fb9640a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb9640a2d00 0x7fb9640a51c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb9680058c0 tx=0x7fb968005c60 comp rx=0 tx=0).stop 2024-09-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97810c0d0 msgr2=0x7fb978101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97810c0d0 0x7fb978101350 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb97000cce0 tx=0x7fb97000a620 comp rx=0 tx=0).stop 2024-09-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 shutdown_connections 2024-09-10T10:52:10.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97810c0d0 0x7fb978101350 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb9640a2d00 0x7fb9640a51c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb9781035a0 0x7fb978100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 --2- 172.21.15.92:0/3703027564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb978102c80 0x7fb9781008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 >> 172.21.15.92:0/3703027564 conn(0x7fb9780fc690 msgr2=0x7fb9780fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 shutdown_connections 2024-09-10T10:52:10.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.781+0000 7fb97f99f640 1 -- 172.21.15.92:0/3703027564 wait complete. 2024-09-10T10:52:10.794 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T10:52:10.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.892+0000 7fd9b0e17640 1 -- 172.21.15.92:0/1851541472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac10c140 msgr2=0x7fd9ac10e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.892+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/1851541472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac10c140 0x7fd9ac10e5c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009ca0 tx=0x7fd9a402a950 comp rx=0 tx=0).stop 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.892+0000 7fd9b0e17640 1 -- 172.21.15.92:0/1851541472 shutdown_connections 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.892+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/1851541472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac10c140 0x7fd9ac10e5c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.892+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/1851541472 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ac103690 0x7fd9ac10bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.892+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/1851541472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9ac102d70 0x7fd9ac103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.892+0000 7fd9b0e17640 1 -- 172.21.15.92:0/1851541472 >> 172.21.15.92:0/1851541472 conn(0x7fd9ac0fc740 msgr2=0x7fd9ac0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.892+0000 7fd9b0e17640 1 -- 172.21.15.92:0/1851541472 shutdown_connections 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.892+0000 7fd9b0e17640 1 -- 172.21.15.92:0/1851541472 wait complete. 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9b0e17640 1 Processor -- start 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9b0e17640 1 -- start start 2024-09-10T10:52:10.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9b0e17640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ac102d70 0x7fd9ac198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9b0e17640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac103690 0x7fd9ac198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9b0e17640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9ac10c140 0x7fd9ac19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9b0e17640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac111f20 con 0x7fd9ac103690 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9b0e17640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac111da0 con 0x7fd9ac102d70 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9b0e17640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9ac1120a0 con 0x7fd9ac10c140 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9a9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac103690 0x7fd9ac198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9a9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac103690 0x7fd9ac198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56222/0 (socket says 172.21.15.92:56222) 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9a9d9b640 1 -- 172.21.15.92:0/3666996260 learned_addr learned my addr 172.21.15.92:0/3666996260 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9a9d9b640 1 -- 172.21.15.92:0/3666996260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9ac10c140 msgr2=0x7fd9ac19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9a9d9b640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9ac10c140 0x7fd9ac19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9aa59c640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ac102d70 0x7fd9ac198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9a9d9b640 1 -- 172.21.15.92:0/3666996260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ac102d70 msgr2=0x7fd9ac198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:10.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9a9d9b640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ac102d70 0x7fd9ac198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:10.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9a9d9b640 1 -- 172.21.15.92:0/3666996260 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9ac19d440 con 0x7fd9ac103690 2024-09-10T10:52:10.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.893+0000 7fd9aa59c640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ac102d70 0x7fd9ac198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:52:10.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.894+0000 7fd9a9d9b640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac103690 0x7fd9ac198990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00d950 tx=0x7fd99c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:10.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.894+0000 7fd99b7fe640 1 -- 172.21.15.92:0/3666996260 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c017030 con 0x7fd9ac103690 2024-09-10T10:52:10.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.894+0000 7fd99b7fe640 1 -- 172.21.15.92:0/3666996260 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd99c004020 con 0x7fd9ac103690 2024-09-10T10:52:10.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.894+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9ac19d730 con 0x7fd9ac103690 2024-09-10T10:52:10.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.894+0000 7fd99b7fe640 1 -- 172.21.15.92:0/3666996260 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0047a0 con 0x7fd9ac103690 2024-09-10T10:52:10.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.894+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9ac1a4fc0 con 0x7fd9ac103690 2024-09-10T10:52:10.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.895+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9ac103150 con 0x7fd9ac103690 2024-09-10T10:52:10.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.896+0000 7fd99b7fe640 1 -- 172.21.15.92:0/3666996260 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd99c0041d0 con 0x7fd9ac103690 2024-09-10T10:52:10.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.896+0000 7fd99b7fe640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd9940a2d80 0x7fd9940a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:10.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.897+0000 7fd9aa59c640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd9940a2d80 0x7fd9940a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:10.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.897+0000 7fd99b7fe640 1 -- 172.21.15.92:0/3666996260 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8499+0+0 (secure 0 0 0) 0x7fd99c0cedb0 con 0x7fd9ac103690 2024-09-10T10:52:10.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.897+0000 7fd9aa59c640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd9940a2d80 0x7fd9940a5240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009b40 tx=0x7fd9a0005e50 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:10.902 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:10.901+0000 7fd99b7fe640 1 -- 172.21.15.92:0/3666996260 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd99c09b9e0 con 0x7fd9ac103690 2024-09-10T10:52:11.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.118+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fd9ac106c60 con 0x7fd9ac103690 2024-09-10T10:52:11.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.126+0000 7fd99b7fe640 1 -- 172.21.15.92:0/3666996260 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740902 (secure 0 0 0) 0x7fd99c09b2e0 con 0x7fd9ac103690 2024-09-10T10:52:11.137 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:11.137 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:52:11.137 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 25, 2024-09-10T10:52:11.137 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.137 INFO:teuthology.orchestra.run.smithi092.stdout: "active_gid": 15234, 2024-09-10T10:52:11.137 INFO:teuthology.orchestra.run.smithi092.stdout: "active_name": "x", 2024-09-10T10:52:11.137 INFO:teuthology.orchestra.run.smithi092.stdout: "active_addrs": { 2024-09-10T10:52:11.137 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:6800", 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3516468262 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v1", 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:6801", 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3516468262 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.138 INFO:teuthology.orchestra.run.smithi092.stdout: "active_addr": "172.21.15.92:6801/3516468262", 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "active_change": "2024-09-10T10:36:38.392110+0000", 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "active_mgr_features": 4540701547738038271, 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "available": true, 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "standbys": [ 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "gid": 24776, 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "y", 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr_features": 4540701547738038271, 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.139 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.140 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.141 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.142 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.143 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.144 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.145 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.146 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to", 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.147 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.148 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.149 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.150 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.151 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.152 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.153 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.154 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.155 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:52:11.156 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:52:11.157 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.158 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.159 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2024-09-10T10:52:11.160 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.161 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-10T10:52:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.163 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.164 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.165 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.165 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.165 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.165 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.168 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.169 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.170 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:11.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.172 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "read", 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap", 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap-read" 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.173 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.174 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T10:52:11.175 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.176 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.177 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.178 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.179 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.180 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.181 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.182 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.183 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.184 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2024-09-10T10:52:11.185 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.186 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.187 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.188 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.189 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.189 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.189 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.189 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T10:52:11.189 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.189 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.189 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.190 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.191 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2024-09-10T10:52:11.192 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.193 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.194 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.195 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.196 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.198 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T10:52:11.199 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.200 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.201 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.202 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.203 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba": { 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba", 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.204 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB container image", 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2024-09-10T10:52:11.205 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2024-09-10T10:52:11.206 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.207 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.208 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.209 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.210 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.211 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.212 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.213 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "grafana_dashboards_path": { 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "grafana_dashboards_path", 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.214 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.215 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "hw_monitoring": { 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hw_monitoring", 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T10:52:11.216 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.217 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.218 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2024-09-10T10:52:11.219 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.220 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.221 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.222 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.223 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.224 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.225 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.226 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.227 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.228 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.229 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "oob_default_addr": { 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "oob_default_addr", 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.230 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "169.254.1.1", 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.231 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.232 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.233 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2024-09-10T10:52:11.234 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2024-09-10T10:52:11.235 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2024-09-10T10:52:11.236 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2024-09-10T10:52:11.237 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.238 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.239 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.240 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.241 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.242 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.244 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.245 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.246 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.247 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.248 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.249 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.252 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.253 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.254 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.255 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.256 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.257 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.258 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.259 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T10:52:11.260 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.262 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.263 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.264 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.265 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.266 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.267 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.268 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.269 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.270 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.271 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.272 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.273 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.274 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.275 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.276 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.277 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.278 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.279 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.280 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.281 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.282 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.283 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.284 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.285 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.286 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.287 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.288 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2024-09-10T10:52:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.289 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.290 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.291 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.292 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.293 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.294 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.295 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.296 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.297 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.298 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.299 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.300 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.301 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.302 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.304 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.305 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.306 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.307 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2024-09-10T10:52:11.308 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T10:52:11.309 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-10T10:52:11.310 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-10T10:52:11.311 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-10T10:52:11.312 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2024-09-10T10:52:11.313 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.315 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.316 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.317 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2024-09-10T10:52:11.318 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.319 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.320 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.321 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.322 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.326 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.328 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T10:52:11.329 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.330 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.331 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.332 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.333 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.335 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.336 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2024-09-10T10:52:11.337 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2024-09-10T10:52:11.338 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.339 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.340 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.341 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.342 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.343 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.344 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.345 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.346 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.348 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.349 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2024-09-10T10:52:11.350 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2024-09-10T10:52:11.351 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-10T10:52:11.352 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2024-09-10T10:52:11.353 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2024-09-10T10:52:11.354 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2024-09-10T10:52:11.355 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.356 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.357 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.358 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.360 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.361 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.362 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.363 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.364 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.365 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.366 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.367 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.368 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.370 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.371 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.372 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.374 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.374 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.374 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.376 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.376 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.376 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.376 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.376 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.376 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.376 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.376 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.376 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.377 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.378 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.379 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.381 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.382 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.383 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.384 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.385 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.386 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.387 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.388 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T10:52:11.389 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.390 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.391 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.392 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.393 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.394 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.395 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.396 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.397 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.398 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.399 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.400 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.401 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.402 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.403 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.404 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.405 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.406 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2024-09-10T10:52:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.408 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.409 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.410 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.411 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.413 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2024-09-10T10:52:11.414 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.415 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.416 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.417 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.418 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.420 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.421 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.422 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.423 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.424 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.425 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.427 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.428 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.429 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.430 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.431 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.432 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.433 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.434 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.435 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.436 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.437 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.439 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.440 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.441 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:11.442 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.443 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.444 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.445 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.446 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.447 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.448 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.449 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.450 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.451 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.452 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.453 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.454 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.455 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.456 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.457 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.458 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.459 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.460 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.461 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.462 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.463 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.464 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.465 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.466 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.467 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.468 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.469 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.470 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.471 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.472 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.473 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.474 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.476 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2024-09-10T10:52:11.477 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.478 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.479 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.480 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.481 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.482 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.483 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.484 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.485 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.486 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.487 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2024-09-10T10:52:11.488 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.490 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.490 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2024-09-10T10:52:11.490 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.490 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.490 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.490 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.490 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.490 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.490 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.491 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.492 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.493 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.494 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2024-09-10T10:52:11.495 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.496 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.497 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.498 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.499 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2024-09-10T10:52:11.500 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2024-09-10T10:52:11.501 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2024-09-10T10:52:11.502 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2024-09-10T10:52:11.503 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2024-09-10T10:52:11.504 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2024-09-10T10:52:11.505 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2024-09-10T10:52:11.506 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.507 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.508 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.509 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.510 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.511 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.513 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.514 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.517 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.518 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.519 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.520 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.521 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.522 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.523 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.524 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.525 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.526 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.527 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.528 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.530 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.531 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.532 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.533 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2024-09-10T10:52:11.534 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2024-09-10T10:52:11.535 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.536 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.537 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2024-09-10T10:52:11.538 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.539 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.540 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.541 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.542 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.543 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.544 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.545 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.546 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.547 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.548 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.554 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T10:52:11.555 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.556 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.557 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.558 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.559 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.561 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.562 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.563 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.564 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.565 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.566 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.567 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.568 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2024-09-10T10:52:11.569 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T10:52:11.570 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_no_wait": { 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T10:52:11.571 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2024-09-10T10:52:11.572 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2024-09-10T10:52:11.573 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:11.574 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.575 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.576 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.577 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.578 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.579 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2024-09-10T10:52:11.580 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2024-09-10T10:52:11.581 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2024-09-10T10:52:11.582 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.583 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: "gid": 24799, 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "z", 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: "mgr_features": 4540701547738038271, 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2024-09-10T10:52:11.584 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.585 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.586 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.587 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.588 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.589 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.590 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2024-09-10T10:52:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to", 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.592 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.593 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.594 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.596 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.597 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T10:52:11.598 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.599 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2024-09-10T10:52:11.600 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.601 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.602 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.603 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.604 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T10:52:11.605 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T10:52:11.606 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.607 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:52:11.608 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.609 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.610 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.611 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.612 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.613 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.614 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.615 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "read", 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap", 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap-read" 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.616 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.617 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.618 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.619 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.620 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.624 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2024-09-10T10:52:11.625 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.626 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.627 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.628 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.629 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.630 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.631 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.632 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.633 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.634 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.635 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.636 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.637 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2024-09-10T10:52:11.638 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.639 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.640 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.642 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.643 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2024-09-10T10:52:11.644 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.645 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.646 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba": { 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba", 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.647 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB container image", 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.648 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.649 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.650 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.651 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2024-09-10T10:52:11.652 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2024-09-10T10:52:11.653 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.654 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.655 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "grafana_dashboards_path": { 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "grafana_dashboards_path", 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.656 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.657 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "hw_monitoring": { 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hw_monitoring", 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.658 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.659 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.660 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.661 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.662 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.663 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.664 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.665 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.666 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.667 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.668 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.669 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.670 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2024-09-10T10:52:11.671 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-10T10:52:11.672 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.673 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "oob_default_addr": { 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "oob_default_addr", 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "169.254.1.1", 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.674 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.675 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T10:52:11.676 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.677 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.678 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.679 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.680 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2024-09-10T10:52:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.682 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.683 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.684 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.685 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.686 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.687 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.688 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.689 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.690 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.691 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.692 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.693 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.694 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.695 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T10:52:11.696 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T10:52:11.697 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.698 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.699 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T10:52:11.700 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T10:52:11.701 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T10:52:11.702 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T10:52:11.703 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T10:52:11.704 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.705 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.706 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T10:52:11.707 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.708 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T10:52:11.709 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T10:52:11.710 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.711 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2024-09-10T10:52:11.712 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T10:52:11.713 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T10:52:11.714 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T10:52:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T10:52:11.716 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T10:52:11.717 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T10:52:11.718 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T10:52:11.719 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.720 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.721 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.722 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.723 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.724 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.725 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.726 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.727 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.728 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.729 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.730 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.731 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.732 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.733 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.734 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T10:52:11.735 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T10:52:11.736 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T10:52:11.737 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T10:52:11.738 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T10:52:11.739 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2024-09-10T10:52:11.740 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2024-09-10T10:52:11.741 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2024-09-10T10:52:11.742 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.743 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.744 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.745 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.746 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.747 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.748 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.750 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2024-09-10T10:52:11.751 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.752 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.753 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.754 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.755 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.756 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.757 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.759 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.760 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.761 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.762 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.763 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.763 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.763 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.763 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.763 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.763 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.763 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.763 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.763 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.764 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.765 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.766 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.767 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.768 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.769 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.770 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.771 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.772 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.773 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T10:52:11.774 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.775 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.776 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.777 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.778 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.779 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.780 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.781 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.782 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.783 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.784 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.785 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.786 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.788 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.789 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.790 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.791 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2024-09-10T10:52:11.793 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.794 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.795 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.796 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2024-09-10T10:52:11.798 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:52:11.799 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.800 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.801 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.802 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.803 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.804 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.805 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.806 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.807 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.809 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.810 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.811 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.812 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.813 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.814 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.815 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.816 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.817 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.818 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.819 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.820 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.821 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.822 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.823 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.824 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T10:52:11.826 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2024-09-10T10:52:11.827 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2024-09-10T10:52:11.828 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.829 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2024-09-10T10:52:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.832 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.833 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.834 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.835 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.836 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.837 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.838 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.839 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.840 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.841 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.842 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.843 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.844 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.845 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.846 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.847 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-10T10:52:11.848 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.849 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.850 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.851 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.852 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.853 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.854 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2024-09-10T10:52:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.856 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.857 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.858 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.859 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.860 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.861 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.862 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.863 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.863 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.863 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.863 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.863 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.863 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.863 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.863 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.863 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.864 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.865 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.866 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.867 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.868 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.869 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.870 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.871 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.872 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T10:52:11.875 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.876 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.877 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.878 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.879 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.880 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.881 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.882 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2024-09-10T10:52:11.883 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:11.884 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.885 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.886 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.887 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.888 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.889 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.890 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.891 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.892 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.893 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.894 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.895 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.896 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.897 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.898 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.899 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.900 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-10T10:52:11.901 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.902 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.903 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.904 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.905 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.906 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.907 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.908 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2024-09-10T10:52:11.910 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.911 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.912 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.913 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.914 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.915 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.916 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.917 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.918 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.919 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.920 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.921 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.922 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.923 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.924 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.925 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.926 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.927 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.928 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.930 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T10:52:11.931 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.932 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.933 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.934 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.935 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.936 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2024-09-10T10:52:11.937 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2024-09-10T10:52:11.938 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2024-09-10T10:52:11.939 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2024-09-10T10:52:11.940 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.941 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.942 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.943 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.944 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.945 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.946 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.947 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.948 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.949 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.950 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.951 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.953 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.954 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.955 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.956 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.957 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.958 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.959 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.960 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.961 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.962 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.963 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.965 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.966 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.967 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.968 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.969 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.970 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.971 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.972 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.973 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.974 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.975 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.976 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.977 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.978 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.979 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.980 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.981 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.982 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.983 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.985 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.986 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2024-09-10T10:52:11.987 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2024-09-10T10:52:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.989 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.990 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.991 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.992 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.993 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:11.994 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.995 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.996 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:11.998 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.000 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.001 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.002 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.003 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.004 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.005 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.006 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.007 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.009 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.010 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.011 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.012 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T10:52:12.013 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2024-09-10T10:52:12.014 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.015 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_no_wait": { 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.016 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.017 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.018 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.019 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.020 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.021 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.022 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.023 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.024 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.025 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.026 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2024-09-10T10:52:12.027 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.028 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.029 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "modules": [ 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "dashboard", 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "iostat", 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "nfs", 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "restful", 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "snap_schedule" 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "available_modules": [ 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "alerts", 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:12.030 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.031 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.032 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.033 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.034 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.035 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.036 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_destination": { 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_destination", 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.037 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email address to send alerts to", 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_from_name": { 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_from_name", 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.038 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "Ceph", 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Email From: name", 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_host": { 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_host", 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.039 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP server", 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_password": { 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_password", 2024-09-10T10:52:12.040 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Password to authenticate with", 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_port": { 2024-09-10T10:52:12.041 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_port", 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "465", 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP port", 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.042 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_sender": { 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_sender", 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SMTP envelope sender", 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.043 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_ssl": { 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_ssl", 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.044 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "smtp_user": { 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "smtp_user", 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "User to authenticate as", 2024-09-10T10:52:12.045 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "balancer", 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "active": { 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "active", 2024-09-10T10:52:12.046 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_time": { 2024-09-10T10:52:12.047 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_time", 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0000", 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "begin_weekday": { 2024-09-10T10:52:12.048 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "begin_weekday", 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.049 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_max_iterations": { 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_max_iterations", 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "25", 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "250", 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.050 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_metrics": { 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_metrics", 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.051 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "crush_compat_step": { 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crush_compat_step", 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.5", 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0.001", 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "0.999", 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "aggressiveness of optimization", 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T10:52:12.052 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "end_time": { 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_time", 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2359", 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T10:52:12.053 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "end_weekday": { 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "end_weekday", 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "0", 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "6", 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.054 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.055 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.056 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.057 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.058 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.059 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "min_score": { 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_score", 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.060 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.061 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "upmap", 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "crush-compat", 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "none", 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "read", 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap", 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap-read" 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Balancer mode", 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.062 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_ids": { 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_ids", 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.063 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:12.064 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_deviation": { 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_deviation", 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.065 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "upmap_max_optimizations": { 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "upmap_max_optimizations", 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:12.066 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.067 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm", 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_down_multiplier": { 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_down_multiplier", 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.068 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_refresh_rate": { 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_refresh_rate", 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "20", 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.069 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "agent_starting_port": { 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "agent_starting_port", 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4721", 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.070 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_ptrace": { 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_ptrace", 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.071 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_interval": { 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_interval", 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:12.072 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "autotune_memory_target_ratio": { 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.073 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0.7", 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm_log_destination": { 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cephadm_log_destination", 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.074 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "file", 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "file,syslog", 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "syslog" 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "cgroups_split": { 2024-09-10T10:52:12.075 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cgroups_split", 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "config_checks_enabled": { 2024-09-10T10:52:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_checks_enabled", 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.077 INFO:teuthology.orchestra.run.smithi092.stdout: "config_dashboard": { 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_dashboard", 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.078 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_alertmanager": { 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_alertmanager", 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.079 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_base": { 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_base", 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Container image name, without the tag", 2024-09-10T10:52:12.080 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_elasticsearch": { 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_elasticsearch", 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.081 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "elasticsearch container image", 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_grafana": { 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_grafana", 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.082 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_haproxy": { 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_haproxy", 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.083 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "HAproxy container image", 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_agent": { 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_agent", 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T10:52:12.084 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger agent container image", 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_collector": { 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_collector", 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.085 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger collector container image", 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_jaeger_query": { 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_jaeger_query", 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.086 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Jaeger query container image", 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_keepalived": { 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_keepalived", 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.087 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Keepalived container image", 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_loki": { 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_loki", 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.088 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Loki container image", 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_node_exporter": { 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_node_exporter", 2024-09-10T10:52:12.089 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_nvmeof": { 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_nvmeof", 2024-09-10T10:52:12.090 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Nvme-of container image", 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_prometheus": { 2024-09-10T10:52:12.091 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_prometheus", 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Prometheus container image", 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_promtail": { 2024-09-10T10:52:12.092 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_promtail", 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Promtail container image", 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.093 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_samba": { 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_samba", 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Samba/SMB container image", 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.094 INFO:teuthology.orchestra.run.smithi092.stdout: "container_image_snmp_gateway": { 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_image_snmp_gateway", 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "SNMP Gateway container image", 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.095 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "container_init": { 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "container_init", 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.096 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "daemon_cache_timeout": { 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "daemon_cache_timeout", 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T10:52:12.097 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "default_cephadm_command_timeout": { 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "900", 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.098 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "default_registry": { 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "default_registry", 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "docker.io", 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.099 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "device_cache_timeout": { 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_cache_timeout", 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1800", 2024-09-10T10:52:12.100 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache device inventory", 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "device_enhanced_scan": { 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_enhanced_scan", 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.101 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "facts_cache_timeout": { 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "facts_cache_timeout", 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.102 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "seconds to cache host facts data", 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "grafana_dashboards_path": { 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "grafana_dashboards_path", 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.103 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "host_check_interval": { 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "host_check_interval", 2024-09-10T10:52:12.104 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to perform a host check", 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "hw_monitoring": { 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hw_monitoring", 2024-09-10T10:52:12.105 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "inventory_list_all": { 2024-09-10T10:52:12.106 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "inventory_list_all", 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.107 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "log_refresh_metadata": { 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_refresh_metadata", 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.109 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.110 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.111 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.112 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.113 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.114 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "*", 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.115 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "max_count_per_host": { 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_count_per_host", 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:12.116 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of daemons per service per host", 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "max_osd_draining_count": { 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_osd_draining_count", 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:12.117 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "migration_current": { 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "migration_current", 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.118 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "internal - do not modify", 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "mode": { 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mode", 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "root", 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm-package", 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "root" 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "oob_default_addr": { 2024-09-10T10:52:12.120 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "oob_default_addr", 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "169.254.1.1", 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.121 INFO:teuthology.orchestra.run.smithi092.stdout: "prometheus_alerts_path": { 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus_alerts_path", 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.122 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_insecure": { 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_insecure", 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.123 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_password": { 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_password", 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.124 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_url": { 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_url", 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.125 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "registry_username": { 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "registry_username", 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T10:52:12.126 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "secure_monitoring_stack": { 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "secure_monitoring_stack", 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.127 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "service_discovery_port": { 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "service_discovery_port", 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8765", 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.128 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "cephadm service discovery port", 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "ssh_config_file": { 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssh_config_file", 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.129 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "use_agent": { 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_agent", 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.130 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "use_repo_digest": { 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "use_repo_digest", 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.131 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_failed_host_check": { 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_failed_host_check", 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.132 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_daemons": { 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_daemons", 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.133 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_on_stray_hosts": { 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_on_stray_hosts", 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.134 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crash", 2024-09-10T10:52:12.135 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.136 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.137 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.138 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.139 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.140 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "retain_interval": { 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retain_interval", 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "31536000", 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T10:52:12.141 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_recent_interval": { 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_recent_interval", 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1209600", 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T10:52:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dashboard", 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.143 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T10:52:12.144 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.145 INFO:teuthology.orchestra.run.smithi092.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_ENABLED": { 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.147 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.148 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.149 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.150 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.151 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.152 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.153 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.154 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.155 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.156 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.157 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.158 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.159 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_URL": { 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_URL", 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.160 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.161 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.162 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T10:52:12.163 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.164 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.164 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.164 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.164 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.164 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.164 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.164 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.164 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.164 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.165 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.166 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.167 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.168 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.169 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.171 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.172 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.173 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.174 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.175 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.176 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.177 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.178 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.179 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8", 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T10:52:12.180 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "45", 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T10:52:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T10:52:12.182 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "admin", 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.183 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.184 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.185 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.186 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.187 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.188 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "cross_origin_url": { 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cross_origin_url", 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.189 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "crt_file": { 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "crt_file", 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.190 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "debug": { 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "debug", 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Enable/disable debug options", 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.191 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "jwt_token_ttl": { 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "jwt_token_ttl", 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "28800", 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.192 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.193 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.194 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.195 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.196 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.197 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.198 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "motd": { 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "motd", 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.199 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "The message of the day", 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect_resolve_ip_addr": { 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.200 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.201 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.202 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8080", 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.203 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl_server_port": { 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl_server_port", 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.204 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8443", 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.205 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "redirect", 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "redirect" 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.206 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.207 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "url_prefix": { 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url_prefix", 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.208 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_monitoring": { 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_monitoring", 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.209 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "monitor device health metrics", 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.210 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.211 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.212 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.213 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.214 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "mark_out_threshold": { 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mark_out_threshold", 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "2419200", 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.216 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "pool_name": { 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pool_name", 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "device_health_metrics", 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T10:52:12.217 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "retention_period": { 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "retention_period", 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15552000", 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.218 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long to retain device health metrics", 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_frequency": { 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_frequency", 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.219 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "self_heal": { 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "self_heal", 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.220 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.221 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.222 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T10:52:12.222 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.222 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.222 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.222 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.222 INFO:teuthology.orchestra.run.smithi092.stdout: "warn_threshold": { 2024-09-10T10:52:12.222 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "warn_threshold", 2024-09-10T10:52:12.222 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.311 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.311 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.311 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7257600", 2024-09-10T10:52:12.311 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.311 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.312 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.312 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T10:52:12.312 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.312 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.312 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.313 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.313 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.313 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.313 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "diskprediction_local", 2024-09-10T10:52:12.313 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.313 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.314 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.314 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.314 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.314 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.314 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.314 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.314 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.314 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.315 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.315 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.315 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.315 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.315 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.315 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.315 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.316 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.317 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.317 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.317 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.317 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.317 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.317 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.317 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.317 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.317 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.318 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.319 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.319 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.319 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.319 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.319 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.319 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.319 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.319 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.319 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.320 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.321 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.321 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.321 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.321 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.321 INFO:teuthology.orchestra.run.smithi092.stdout: "predict_interval": { 2024-09-10T10:52:12.321 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predict_interval", 2024-09-10T10:52:12.321 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.321 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.322 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.322 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "86400", 2024-09-10T10:52:12.322 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.322 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.322 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.322 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.322 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.322 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "predictor_model": { 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "predictor_model", 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "prophetstor", 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.323 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.324 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.324 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.324 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.324 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.324 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.324 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:12.324 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:12.324 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.324 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "600", 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.325 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "influx", 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": false, 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "influxdb python module not found", 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "batch_size": { 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "batch_size", 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5000", 2024-09-10T10:52:12.326 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "database": { 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "database", 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.327 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "ceph", 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "hostname": { 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "hostname", 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.328 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server hostname", 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:12.329 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "30", 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "5", 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.330 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.331 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.332 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.333 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.334 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.335 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "password": { 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "password", 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.336 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "password of InfluxDB server user", 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "port": { 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "port", 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "8086", 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.337 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "InfluxDB server port", 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "ssl": { 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ssl", 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "false", 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.338 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "threads": { 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threads", 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:12.339 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "32", 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "username": { 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "username", 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.340 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "username of InfluxDB server user", 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "verify_ssl": { 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "verify_ssl", 2024-09-10T10:52:12.341 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "true", 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.342 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "insights", 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.343 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.344 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.345 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.346 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.347 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.348 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "iostat", 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.349 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.350 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.351 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.352 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.353 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.354 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "k8sevents", 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_event_retention_days": { 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "ceph_event_retention_days", 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.355 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "7", 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "config_check_secs": { 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "config_check_secs", 2024-09-10T10:52:12.356 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "10", 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.357 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.358 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.359 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.360 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.361 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.362 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "localpool", 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: "failure_domain": { 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "failure_domain", 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.363 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "host", 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "failure domain for any created local pool", 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.364 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.365 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.365 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.365 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.365 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.365 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.365 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.365 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.365 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.365 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.366 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.367 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.368 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.369 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "min_size": { 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "min_size", 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.370 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default min_size for any created local pool", 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "num_rep": { 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "num_rep", 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3", 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.371 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default replica count for any created local pool", 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_num": { 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_num", 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "128", 2024-09-10T10:52:12.372 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "prefix": { 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prefix", 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.373 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "name prefix for any created local pool", 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "subtree": { 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "subtree", 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.374 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "rack", 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.375 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mds_autoscaler", 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.376 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.377 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.378 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.379 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.380 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.381 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirroring", 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.382 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.383 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.384 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.385 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.386 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.387 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "nfs", 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.388 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.389 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.390 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.392 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-10T10:52:12.393 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "fail_fs": { 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "fail_fs", 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T10:52:12.394 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.395 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.396 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.397 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.398 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.399 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator": { 2024-09-10T10:52:12.400 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "orchestrator", 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "cephadm", 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "rook", 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "test_orchestrator" 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.401 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Orchestrator backend", 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_perf_query", 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.402 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.403 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.404 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.405 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.406 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.407 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "osd_support", 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.408 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.409 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.410 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.411 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.412 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.413 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "pg_autoscaler", 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.414 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.416 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.417 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.418 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.419 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "threshold": { 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "threshold", 2024-09-10T10:52:12.420 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "3.0", 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1.0", 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "scaling threshold", 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "progress", 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_pg_recovery_event": { 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_pg_recovery_event", 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.422 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.423 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.424 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.425 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.426 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.427 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.428 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "max_completed_events": { 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_completed_events", 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.429 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "50", 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "number of past completed events to remember", 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "sleep_interval": { 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "sleep_interval", 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.430 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "5", 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "how long the module is going to sleep", 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "prometheus", 2024-09-10T10:52:12.431 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "cache": { 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "cache", 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.432 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "exclude_perf_counters": { 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "exclude_perf_counters", 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.433 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.434 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.435 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.436 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.437 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.438 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.439 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools": { 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools", 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "300", 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.441 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "scrape_interval": { 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "scrape_interval", 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15.0", 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.442 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "::", 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.443 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "9283", 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.444 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "stale_cache_strategy": { 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stale_cache_strategy", 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "log", 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_behaviour": { 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_behaviour", 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "default", 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.446 INFO:teuthology.orchestra.run.smithi092.stdout: "default", 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "error" 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "standby_error_status_code": { 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "standby_error_status_code", 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.447 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "500", 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "400", 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "599", 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.448 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.449 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.450 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.451 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.452 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.453 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_snap_create": { 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_snap_create", 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10", 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.454 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "mirror_snapshot_schedule": { 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.455 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "trash_purge_schedule": { 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "trash_purge_schedule", 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.456 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "restful", 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "enable_auth": { 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enable_auth", 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.457 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "key_file": { 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "key_file", 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.458 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.459 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.460 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.461 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.462 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.463 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "server_addr": { 2024-09-10T10:52:12.464 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_addr", 2024-09-10T10:52:12.465 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.465 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.465 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.465 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.465 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.465 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.465 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.465 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "server_port": { 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "server_port", 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.466 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rgw", 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.467 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.468 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.469 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.470 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.471 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.472 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rook", 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.473 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.474 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.475 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.476 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.477 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.478 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "storage_class": { 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "storage_class", 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.479 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "local", 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.480 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "selftest", 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.481 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.482 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.483 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.484 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.485 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "roption1": { 2024-09-10T10:52:12.486 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption1", 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.487 INFO:teuthology.orchestra.run.smithi092.stdout: "roption2": { 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "roption2", 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "xyz", 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.488 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption1": { 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption1", 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.489 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption2": { 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption2", 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.490 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption3": { 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption3", 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "float", 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.491 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption4": { 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption4", 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.492 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption5": { 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption5", 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.493 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption6": { 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption6", 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.494 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "rwoption7": { 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rwoption7", 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.495 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "1", 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "42", 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "testkey": { 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testkey", 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.496 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "testlkey": { 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testlkey", 2024-09-10T10:52:12.497 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "testnewline": { 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "testnewline", 2024-09-10T10:52:12.498 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.499 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "allow_m_granularity": { 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "allow_m_granularity", 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.500 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "dump_on_update": { 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "dump_on_update", 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.501 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "dump database to debug log on update", 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.502 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.503 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.504 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.505 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.506 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.507 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "stats", 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.508 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.509 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.510 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.511 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.512 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.513 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "status", 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.514 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.515 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.516 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.517 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.518 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.519 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telegraf", 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "address": { 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "address", 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.520 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "15", 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.521 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.522 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.523 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.524 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.525 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.526 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "telemetry", 2024-09-10T10:52:12.527 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_basic": { 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_basic", 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.528 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_crash": { 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_crash", 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.529 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_device": { 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_device", 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.530 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_ident": { 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_ident", 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.531 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "channel_perf": { 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "channel_perf", 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.532 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "contact": { 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "contact", 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.533 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "description": { 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "description", 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.534 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "device_url": { 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "device_url", 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.535 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "enabled": { 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "enabled", 2024-09-10T10:52:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:12.537 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "24", 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "8", 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.538 INFO:teuthology.orchestra.run.smithi092.stdout: "last_opt_revision": { 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "last_opt_revision", 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "1", 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard": { 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard", 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.540 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "leaderboard_description": { 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "leaderboard_description", 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.541 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.542 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.543 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.544 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.545 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.546 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "organization": { 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "organization", 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.547 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "proxy": { 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "proxy", 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.548 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "url": { 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "url", 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.549 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.550 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "test_orchestrator", 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.551 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.552 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.553 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.554 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.555 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.556 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.557 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.558 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.559 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.560 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.561 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "max_concurrent_clones": { 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "max_concurrent_clones", 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "4", 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.562 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "periodic_async_work": { 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "periodic_async_work", 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.563 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Periodically check for async work", 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_delay": { 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_delay", 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "0", 2024-09-10T10:52:12.564 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: "snapshot_clone_no_wait": { 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T10:52:12.565 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "True", 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.566 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix", 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "can_run": true, 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "error_string": "", 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "module_options": { 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "discovery_interval": { 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "discovery_interval", 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "uint", 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.567 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "100", 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "identifier": { 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "identifier", 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.568 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "interval": { 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "interval", 2024-09-10T10:52:12.569 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "secs", 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "60", 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "log_level": { 2024-09-10T10:52:12.570 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_level", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.571 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster": { 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster", 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.572 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_cluster_level": { 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_cluster_level", 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "info", 2024-09-10T10:52:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [ 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "", 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "critical", 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "debug", 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "error", 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "info", 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "warning" 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.574 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "log_to_file": { 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "log_to_file", 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "bool", 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 1, 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "False", 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.575 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_host": { 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_host", 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "", 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_port": { 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_port", 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "int", 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "10051", 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.577 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "zabbix_sender": { 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "zabbix_sender", 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "str", 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "level": "advanced", 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "flags": 0, 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "min": "", 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "max": "", 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "enum_allowed": [], 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "desc": "", 2024-09-10T10:52:12.578 INFO:teuthology.orchestra.run.smithi092.stdout: "long_desc": "", 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: "tags": [], 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: "see_also": [] 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: "services": { 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: "dashboard": "https://172.21.15.92:8443/" 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: "always_on_modules": { 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: "octopus": [ 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-10T10:52:12.579 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "pacific": [ 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-10T10:52:12.580 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "quincy": [ 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-10T10:52:12.581 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "reef": [ 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-10T10:52:12.582 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: ], 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "squid": [ 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "balancer", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "crash", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "devicehealth", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "orchestrator", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "pg_autoscaler", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "progress", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "rbd_support", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "status", 2024-09-10T10:52:12.583 INFO:teuthology.orchestra.run.smithi092.stdout: "telemetry", 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: "volumes" 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: "last_failure_osd_epoch": 84, 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: "active_clients": [ 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "devicehealth", 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2909984763 2024-09-10T10:52:12.584 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "libcephsqlite", 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 1864695122 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.585 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "rbd_support", 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 813233524 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-10T10:52:12.586 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 3201482269 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "snap_schedule", 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-10T10:52:12.587 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 1164028964 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "volumes", 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: "addrvec": [ 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: "type": "v2", 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: "addr": "172.21.15.92:0", 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: "nonce": 2492587476 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:12.588 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:12.589 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-10T10:52:12.589 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:52:12.590 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:11 smithi097 ceph-mon[35213]: from='client.16488 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:12.590 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:11 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2835051945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:52:12.590 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:11 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3124619956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T10:52:12.590 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:11 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3703027564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T10:52:12.590 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:11 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3666996260' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T10:52:12.591 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:12 smithi097 ceph-mon[35213]: pgmap v489: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 15 MiB/s wr, 1.55k op/s 2024-09-10T10:52:12.591 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:11 smithi121 ceph-mon[35231]: from='client.16488 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:12.591 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:11 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2835051945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:52:12.591 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:11 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3124619956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T10:52:12.591 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:11 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3703027564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T10:52:12.591 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:11 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3666996260' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T10:52:12.591 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:12 smithi121 ceph-mon[35231]: pgmap v489: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 15 MiB/s wr, 1.55k op/s 2024-09-10T10:52:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd9940a2d80 msgr2=0x7fd9940a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd9940a2d80 0x7fd9940a5240 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009b40 tx=0x7fd9a0005e50 comp rx=0 tx=0).stop 2024-09-10T10:52:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac103690 msgr2=0x7fd9ac198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac103690 0x7fd9ac198990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00d950 tx=0x7fd99c00de10 comp rx=0 tx=0).stop 2024-09-10T10:52:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 shutdown_connections 2024-09-10T10:52:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9ac10c140 0x7fd9ac19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd9ac103690 0x7fd9ac198990 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fd9940a2d80 0x7fd9940a5240 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:12.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 --2- 172.21.15.92:0/3666996260 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fd9ac102d70 0x7fd9ac198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:12.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.131+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 >> 172.21.15.92:0/3666996260 conn(0x7fd9ac0fc740 msgr2=0x7fd9ac0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:12.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.132+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 shutdown_connections 2024-09-10T10:52:12.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:11.132+0000 7fd9b0e17640 1 -- 172.21.15.92:0/3666996260 wait complete. 2024-09-10T10:52:12.655 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T10:52:12.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T10:52:12.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:11 smithi092 ceph-mon[30834]: from='client.16488 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T10:52:12.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:11 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2835051945' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T10:52:12.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:11 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3124619956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T10:52:12.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:11 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3703027564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T10:52:12.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:11 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3666996260' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T10:52:12.657 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:12 smithi092 ceph-mon[30834]: pgmap v489: 97 pgs: 13 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 58 active+clean; 4.6 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 15 MiB/s wr, 1.55k op/s 2024-09-10T10:52:12.997 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:13.535 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1392, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1340, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 2122592, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 506996, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 5, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.158784165, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.053997588, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.074354298, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.035635013, 2024-09-10T10:52:13.536 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1339, 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.080432788, 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000060069 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1776512, 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 179456 2024-09-10T10:52:13.537 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 952, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1164, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 237247, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 849426, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 8, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.098953188, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.031114439, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.022425366, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.035687446, 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1162, 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.059022233, 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000050793 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 548848 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.539 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1237, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1239, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 3639257, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 393367, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 5, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 3, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.098823504, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.028158482, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.028592774, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.032432879, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1237, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.061762195, 2024-09-10T10:52:13.540 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000049929 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-09-10T10:52:13.541 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 5308, 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.158790268, 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000029915 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.542 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 0, 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 0, 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 0, 2024-09-10T10:52:13.543 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 0, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 0, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 935, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 5, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 930, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 0, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 928, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 0, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2024-09-10T10:52:13.544 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 33, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 0, 2024-09-10T10:52:13.545 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:13.546 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 0 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:13.547 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-09-10T10:52:13.548 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2024-09-10T10:52:13.549 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 2176, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 0, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 4, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 7512722, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 7512148, 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-09-10T10:52:13.550 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 2176 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 916, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 1153, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 237, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 42, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 52, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 10, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 935, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 1226, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 291, 2024-09-10T10:52:13.551 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 0, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 0, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 54152, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 215328 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 0, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 0, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 0, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 0, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 0, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.552 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.553 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.555 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.556 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-09-10T10:52:13.557 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.557 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.557 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.557 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.557 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-09-10T10:52:13.557 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.557 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.557 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.557 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.558 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.559 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.560 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.561 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.562 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.563 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 5, 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 3, 2024-09-10T10:52:13.564 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 4, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 0, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 0, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 3032, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:13.565 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:13.566 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:13.567 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 223157, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 964, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:52:13.568 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 8056, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 178, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:13.569 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 2841509, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 24675, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 3212, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 21, 2024-09-10T10:52:13.570 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 3, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 3212, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3212, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 6.858807628, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002135369 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3212, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3213 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 3212, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 3212, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 0, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-09-10T10:52:13.571 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 1972, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 1238, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:13.572 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-09-10T10:52:13.573 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-09-10T10:52:13.574 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 104, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 21, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 5, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 7, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 2, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 0, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 0 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 0, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-09-10T10:52:13.575 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 0, 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 0, 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 0, 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.576 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 3577, 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 5655806, 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 3577, 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-10T10:52:13.577 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3577, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 5655806, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-10T10:52:13.578 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 3212, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 3318423, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3212, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 3318423, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:13.579 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 3212, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 3212, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3212, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 3212, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:13.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-10T10:52:13.581 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x55e18b2ceb40": { 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-10T10:52:13.582 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-10T10:52:13.583 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-10T10:52:13.583 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-10T10:52:13.583 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:13.583 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:13.583 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:13.583 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:13.583 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:13.583 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:13.583 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:52:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:14 smithi121 ceph-mon[35231]: pgmap v490: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-10T10:52:14.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:14 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:52:14.547 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:14 smithi092 ceph-mon[30834]: pgmap v490: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-10T10:52:14.547 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:14 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:52:14.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:14 smithi097 ceph-mon[35213]: pgmap v490: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-10T10:52:14.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:14 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:52:14.578 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-10T10:52:14.578 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-10T10:52:14.578 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-10T10:52:14.578 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-10T10:52:14.578 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T10:52:14.578 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T10:52:14.579 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T10:52:14.836 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:15.393 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:52:15.393 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:15.393 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 0, 2024-09-10T10:52:15.393 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2, 2024-09-10T10:52:15.393 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 0, 2024-09-10T10:52:15.393 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 0, 2024-09-10T10:52:15.393 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2024-09-10T10:52:15.393 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2024-09-10T10:52:15.393 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.001013497, 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.000151161, 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:15.394 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 300, 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 290, 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1465728, 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 178480, 2024-09-10T10:52:15.395 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.052518617, 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.018209807, 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.047038319, 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 289, 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.014727202, 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000050959 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:15.396 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1465728, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 178480 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 7, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 225, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 3472, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 275664, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 6, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 3, 2024-09-10T10:52:15.397 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.018380505, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.010923822, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.004890000, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 223, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.025306447, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000113481 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.398 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3472, 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 275664 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:15.399 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:15.400 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 147930, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 28, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:15.402 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 928, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:15.403 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 303, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 1423408, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 303, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-10T10:52:15.404 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-10T10:52:15.405 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 303, 2024-09-10T10:52:15.405 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1423408, 2024-09-10T10:52:15.405 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:15.405 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:15.405 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:15.405 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:15.405 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:15.405 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:15.405 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:52:15.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:15 smithi092 ceph-mon[30834]: osdmap e105: 12 total, 12 up, 12 in 2024-09-10T10:52:15.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:15 smithi121 ceph-mon[35231]: osdmap e105: 12 total, 12 up, 12 in 2024-09-10T10:52:15.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:15 smithi097 ceph-mon[35213]: osdmap e105: 12 total, 12 up, 12 in 2024-09-10T10:52:16.305 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T10:52:16.305 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T10:52:16.305 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-10T10:52:16.305 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-10T10:52:16.305 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-10T10:52:16.305 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T10:52:16.306 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T10:52:16.571 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:16.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:16 smithi092 ceph-mon[30834]: pgmap v492: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 7.4 MiB/s wr, 820 op/s 2024-09-10T10:52:16.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:16 smithi121 ceph-mon[35231]: pgmap v492: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 7.4 MiB/s wr, 820 op/s 2024-09-10T10:52:16.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:16 smithi097 ceph-mon[35213]: pgmap v492: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 7.4 MiB/s wr, 820 op/s 2024-09-10T10:52:17.066 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:52:17.066 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:17.066 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1399, 2024-09-10T10:52:17.066 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1345, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 2126656, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 508594, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 5, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.165552240, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.061263207, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.072198059, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.037044164, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1345, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.099358764, 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000073872 2024-09-10T10:52:17.067 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1780240, 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 180736 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 2202, 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2418, 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 5428101, 2024-09-10T10:52:17.068 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 1336203, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 8, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.167459561, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.048775830, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.046811106, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.059601259, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2415, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.104901007, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000043437 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.069 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 636864 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 4, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 6, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1629, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 1284, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 7, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.002142454, 2024-09-10T10:52:17.070 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000058719, 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001779149, 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000071998, 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 4, 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.002625661, 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000656415 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.071 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:52:17.072 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:52:17.072 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.072 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 5434, 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.131390633, 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000024179 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:17.073 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 0, 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 0, 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-09-10T10:52:17.074 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 0, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 0, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 0, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 1146, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 16, 2024-09-10T10:52:17.075 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 1130, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 1124, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 34, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-09-10T10:52:17.076 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-09-10T10:52:17.077 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:52:17.078 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 0, 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 0, 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 0 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-09-10T10:52:17.079 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:17.080 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.081 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 0, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 974, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 0, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 3, 2024-09-10T10:52:17.082 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2024-09-10T10:52:17.083 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-09-10T10:52:17.083 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2024-09-10T10:52:17.083 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2024-09-10T10:52:17.083 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 9064363, 2024-09-10T10:52:17.083 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 9045027, 2024-09-10T10:52:17.083 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-09-10T10:52:17.083 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.083 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.083 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 974 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 1112, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 1187, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 75, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 77, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 83, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 6, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 1146, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 1219, 2024-09-10T10:52:17.084 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 73, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 0, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 0, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 57156, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 215328 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 0, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 0, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 0, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 0, 2024-09-10T10:52:17.085 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 0, 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:17.086 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.087 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.087 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.087 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-09-10T10:52:17.087 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.087 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.087 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.087 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.087 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.088 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:17.089 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-09-10T10:52:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.090 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-09-10T10:52:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-09-10T10:52:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.091 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.092 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-09-10T10:52:17.093 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.093 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.093 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.093 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.093 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-09-10T10:52:17.093 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.093 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.093 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-09-10T10:52:17.094 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.095 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.096 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.097 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:17.098 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 1, 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 2, 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 1, 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 2, 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-09-10T10:52:17.099 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 0, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 0, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 3034, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:17.100 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:17.101 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:17.102 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 239156, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 1181, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-10T10:52:17.103 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 7936, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 175, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-10T10:52:17.104 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 3506645, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 30323, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 3234, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 21, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 3, 2024-09-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 3234, 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3234, 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 12.138659581, 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.003753450 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3234, 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3235 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 3234, 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 3234, 2024-09-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 1960, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 1272, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2024-09-10T10:52:17.107 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-09-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 105, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 22, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 6, 2024-09-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 8, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 2, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 0, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 0 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 0, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 0, 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 0, 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 0, 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:17.112 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 3601, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 7210799, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 3601, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3601, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 7210799, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.113 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 3234, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 4870064, 2024-09-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3234, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 4870064, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-10T10:52:17.115 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 3234, 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 3234, 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3234, 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 3234, 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:17.116 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.117 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x562e3754ab40": { 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-10T10:52:17.118 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-10T10:52:17.119 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:17.119 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:17.119 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:17.119 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:17.119 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:17.119 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:17.119 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:52:17.866 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-10T10:52:17.866 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-10T10:52:17.867 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-10T10:52:17.867 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-10T10:52:17.867 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T10:52:17.867 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T10:52:17.867 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T10:52:18.115 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:18.576 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 302, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 292, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1466272, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 179760, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.051943452, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.018200128, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.044950972, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:52:18.577 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 291, 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.016933888, 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000058192 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 1466272, 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 179760 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.578 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 3, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 223, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 480, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 275216, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 6, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 3, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.016699219, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.011734605, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.002440990, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 220, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.023825458, 2024-09-10T10:52:18.579 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000108297 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 275216 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 4, 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 4, 2024-09-10T10:52:18.580 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 2992, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 448, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.003522776, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000055147, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.003424723, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.006206906, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002068968 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.581 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-10T10:52:18.582 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:18.584 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 148714, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 30, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-10T10:52:18.585 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 928, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2024-09-10T10:52:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 305, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 1423668, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 305, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-10T10:52:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-10T10:52:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 305, 2024-09-10T10:52:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1423668, 2024-09-10T10:52:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-10T10:52:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-10T10:52:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-10T10:52:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-10T10:52:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:18.588 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-10T10:52:18.588 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-10T10:52:18.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:18 smithi121 ceph-mon[35231]: pgmap v493: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 3.0 MiB/s wr, 342 op/s 2024-09-10T10:52:18.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:18 smithi097 ceph-mon[35213]: pgmap v493: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 3.0 MiB/s wr, 342 op/s 2024-09-10T10:52:18.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:18 smithi092 ceph-mon[30834]: pgmap v493: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 3.0 MiB/s wr, 342 op/s 2024-09-10T10:52:19.226 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T10:52:19.226 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T10:52:19.226 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-10T10:52:19.226 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-10T10:52:19.226 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-10T10:52:19.226 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T10:52:19.226 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T10:52:19.775 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:52:19.790 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:19 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:52:19.791 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:19 smithi121 ceph-mon[35231]: pgmap v494: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 1.6 MiB/s wr, 184 op/s 2024-09-10T10:52:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:19 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:52:19.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:19 smithi097 ceph-mon[35213]: pgmap v494: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 1.6 MiB/s wr, 184 op/s 2024-09-10T10:52:19.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:19 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:52:19.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:19 smithi092 ceph-mon[30834]: pgmap v494: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 1.6 MiB/s wr, 184 op/s 2024-09-10T10:52:20.383 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 1891, 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 1779, 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 1127618, 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 3974806, 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 17, 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 6, 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.124974582, 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.047195744, 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.071238154, 2024-09-10T10:52:20.384 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.014731323, 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 1778, 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.087881467, 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000049427 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 2440, 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000364468, 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000149 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 2672, 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 429632 2024-09-10T10:52:20.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 3147, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 3766, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 1733273, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 2465267, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 12, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 8, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.218785899, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.086354209, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.156620656, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.006289990, 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:20.386 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 3762, 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.146821332, 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000039027 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 6270, 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.001120650, 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000178 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 425040, 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 1376480 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:20.387 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 851, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 756, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 2390646, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 958753, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 11, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 7, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.081579117, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.027881052, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.067813100, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.003590759, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 756, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.059532209, 2024-09-10T10:52:20.388 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000078746 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 574, 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000100601, 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000175 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 1807264, 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 187968 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: "cct": { 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: "total_workers": 1, 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: "unhealthy_workers": 0 2024-09-10T10:52:20.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-MDSRank": { 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 915, 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.231158636, 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000252632 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 18, 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000500752, 2024-09-10T10:52:20.390 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000027819 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": { 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "request": 444, 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "reply": 402, 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "reply_latency": { 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 402, 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.491966804, 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.001223798 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "slow_reply": 0, 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "forward": 42, 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_fetch_complete": 7, 2024-09-10T10:52:20.391 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_commit": 35, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_split": 3, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_merge": 0, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes": 949, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_top": 132, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_bottom": 805, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_pin_tail": 12, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_pinned": 760, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_expired": 346, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_with_caps": 402, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": 402, 2024-09-10T10:52:20.392 INFO:teuthology.orchestra.run.smithi097.stdout: "subtrees": 45, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse": 1063, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_hit": 921, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_forward": 37, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_discover": 36, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_remote_ino": 3, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_lock": 13, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "load_cent": 30548, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "q": 0, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "exported": 7, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "exported_inodes": 284, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "imported": 17, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "imported_inodes": 577, 2024-09-10T10:52:20.393 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_peer_discover": 3, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rfiles": 1010, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rbytes": 1197432100, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rsnaps": 3, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:20.394 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_inode_file_caps": 12, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_revoke": 167, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_grant": 268, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_caps": 590, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_caps_dirty": 319, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_cap_release": 13, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "process_request_cap_release": 65 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.395 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache": { 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_update": 0, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_try_discover": 0, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_send_discover": 48, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_handle_discover": 57, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays": 0, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_created": 13, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_enqueued": 3, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_reintegrated": 9, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_migrated": 7, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:20.396 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_started": 0, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_completed": 0, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_exportdir": 7, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_flush": 0, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_fragmentdir": 3, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_inodestats": 0 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log": { 2024-09-10T10:52:20.397 INFO:teuthology.orchestra.run.smithi097.stdout: "evlrg": 0, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "evadd": 2214, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "evex": 0, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "evtrm": 0, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "ev": 2214, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "evexg": 0, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "evexd": 0, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "segadd": 4, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "segex": 0, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "segtrm": 0, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "seg": 4, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "segmjr": 2, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "segexg": 0, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "segexd": 0, 2024-09-10T10:52:20.398 INFO:teuthology.orchestra.run.smithi097.stdout: "expos": 4194304, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "wrpos": 7542973, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "rdpos": 0, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "jlat": { 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 371, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 3.672628426, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.009899267 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "replayed": 0 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_mem": { 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "ino": 939, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "ino+": 1202, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "ino-": 263, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "dir": 67, 2024-09-10T10:52:20.399 INFO:teuthology.orchestra.run.smithi097.stdout: "dir+": 74, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "dir-": 7, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "dn": 949, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "dn+": 1304, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "dn-": 355, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "cap": 402, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "cap+": 910, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "cap-": 508, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "rss": 58936, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "heap": 223520 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_server": { 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "dispatch_client_request": 685, 2024-09-10T10:52:20.400 INFO:teuthology.orchestra.run.smithi097.stdout: "dispatch_server_request": 187, 2024-09-10T10:52:20.401 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_request": 444, 2024-09-10T10:52:20.401 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_session": 57, 2024-09-10T10:52:20.401 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_peer_request": 306, 2024-09-10T10:52:20.401 INFO:teuthology.orchestra.run.smithi097.stdout: "req_create_latency": { 2024-09-10T10:52:20.401 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 1, 2024-09-10T10:52:20.401 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.002295706, 2024-09-10T10:52:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.002295706 2024-09-10T10:52:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getattr_latency": { 2024-09-10T10:52:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 13, 2024-09-10T10:52:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.004067038, 2024-09-10T10:52:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000312849 2024-09-10T10:52:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:20.404 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "req_link_latency": { 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 11, 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.066345948, 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.006031449 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookup_latency": { 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 290, 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.111656191, 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000385021 2024-09-10T10:52:20.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupino_latency": { 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupname_latency": { 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.406 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.407 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lssnap_latency": { 2024-09-10T10:52:20.408 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.408 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.408 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mkdir_latency": { 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mknod_latency": { 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mksnap_latency": { 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.409 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.410 INFO:teuthology.orchestra.run.smithi097.stdout: "req_open_latency": { 2024-09-10T10:52:20.410 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 26, 2024-09-10T10:52:20.410 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.013854319, 2024-09-10T10:52:20.410 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000532858 2024-09-10T10:52:20.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.410 INFO:teuthology.orchestra.run.smithi097.stdout: "req_readdir_latency": { 2024-09-10T10:52:20.410 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 33, 2024-09-10T10:52:20.410 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.033792370, 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.001024011 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rename_latency": { 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 15, 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.217340166, 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.014489344 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:20.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmdir_latency": { 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setattr_latency": { 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setlayout_latency": { 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setxattr_latency": { 2024-09-10T10:52:20.414 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "req_symlink_latency": { 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "req_unlink_latency": { 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 13, 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.042615066, 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.003278082 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.415 INFO:teuthology.orchestra.run.smithi097.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_sessions": { 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "session_count": 2, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "session_add": 5, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "session_remove": 3, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "sessions_open": 2, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "sessions_stale": 0, 2024-09-10T10:52:20.416 INFO:teuthology.orchestra.run.smithi097.stdout: "total_load": 70, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "average_load": 35, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "avg_session_uptime": 931, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "mempool": { 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:20.417 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:20.418 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_items": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:20.419 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_bytes": 587819, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_items": 645, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_items": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bytes": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_items": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_bytes": 7936, 2024-09-10T10:52:20.420 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_items": 175, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_items": 0, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_bytes": 3092714, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_items": 25375, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_items": 0, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_items": 0 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter": { 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "op_active": 0, 2024-09-10T10:52:20.421 INFO:teuthology.orchestra.run.smithi097.stdout: "op_laggy": 0, 2024-09-10T10:52:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send": 580, 2024-09-10T10:52:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send_bytes": 3594033, 2024-09-10T10:52:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: "op_resend": 33, 2024-09-10T10:52:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: "op_reply": 580, 2024-09-10T10:52:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: "op_latency": { 2024-09-10T10:52:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 580, 2024-09-10T10:52:20.422 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 5.947897593, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.010254995 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "op_inflight": 0, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "oplen_avg": { 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 580, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 702 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "op": 580, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "op_r": 13, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "op_w": 567, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "op_rmw": 0, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "op_pg": 0, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_stat": 0, 2024-09-10T10:52:20.423 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_create": 10, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_read": 1, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_write": 372, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writefull": 64, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writesame": 0, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_append": 0, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_zero": 0, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_truncate": 0, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_delete": 18, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_mapext": 0, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_getxattr": 0, 2024-09-10T10:52:20.424 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_setxattr": 20, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_call": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_watch": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_notify": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_other": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_active": 0, 2024-09-10T10:52:20.425 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_send": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_resend": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_ping": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_active": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_send": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_resend": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_active": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_send": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_resend": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_active": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_send": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_resend": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "command_active": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "command_send": 0, 2024-09-10T10:52:20.426 INFO:teuthology.orchestra.run.smithi097.stdout: "command_resend": 0, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "map_epoch": 105, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "map_full": 0, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "map_inc": 23, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_sessions": 11, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_open": 12, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_close": 1, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_laggy": 0, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_wr": 170, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_rd": 19, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_del": 28 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "oft": { 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_objs": 1, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:20.427 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_updates": 0, 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_removes": 0 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "osd-slow-ops": { 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "slow_ops_count": 2 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "purge_queue": { 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_ops_high_water": 3, 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing": 0, 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_high_water": 3, 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executed_ops": 3, 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executed": 3, 2024-09-10T10:52:20.428 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 5885, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 4643251, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 5885, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 5885, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 4643251, 2024-09-10T10:52:20.429 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:20.430 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 580, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 3594195, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 580, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 3594195, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 1024, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:20.431 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 580, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 580, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 580, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 580, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:20.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 3758096384, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 3, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 399, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 3, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 1, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 399, 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:20.433 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-write_buf_throttle-0x564382814960": { 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 4528, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 3758096384, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 2214, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 3348669, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 2214, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:20.434 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:20.435 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 371, 2024-09-10T10:52:20.435 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 3344141, 2024-09-10T10:52:20.435 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:20.435 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:20.435 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:20.435 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:20.435 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:20.435 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:20.435 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-10T10:52:21.482 INFO:tasks.check_counter:Daemon mds.b mds.exported=7 2024-09-10T10:52:21.482 INFO:tasks.check_counter:Daemon mds.b mds.imported=17 2024-09-10T10:52:21.482 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=3 2024-09-10T10:52:21.482 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-10T10:52:21.482 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T10:52:21.482 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T10:52:21.483 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T10:52:21.734 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:52:22.005 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:21 smithi097 ceph-mon[35213]: pgmap v495: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 689 KiB/s wr, 83 op/s 2024-09-10T10:52:22.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:21 smithi121 ceph-mon[35231]: pgmap v495: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 689 KiB/s wr, 83 op/s 2024-09-10T10:52:22.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:21 smithi092 ceph-mon[30834]: pgmap v495: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 689 KiB/s wr, 83 op/s 2024-09-10T10:52:22.550 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 1414, 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 1361, 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 2136736, 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 515482, 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 5, 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 1, 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.144950503, 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.052178103, 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.071192288, 2024-09-10T10:52:22.551 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.028913173, 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 1360, 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.066498636, 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000048896 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 1786288, 2024-09-10T10:52:22.552 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 183808 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 9, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 227, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 4028, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 640330, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 8, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 4, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.013892103, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.007487048, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.004324135, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.000060613, 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:22.553 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 225, 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.024651232, 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000109561 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 3472, 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 639632 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 2233, 2024-09-10T10:52:22.554 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 2235, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 5934933, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 710101, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 5, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 3, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.126572205, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.028794605, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.039543843, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.050444189, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 2233, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.087092674, 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000039002 2024-09-10T10:52:22.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "cct": { 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "total_workers": 1, 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "unhealthy_workers": 0 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.556 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-MDSRank": { 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 5526, 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.117066746, 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000021184 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.557 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": { 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "request": 0, 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "reply": 0, 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "reply_latency": { 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "slow_reply": 0, 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "forward": 0, 2024-09-10T10:52:22.558 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_fetch_complete": 0, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_commit": 0, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_split": 0, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_merge": 0, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes": 497, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_top": 23, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_bottom": 474, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_pin_tail": 0, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_pinned": 464, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_expired": 0, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_with_caps": 0, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": 0, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "subtrees": 9, 2024-09-10T10:52:22.559 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_hit": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_forward": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_discover": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_remote_ino": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_lock": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "load_cent": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "q": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "exported": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "exported_inodes": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "imported": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "imported_inodes": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:22.560 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_peer_discover": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rfiles": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rbytes": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rsnaps": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:22.561 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_caps": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_cap_release": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "process_request_cap_release": 0 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache": { 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_update": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:22.562 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_try_discover": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_send_discover": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_handle_discover": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_created": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_enqueued": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_reintegrated": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_migrated": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_started": 0, 2024-09-10T10:52:22.563 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_completed": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_exportdir": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_flush": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_inodestats": 0 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log": { 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "evlrg": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "evadd": 0, 2024-09-10T10:52:22.564 INFO:teuthology.orchestra.run.smithi097.stdout: "evex": 0, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "evtrm": 0, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "ev": 2185, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "evexg": 0, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "evexd": 0, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "segadd": 0, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "segex": 0, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "segtrm": 0, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "seg": 4, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "segmjr": 2, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "segexg": 0, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "segexd": 0, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "expos": 4194304, 2024-09-10T10:52:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "wrpos": 9562554, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rdpos": 9539593, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "jlat": { 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "replayed": 2185 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_mem": { 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "ino": 164, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "ino+": 554, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "ino-": 390, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "dir": 17, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "dir+": 35, 2024-09-10T10:52:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "dir-": 18, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "dn": 497, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "dn+": 958, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "dn-": 461, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "cap": 0, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "cap+": 0, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "cap-": 0, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rss": 51264, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "heap": 215328 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_server": { 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "dispatch_client_request": 0, 2024-09-10T10:52:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "dispatch_server_request": 0, 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_request": 0, 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_session": 0, 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_peer_request": 0, 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "req_create_latency": { 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getattr_latency": { 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "req_link_latency": { 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookup_latency": { 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupino_latency": { 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupname_latency": { 2024-09-10T10:52:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lssnap_latency": { 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mkdir_latency": { 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mknod_latency": { 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mksnap_latency": { 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "req_open_latency": { 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "req_readdir_latency": { 2024-09-10T10:52:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rename_latency": { 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmdir_latency": { 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setattr_latency": { 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setlayout_latency": { 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setxattr_latency": { 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "req_symlink_latency": { 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "req_unlink_latency": { 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_sessions": { 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "session_count": 2, 2024-09-10T10:52:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "session_add": 3, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "session_remove": 1, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "sessions_open": 3, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "sessions_stale": 0, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "total_load": 0, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "average_load": 0, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "avg_session_uptime": 2844, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "mempool": { 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_items": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_bytes": 192682, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_items": 335, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_items": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bytes": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_items": 0, 2024-09-10T10:52:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_bytes": 7936, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_items": 175, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_items": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_bytes": 923577, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_items": 32827, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_items": 0, 2024-09-10T10:52:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_items": 0 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter": { 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "op_active": 0, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "op_laggy": 0, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send": 3278, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send_bytes": 21, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "op_resend": 3, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "op_reply": 3278, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "op_latency": { 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 3278, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 3.509939453, 2024-09-10T10:52:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.001070756 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "op_inflight": 0, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "oplen_avg": { 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 3278, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 3279 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "op": 3278, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "op_r": 3278, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "op_w": 0, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "op_rmw": 0, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "op_pg": 0, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_stat": 1984, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_create": 0, 2024-09-10T10:52:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_read": 1292, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_write": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writefull": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writesame": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_append": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_zero": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_truncate": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_delete": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_mapext": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_getxattr": 1, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_setxattr": 0, 2024-09-10T10:52:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_call": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_watch": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_notify": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_other": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_active": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_send": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_resend": 0, 2024-09-10T10:52:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_ping": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_active": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_send": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_resend": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_active": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_send": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_resend": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_active": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_send": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_resend": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "command_active": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "command_send": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "command_resend": 0, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "map_epoch": 105, 2024-09-10T10:52:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "map_full": 0, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "map_inc": 22, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_sessions": 4, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_open": 6, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_close": 2, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_laggy": 0, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_wr": 0, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_rd": 2, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_del": 0 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "oft": { 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_objs": 0, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_updates": 0, 2024-09-10T10:52:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_removes": 0 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "osd-slow-ops": { 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "slow_ops_count": 0 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "purge_queue": { 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing": 0, 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_high_water": 0, 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executed_ops": 0, 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executed": 0, 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 3652, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 7725172, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 3652, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 3652, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 7725172, 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 3278, 2024-09-10T10:52:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 5368255, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 3278, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 5368255, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 1024, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 3278, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 3278, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 3278, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 3278, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 3758096384, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-write_buf_throttle-0x56504a48ab40": { 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 3758096384, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:22.598 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-10T10:52:23.600 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T10:52:23.601 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T10:52:23.601 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-10T10:52:23.601 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-10T10:52:23.601 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T10:52:23.601 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T10:52:23.601 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T10:52:23.860 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:52:23.981 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:23 smithi097 ceph-mon[35213]: pgmap v496: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-10T10:52:24.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:23 smithi121 ceph-mon[35231]: pgmap v496: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-10T10:52:24.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:23 smithi092 ceph-mon[30834]: pgmap v496: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-10T10:52:24.409 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 3, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 5, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 795, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 960, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 7, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 2, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.001966067, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.000039204, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.000968115, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.000046557, 2024-09-10T10:52:24.410 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 3, 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.001476696, 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000492232 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:52:24.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 2284, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 2240, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 4054277, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 782803, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 4, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 3, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.187403833, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.060550266, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.072034034, 2024-09-10T10:52:24.412 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.055656419, 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 2239, 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.108458857, 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000048440 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 793504, 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 157872 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 1101, 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 1288, 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 4468142, 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 772378, 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 5, 2024-09-10T10:52:24.414 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 4, 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.087854206, 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.026372802, 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.026485436, 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.026808107, 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 1287, 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.056711224, 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000044064 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.415 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.416 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.416 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T10:52:24.416 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 423840 2024-09-10T10:52:24.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.416 INFO:teuthology.orchestra.run.smithi097.stdout: "cct": { 2024-09-10T10:52:24.416 INFO:teuthology.orchestra.run.smithi097.stdout: "total_workers": 1, 2024-09-10T10:52:24.416 INFO:teuthology.orchestra.run.smithi097.stdout: "unhealthy_workers": 0 2024-09-10T10:52:24.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-MDSRank": { 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 5103, 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.124240444, 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000024346 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2024-09-10T10:52:24.417 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": { 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: "request": 0, 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: "reply": 0, 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: "reply_latency": { 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.418 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.419 INFO:teuthology.orchestra.run.smithi097.stdout: "slow_reply": 0, 2024-09-10T10:52:24.419 INFO:teuthology.orchestra.run.smithi097.stdout: "forward": 0, 2024-09-10T10:52:24.419 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_fetch_complete": 0, 2024-09-10T10:52:24.419 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:24.419 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_commit": 0, 2024-09-10T10:52:24.419 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_split": 0, 2024-09-10T10:52:24.419 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_merge": 0, 2024-09-10T10:52:24.420 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes": 210, 2024-09-10T10:52:24.420 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_top": 135, 2024-09-10T10:52:24.420 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_bottom": 75, 2024-09-10T10:52:24.420 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_pin_tail": 0, 2024-09-10T10:52:24.420 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_pinned": 20, 2024-09-10T10:52:24.420 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_expired": 0, 2024-09-10T10:52:24.420 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_with_caps": 0, 2024-09-10T10:52:24.420 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": 0, 2024-09-10T10:52:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "subtrees": 6, 2024-09-10T10:52:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse": 0, 2024-09-10T10:52:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_hit": 0, 2024-09-10T10:52:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_forward": 0, 2024-09-10T10:52:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_discover": 0, 2024-09-10T10:52:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:52:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_remote_ino": 0, 2024-09-10T10:52:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_lock": 0, 2024-09-10T10:52:24.422 INFO:teuthology.orchestra.run.smithi097.stdout: "load_cent": 0, 2024-09-10T10:52:24.422 INFO:teuthology.orchestra.run.smithi097.stdout: "q": 0, 2024-09-10T10:52:24.422 INFO:teuthology.orchestra.run.smithi097.stdout: "exported": 0, 2024-09-10T10:52:24.422 INFO:teuthology.orchestra.run.smithi097.stdout: "exported_inodes": 0, 2024-09-10T10:52:24.422 INFO:teuthology.orchestra.run.smithi097.stdout: "imported": 0, 2024-09-10T10:52:24.422 INFO:teuthology.orchestra.run.smithi097.stdout: "imported_inodes": 0, 2024-09-10T10:52:24.422 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:24.422 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:24.422 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_peer_discover": 0, 2024-09-10T10:52:24.423 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rfiles": 998, 2024-09-10T10:52:24.423 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rbytes": 1240159601, 2024-09-10T10:52:24.423 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rsnaps": 6, 2024-09-10T10:52:24.423 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:24.423 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:24.423 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:24.423 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:24.423 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:24.423 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_caps": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:52:24.424 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_cap_release": 0, 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "process_request_cap_release": 0 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache": { 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_update": 0, 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_try_discover": 0, 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_send_discover": 0, 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_handle_discover": 0, 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays": 0, 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:24.425 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_created": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_enqueued": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_reintegrated": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_migrated": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_started": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_completed": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:24.426 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_exportdir": 0, 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_flush": 0, 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_inodestats": 0 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log": { 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: "evlrg": 0, 2024-09-10T10:52:24.427 INFO:teuthology.orchestra.run.smithi097.stdout: "evadd": 0, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "evex": 0, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "evtrm": 0, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "ev": 1302, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "evexg": 0, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "evexd": 0, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "segadd": 0, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "segex": 0, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "segtrm": 0, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "seg": 2, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "segmjr": 70, 2024-09-10T10:52:24.428 INFO:teuthology.orchestra.run.smithi097.stdout: "segexg": 0, 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: "segexd": 0, 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: "expos": 15169969, 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: "wrpos": 15268969, 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: "rdpos": 15267354, 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: "jlat": { 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: "replayed": 1302 2024-09-10T10:52:24.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_mem": { 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "ino": 74, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "ino+": 211, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "ino-": 137, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "dir": 14, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "dir+": 65, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "dir-": 51, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "dn": 210, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "dn+": 381, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "dn-": 171, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "cap": 0, 2024-09-10T10:52:24.430 INFO:teuthology.orchestra.run.smithi097.stdout: "cap+": 0, 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "cap-": 0, 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "rss": 48316, 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "heap": 215328 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_server": { 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "dispatch_client_request": 0, 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "dispatch_server_request": 0, 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_request": 0, 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_session": 0, 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_peer_request": 0, 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "req_create_latency": { 2024-09-10T10:52:24.431 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getattr_latency": { 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.432 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: "req_link_latency": { 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookup_latency": { 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.433 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupino_latency": { 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupname_latency": { 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.435 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lssnap_latency": { 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mkdir_latency": { 2024-09-10T10:52:24.436 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mknod_latency": { 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mksnap_latency": { 2024-09-10T10:52:24.437 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: "req_open_latency": { 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: "req_readdir_latency": { 2024-09-10T10:52:24.438 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rename_latency": { 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.439 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmdir_latency": { 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.440 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setattr_latency": { 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.442 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setlayout_latency": { 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setxattr_latency": { 2024-09-10T10:52:24.443 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: "req_symlink_latency": { 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: "req_unlink_latency": { 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.444 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:24.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_sessions": { 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "session_count": 2, 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "session_add": 3, 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "session_remove": 1, 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "sessions_open": 3, 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "sessions_stale": 0, 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "total_load": 0, 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "average_load": 0, 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "avg_session_uptime": 2855, 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:24.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "mempool": { 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:24.447 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:24.448 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:24.449 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_items": 0, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_bytes": 201809, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_items": 172, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_items": 0, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bytes": 0, 2024-09-10T10:52:24.450 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_items": 0, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_bytes": 7936, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_items": 175, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_items": 0, 2024-09-10T10:52:24.451 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_bytes": 419546, 2024-09-10T10:52:24.452 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_items": 14740, 2024-09-10T10:52:24.452 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:24.452 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_items": 0, 2024-09-10T10:52:24.452 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:24.452 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_items": 0 2024-09-10T10:52:24.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.452 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter": { 2024-09-10T10:52:24.452 INFO:teuthology.orchestra.run.smithi097.stdout: "op_active": 0, 2024-09-10T10:52:24.452 INFO:teuthology.orchestra.run.smithi097.stdout: "op_laggy": 0, 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send": 3064, 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send_bytes": 26, 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "op_resend": 4, 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "op_reply": 3064, 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "op_latency": { 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 3064, 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 7.872865859, 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.002569473 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.453 INFO:teuthology.orchestra.run.smithi097.stdout: "op_inflight": 0, 2024-09-10T10:52:24.454 INFO:teuthology.orchestra.run.smithi097.stdout: "oplen_avg": { 2024-09-10T10:52:24.454 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 3064, 2024-09-10T10:52:24.454 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 3065 2024-09-10T10:52:24.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.454 INFO:teuthology.orchestra.run.smithi097.stdout: "op": 3064, 2024-09-10T10:52:24.454 INFO:teuthology.orchestra.run.smithi097.stdout: "op_r": 3064, 2024-09-10T10:52:24.454 INFO:teuthology.orchestra.run.smithi097.stdout: "op_w": 0, 2024-09-10T10:52:24.454 INFO:teuthology.orchestra.run.smithi097.stdout: "op_rmw": 0, 2024-09-10T10:52:24.454 INFO:teuthology.orchestra.run.smithi097.stdout: "op_pg": 0, 2024-09-10T10:52:24.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_stat": 1846, 2024-09-10T10:52:24.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_create": 0, 2024-09-10T10:52:24.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_read": 1215, 2024-09-10T10:52:24.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_write": 0, 2024-09-10T10:52:24.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writefull": 0, 2024-09-10T10:52:24.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writesame": 0, 2024-09-10T10:52:24.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_append": 0, 2024-09-10T10:52:24.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_zero": 0, 2024-09-10T10:52:24.455 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_truncate": 0, 2024-09-10T10:52:24.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_delete": 0, 2024-09-10T10:52:24.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_mapext": 0, 2024-09-10T10:52:24.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:24.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:24.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_getxattr": 2, 2024-09-10T10:52:24.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_setxattr": 0, 2024-09-10T10:52:24.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:24.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:24.456 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_call": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_watch": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_notify": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_other": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_active": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_send": 0, 2024-09-10T10:52:24.457 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_resend": 0, 2024-09-10T10:52:24.458 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_ping": 0, 2024-09-10T10:52:24.458 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_active": 0, 2024-09-10T10:52:24.458 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_send": 0, 2024-09-10T10:52:24.458 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_resend": 0, 2024-09-10T10:52:24.458 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_active": 0, 2024-09-10T10:52:24.458 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_send": 0, 2024-09-10T10:52:24.458 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_resend": 0, 2024-09-10T10:52:24.458 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_active": 0, 2024-09-10T10:52:24.458 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_send": 0, 2024-09-10T10:52:24.459 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_resend": 0, 2024-09-10T10:52:24.459 INFO:teuthology.orchestra.run.smithi097.stdout: "command_active": 0, 2024-09-10T10:52:24.459 INFO:teuthology.orchestra.run.smithi097.stdout: "command_send": 0, 2024-09-10T10:52:24.459 INFO:teuthology.orchestra.run.smithi097.stdout: "command_resend": 0, 2024-09-10T10:52:24.459 INFO:teuthology.orchestra.run.smithi097.stdout: "map_epoch": 105, 2024-09-10T10:52:24.459 INFO:teuthology.orchestra.run.smithi097.stdout: "map_full": 0, 2024-09-10T10:52:24.459 INFO:teuthology.orchestra.run.smithi097.stdout: "map_inc": 20, 2024-09-10T10:52:24.459 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_sessions": 6, 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_open": 7, 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_close": 1, 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_laggy": 0, 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_wr": 0, 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_rd": 2, 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_del": 0 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: "oft": { 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_objs": 0, 2024-09-10T10:52:24.460 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_updates": 0, 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_removes": 0 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: "osd-slow-ops": { 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: "slow_ops_count": 0 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: "purge_queue": { 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing": 0, 2024-09-10T10:52:24.461 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_high_water": 0, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executed_ops": 0, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executed": 0, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 3384, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 8199565, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:24.462 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 3384, 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 3384, 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 8199565, 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.463 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 3064, 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 6871936, 2024-09-10T10:52:24.464 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 3064, 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 6871936, 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 1024, 2024-09-10T10:52:24.465 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 3064, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 3064, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 3064, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 3064, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.466 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 3758096384, 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:24.467 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-write_buf_throttle-0x56125cafc640": { 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:24.468 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 3758096384, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:24.469 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:24.470 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:24.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:24.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:24.470 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-10T10:52:25.132 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-10T10:52:25.132 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-10T10:52:25.133 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-10T10:52:25.133 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-10T10:52:25.133 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T10:52:25.133 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T10:52:25.133 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T10:52:25.379 INFO:teuthology.orchestra.run.smithi097.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T10:52:25.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:25 smithi097 ceph-mon[35213]: pgmap v497: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-10T10:52:25.957 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 388, 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 335, 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 1791136, 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 190202, 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 7, 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 2, 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.049343623, 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.016461735, 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.046765085, 2024-09-10T10:52:25.958 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.000470729, 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 334, 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.024913994, 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000074592 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 1787104, 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 185744 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.959 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 1055, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 1276, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 6292033, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 888691, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 7, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 5, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.092360332, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.028254314, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.026804196, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.027755779, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 1274, 2024-09-10T10:52:25.960 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.066186379, 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000051951 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 555104 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_messages": 2281, 2024-09-10T10:52:25.961 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages": 2283, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_bytes": 9055169, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_bytes": 725416, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_created_connections": 5, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_active_connections": 4, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_total_time": 0.190463273, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_send_time": 0.058894412, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_recv_time": 0.053158243, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_running_fast_dispatch_time": 0.063816241, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 2281, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.114784645, 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000050322 2024-09-10T10:52:25.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "cct": { 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "total_workers": 1, 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "unhealthy_workers": 0 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-MDSRank": { 2024-09-10T10:52:25.963 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 5714, 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.131907695, 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000023085 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "queue_len": 0, 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "complete_latency": { 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.964 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: "mds": { 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: "request": 0, 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: "reply": 0, 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: "reply_latency": { 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: "slow_reply": 0, 2024-09-10T10:52:25.965 INFO:teuthology.orchestra.run.smithi097.stdout: "forward": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_fetch_complete": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_commit": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_split": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_merge": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes": 582, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_top": 79, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_bottom": 503, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_pin_tail": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_pinned": 469, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_expired": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "inodes_with_caps": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "caps": 0, 2024-09-10T10:52:25.966 INFO:teuthology.orchestra.run.smithi097.stdout: "subtrees": 12, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_hit": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_forward": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_discover": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_remote_ino": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "traverse_lock": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "load_cent": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "q": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "exported": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "exported_inodes": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "imported": 0, 2024-09-10T10:52:25.967 INFO:teuthology.orchestra.run.smithi097.stdout: "imported_inodes": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "openino_peer_discover": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rfiles": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rbytes": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "root_rsnaps": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:25.968 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_inode_file_caps": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_grant": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_caps": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_caps_dirty": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_cap_release": 0, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "process_request_cap_release": 0 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.969 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache": { 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_update": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_try_discover": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_send_discover": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "dir_handle_discover": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_created": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_enqueued": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_reintegrated": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "strays_migrated": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:25.970 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_started": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_completed": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_exportdir": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_flush": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "ireq_inodestats": 0 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log": { 2024-09-10T10:52:25.971 INFO:teuthology.orchestra.run.smithi097.stdout: "evlrg": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "evadd": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "evex": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "evtrm": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "ev": 2263, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "evexg": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "evexd": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "segadd": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "segex": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "segtrm": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "seg": 6, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "segmjr": 2, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "segexg": 0, 2024-09-10T10:52:25.972 INFO:teuthology.orchestra.run.smithi097.stdout: "segexd": 0, 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "expos": 4194304, 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "wrpos": 18608757, 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "rdpos": 18599084, 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "jlat": { 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "replayed": 2263 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_mem": { 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "ino": 249, 2024-09-10T10:52:25.973 INFO:teuthology.orchestra.run.smithi097.stdout: "ino+": 1047, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "ino-": 798, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "dir": 49, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "dir+": 82, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "dir-": 33, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "dn": 582, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "dn+": 1235, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "dn-": 653, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "cap": 0, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "cap+": 0, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "cap-": 0, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "rss": 52708, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "heap": 215328 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.974 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_server": { 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "dispatch_client_request": 0, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "dispatch_server_request": 0, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_request": 0, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_client_session": 0, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "handle_peer_request": 0, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "req_create_latency": { 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getattr_latency": { 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.975 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "req_link_latency": { 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookup_latency": { 2024-09-10T10:52:25.976 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupino_latency": { 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupname_latency": { 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.978 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.979 INFO:teuthology.orchestra.run.smithi097.stdout: "req_lssnap_latency": { 2024-09-10T10:52:25.979 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.979 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.979 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.979 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mkdir_latency": { 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mknod_latency": { 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "req_mksnap_latency": { 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.980 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "req_open_latency": { 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "req_readdir_latency": { 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.981 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rename_latency": { 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmdir_latency": { 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.983 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setattr_latency": { 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.984 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setlayout_latency": { 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "req_setxattr_latency": { 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "req_symlink_latency": { 2024-09-10T10:52:25.985 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "req_unlink_latency": { 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:25.986 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_sessions": { 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "session_count": 1, 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "session_add": 2, 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "session_remove": 1, 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "sessions_open": 2, 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "sessions_stale": 0, 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "total_load": 0, 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "average_load": 0, 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "avg_session_uptime": 3479, 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:25.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "mempool": { 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:25.988 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:25.989 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_items": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:25.990 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_bytes": 222812, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_anon_items": 487, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "buffer_meta_items": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bytes": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_items": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_bytes": 7936, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_items": 175, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:25.991 INFO:teuthology.orchestra.run.smithi097.stdout: "pgmap_items": 0, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_bytes": 1262932, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_co_items": 28230, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_1_items": 0, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "unittest_2_items": 0 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter": { 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "op_active": 0, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "op_laggy": 0, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send": 3344, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "op_send_bytes": 21, 2024-09-10T10:52:25.992 INFO:teuthology.orchestra.run.smithi097.stdout: "op_resend": 3, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "op_reply": 3344, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "op_latency": { 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 3344, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 13.723765920, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.004103996 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "op_inflight": 0, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "oplen_avg": { 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 3344, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 3345 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "op": 3344, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "op_r": 3344, 2024-09-10T10:52:25.993 INFO:teuthology.orchestra.run.smithi097.stdout: "op_w": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "op_rmw": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "op_pg": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_stat": 1970, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_create": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_read": 1372, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_write": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writefull": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_writesame": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_append": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_zero": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_truncate": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_delete": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_mapext": 0, 2024-09-10T10:52:25.994 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_getxattr": 1, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_setxattr": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_call": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_watch": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_notify": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "osdop_other": 0, 2024-09-10T10:52:25.995 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_active": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_send": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_resend": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "linger_ping": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_active": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_send": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "poolop_resend": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_active": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_send": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "poolstat_resend": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_active": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_send": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "statfs_resend": 0, 2024-09-10T10:52:25.996 INFO:teuthology.orchestra.run.smithi097.stdout: "command_active": 0, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "command_send": 0, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "command_resend": 0, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "map_epoch": 105, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "map_full": 0, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "map_inc": 22, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_sessions": 7, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_open": 8, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_session_close": 1, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_laggy": 0, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_wr": 0, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_rd": 2, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_del": 0 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.997 INFO:teuthology.orchestra.run.smithi097.stdout: "oft": { 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_objs": 0, 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_updates": 0, 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "omap_total_removes": 0 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "osd-slow-ops": { 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "slow_ops_count": 0 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "purge_queue": { 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing": 0, 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executing_high_water": 0, 2024-09-10T10:52:25.998 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executed_ops": 0, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_executed": 0, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 3720, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 16781580, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 3720, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:25.999 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 3720, 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 16781580, 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 104857600, 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:26.000 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 3344, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 14414458, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 3344, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 14414458, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 1024, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 3344, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 3344, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 3344, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 3344, 2024-09-10T10:52:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 3758096384, 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:26.003 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:26.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "throttle-write_buf_throttle-0x563594760b40": { 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "val": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "max": 3758096384, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "get_started": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "get": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "get_sum": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "take": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "take_sum": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "put": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "put_sum": 0, 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "wait": { 2024-09-10T10:52:26.005 INFO:teuthology.orchestra.run.smithi097.stdout: "avgcount": 0, 2024-09-10T10:52:26.006 INFO:teuthology.orchestra.run.smithi097.stdout: "sum": 0.000000000, 2024-09-10T10:52:26.006 INFO:teuthology.orchestra.run.smithi097.stdout: "avgtime": 0.000000000 2024-09-10T10:52:26.006 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:26.006 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-09-10T10:52:26.006 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-09-10T10:52:26.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:25 smithi121 ceph-mon[35231]: pgmap v497: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-10T10:52:26.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:25 smithi092 ceph-mon[30834]: pgmap v497: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-10T10:52:26.748 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-10T10:52:26.748 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-10T10:52:26.748 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-10T10:52:26.748 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-10T10:52:26.748 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T10:52:26.748 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T10:52:26.748 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T10:52:27.154 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:52:27.961 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:27 smithi121 ceph-mon[35231]: pgmap v498: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 18 op/s 2024-09-10T10:52:28.067 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-10T10:52:28.067 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:28.067 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 2046, 2024-09-10T10:52:28.067 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2088, 2024-09-10T10:52:28.067 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 788246, 2024-09-10T10:52:28.067 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 6482305, 2024-09-10T10:52:28.067 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 19, 2024-09-10T10:52:28.067 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.148865294, 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.055428694, 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.052014628, 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.034401784, 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2083, 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.104053564, 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000049953 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1283, 2024-09-10T10:52:28.068 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000211656, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000164 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 1216 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 3224, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 3652, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 1652806, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 2583374, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 11, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.243748449, 2024-09-10T10:52:28.069 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.116358569, 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.141055104, 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.005357473, 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3653, 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.144331169, 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000039510 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 6365, 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.001183639, 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000185 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.070 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 5520, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 563728 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 6924, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 7826, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 4387413, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 3831116, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 9, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.454662789, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.205536227, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.336133387, 2024-09-10T10:52:28.071 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000779375, 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 7825, 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.415227822, 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000053064 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 12737, 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.001979422, 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000155 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 2802848, 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 2152544 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.072 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-10T10:52:28.073 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-09-10T10:52:28.073 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-10T10:52:28.073 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.073 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-09-10T10:52:28.073 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2461, 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.717523741, 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000291557 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 21, 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000849396, 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000040447 2024-09-10T10:52:28.074 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 1186, 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 1135, 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1135, 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 3.074507301, 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002708817 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 51, 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 3, 2024-09-10T10:52:28.075 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 27, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 2, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 497, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 30, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 318, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 149, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 454, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 548, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 36, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 36, 2024-09-10T10:52:28.076 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 14, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 4244, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 3173, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 49, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 56, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 1, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 226, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 2253, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 15, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 385, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 7, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 303, 2024-09-10T10:52:28.077 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 3, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 1010, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 1197432100, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 3, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:28.078 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 33, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 438, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 822, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 1283, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 519, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 45, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 596 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-09-10T10:52:28.079 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 58, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 84, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 13, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 152, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 6, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 132, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 19, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:28.080 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 18, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 2, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-09-10T10:52:28.081 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 2187, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 2187, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 4, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 4, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 2, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-09-10T10:52:28.082 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 9586089, 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 0, 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1167, 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 5.107214859, 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.004376362 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 0 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 189, 2024-09-10T10:52:28.083 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 573, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 384, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 45, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 51, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 6, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 514, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 1092, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 578, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 36, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 300, 2024-09-10T10:52:28.084 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 264, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 61084, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 223520 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 3048, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 651, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 1186, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 312, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 1407, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 44, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.055061784, 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001251404 2024-09-10T10:52:28.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 43, 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.018638037, 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000433442 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 150, 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.628360427, 2024-09-10T10:52:28.086 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.004189069 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 499, 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.586994975, 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001176342 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-09-10T10:52:28.087 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.088 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.089 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:28.089 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.089 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.089 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.089 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.089 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-09-10T10:52:28.089 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.091 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:27 smithi097 ceph-mon[35213]: pgmap v498: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 18 op/s 2024-09-10T10:52:28.091 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.091 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.091 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.091 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-09-10T10:52:28.091 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.091 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-09-10T10:52:28.092 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 70, 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.100165744, 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001430939 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 27, 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.077403878, 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002866810 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 150, 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1.236258418, 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.008241722 2024-09-10T10:52:28.093 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.094 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.096 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.097 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 152, 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.371624038, 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002444894 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.098 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 2, 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 3, 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 1, 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 2, 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 160, 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 80, 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 935, 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:28.099 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:28.100 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:28.101 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 830994, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 544, 2024-09-10T10:52:28.102 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 176, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 2, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 7936, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 175, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:28.103 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 1179167, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 46704, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 3, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 1445, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 5611546, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 28, 2024-09-10T10:52:28.104 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 1442, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1442, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 13.828839903, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.009590041 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1445, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1652 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 1445, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 7, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 1438, 2024-09-10T10:52:28.105 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 0, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 10, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 1, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 1170, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 61, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 2, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 19, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:28.106 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 20, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-09-10T10:52:28.107 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-09-10T10:52:28.108 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 105, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 24, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 11, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 13, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 2, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 294, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 9, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 66 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-09-10T10:52:28.109 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 1, 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "osd-slow-ops": { 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 6, 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 6, 2024-09-10T10:52:28.110 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 6, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 6, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 12190, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 5571764, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 12190, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:28.111 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 12190, 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 5571764, 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 23625, 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-10T10:52:28.112 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 1445, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 5612133, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1442, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 5588508, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.113 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 3, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 1445, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 1445, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1442, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 1442, 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:28.114 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 6, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 750, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 6, 2024-09-10T10:52:28.115 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1, 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 750, 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x56022616c960": { 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-10T10:52:28.116 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 2187, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 5391785, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 2187, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1169, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 5391785, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:28.117 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:28.118 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:28.118 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-10T10:52:28.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:27 smithi092 ceph-mon[30834]: pgmap v498: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 18 op/s 2024-09-10T10:52:29.018 INFO:tasks.check_counter:Daemon mds.c mds.exported=15 2024-09-10T10:52:29.018 INFO:tasks.check_counter:Daemon mds.c mds.imported=7 2024-09-10T10:52:29.018 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=3 2024-09-10T10:52:29.018 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-10T10:52:29.018 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T10:52:29.019 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T10:52:29.019 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T10:52:29.276 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:52:29.780 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-10T10:52:29.780 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:29.780 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 3344, 2024-09-10T10:52:29.780 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 3896, 2024-09-10T10:52:29.780 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 1910542, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 5909875, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 11, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 4, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.257547009, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.117157234, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.137410722, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.016088886, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3896, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.151287426, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000038831 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.781 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 6114, 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.001135082, 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000185 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1810, 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1921, 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 2681038, 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 7814459, 2024-09-10T10:52:29.782 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 13, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.162931305, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.069027046, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.101604250, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.014732053, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1920, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.084194419, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000043851 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1589, 2024-09-10T10:52:29.783 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000325141, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000204 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1818432, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 621904 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 7251, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 8183, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 2857472, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 8151846, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 13, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 7, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.543439143, 2024-09-10T10:52:29.784 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.210701718, 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.311992726, 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.088624322, 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 8179, 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.282253573, 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000034509 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 13051, 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.002211508, 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000169 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.785 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 998512, 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 2081952 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1936, 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.742948868, 2024-09-10T10:52:29.786 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000383754 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 763, 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.026281291, 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000034444 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 1017, 2024-09-10T10:52:29.787 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 883, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 883, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 4.386939852, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.004968221 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 134, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 8, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 11, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 0, 2024-09-10T10:52:29.788 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 392, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 40, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 266, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 86, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 334, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 754, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 119, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 119, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 39, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 2290, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 1890, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 132, 2024-09-10T10:52:29.789 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 43, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 4, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 40, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 2893, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 6, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 651, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 21, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 573, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 15, 2024-09-10T10:52:29.790 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 1010, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 1197432100, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 3, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 39, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 381, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 920, 2024-09-10T10:52:29.791 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 1159, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 355, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 161, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 560 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 123, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 83, 2024-09-10T10:52:29.792 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 15, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 248, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 213, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 26, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 12, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:29.793 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 6, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 0, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 2264, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 2264, 2024-09-10T10:52:29.794 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 6, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 6, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 2, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 18609331, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 0, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 892, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 6.245514713, 2024-09-10T10:52:29.795 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.007001698 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 0 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 277, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 1111, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 834, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 105, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 141, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 36, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 411, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 1387, 2024-09-10T10:52:29.796 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 976, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 119, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 662, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 543, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 59900, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 223520 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 1827, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 986, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 1017, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 253, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 1859, 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-09-10T10:52:29.797 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 215, 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.438301245, 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002038610 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 109, 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.117282359, 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001075984 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.798 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 31, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.247508993, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.007984161 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 188, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.157830208, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000839522 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.799 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.800 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.801 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 17, 2024-09-10T10:52:29.802 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.007490665, 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000440627 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 28, 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.056425740, 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002015205 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 257, 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 3.247564910, 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.012636439 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:29.803 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.804 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.805 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.806 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 38, 2024-09-10T10:52:29.807 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.114535732, 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.003014098 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 1, 2024-09-10T10:52:29.808 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 2, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 1, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 1, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 247, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 247, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 949, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:29.809 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:29.810 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:29.811 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 654763, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 554, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 176, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 2, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:29.812 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 7936, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 175, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 1426920, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 37614, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-10T10:52:29.813 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 1637, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 14527586, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 33, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 1637, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1637, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 16.499808617, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.010079296 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-09-10T10:52:29.814 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1637, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1850 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 1637, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 107, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 1530, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 0, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 10, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 90, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 982, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 133, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-09-10T10:52:29.815 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-09-10T10:52:29.816 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-09-10T10:52:29.816 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 0, 2024-09-10T10:52:29.816 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 228, 2024-09-10T10:52:29.816 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-09-10T10:52:29.816 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:29.816 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:29.816 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 2, 2024-09-10T10:52:29.816 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 20, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-09-10T10:52:29.817 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 105, 2024-09-10T10:52:29.818 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 24, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 12, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 12, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 275, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 25, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 85 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 1, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-09-10T10:52:29.819 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "osd-slow-ops": { 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 6, 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 6, 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 213, 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 213, 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.820 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 12401, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 6173207, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 12401, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 12401, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 6173207, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.821 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 1637, 2024-09-10T10:52:29.822 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 14549257, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1637, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 14549257, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-10T10:52:29.823 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 1637, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 1637, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1637, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 1637, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.824 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 213, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 22073, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 213, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 90, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 22073, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.825 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x557d91416960": { 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 574, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 2264, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 14415027, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 2264, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:29.826 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 892, 2024-09-10T10:52:29.827 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 14414453, 2024-09-10T10:52:29.827 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:29.827 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:29.827 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:29.827 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:29.827 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:29.827 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:29.827 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-10T10:52:30.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:29 smithi121 ceph-mon[35231]: pgmap v499: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-10T10:52:30.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:29 smithi121 ceph-mon[35231]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:52:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:29 smithi097 ceph-mon[35213]: pgmap v499: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-10T10:52:30.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:29 smithi097 ceph-mon[35213]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:52:30.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:29 smithi092 ceph-mon[30834]: pgmap v499: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-10T10:52:30.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:29 smithi092 ceph-mon[30834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T10:52:30.606 INFO:tasks.check_counter:Daemon mds.f mds.exported=6 2024-09-10T10:52:30.606 INFO:tasks.check_counter:Daemon mds.f mds.imported=21 2024-09-10T10:52:30.606 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=3 2024-09-10T10:52:30.606 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-10T10:52:30.606 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T10:52:30.606 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T10:52:30.606 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T10:52:30.855 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 6233, 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 4917, 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 2521601, 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 12854586, 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 147, 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.511766017, 2024-09-10T10:52:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.168636075, 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.255695351, 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.101434363, 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 4915, 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.806864211, 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000164163 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 6729, 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.001190975, 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000176 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.343 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 596640, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 189024 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 7303, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 9989, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 3470528, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 9480573, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 24, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 5, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.592211002, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.235389611, 2024-09-10T10:52:31.344 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.483075003, 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.091204788, 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 9987, 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1.114754982, 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000111620 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 13459, 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.002127754, 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000158 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1769248, 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 4151504 2024-09-10T10:52:31.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 6035, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 6291, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 4689396, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 4640065, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 8, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 7, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.401768646, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.172109893, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.270503468, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.020892739, 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:31.346 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 6290, 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.527673914, 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000083890 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 9587, 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.001663170, 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000173 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1829712, 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 629072 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-09-10T10:52:31.347 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3495, 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1.519966218, 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000434897 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 105, 2024-09-10T10:52:31.348 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.002906279, 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000027678 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 2179, 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 2110, 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2110, 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 8.893669623, 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.004215009 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.349 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 69, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 608, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 3, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 558, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 69, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 478, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 11, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 433, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 1211, 2024-09-10T10:52:31.350 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 210, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 210, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 20, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 3345, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 2525, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 69, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 50, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 82, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 893, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 32, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 1114, 2024-09-10T10:52:31.351 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 11, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 561, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 6, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 988, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 1090534916, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 6, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:31.352 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 31, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 291, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 1542, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 1550, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 1031, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 39, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 266 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-09-10T10:52:31.353 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 62, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 104, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 10, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 80, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 24, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 41, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 16, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:31.354 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 32, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 3, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.355 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 3291, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 3251, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 3251, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 40, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 106, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 75, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 74, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 74, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 1, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 1, 2024-09-10T10:52:31.356 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 1, 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 15169969, 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 15600596, 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 0, 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1423, 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 11.313792190, 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.007950662 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 0 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-09-10T10:52:31.357 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 506, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 1610, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 1104, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 51, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 122, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 71, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 567, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 2158, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 1591, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 210, 2024-09-10T10:52:31.358 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 1331, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 1121, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 69388, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 231712 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 2998, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 585, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 2179, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 182, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 908, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1013, 2024-09-10T10:52:31.359 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 6.897734943, 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.006809215 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 198, 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.050031039, 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000252682 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-09-10T10:52:31.360 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 54, 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.390303401, 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.007227840 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 165, 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.210944451, 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001278451 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1, 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000102222, 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000102222 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.362 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.363 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 16, 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.002344234, 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000146514 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 37, 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.248310846, 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.006711103 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.364 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 16, 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.088773884, 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.005548367 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 396, 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.077105324, 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000194710 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 53, 2024-09-10T10:52:31.365 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.114749301, 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002165081 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 75, 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.546554033, 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.007287387 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.366 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2, 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.008311348, 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.004155674 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 10, 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.056136085, 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.005613608 2024-09-10T10:52:31.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1, 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000895069, 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000895069 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.368 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-09-10T10:52:31.369 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 7, 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.019907509, 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002843929 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 66, 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.181465934, 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002749483 2024-09-10T10:52:31.370 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 2, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 4, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 2, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 2, 2024-09-10T10:52:31.371 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 103, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 51, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 942, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 240, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 240, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:31.372 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:31.373 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-10T10:52:31.374 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 658724, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 749, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:31.375 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 7936, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 175, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 1901724, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 34533, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-10T10:52:31.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 4226, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 14433572, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 34, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 4226, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 4226, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 104.218727320, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.024661317 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.377 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 4226, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 7654 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 4226, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 10, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 4216, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 537, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 1106, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 10, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 1433, 2024-09-10T10:52:31.378 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 281, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 3, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 554, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 2212, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-09-10T10:52:31.379 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-09-10T10:52:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 105, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 24, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 12, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 12, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-09-10T10:52:31.381 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 1420, 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 0, 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 98 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 1, 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "osd-slow-ops": { 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-09-10T10:52:31.382 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 13, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 6, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 38, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 24, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 19567, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 8601854, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:31.383 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 19567, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 19567, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 8601854, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:31.384 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-10T10:52:31.385 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-10T10:52:31.385 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:31.385 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:31.385 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 4226, 2024-09-10T10:52:31.385 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 14435996, 2024-09-10T10:52:31.385 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 4226, 2024-09-10T10:52:31.385 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 14435996, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 4226, 2024-09-10T10:52:31.386 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 4226, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 4226, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 4226, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 24, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 2424, 2024-09-10T10:52:31.387 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 24, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 10, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 2424, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x55e444462960": { 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:31.388 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 3291, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 11406292, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 3291, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1423, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 11406292, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:31.389 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:31.390 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:31.390 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-10T10:52:32.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:31 smithi121 ceph-mon[35231]: pgmap v500: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-09-10T10:52:32.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:31 smithi097 ceph-mon[35213]: pgmap v500: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-09-10T10:52:32.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:31 smithi092 ceph-mon[30834]: pgmap v500: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-09-10T10:52:32.154 INFO:tasks.check_counter:Daemon mds.i mds.exported=32 2024-09-10T10:52:32.154 INFO:tasks.check_counter:Daemon mds.i mds.imported=11 2024-09-10T10:52:32.154 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-10T10:52:32.154 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=16 2024-09-10T10:52:32.155 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=10 2024-09-10T10:52:32.155 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T10:52:32.155 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T10:52:32.406 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T10:52:32.994 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1293, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1334, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 1098129, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 5145114, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 18, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 7, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.106917861, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.047285189, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.047304204, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.012906973, 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:32.995 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1329, 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.056230239, 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000042310 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1571, 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000311458, 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000198 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1856, 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 3360 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:32.996 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1177, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1466, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 709656, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 1888710, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 11, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 5, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.116914025, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.056853313, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.058482529, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.004895016, 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:32.997 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1464, 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.085745569, 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000058569 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2291, 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000458100, 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000199 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 554832 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T10:52:32.998 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 2178, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2649, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 3174230, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 3106727, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 8, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 7, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.203151400, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.078529067, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.154192275, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.005661721, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2651, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.132789321, 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000050090 2024-09-10T10:52:32.999 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3398, 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000646004, 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000190 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 2171440, 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 1287424 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-10T10:52:33.000 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 939, 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.308018830, 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000328028 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-10T10:52:33.001 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 101, 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.003362609, 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000033293 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 437, 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 414, 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 414, 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.310928396, 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000751034 2024-09-10T10:52:33.002 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 23, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 6, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 35, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 3, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 940, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 135, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 795, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 10, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 747, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 497, 2024-09-10T10:52:33.003 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 401, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 401, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 38, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 841, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 731, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 5, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 7, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 0, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 5966, 2024-09-10T10:52:33.004 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 6, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 469, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 10, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 889, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 1, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 1010, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 1197432100, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 3, 2024-09-10T10:52:33.005 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 4, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 88, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 182, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 1, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T10:52:33.006 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 469, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 362, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 15, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 127 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 45, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 8, 2024-09-10T10:52:33.007 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 27, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 27, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-09-10T10:52:33.008 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 6, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 3, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 987, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-09-10T10:52:33.009 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 987, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 3, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 3, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 2, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 9215828, 2024-09-10T10:52:33.010 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 0, 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 380, 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 2.953928625, 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.007773496 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 0 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 732, 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 1229, 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 497, 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 89, 2024-09-10T10:52:33.011 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 95, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 6, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 731, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 1262, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 531, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 305, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 636, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 331, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 60496, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 223520 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 547, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 7, 2024-09-10T10:52:33.012 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 437, 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 23, 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 65, 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 24, 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.040901066, 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001704211 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 12, 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.045272074, 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.003772672 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.013 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 292, 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.101086109, 2024-09-10T10:52:33.014 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000346185 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1, 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000071278, 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000071278 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.015 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.016 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-09-10T10:52:33.017 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.017 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.018 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 18, 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.010062098, 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000559005 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 39, 2024-09-10T10:52:33.019 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.030250913, 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000775664 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.020 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.021 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1, 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.021199052, 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.021199052 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.022 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.023 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 27, 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.062085806, 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002299474 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-09-10T10:52:33.024 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 1, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 2, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 1, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 1, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 81, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 81, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 947, 2024-09-10T10:52:33.025 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-10T10:52:33.026 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T10:52:33.027 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 337156, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 1042, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 352, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 4, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-10T10:52:33.028 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 7936, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 175, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 3736082, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 31535, 2024-09-10T10:52:33.029 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 670, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 5248793, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 33, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 670, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 670, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 4.971941716, 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.007420808 2024-09-10T10:52:33.030 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 670, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 820 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 670, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 21, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 649, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 0, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 10, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 11, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 391, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 74, 2024-09-10T10:52:33.031 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 43, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 20, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-09-10T10:52:33.032 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 1, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-09-10T10:52:33.033 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 105, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 22, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 12, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 12, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-09-10T10:52:33.034 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 217, 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 16, 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 37 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 1, 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "osd-slow-ops": { 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 2 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-09-10T10:52:33.035 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 6, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 6, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 27, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 27, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 4644, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 4493460, 2024-09-10T10:52:33.036 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 4644, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 4644, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 4493460, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:33.037 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 670, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 5251794, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 670, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 5251794, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.038 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 670, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 670, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 670, 2024-09-10T10:52:33.039 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 670, 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 27, 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 3191, 2024-09-10T10:52:33.040 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:33.041 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 27, 2024-09-10T10:52:33.041 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:33.041 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:33.041 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 11, 2024-09-10T10:52:33.041 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 3191, 2024-09-10T10:52:33.041 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:33.041 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.041 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.041 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x55b7d2cf4960": { 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 987, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 5021524, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 987, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-10T10:52:33.042 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 380, 2024-09-10T10:52:33.043 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 5021524, 2024-09-10T10:52:33.043 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-10T10:52:33.043 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-10T10:52:33.043 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-10T10:52:33.043 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-10T10:52:33.043 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:33.043 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-10T10:52:33.043 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-10T10:52:33.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:33 smithi121 ceph-mon[35231]: pgmap v501: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 13 op/s 2024-09-10T10:52:33.893 INFO:tasks.check_counter:Daemon mds.l mds.exported=6 2024-09-10T10:52:33.894 INFO:tasks.check_counter:Daemon mds.l mds.imported=10 2024-09-10T10:52:33.894 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=3 2024-09-10T10:52:33.894 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-10T10:52:33.894 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T10:52:33.894 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T10:52:33.905 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T10:52:33.905 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:52:33.905 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:52:34.010 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-10T10:52:34.010 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T10:52:34.022 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:33 smithi092 ceph-mon[30834]: pgmap v501: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 13 op/s 2024-09-10T10:52:34.041 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T10:52:34.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:33 smithi097 ceph-mon[35213]: pgmap v501: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 13 op/s 2024-09-10T10:52:34.339 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:34.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.842+0000 7f4c82a5f640 1 -- 172.21.15.92:0/3822080690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 msgr2=0x7f4c7c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:34.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.842+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/3822080690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 0x7f4c7c1067e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009900 tx=0x7f4c7002a410 comp rx=0 tx=0).stop 2024-09-10T10:52:34.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.842+0000 7f4c82a5f640 1 -- 172.21.15.92:0/3822080690 shutdown_connections 2024-09-10T10:52:34.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.842+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/3822080690 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c7c106f10 0x7f4c7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:34.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.842+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/3822080690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 0x7f4c7c1067e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.842+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/3822080690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c101de0 0x7f4c7c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.842+0000 7f4c82a5f640 1 -- 172.21.15.92:0/3822080690 >> 172.21.15.92:0/3822080690 conn(0x7f4c7c0fd880 msgr2=0x7f4c7c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.842+0000 7f4c82a5f640 1 -- 172.21.15.92:0/3822080690 shutdown_connections 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.842+0000 7f4c82a5f640 1 -- 172.21.15.92:0/3822080690 wait complete. 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.843+0000 7f4c82a5f640 1 Processor -- start 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.843+0000 7f4c82a5f640 1 -- start start 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.843+0000 7f4c82a5f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c101de0 0x7f4c7c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.843+0000 7f4c82a5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 0x7f4c7c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.843+0000 7f4c82a5f640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c7c106f10 0x7f4c7c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.843+0000 7f4c82a5f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c111f70 con 0x7f4c7c102790 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.843+0000 7f4c82a5f640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c111df0 con 0x7f4c7c106f10 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.843+0000 7f4c82a5f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1120f0 con 0x7f4c7c101de0 2024-09-10T10:52:34.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 0x7f4c7c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 0x7f4c7c198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35670/0 (socket says 172.21.15.92:35670) 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7b7fe640 1 -- 172.21.15.92:0/4056135079 learned_addr learned my addr 172.21.15.92:0/4056135079 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c101de0 0x7f4c7c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c80ffc640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c7c106f10 0x7f4c7c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7b7fe640 1 -- 172.21.15.92:0/4056135079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c101de0 msgr2=0x7f4c7c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7b7fe640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c101de0 0x7f4c7c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7b7fe640 1 -- 172.21.15.92:0/4056135079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c7c106f10 msgr2=0x7f4c7c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7b7fe640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c7c106f10 0x7f4c7c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7b7fe640 1 -- 172.21.15.92:0/4056135079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c19d3c0 con 0x7f4c7c102790 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c7b7fe640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 0x7f4c7c198950 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4c70006010 tx=0x7f4c700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c797fa640 1 -- 172.21.15.92:0/4056135079 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7003f030 con 0x7f4c7c102790 2024-09-10T10:52:34.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c797fa640 1 -- 172.21.15.92:0/4056135079 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c70003ce0 con 0x7f4c7c102790 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c797fa640 1 -- 172.21.15.92:0/4056135079 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70035070 con 0x7f4c7c102790 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c19d650 con 0x7f4c7c102790 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.844+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1a4f90 con 0x7f4c7c102790 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.845+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7c1021c0 con 0x7f4c7c102790 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.847+0000 7f4c797fa640 1 -- 172.21.15.92:0/4056135079 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4c70042030 con 0x7f4c7c102790 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.847+0000 7f4c797fa640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4c640a2cf0 0x7f4c640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.848+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4c640a2cf0 0x7f4c640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.848+0000 7f4c797fa640 1 -- 172.21.15.92:0/4056135079 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8455+0+0 (secure 0 0 0) 0x7f4c700efbd0 con 0x7f4c7c102790 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.848+0000 7f4c7bfff640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4c640a2cf0 0x7f4c640a51b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009bd0 tx=0x7f4c6c005f90 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:34.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:34.851+0000 7f4c797fa640 1 -- 172.21.15.92:0/4056135079 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c700bc8f0 con 0x7f4c7c102790 2024-09-10T10:52:35.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.038+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4c7c199770 con 0x7f4c7c102790 2024-09-10T10:52:35.040 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.038+0000 7f4c797fa640 1 -- 172.21.15.92:0/4056135079 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v105) ==== 81+0+942 (secure 0 0 0) 0x7f4c7c199770 con 0x7f4c7c102790 2024-09-10T10:52:35.040 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/2834815615 2024-09-11T10:36:38.391872+0000 2024-09-10T10:52:35.040 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1111474699 2024-09-11T10:27:30.810536+0000 2024-09-10T10:52:35.040 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/1855060807 2024-09-11T10:27:54.047303+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2311894425 2024-09-11T10:27:30.810536+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3275925367 2024-09-11T10:36:38.391872+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/2836317933 2024-09-11T10:27:30.810536+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6801/2836317933 2024-09-11T10:27:30.810536+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/88974791 2024-09-11T10:36:38.391872+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/140795142 2024-09-11T10:27:54.047303+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1498104734 2024-09-11T10:36:38.391872+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/1855060807 2024-09-11T10:27:54.047303+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/2939690439 2024-09-11T10:27:30.810536+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/3917916504 2024-09-11T10:27:54.047303+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/1058999410 2024-09-11T10:36:38.391872+0000 2024-09-10T10:52:35.041 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:0/896601966 2024-09-11T10:27:54.047303+0000 2024-09-10T10:52:35.042 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92:6800/2834815615 2024-09-11T10:36:38.391872+0000 2024-09-10T10:52:35.042 INFO:teuthology.orchestra.run.smithi092.stderr:listed 16 entries 2024-09-10T10:52:35.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4c640a2cf0 msgr2=0x7f4c640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:35.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4c640a2cf0 0x7f4c640a51b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009bd0 tx=0x7f4c6c005f90 comp rx=0 tx=0).stop 2024-09-10T10:52:35.042 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 msgr2=0x7f4c7c198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:35.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 0x7f4c7c198950 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4c70006010 tx=0x7f4c700042f0 comp rx=0 tx=0).stop 2024-09-10T10:52:35.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 shutdown_connections 2024-09-10T10:52:35.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f4c640a2cf0 0x7f4c640a51b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:35.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f4c7c106f10 0x7f4c7c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:35.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102790 0x7f4c7c198950 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:35.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 --2- 172.21.15.92:0/4056135079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c101de0 0x7f4c7c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:35.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.040+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 >> 172.21.15.92:0/4056135079 conn(0x7f4c7c0fd880 msgr2=0x7f4c7c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:35.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.041+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 shutdown_connections 2024-09-10T10:52:35.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:35.041+0000 7f4c82a5f640 1 -- 172.21.15.92:0/4056135079 wait complete. 2024-09-10T10:52:35.700 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T10:52:35.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:52:35.701 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /tmp/cephfs 2024-09-10T10:52:36.030 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:52:36.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:52:36.030 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-10T10:52:36.031 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:35 smithi092 ceph-mon[30834]: pgmap v502: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-09-10T10:52:36.031 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:35 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/4056135079' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:52:36.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:35 smithi121 ceph-mon[35231]: pgmap v502: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-09-10T10:52:36.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:35 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/4056135079' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:52:36.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:35 smithi097 ceph-mon[35213]: pgmap v502: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 12 op/s 2024-09-10T10:52:36.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:35 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/4056135079' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T10:52:36.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:52:36.105 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-09-10T10:52:36.178 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-10T10:52:36.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:52:36.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-10T10:52:36.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T10:52:36.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-09-10T10:52:36.343 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T10:52:36.353 INFO:tasks.cephadm:Teardown begin 2024-09-10T10:52:36.354 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T10:52:36.354 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:52:36.836 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:37.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.350+0000 7f11edefd640 1 -- 172.21.15.92:0/2607229257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 msgr2=0x7f11e81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:37.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.350+0000 7f11edefd640 1 --2- 172.21.15.92:0/2607229257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 0x7f11e81021d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009900 tx=0x7f11d802a410 comp rx=0 tx=0).stop 2024-09-10T10:52:37.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.350+0000 7f11edefd640 1 -- 172.21.15.92:0/2607229257 shutdown_connections 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.350+0000 7f11edefd640 1 --2- 172.21.15.92:0/2607229257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e8106f20 0x7f11e810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.350+0000 7f11edefd640 1 --2- 172.21.15.92:0/2607229257 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e81027a0 0x7f11e81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.350+0000 7f11edefd640 1 --2- 172.21.15.92:0/2607229257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 0x7f11e81021d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.350+0000 7f11edefd640 1 -- 172.21.15.92:0/2607229257 >> 172.21.15.92:0/2607229257 conn(0x7f11e80fd8b0 msgr2=0x7f11e80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.350+0000 7f11edefd640 1 -- 172.21.15.92:0/2607229257 shutdown_connections 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.350+0000 7f11edefd640 1 -- 172.21.15.92:0/2607229257 wait complete. 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11edefd640 1 Processor -- start 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11edefd640 1 -- start start 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11edefd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 0x7f11e8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11edefd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e81027a0 0x7f11e81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11edefd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e8106f20 0x7f11e819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11edefd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8111f80 con 0x7f11e8101df0 2024-09-10T10:52:37.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11edefd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8111e00 con 0x7f11e8106f20 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11edefd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8112100 con 0x7f11e81027a0 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11e77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 0x7f11e8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11e77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 0x7f11e8198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35692/0 (socket says 172.21.15.92:35692) 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.351+0000 7f11e77fe640 1 -- 172.21.15.92:0/3087485038 learned_addr learned my addr 172.21.15.92:0/3087485038 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11dffff640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e81027a0 0x7f11e81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e7fff640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e8106f20 0x7f11e819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e77fe640 1 -- 172.21.15.92:0/3087485038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e81027a0 msgr2=0x7f11e81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e77fe640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e81027a0 0x7f11e81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e77fe640 1 -- 172.21.15.92:0/3087485038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e8106f20 msgr2=0x7f11e819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e77fe640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e8106f20 0x7f11e819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e77fe640 1 -- 172.21.15.92:0/3087485038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e819d410 con 0x7f11e8101df0 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e7fff640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e8106f20 0x7f11e819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:52:37.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e77fe640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 0x7f11e8198460 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f11d8006010 tx=0x7f11d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e57fa640 1 -- 172.21.15.92:0/3087485038 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d803f030 con 0x7f11e8101df0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e819d6a0 con 0x7f11e8101df0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e57fa640 1 -- 172.21.15.92:0/3087485038 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11d8003ce0 con 0x7f11e8101df0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11e57fa640 1 -- 172.21.15.92:0/3087485038 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d8035070 con 0x7f11e8101df0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.352+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e81a4fe0 con 0x7f11e8101df0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.353+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e81021d0 con 0x7f11e8101df0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.354+0000 7f11e57fa640 1 -- 172.21.15.92:0/3087485038 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f11d8042030 con 0x7f11e8101df0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.355+0000 7f11e57fa640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f11d40a2cf0 0x7f11d40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.355+0000 7f11e57fa640 1 -- 172.21.15.92:0/3087485038 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8455+0+0 (secure 0 0 0) 0x7f11d80efbd0 con 0x7f11e8101df0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.355+0000 7f11dffff640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f11d40a2cf0 0x7f11d40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.355+0000 7f11dffff640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f11d40a2cf0 0x7f11d40a51b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f11e80fddd0 tx=0x7f11d000b410 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:37.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.358+0000 7f11e57fa640 1 -- 172.21.15.92:0/3087485038 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11d80bc8f0 con 0x7f11e8101df0 2024-09-10T10:52:37.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.559+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11e81997c0 con 0x7f11e8101df0 2024-09-10T10:52:37.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.560+0000 7f11e57fa640 1 -- 172.21.15.92:0/3087485038 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+11981 (secure 0 0 0) 0x7f11d80bc1f0 con 0x7f11e8101df0 2024-09-10T10:52:37.562 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:37.562 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":71,"btime":"2024-09-10T10:52:28:738664+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:34:45.351151+0000","modified":"2024-09-10T10:52:28.662240+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24472,"mds_1":24451,"mds_2":24445,"mds_3":24431,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/15499972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":15499972},{"type":"v1","addr":"172.21.15.92:6841","nonce":15499972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24359":{"gid":24359,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24386":{"gid":24386,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":15,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"b","rank":3,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6839/2331166625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6838","nonce":2331166625},{"type":"v1","addr":"172.21.15.97:6839","nonce":2331166625}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24878":{"gid":24878,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6837/1495848279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1495848279},{"type":"v1","addr":"172.21.15.97:6837","nonce":1495848279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24451,24445,24431,24424]},"id":1}]} 2024-09-10T10:52:37.562 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 71 2024-09-10T10:52:37.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.562+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f11d40a2cf0 msgr2=0x7f11d40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:37.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.562+0000 7f11edefd640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f11d40a2cf0 0x7f11d40a51b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f11e80fddd0 tx=0x7f11d000b410 comp rx=0 tx=0).stop 2024-09-10T10:52:37.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.562+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 msgr2=0x7f11e8198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:37.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.562+0000 7f11edefd640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 0x7f11e8198460 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f11d8006010 tx=0x7f11d80042f0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.563+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 shutdown_connections 2024-09-10T10:52:37.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.563+0000 7f11edefd640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f11d40a2cf0 0x7f11d40a51b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.563+0000 7f11edefd640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f11e8106f20 0x7f11e819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.563+0000 7f11edefd640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11e81027a0 0x7f11e81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.563+0000 7f11edefd640 1 --2- 172.21.15.92:0/3087485038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e8101df0 0x7f11e8198460 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:37.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.563+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 >> 172.21.15.92:0/3087485038 conn(0x7f11e80fd8b0 msgr2=0x7f11e80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:37.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.563+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 shutdown_connections 2024-09-10T10:52:37.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:37.563+0000 7f11edefd640 1 -- 172.21.15.92:0/3087485038 wait complete. 2024-09-10T10:52:37.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:37 smithi092 ceph-mon[30834]: pgmap v503: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-09-10T10:52:38.194 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:37 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3087485038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:52:38.195 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:37 smithi097 ceph-mon[35213]: pgmap v503: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-09-10T10:52:38.195 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:37 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3087485038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:52:38.195 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:37 smithi121 ceph-mon[35231]: pgmap v503: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-09-10T10:52:38.195 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:37 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3087485038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:52:38.271 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T10:52:38.520 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.016+0000 7fe30bcbd640 1 -- 172.21.15.92:0/2346003870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100a80 msgr2=0x7fe304100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.016+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/2346003870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100a80 0x7fe304100ee0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009930 tx=0x7fe2f402a420 comp rx=0 tx=0).stop 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.016+0000 7fe30bcbd640 1 -- 172.21.15.92:0/2346003870 shutdown_connections 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.016+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/2346003870 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe304101420 0x7fe30410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.016+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/2346003870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304100a80 0x7fe304100ee0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.016+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/2346003870 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe304106a80 0x7fe304106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.016+0000 7fe30bcbd640 1 -- 172.21.15.92:0/2346003870 >> 172.21.15.92:0/2346003870 conn(0x7fe3040fc7a0 msgr2=0x7fe3040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.016+0000 7fe30bcbd640 1 -- 172.21.15.92:0/2346003870 shutdown_connections 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.016+0000 7fe30bcbd640 1 -- 172.21.15.92:0/2346003870 wait complete. 2024-09-10T10:52:39.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30bcbd640 1 Processor -- start 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30bcbd640 1 -- start start 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30bcbd640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe304100a80 0x7fe304198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30bcbd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304101420 0x7fe304198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30bcbd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe304106a80 0x7fe30419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30bcbd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe304110ea0 con 0x7fe304101420 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30bcbd640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fe304110d20 con 0x7fe304100a80 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30bcbd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe304111020 con 0x7fe304106a80 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe309258640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304101420 0x7fe304198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe309258640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304101420 0x7fe304198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35708/0 (socket says 172.21.15.92:35708) 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe309258640 1 -- 172.21.15.92:0/3186157784 learned_addr learned my addr 172.21.15.92:0/3186157784 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe309a59640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe304100a80 0x7fe304198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30a25a640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe304106a80 0x7fe30419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:39.031 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe309258640 1 -- 172.21.15.92:0/3186157784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe304106a80 msgr2=0x7fe30419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe309258640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe304106a80 0x7fe30419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe309258640 1 -- 172.21.15.92:0/3186157784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe304100a80 msgr2=0x7fe304198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe309258640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe304100a80 0x7fe304198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe309258640 1 -- 172.21.15.92:0/3186157784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30419d3d0 con 0x7fe304101420 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.017+0000 7fe30a25a640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe304106a80 0x7fe30419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.018+0000 7fe309258640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304101420 0x7fe304198960 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009a50 tx=0x7fe2f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.018+0000 7fe2faffd640 1 -- 172.21.15.92:0/3186157784 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f403f030 con 0x7fe304101420 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.018+0000 7fe2faffd640 1 -- 172.21.15.92:0/3186157784 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2f4003ad0 con 0x7fe304101420 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.018+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30419d660 con 0x7fe304101420 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.018+0000 7fe2faffd640 1 -- 172.21.15.92:0/3186157784 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4035070 con 0x7fe304101420 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.018+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3041a4fa0 con 0x7fe304101420 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.019+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3041021c0 con 0x7fe304101420 2024-09-10T10:52:39.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.020+0000 7fe2faffd640 1 -- 172.21.15.92:0/3186157784 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe2f4042030 con 0x7fe304101420 2024-09-10T10:52:39.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.021+0000 7fe2faffd640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe2f00a2cf0 0x7fe2f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:39.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.021+0000 7fe309a59640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe2f00a2cf0 0x7fe2f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:39.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.021+0000 7fe2faffd640 1 -- 172.21.15.92:0/3186157784 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8455+0+0 (secure 0 0 0) 0x7fe2f40efbf0 con 0x7fe304101420 2024-09-10T10:52:39.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.021+0000 7fe309a59640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe2f00a2cf0 0x7fe2f00a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe30000abe0 tx=0x7fe30000a2d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:39.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.025+0000 7fe2faffd640 1 -- 172.21.15.92:0/3186157784 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe2f40bc850 con 0x7fe304101420 2024-09-10T10:52:39.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.223+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3041a5170 con 0x7fe304101420 2024-09-10T10:52:39.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.224+0000 7fe2faffd640 1 -- 172.21.15.92:0/3186157784 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+11981 (secure 0 0 0) 0x7fe2f40bc150 con 0x7fe304101420 2024-09-10T10:52:39.226 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:39.226 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":71,"btime":"2024-09-10T10:52:28:738664+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3858072371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3858072371},{"type":"v1","addr":"172.21.15.92:6835","nonce":3858072371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1435061291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1435061291},{"type":"v1","addr":"172.21.15.92:6837","nonce":1435061291}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":71,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T10:34:45.351151+0000","modified":"2024-09-10T10:52:28.662240+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24472,"mds_1":24451,"mds_2":24445,"mds_3":24431,"mds_4":24424},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6839/1641635662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":1641635662},{"type":"v1","addr":"172.21.15.92:6839","nonce":1641635662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14625":{"gid":14625,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6841/15499972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":15499972},{"type":"v1","addr":"172.21.15.92:6841","nonce":15499972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24359":{"gid":24359,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6833/2610071582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":2610071582},{"type":"v1","addr":"172.21.15.97:6833","nonce":2610071582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24386":{"gid":24386,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6835/9514508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6834","nonce":9514508},{"type":"v1","addr":"172.21.15.97:6835","nonce":9514508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":15,"addr":"172.21.15.121:6833/4152552339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4152552339},{"type":"v1","addr":"172.21.15.121:6833","nonce":4152552339}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"b","rank":3,"incarnation":23,"state":"up:active","state_seq":6,"addr":"172.21.15.97:6839/2331166625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6838","nonce":2331166625},{"type":"v1","addr":"172.21.15.97:6839","nonce":2331166625}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"f","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6835/2121443701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2121443701},{"type":"v1","addr":"172.21.15.121:6835","nonce":2121443701}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"c","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.121:6837/332654710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":332654710},{"type":"v1","addr":"172.21.15.121:6837","nonce":332654710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/3692560393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3692560393},{"type":"v1","addr":"172.21.15.121:6839","nonce":3692560393}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24878":{"gid":24878,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.97:6837/1495848279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6836","nonce":1495848279},{"type":"v1","addr":"172.21.15.97:6837","nonce":1495848279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24472,"qdb_cluster":[24472,24451,24445,24431,24424]},"id":1}]} 2024-09-10T10:52:39.226 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 71 2024-09-10T10:52:39.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.226+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe2f00a2cf0 msgr2=0x7fe2f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:39.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.226+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe2f00a2cf0 0x7fe2f00a51b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe30000abe0 tx=0x7fe30000a2d0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.226+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304101420 msgr2=0x7fe304198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:39.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.226+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304101420 0x7fe304198960 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009a50 tx=0x7fe2f4004270 comp rx=0 tx=0).stop 2024-09-10T10:52:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.226+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 shutdown_connections 2024-09-10T10:52:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.226+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe304106a80 0x7fe30419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.226+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe304101420 0x7fe304198960 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.227+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fe2f00a2cf0 0x7fe2f00a51b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.227+0000 7fe30bcbd640 1 --2- 172.21.15.92:0/3186157784 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fe304100a80 0x7fe304198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.227+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 >> 172.21.15.92:0/3186157784 conn(0x7fe3040fc7a0 msgr2=0x7fe304104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.227+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 shutdown_connections 2024-09-10T10:52:39.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:39.227+0000 7fe30bcbd640 1 -- 172.21.15.92:0/3186157784 wait complete. 2024-09-10T10:52:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:39 smithi121 ceph-mon[35231]: pgmap v504: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T10:52:40.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:39 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3186157784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:52:40.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:39 smithi092 ceph-mon[30834]: pgmap v504: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T10:52:40.043 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:39 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3186157784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:52:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:39 smithi097 ceph-mon[35213]: pgmap v504: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-10T10:52:40.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:39 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3186157784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T10:52:40.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T10:52:40.321 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.792+0000 7f236b0f4640 1 -- 172.21.15.92:0/2711281941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 msgr2=0x7f2364100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2711281941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 0x7f2364100860 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2354009900 tx=0x7f235402a410 comp rx=0 tx=0).stop 2024-09-10T10:52:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 -- 172.21.15.92:0/2711281941 shutdown_connections 2024-09-10T10:52:40.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2711281941 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f23641055b0 0x7f236410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2711281941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2364100e30 0x7f2364104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2711281941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 0x7f2364100860 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 -- 172.21.15.92:0/2711281941 >> 172.21.15.92:0/2711281941 conn(0x7f2364077210 msgr2=0x7f23640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 -- 172.21.15.92:0/2711281941 shutdown_connections 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 -- 172.21.15.92:0/2711281941 wait complete. 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 Processor -- start 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 -- start start 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 0x7f2364198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2364100e30 0x7f2364198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23641055b0 0x7f236419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2364111f90 con 0x7f2364100480 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f2364111e10 con 0x7f2364100e30 2024-09-10T10:52:40.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.793+0000 7f236b0f4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2364112110 con 0x7f23641055b0 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2368e90640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 0x7f2364198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2368e90640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 0x7f2364198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:35724/0 (socket says 172.21.15.92:35724) 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2368e90640 1 -- 172.21.15.92:0/2795256667 learned_addr learned my addr 172.21.15.92:0/2795256667 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2363fff640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2364100e30 0x7f2364198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2369691640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23641055b0 0x7f236419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2368e90640 1 -- 172.21.15.92:0/2795256667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23641055b0 msgr2=0x7f236419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2368e90640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23641055b0 0x7f236419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2368e90640 1 -- 172.21.15.92:0/2795256667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2364100e30 msgr2=0x7f2364198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2368e90640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2364100e30 0x7f2364198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2368e90640 1 -- 172.21.15.92:0/2795256667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236419d400 con 0x7f2364100480 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2368e90640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 0x7f2364198450 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2354006010 tx=0x7f23540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2361ffb640 1 -- 172.21.15.92:0/2795256667 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235403f030 con 0x7f2364100480 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2361ffb640 1 -- 172.21.15.92:0/2795256667 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2354003ce0 con 0x7f2364100480 2024-09-10T10:52:40.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236419d690 con 0x7f2364100480 2024-09-10T10:52:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.794+0000 7f2361ffb640 1 -- 172.21.15.92:0/2795256667 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354035070 con 0x7f2364100480 2024-09-10T10:52:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.795+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23641a4fd0 con 0x7f2364100480 2024-09-10T10:52:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.796+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2364101960 con 0x7f2364100480 2024-09-10T10:52:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.797+0000 7f2361ffb640 1 -- 172.21.15.92:0/2795256667 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2354042030 con 0x7f2364100480 2024-09-10T10:52:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.797+0000 7f2361ffb640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f234c0a2cf0 0x7f234c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.797+0000 7f2363fff640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f234c0a2cf0 0x7f234c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.797+0000 7f2361ffb640 1 -- 172.21.15.92:0/2795256667 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8455+0+0 (secure 0 0 0) 0x7f23540efa20 con 0x7f2364100480 2024-09-10T10:52:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.798+0000 7f2363fff640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f234c0a2cf0 0x7f234c0a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23640ff7f0 tx=0x7f235800b390 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:40.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.801+0000 7f2361ffb640 1 -- 172.21.15.92:0/2795256667 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23540bc0f0 con 0x7f2364100480 2024-09-10T10:52:40.972 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.971+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2364108790 con 0x7f2364100480 2024-09-10T10:52:40.974 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.972+0000 7f2361ffb640 1 -- 172.21.15.92:0/2795256667 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+23064 (secure 0 0 0) 0x7f23540c03f0 con 0x7f2364100480 2024-09-10T10:52:40.974 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-10T10:52:40.974 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":105,"fsid":"0df4af84-6f5f-11ef-bcea-c7b262605968","created":"2024-09-10T10:27:09.104347+0000","modified":"2024-09-10T10:52:14.502580+0000","last_up_change":"2024-09-10T10:33:53.565686+0000","last_in_change":"2024-09-10T10:33:29.985482+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T10:30:06.350576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T10:34:41.056656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T10:34:43.485327+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1c3ff3a-9a5b-4d65-83f1-22fda2993201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6803","nonce":2143150260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6805","nonce":2143150260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6809","nonce":2143150260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2143150260},{"type":"v1","addr":"172.21.15.92:6807","nonce":2143150260}]},"public_addr":"172.21.15.92:6803/2143150260","cluster_addr":"172.21.15.92:6805/2143150260","heartbeat_back_addr":"172.21.15.92:6809/2143150260","heartbeat_front_addr":"172.21.15.92:6807/2143150260","state":["exists","up"]},{"osd":1,"uuid":"618212b8-db9b-4682-8a6b-f021f814c0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6801","nonce":3508346445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6803","nonce":3508346445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6807","nonce":3508346445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":3508346445},{"type":"v1","addr":"172.21.15.97:6805","nonce":3508346445}]},"public_addr":"172.21.15.97:6801/3508346445","cluster_addr":"172.21.15.97:6803/3508346445","heartbeat_back_addr":"172.21.15.97:6807/3508346445","heartbeat_front_addr":"172.21.15.97:6805/3508346445","state":["exists","up"]},{"osd":2,"uuid":"a872b862-b9b4-48e9-8130-87c1c7e5ef36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6801","nonce":1231693534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6803","nonce":1231693534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6807","nonce":1231693534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1231693534},{"type":"v1","addr":"172.21.15.121:6805","nonce":1231693534}]},"public_addr":"172.21.15.121:6801/1231693534","cluster_addr":"172.21.15.121:6803/1231693534","heartbeat_back_addr":"172.21.15.121:6807/1231693534","heartbeat_front_addr":"172.21.15.121:6805/1231693534","state":["exists","up"]},{"osd":3,"uuid":"f1315d40-d449-4284-901e-5526d9ea4bd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6811","nonce":3638563027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6813","nonce":3638563027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6817","nonce":3638563027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3638563027},{"type":"v1","addr":"172.21.15.92:6815","nonce":3638563027}]},"public_addr":"172.21.15.92:6811/3638563027","cluster_addr":"172.21.15.92:6813/3638563027","heartbeat_back_addr":"172.21.15.92:6817/3638563027","heartbeat_front_addr":"172.21.15.92:6815/3638563027","state":["exists","up"]},{"osd":4,"uuid":"5a88f8cd-b3ae-4ea2-9e04-803585cb6a6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6809","nonce":1960503640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6811","nonce":1960503640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6814","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6815","nonce":1960503640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":1960503640},{"type":"v1","addr":"172.21.15.97:6813","nonce":1960503640}]},"public_addr":"172.21.15.97:6809/1960503640","cluster_addr":"172.21.15.97:6811/1960503640","heartbeat_back_addr":"172.21.15.97:6815/1960503640","heartbeat_front_addr":"172.21.15.97:6813/1960503640","state":["exists","up"]},{"osd":5,"uuid":"9f4ef1d2-3f17-44ca-8abe-d0f137a688ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6809","nonce":2173743717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6811","nonce":2173743717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6815","nonce":2173743717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2173743717},{"type":"v1","addr":"172.21.15.121:6813","nonce":2173743717}]},"public_addr":"172.21.15.121:6809/2173743717","cluster_addr":"172.21.15.121:6811/2173743717","heartbeat_back_addr":"172.21.15.121:6815/2173743717","heartbeat_front_addr":"172.21.15.121:6813/2173743717","state":["exists","up"]},{"osd":6,"uuid":"8e1ea615-df4a-4948-b6a9-39323edfed2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6819","nonce":4073590316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6821","nonce":4073590316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6825","nonce":4073590316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4073590316},{"type":"v1","addr":"172.21.15.92:6823","nonce":4073590316}]},"public_addr":"172.21.15.92:6819/4073590316","cluster_addr":"172.21.15.92:6821/4073590316","heartbeat_back_addr":"172.21.15.92:6825/4073590316","heartbeat_front_addr":"172.21.15.92:6823/4073590316","state":["exists","up"]},{"osd":7,"uuid":"62e6ec88-d78d-4759-b4b9-37a846ef4a46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6817","nonce":2587554904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6819","nonce":2587554904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6823","nonce":2587554904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":2587554904},{"type":"v1","addr":"172.21.15.97:6821","nonce":2587554904}]},"public_addr":"172.21.15.97:6817/2587554904","cluster_addr":"172.21.15.97:6819/2587554904","heartbeat_back_addr":"172.21.15.97:6823/2587554904","heartbeat_front_addr":"172.21.15.97:6821/2587554904","state":["exists","up"]},{"osd":8,"uuid":"2925118a-dd87-43bb-b3a2-43938fa103e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6817","nonce":852392331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6819","nonce":852392331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6823","nonce":852392331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":852392331},{"type":"v1","addr":"172.21.15.121:6821","nonce":852392331}]},"public_addr":"172.21.15.121:6817/852392331","cluster_addr":"172.21.15.121:6819/852392331","heartbeat_back_addr":"172.21.15.121:6823/852392331","heartbeat_front_addr":"172.21.15.121:6821/852392331","state":["exists","up"]},{"osd":9,"uuid":"478185a7-99a3-4808-8a0a-5ebf8e201b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6827","nonce":1628602922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6829","nonce":1628602922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6833","nonce":1628602922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1628602922},{"type":"v1","addr":"172.21.15.92:6831","nonce":1628602922}]},"public_addr":"172.21.15.92:6827/1628602922","cluster_addr":"172.21.15.92:6829/1628602922","heartbeat_back_addr":"172.21.15.92:6833/1628602922","heartbeat_front_addr":"172.21.15.92:6831/1628602922","state":["exists","up"]},{"osd":10,"uuid":"7573d9e2-f7cd-4c9c-8939-54e13784e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6825","nonce":4185201186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6827","nonce":4185201186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6831","nonce":4185201186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":4185201186},{"type":"v1","addr":"172.21.15.97:6829","nonce":4185201186}]},"public_addr":"172.21.15.97:6825/4185201186","cluster_addr":"172.21.15.97:6827/4185201186","heartbeat_back_addr":"172.21.15.97:6831/4185201186","heartbeat_front_addr":"172.21.15.97:6829/4185201186","state":["exists","up"]},{"osd":11,"uuid":"8e24d820-116a-48eb-a6de-fbe19ab78cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6825","nonce":328137928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6827","nonce":328137928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6831","nonce":328137928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":328137928},{"type":"v1","addr":"172.21.15.121:6829","nonce":328137928}]},"public_addr":"172.21.15.121:6825/328137928","cluster_addr":"172.21.15.121:6827/328137928","heartbeat_back_addr":"172.21.15.121:6831/328137928","heartbeat_front_addr":"172.21.15.121:6829/328137928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:16.260913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:29:39.996047+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:04.683924+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:29.344903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:30:52.993651+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:19.717364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:31:44.918416+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:09.726939+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:32:34.561708+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:00.882185+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:26.166740+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T10:33:52.031980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2834815615":"2024-09-11T10:36:38.391872+0000","172.21.15.92:0/1111474699":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/2311894425":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/3275925367":"2024-09-11T10:36:38.391872+0000","172.21.15.92:6800/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:6801/2836317933":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/88974791":"2024-09-11T10:36:38.391872+0000","172.21.15.92:0/140795142":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1498104734":"2024-09-11T10:36:38.391872+0000","172.21.15.92:6800/1855060807":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/2939690439":"2024-09-11T10:27:30.810536+0000","172.21.15.92:0/3917916504":"2024-09-11T10:27:54.047303+0000","172.21.15.92:0/1058999410":"2024-09-11T10:36:38.391872+0000","172.21.15.92:0/896601966":"2024-09-11T10:27:54.047303+0000","172.21.15.92:6800/2834815615":"2024-09-11T10:36:38.391872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T10:52:40.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f234c0a2cf0 msgr2=0x7f234c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f234c0a2cf0 0x7f234c0a51b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f23640ff7f0 tx=0x7f235800b390 comp rx=0 tx=0).stop 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 msgr2=0x7f2364198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 0x7f2364198450 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2354006010 tx=0x7f23540042f0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 shutdown_connections 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23641055b0 0x7f236419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f234c0a2cf0 0x7f234c0a51b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f2364100e30 0x7f2364198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 --2- 172.21.15.92:0/2795256667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2364100480 0x7f2364198450 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 >> 172.21.15.92:0/2795256667 conn(0x7f2364077210 msgr2=0x7f2364103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 shutdown_connections 2024-09-10T10:52:40.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:40.975+0000 7f236b0f4640 1 -- 172.21.15.92:0/2795256667 wait complete. 2024-09-10T10:52:41.674 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T10:52:41.922 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:41 smithi121 ceph-mon[35231]: pgmap v505: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 17 op/s 2024-09-10T10:52:42.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:41 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2795256667' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:52:42.042 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:41 smithi092 ceph-mon[30834]: pgmap v505: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 17 op/s 2024-09-10T10:52:42.042 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:41 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2795256667' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:52:42.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:41 smithi097 ceph-mon[35213]: pgmap v505: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 105 KiB/s wr, 17 op/s 2024-09-10T10:52:42.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:41 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2795256667' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T10:52:42.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.386+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/245358697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 msgr2=0x7fc8b41031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:42.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.386+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/245358697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 0x7fc8b41031e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009900 tx=0x7fc8a402a480 comp rx=0 tx=0).stop 2024-09-10T10:52:42.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.386+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/245358697 shutdown_connections 2024-09-10T10:52:42.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.386+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/245358697 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8b410c1a0 0x7fc8b410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.386+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/245358697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b4103720 0x7fc8b410bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.386+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/245358697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 0x7fc8b41031e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.386+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/245358697 >> 172.21.15.92:0/245358697 conn(0x7fc8b40fc7a0 msgr2=0x7fc8b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:42.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.386+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/245358697 shutdown_connections 2024-09-10T10:52:42.408 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.386+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/245358697 wait complete. 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b9b1a640 1 Processor -- start 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b9b1a640 1 -- start start 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b9b1a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 0x7fc8b4100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b9b1a640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8b4103720 0x7fc8b4100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b9b1a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b410c1a0 0x7fc8b41014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b9b1a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b4111f70 con 0x7fc8b4102e00 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b9b1a640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b4111df0 con 0x7fc8b4103720 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b9b1a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b41120f0 con 0x7fc8b410c1a0 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 0x7fc8b4100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 0x7fc8b4100a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34746/0 (socket says 172.21.15.92:34746) 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b37fe640 1 -- 172.21.15.92:0/3841478644 learned_addr learned my addr 172.21.15.92:0/3841478644 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:42.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.387+0000 7fc8b3fff640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b410c1a0 0x7fc8b41014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b37fe640 1 -- 172.21.15.92:0/3841478644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b410c1a0 msgr2=0x7fc8b41014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b37fe640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b410c1a0 0x7fc8b41014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b37fe640 1 -- 172.21.15.92:0/3841478644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8b4103720 msgr2=0x7fc8b4100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b37fe640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8b4103720 0x7fc8b4100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b37fe640 1 -- 172.21.15.92:0/3841478644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b41a68f0 con 0x7fc8b4102e00 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b3fff640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b410c1a0 0x7fc8b41014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b37fe640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 0x7fc8b4100a60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4006010 tx=0x7fc8a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b17fa640 1 -- 172.21.15.92:0/3841478644 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a403f030 con 0x7fc8b4102e00 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b17fa640 1 -- 172.21.15.92:0/3841478644 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8a4003ce0 con 0x7fc8b4102e00 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b41a6b80 con 0x7fc8b4102e00 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b17fa640 1 -- 172.21.15.92:0/3841478644 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4035070 con 0x7fc8b4102e00 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.388+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b41a70b0 con 0x7fc8b4102e00 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.389+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b41031e0 con 0x7fc8b4102e00 2024-09-10T10:52:42.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.390+0000 7fc8b17fa640 1 -- 172.21.15.92:0/3841478644 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc8a4042030 con 0x7fc8b4102e00 2024-09-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.391+0000 7fc8b17fa640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc8a00a2d70 0x7fc8a00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.391+0000 7fc8abfff640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc8a00a2d70 0x7fc8a00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.391+0000 7fc8b17fa640 1 -- 172.21.15.92:0/3841478644 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8455+0+0 (secure 0 0 0) 0x7fc8a40ef640 con 0x7fc8b4102e00 2024-09-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.391+0000 7fc8abfff640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc8a00a2d70 0x7fc8a00a5230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc8b41024f0 tx=0x7fc89c005bf0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:42.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.395+0000 7fc8b17fa640 1 -- 172.21.15.92:0/3841478644 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8a40bc360 con 0x7fc8b4102e00 2024-09-10T10:52:42.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.597+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc8b4101f90 con 0x7fc8b4102e00 2024-09-10T10:52:42.600 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.599+0000 7fc8b17fa640 1 -- 172.21.15.92:0/3841478644 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) ==== 161+0+0 (secure 0 0 0) 0x7fc8a40bbc60 con 0x7fc8b4102e00 2024-09-10T10:52:42.600 INFO:teuthology.orchestra.run.smithi092.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T10:52:42.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.602+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc8a00a2d70 msgr2=0x7fc8a00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.602+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc8a00a2d70 0x7fc8a00a5230 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc8b41024f0 tx=0x7fc89c005bf0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.602+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 msgr2=0x7fc8b4100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.602+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 0x7fc8b4100a60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4006010 tx=0x7fc8a40042f0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.603+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 shutdown_connections 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.603+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b410c1a0 0x7fc8b41014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.603+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fc8a00a2d70 0x7fc8a00a5230 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.603+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fc8b4103720 0x7fc8b4100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.603+0000 7fc8b9b1a640 1 --2- 172.21.15.92:0/3841478644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8b4102e00 0x7fc8b4100a60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.603+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 >> 172.21.15.92:0/3841478644 conn(0x7fc8b40fc7a0 msgr2=0x7fc8b40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.603+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 shutdown_connections 2024-09-10T10:52:42.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:42.603+0000 7fc8b9b1a640 1 -- 172.21.15.92:0/3841478644 wait complete. 2024-09-10T10:52:42.860 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a[71696]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:42.861 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a[71696]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:42.861 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-mds[71712]: -- 172.21.15.92:0/4151589664 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572cc99f860 con 0x5572cc97d400 2024-09-10T10:52:42.861 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a[71696]: starting mds.a at 2024-09-10T10:52:42.861 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g[71356]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:42.861 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g[71356]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:42.861 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-mds[71364]: -- 172.21.15.92:0/1693876712 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623fb35f860 con 0x5623fb33d400 2024-09-10T10:52:42.861 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g[71356]: starting mds.g at 2024-09-10T10:52:42.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a[30830]: 2024-09-10T10:52:42.597+0000 7fef90208640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:52:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3841478644' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T10:52:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-mon[30834]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:52:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-mon[30834]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:52:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3841478644' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T10:52:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-mon[30834]: osdmap e106: 12 total, 12 up, 12 in 2024-09-10T10:52:42.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:42 smithi092 ceph-mon[30834]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T10:52:43.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3841478644' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T10:52:43.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mon[35231]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:52:43.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mon[35231]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:52:43.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3841478644' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T10:52:43.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mon[35231]: osdmap e106: 12 total, 12 up, 12 in 2024-09-10T10:52:43.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mon[35231]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T10:52:43.042 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c[65602]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:43.042 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c[65602]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:43.042 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mds[65606]: -- 172.21.15.121:0/2888849728 <== mon.2 v2:172.21.15.97:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d28ecb5860 con 0x55d28ec93400 2024-09-10T10:52:43.042 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c[65602]: starting mds.c at 2024-09-10T10:52:43.042 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f[65302]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:43.042 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f[65302]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:43.043 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mds[65306]: -- 172.21.15.121:0/297683040 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b1ec1d9c20 con 0x55b1ec1b6800 2024-09-10T10:52:43.043 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f[65302]: starting mds.f at 2024-09-10T10:52:43.043 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:43.043 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:43.043 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mds[65911]: -- 172.21.15.121:0/1581249449 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559872f53860 con 0x559872f31400 2024-09-10T10:52:43.043 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: starting mds.i at 2024-09-10T10:52:43.043 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l[64999]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:43.043 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l[64999]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:43.043 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-mds[65003]: -- 172.21.15.121:0/239262798 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c2ca39860 con 0x564c2ca16800 2024-09-10T10:52:43.044 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:52:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l[64999]: starting mds.l at 2024-09-10T10:52:43.070 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e[64867]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:43.070 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e[64867]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:43.070 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mds[64871]: -- 172.21.15.97:0/4192414430 <== mon.2 v2:172.21.15.97:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55939d099c20 con 0x55939d077400 2024-09-10T10:52:43.070 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e[64867]: starting mds.e at 2024-09-10T10:52:43.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3841478644' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T10:52:43.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mon[35213]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T10:52:43.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mon[35213]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T10:52:43.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3841478644' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T10:52:43.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mon[35213]: osdmap e106: 12 total, 12 up, 12 in 2024-09-10T10:52:43.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mon[35213]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T10:52:43.071 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-b[65470]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:43.071 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-b[65470]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:43.072 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mds[65474]: -- 172.21.15.97:0/2391674904 <== mon.2 v2:172.21.15.97:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c3c25b860 con 0x564c3c239400 2024-09-10T10:52:43.072 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-b[65470]: starting mds.b at 2024-09-10T10:52:43.072 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h[65169]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:43.072 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h[65169]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:43.072 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mds[65173]: -- 172.21.15.97:0/1591426095 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5605fbe01860 con 0x5605fbdde800 2024-09-10T10:52:43.072 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h[65169]: starting mds.h at 2024-09-10T10:52:43.072 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k[64553]: ignoring --setuser ceph since I am not root 2024-09-10T10:52:43.072 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k[64553]: ignoring --setgroup ceph since I am not root 2024-09-10T10:52:43.073 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-mds[64557]: -- 172.21.15.97:0/2170258954 <== mon.2 v2:172.21.15.97:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572c4e5bc20 con 0x5572c4e39000 2024-09-10T10:52:43.073 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:52:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k[64553]: starting mds.k at 2024-09-10T10:52:43.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T10:52:43.755 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: pgmap v507: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 85 KiB/s wr, 15 op/s 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.92:6838/2043109288,v1:172.21.15.92:6839/2043109288] up:boot 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6832/237112269,v1:172.21.15.97:6833/237112269] up:boot 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.92:6840/1333642906,v1:172.21.15.92:6841/1333642906] up:boot 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6834/1037004541,v1:172.21.15.97:6835/1037004541] up:boot 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6836/138346608,v1:172.21.15.97:6838/138346608] up:boot 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6832/3776954550,v1:172.21.15.121:6833/3776954550] up:boot 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.97:6837/4140302786,v1:172.21.15.97:6839/4140302786] up:boot 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6834/2644965718,v1:172.21.15.121:6837/2644965718] up:boot 2024-09-10T10:52:44.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6836/3900839262,v1:172.21.15.121:6839/3900839262] up:boot 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: mds.? [v2:172.21.15.121:6835/3873822681,v1:172.21.15.121:6838/3873822681] up:boot 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:52:44.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:52:44.027 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:52:44.027 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:43 smithi092 ceph-mon[30834]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:52:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: pgmap v507: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 85 KiB/s wr, 15 op/s 2024-09-10T10:52:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.92:6838/2043109288,v1:172.21.15.92:6839/2043109288] up:boot 2024-09-10T10:52:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6832/237112269,v1:172.21.15.97:6833/237112269] up:boot 2024-09-10T10:52:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.92:6840/1333642906,v1:172.21.15.92:6841/1333642906] up:boot 2024-09-10T10:52:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6834/1037004541,v1:172.21.15.97:6835/1037004541] up:boot 2024-09-10T10:52:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6836/138346608,v1:172.21.15.97:6838/138346608] up:boot 2024-09-10T10:52:44.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6832/3776954550,v1:172.21.15.121:6833/3776954550] up:boot 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.97:6837/4140302786,v1:172.21.15.97:6839/4140302786] up:boot 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6834/2644965718,v1:172.21.15.121:6837/2644965718] up:boot 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6836/3900839262,v1:172.21.15.121:6839/3900839262] up:boot 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: mds.? [v2:172.21.15.121:6835/3873822681,v1:172.21.15.121:6838/3873822681] up:boot 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:52:44.042 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:52:44.043 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:52:44.043 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:52:44.043 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:52:44.043 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:43 smithi121 ceph-mon[35231]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:52:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: pgmap v507: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 85 KiB/s wr, 15 op/s 2024-09-10T10:52:44.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.92:6838/2043109288,v1:172.21.15.92:6839/2043109288] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6832/237112269,v1:172.21.15.97:6833/237112269] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.92:6840/1333642906,v1:172.21.15.92:6841/1333642906] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6834/1037004541,v1:172.21.15.97:6835/1037004541] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6836/138346608,v1:172.21.15.97:6838/138346608] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6832/3776954550,v1:172.21.15.121:6833/3776954550] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.97:6837/4140302786,v1:172.21.15.97:6839/4140302786] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6834/2644965718,v1:172.21.15.121:6837/2644965718] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6836/3900839262,v1:172.21.15.121:6839/3900839262] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: mds.? [v2:172.21.15.121:6835/3873822681,v1:172.21.15.121:6838/3873822681] up:boot 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T10:52:44.071 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T10:52:44.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T10:52:44.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T10:52:44.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T10:52:44.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T10:52:44.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T10:52:44.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T10:52:44.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T10:52:44.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T10:52:44.072 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:43 smithi097 ceph-mon[35213]: from='mgr.15234 172.21.15.92:0/3398396278' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T10:52:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.229+0000 7f632a359640 1 -- 172.21.15.92:0/4280664043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 msgr2=0x7f632410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.229+0000 7f632a359640 1 --2- 172.21.15.92:0/4280664043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 0x7f632410bb50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6318009900 tx=0x7f631802a480 comp rx=0 tx=0).stop 2024-09-10T10:52:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.229+0000 7f632a359640 1 -- 172.21.15.92:0/4280664043 shutdown_connections 2024-09-10T10:52:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.229+0000 7f632a359640 1 --2- 172.21.15.92:0/4280664043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f632410c170 0x7f632410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.229+0000 7f632a359640 1 --2- 172.21.15.92:0/4280664043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 0x7f632410bb50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.229+0000 7f632a359640 1 --2- 172.21.15.92:0/4280664043 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6324102d40 0x7f6324103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.229+0000 7f632a359640 1 -- 172.21.15.92:0/4280664043 >> 172.21.15.92:0/4280664043 conn(0x7f63240fc7a0 msgr2=0x7f63240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.229+0000 7f632a359640 1 -- 172.21.15.92:0/4280664043 shutdown_connections 2024-09-10T10:52:44.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.229+0000 7f632a359640 1 -- 172.21.15.92:0/4280664043 wait complete. 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.230+0000 7f632a359640 1 Processor -- start 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.230+0000 7f632a359640 1 -- start start 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f632a359640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6324102d40 0x7f6324198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f632a359640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 0x7f6324198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f632a359640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f632410c170 0x7f632419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f632a359640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6324111f70 con 0x7f6324103660 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f632a359640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7f6324111df0 con 0x7f6324102d40 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f632a359640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f63241120f0 con 0x7f632410c170 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 0x7f6324198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 0x7f6324198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34790/0 (socket says 172.21.15.92:34790) 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63237fe640 1 -- 172.21.15.92:0/3000651595 learned_addr learned my addr 172.21.15.92:0/3000651595 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:44.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63288f6640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f632410c170 0x7f632419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f6323fff640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6324102d40 0x7f6324198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63237fe640 1 -- 172.21.15.92:0/3000651595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f632410c170 msgr2=0x7f632419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63237fe640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f632410c170 0x7f632419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63237fe640 1 -- 172.21.15.92:0/3000651595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6324102d40 msgr2=0x7f6324198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63237fe640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6324102d40 0x7f6324198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63237fe640 1 -- 172.21.15.92:0/3000651595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632419d3e0 con 0x7f6324103660 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63288f6640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f632410c170 0x7f632419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f6323fff640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6324102d40 0x7f6324198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63237fe640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 0x7f6324198970 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6318005ab0 tx=0x7f63180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63217fa640 1 -- 172.21.15.92:0/3000651595 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631803f030 con 0x7f6324103660 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63217fa640 1 -- 172.21.15.92:0/3000651595 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6318003ce0 con 0x7f6324103660 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632419d670 con 0x7f6324103660 2024-09-10T10:52:44.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f63217fa640 1 -- 172.21.15.92:0/3000651595 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318035070 con 0x7f6324103660 2024-09-10T10:52:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.231+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63241a4fb0 con 0x7f6324103660 2024-09-10T10:52:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.232+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632406b070 con 0x7f6324103660 2024-09-10T10:52:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.234+0000 7f63217fa640 1 -- 172.21.15.92:0/3000651595 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6318042030 con 0x7f6324103660 2024-09-10T10:52:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.234+0000 7f63217fa640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f630c0a2d70 0x7f630c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.234+0000 7f6323fff640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f630c0a2d70 0x7f630c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.234+0000 7f63217fa640 1 -- 172.21.15.92:0/3000651595 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8841+0+0 (secure 0 0 0) 0x7f63180f0090 con 0x7f6324103660 2024-09-10T10:52:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.235+0000 7f6323fff640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f630c0a2d70 0x7f630c0a5230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f63140058c0 tx=0x7f6314005d30 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:44.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.238+0000 7f63217fa640 1 -- 172.21.15.92:0/3000651595 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63180bcb70 con 0x7f6324103660 2024-09-10T10:52:44.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.440+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6324199790 con 0x7f6324103660 2024-09-10T10:52:44.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.778+0000 7f63217fa640 1 -- 172.21.15.92:0/3000651595 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) ==== 104+0+0 (secure 0 0 0) 0x7f63180bc470 con 0x7f6324103660 2024-09-10T10:52:44.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.780+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f630c0a2d70 msgr2=0x7f630c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:44.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.780+0000 7f632a359640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f630c0a2d70 0x7f630c0a5230 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f63140058c0 tx=0x7f6314005d30 comp rx=0 tx=0).stop 2024-09-10T10:52:44.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.780+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 msgr2=0x7f6324198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:44.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.780+0000 7f632a359640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 0x7f6324198970 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6318005ab0 tx=0x7f63180042f0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.781+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 shutdown_connections 2024-09-10T10:52:44.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.781+0000 7f632a359640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f632410c170 0x7f632419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.781+0000 7f632a359640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6324103660 0x7f6324198970 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.781+0000 7f632a359640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7f630c0a2d70 0x7f630c0a5230 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.781+0000 7f632a359640 1 --2- 172.21.15.92:0/3000651595 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7f6324102d40 0x7f6324198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:44.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.781+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 >> 172.21.15.92:0/3000651595 conn(0x7f63240fc7a0 msgr2=0x7f63240fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:44.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.781+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 shutdown_connections 2024-09-10T10:52:44.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:44.781+0000 7f632a359640 1 -- 172.21.15.92:0/3000651595 wait complete. 2024-09-10T10:52:45.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:44 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3000651595' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:52:45.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:44 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3000651595' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:52:45.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:44 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3000651595' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T10:52:45.465 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T10:52:45.716 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:45 smithi121 ceph-mon[35231]: pgmap v508: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 85 KiB/s wr, 15 op/s 2024-09-10T10:52:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:45 smithi121 ceph-mon[35231]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:52:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:45 smithi121 ceph-mon[35231]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:52:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:45 smithi121 ceph-mon[35231]: Cluster is now healthy 2024-09-10T10:52:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:45 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/3000651595' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:52:46.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:45 smithi121 ceph-mon[35231]: fsmap 12 up:standby 2024-09-10T10:52:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:45 smithi097 ceph-mon[35213]: pgmap v508: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 85 KiB/s wr, 15 op/s 2024-09-10T10:52:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:45 smithi097 ceph-mon[35213]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:52:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:45 smithi097 ceph-mon[35213]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:52:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:45 smithi097 ceph-mon[35213]: Cluster is now healthy 2024-09-10T10:52:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:45 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/3000651595' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:52:46.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:45 smithi097 ceph-mon[35213]: fsmap 12 up:standby 2024-09-10T10:52:46.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:45 smithi092 ceph-mon[30834]: pgmap v508: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 85 KiB/s wr, 15 op/s 2024-09-10T10:52:46.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:45 smithi092 ceph-mon[30834]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T10:52:46.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:45 smithi092 ceph-mon[30834]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T10:52:46.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:45 smithi092 ceph-mon[30834]: Cluster is now healthy 2024-09-10T10:52:46.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:45 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/3000651595' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T10:52:46.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:45 smithi092 ceph-mon[30834]: fsmap 12 up:standby 2024-09-10T10:52:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.194+0000 7fb3327fb640 1 -- 172.21.15.92:0/113303634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c106f20 msgr2=0x7fb32c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.194+0000 7fb3327fb640 1 --2- 172.21.15.92:0/113303634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c106f20 0x7fb32c10eaa0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb324009ca0 tx=0x7fb32402a8c0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.194+0000 7fb3327fb640 1 -- 172.21.15.92:0/113303634 shutdown_connections 2024-09-10T10:52:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.194+0000 7fb3327fb640 1 --2- 172.21.15.92:0/113303634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c106f20 0x7fb32c10eaa0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.194+0000 7fb3327fb640 1 --2- 172.21.15.92:0/113303634 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb32c1027a0 0x7fb32c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.194+0000 7fb3327fb640 1 --2- 172.21.15.92:0/113303634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c101df0 0x7fb32c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.194+0000 7fb3327fb640 1 -- 172.21.15.92:0/113303634 >> 172.21.15.92:0/113303634 conn(0x7fb32c0fd8f0 msgr2=0x7fb32c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.194+0000 7fb3327fb640 1 -- 172.21.15.92:0/113303634 shutdown_connections 2024-09-10T10:52:46.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.194+0000 7fb3327fb640 1 -- 172.21.15.92:0/113303634 wait complete. 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb3327fb640 1 Processor -- start 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb3327fb640 1 -- start start 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb3327fb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c101df0 0x7fb32c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb3327fb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c1027a0 0x7fb32c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb3327fb640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb32c106f20 0x7fb32c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb3327fb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c111fa0 con 0x7fb32c1027a0 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb3327fb640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c111e20 con 0x7fb32c106f20 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb3327fb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c112120 con 0x7fb32c101df0 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb323fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c1027a0 0x7fb32c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb323fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c1027a0 0x7fb32c198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34812/0 (socket says 172.21.15.92:34812) 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb323fff640 1 -- 172.21.15.92:0/2402675142 learned_addr learned my addr 172.21.15.92:0/2402675142 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb32bfff640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c101df0 0x7fb32c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:46.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.195+0000 7fb330d98640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb32c106f20 0x7fb32c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb323fff640 1 -- 172.21.15.92:0/2402675142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c101df0 msgr2=0x7fb32c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb323fff640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c101df0 0x7fb32c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb323fff640 1 -- 172.21.15.92:0/2402675142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb32c106f20 msgr2=0x7fb32c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb323fff640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb32c106f20 0x7fb32c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb323fff640 1 -- 172.21.15.92:0/2402675142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c19d3b0 con 0x7fb32c1027a0 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb323fff640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c1027a0 0x7fb32c198940 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb31400d950 tx=0x7fb31400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb329ffb640 1 -- 172.21.15.92:0/2402675142 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314017070 con 0x7fb32c1027a0 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb329ffb640 1 -- 172.21.15.92:0/2402675142 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb31400de80 con 0x7fb32c1027a0 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb329ffb640 1 -- 172.21.15.92:0/2402675142 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31400f620 con 0x7fb32c1027a0 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c19d6a0 con 0x7fb32c1027a0 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.196+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c1a4f80 con 0x7fb32c1027a0 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.197+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32c1021d0 con 0x7fb32c1027a0 2024-09-10T10:52:46.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.198+0000 7fb329ffb640 1 -- 172.21.15.92:0/2402675142 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb314009c30 con 0x7fb32c1027a0 2024-09-10T10:52:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.199+0000 7fb329ffb640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb3180a2d70 0x7fb3180a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.199+0000 7fb32bfff640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb3180a2d70 0x7fb3180a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.199+0000 7fb329ffb640 1 -- 172.21.15.92:0/2402675142 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8841+0+0 (secure 0 0 0) 0x7fb3140cf110 con 0x7fb32c1027a0 2024-09-10T10:52:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.199+0000 7fb32bfff640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb3180a2d70 0x7fb3180a5230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009990 tx=0x7fb31c009110 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:46.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.203+0000 7fb329ffb640 1 -- 172.21.15.92:0/2402675142 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb31409bbf0 con 0x7fb32c1027a0 2024-09-10T10:52:46.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.368+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb32c10a130 con 0x7fb32c1027a0 2024-09-10T10:52:46.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.779+0000 7fb329ffb640 1 -- 172.21.15.92:0/2402675142 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) ==== 181+0+0 (secure 0 0 0) 0x7fb31409b4f0 con 0x7fb32c1027a0 2024-09-10T10:52:46.781 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' removed 2024-09-10T10:52:46.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb3180a2d70 msgr2=0x7fb3180a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb3180a2d70 0x7fb3180a5230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009990 tx=0x7fb31c009110 comp rx=0 tx=0).stop 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c1027a0 msgr2=0x7fb32c198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c1027a0 0x7fb32c198940 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb31400d950 tx=0x7fb31400dd50 comp rx=0 tx=0).stop 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 shutdown_connections 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fb3180a2d70 0x7fb3180a5230 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fb32c106f20 0x7fb32c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb32c1027a0 0x7fb32c198940 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 --2- 172.21.15.92:0/2402675142 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb32c101df0 0x7fb32c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 >> 172.21.15.92:0/2402675142 conn(0x7fb32c0fd8f0 msgr2=0x7fb32c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 shutdown_connections 2024-09-10T10:52:46.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:46.782+0000 7fb3327fb640 1 -- 172.21.15.92:0/2402675142 wait complete. 2024-09-10T10:52:47.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:46 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2402675142' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:52:47.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:46 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2402675142' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:52:47.106 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:46 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2402675142' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:52:47.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T10:52:47.632 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T10:52:48.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:47 smithi121 ceph-mon[35231]: pgmap v509: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2024-09-10T10:52:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:47 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/2402675142' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:52:48.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:47 smithi121 ceph-mon[35231]: osdmap e107: 12 total, 12 up, 12 in 2024-09-10T10:52:48.053 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:47 smithi092 ceph-mon[30834]: pgmap v509: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2024-09-10T10:52:48.053 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:47 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/2402675142' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:52:48.053 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:47 smithi092 ceph-mon[30834]: osdmap e107: 12 total, 12 up, 12 in 2024-09-10T10:52:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:47 smithi097 ceph-mon[35213]: pgmap v509: 97 pgs: 97 active+clean; 4.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 10 op/s 2024-09-10T10:52:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:47 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/2402675142' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:52:48.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:47 smithi097 ceph-mon[35213]: osdmap e107: 12 total, 12 up, 12 in 2024-09-10T10:52:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.134+0000 7fdc4f03e640 1 -- 172.21.15.92:0/131096156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48102790 msgr2=0x7fdc481067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.134+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/131096156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48102790 0x7fdc481067e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009900 tx=0x7fdc3402a410 comp rx=0 tx=0).stop 2024-09-10T10:52:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.134+0000 7fdc4f03e640 1 -- 172.21.15.92:0/131096156 shutdown_connections 2024-09-10T10:52:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.134+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/131096156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc48106f10 0x7fdc4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.134+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/131096156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48102790 0x7fdc481067e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.134+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/131096156 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc48101de0 0x7fdc481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.134+0000 7fdc4f03e640 1 -- 172.21.15.92:0/131096156 >> 172.21.15.92:0/131096156 conn(0x7fdc480fd8c0 msgr2=0x7fdc480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.134+0000 7fdc4f03e640 1 -- 172.21.15.92:0/131096156 shutdown_connections 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.134+0000 7fdc4f03e640 1 -- 172.21.15.92:0/131096156 wait complete. 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4f03e640 1 Processor -- start 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4f03e640 1 -- start start 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4f03e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48101de0 0x7fdc48198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4f03e640 1 --2- >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc48102790 0x7fdc48198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4f03e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc48106f10 0x7fdc4819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4f03e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdc48111f70 con 0x7fdc48101de0 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4f03e640 1 -- --> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] -- mon_getmap magic: 0 -- 0x7fdc48111df0 con 0x7fdc48102790 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4f03e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481120f0 con 0x7fdc48106f10 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4cdda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48101de0 0x7fdc48198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4cdda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48101de0 0x7fdc48198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34834/0 (socket says 172.21.15.92:34834) 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4cdda640 1 -- 172.21.15.92:0/1940623170 learned_addr learned my addr 172.21.15.92:0/1940623170 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-10T10:52:48.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc47fff640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc48102790 0x7fdc48198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.135+0000 7fdc4d5db640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc48106f10 0x7fdc4819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc4cdda640 1 -- 172.21.15.92:0/1940623170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc48106f10 msgr2=0x7fdc4819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc4cdda640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc48106f10 0x7fdc4819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc4cdda640 1 -- 172.21.15.92:0/1940623170 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc48102790 msgr2=0x7fdc48198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc4cdda640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc48102790 0x7fdc48198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc4cdda640 1 -- 172.21.15.92:0/1940623170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4819d400 con 0x7fdc48101de0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc4cdda640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48101de0 0x7fdc48198450 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00c920 tx=0x7fdc3c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc45ffb640 1 -- 172.21.15.92:0/1940623170 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c007c70 con 0x7fdc48101de0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc45ffb640 1 -- 172.21.15.92:0/1940623170 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc3c007e10 con 0x7fdc48101de0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4819d6f0 con 0x7fdc48101de0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc45ffb640 1 -- 172.21.15.92:0/1940623170 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c018890 con 0x7fdc48101de0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.136+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc481a4fd0 con 0x7fdc48101de0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.137+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc481021c0 con 0x7fdc48101de0 2024-09-10T10:52:48.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.138+0000 7fdc45ffb640 1 -- 172.21.15.92:0/1940623170 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fdc3c018a70 con 0x7fdc48101de0 2024-09-10T10:52:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.139+0000 7fdc45ffb640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdc380a2cf0 0x7fdc380a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T10:52:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.139+0000 7fdc47fff640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdc380a2cf0 0x7fdc380a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T10:52:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.139+0000 7fdc45ffb640 1 -- 172.21.15.92:0/1940623170 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8345+0+0 (secure 0 0 0) 0x7fdc3c0cf440 con 0x7fdc48101de0 2024-09-10T10:52:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.139+0000 7fdc47fff640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdc380a2cf0 0x7fdc380a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdc34000c00 tx=0x7fdc340058d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T10:52:48.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.143+0000 7fdc45ffb640 1 -- 172.21.15.92:0/1940623170 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc3c014030 con 0x7fdc48101de0 2024-09-10T10:52:48.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.308+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdc4810a0f0 con 0x7fdc48101de0 2024-09-10T10:52:48.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.791+0000 7fdc45ffb640 1 -- 172.21.15.92:0/1940623170 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) ==== 169+0+0 (secure 0 0 0) 0x7fdc3c09c110 con 0x7fdc48101de0 2024-09-10T10:52:48.793 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' removed 2024-09-10T10:52:48.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.796+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdc380a2cf0 msgr2=0x7fdc380a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:48.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.796+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdc380a2cf0 0x7fdc380a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdc34000c00 tx=0x7fdc340058d0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.796+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48101de0 msgr2=0x7fdc48198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T10:52:48.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.796+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48101de0 0x7fdc48198450 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00c920 tx=0x7fdc3c00cde0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.797+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 shutdown_connections 2024-09-10T10:52:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.797+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdc48106f10 0x7fdc4819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.797+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:6800/3516468262,v1:172.21.15.92:6801/3516468262] conn(0x7fdc380a2cf0 0x7fdc380a51b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.797+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] conn(0x7fdc48102790 0x7fdc48198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.797+0000 7fdc4f03e640 1 --2- 172.21.15.92:0/1940623170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc48101de0 0x7fdc48198450 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T10:52:48.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.797+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 >> 172.21.15.92:0/1940623170 conn(0x7fdc480fd8c0 msgr2=0x7fdc480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T10:52:48.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.800+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 shutdown_connections 2024-09-10T10:52:48.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-10T10:52:48.800+0000 7fdc4f03e640 1 -- 172.21.15.92:0/1940623170 wait complete. 2024-09-10T10:52:49.040 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:48 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1940623170' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:52:49.069 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:48 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1940623170' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:52:49.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:48 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1940623170' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T10:52:49.574 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:52:49.644 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:52:49.698 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:52:49.809 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T10:52:49.809 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:52:49.851 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:52:49.881 DEBUG:teuthology.orchestra.run.smithi121:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T10:52:49.902 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T10:52:49.902 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T10:52:49.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.a 2024-09-10T10:52:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:49 smithi121 ceph-mon[35231]: pgmap v511: 65 pgs: 65 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:52:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:49 smithi121 ceph-mon[35231]: from='client.? 172.21.15.92:0/1940623170' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:52:50.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:49 smithi121 ceph-mon[35231]: osdmap e108: 12 total, 12 up, 12 in 2024-09-10T10:52:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:49 smithi097 ceph-mon[35213]: pgmap v511: 65 pgs: 65 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:52:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:49 smithi097 ceph-mon[35213]: from='client.? 172.21.15.92:0/1940623170' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:52:50.070 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:49 smithi097 ceph-mon[35213]: osdmap e108: 12 total, 12 up, 12 in 2024-09-10T10:52:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:49 smithi092 ceph-mon[30834]: pgmap v511: 65 pgs: 65 active+clean; 4.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T10:52:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:49 smithi092 ceph-mon[30834]: from='client.? 172.21.15.92:0/1940623170' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T10:52:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:49 smithi092 ceph-mon[30834]: osdmap e108: 12 total, 12 up, 12 in 2024-09-10T10:52:50.111 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:49 smithi092 systemd[1]: Stopping Ceph mon.a for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:52:50.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a[30830]: 2024-09-10T10:52:50.372+0000 7fef95a13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:52:50.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a[30830]: 2024-09-10T10:52:50.372+0000 7fef95a13640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T10:52:50.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:50 smithi092 podman[93080]: 2024-09-10 10:52:50.453889238 +0000 UTC m=+0.202408994 container died 46dfc501a658e1d3041fb408b6bad10441ff10e951426effe3abb41298a5b3f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux ) 2024-09-10T10:52:51.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:50 smithi092 podman[93080]: 2024-09-10 10:52:50.838932442 +0000 UTC m=+0.587452194 container cleanup 46dfc501a658e1d3041fb408b6bad10441ff10e951426effe3abb41298a5b3f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T10:52:51.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Sep 10 10:52:50 smithi092 bash[93080]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-a 2024-09-10T10:52:51.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T10:52:51.418 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:52:51.418 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T10:52:51.418 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T10:52:51.418 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.b 2024-09-10T10:52:51.820 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:51 smithi097 systemd[1]: Stopping Ceph mon.b for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:52:52.219 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:51 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-b[35209]: 2024-09-10T10:52:51.860+0000 7feb8916a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:52:52.220 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:51 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-b[35209]: 2024-09-10T10:52:51.860+0000 7feb8916a640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T10:52:52.220 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:51 smithi097 podman[72213]: 2024-09-10 10:52:51.952214213 +0000 UTC m=+0.203932138 container died 530a778e5ad08cc8425b470bab903d9d0abff37d92c46c2c908bf4f9e2ecd82f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T10:52:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:52 smithi097 podman[72213]: 2024-09-10 10:52:52.335576383 +0000 UTC m=+0.587294298 container cleanup 530a778e5ad08cc8425b470bab903d9d0abff37d92c46c2c908bf4f9e2ecd82f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T10:52:52.570 INFO:journalctl@ceph.mon.b.smithi097.stdout:Sep 10 10:52:52 smithi097 bash[72213]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-b 2024-09-10T10:52:52.720 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T10:52:52.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:52:52.769 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T10:52:52.770 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T10:52:52.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.c 2024-09-10T10:52:53.170 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:52 smithi121 systemd[1]: Stopping Ceph mon.c for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:52:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-c[35227]: 2024-09-10T10:52:53.167+0000 7fbbab243640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:52:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-c[35227]: 2024-09-10T10:52:53.168+0000 7fbbab243640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T10:52:53.541 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:53 smithi121 podman[71829]: 2024-09-10 10:52:53.311585203 +0000 UTC m=+0.282380197 container died 8822ad9ce996c0fb5a4db3193da2679dfc067d8a6288c7d9e28a3d11730650d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T10:52:54.005 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:53 smithi121 podman[71829]: 2024-09-10 10:52:53.727149066 +0000 UTC m=+0.697944055 container cleanup 8822ad9ce996c0fb5a4db3193da2679dfc067d8a6288c7d9e28a3d11730650d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS) 2024-09-10T10:52:54.005 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 10 10:52:53 smithi121 bash[71829]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mon-c 2024-09-10T10:52:54.148 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T10:52:54.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:52:54.196 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T10:52:54.196 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T10:52:54.196 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.x 2024-09-10T10:52:54.525 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:52:54 smithi092 systemd[1]: Stopping Ceph mgr.x for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:52:54.846 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:52:54 smithi092 podman[93199]: 2024-09-10 10:52:54.53433521 +0000 UTC m=+0.146619299 container died 69cf79c28a628b81c1b52f116be99d8e8cad3060d6c1786fbb3e31872985ab6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:52:55.110 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:52:54 smithi092 podman[93199]: 2024-09-10 10:52:54.953464498 +0000 UTC m=+0.565748587 container cleanup 69cf79c28a628b81c1b52f116be99d8e8cad3060d6c1786fbb3e31872985ab6c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:52:55.110 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Sep 10 10:52:54 smithi092 bash[93199]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-x 2024-09-10T10:52:55.459 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T10:52:55.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:52:55.494 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T10:52:55.494 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T10:52:55.494 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.y 2024-09-10T10:52:55.820 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:52:55 smithi097 systemd[1]: Stopping Ceph mgr.y for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:52:56.320 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:52:55 smithi097 podman[72335]: 2024-09-10 10:52:55.837877708 +0000 UTC m=+0.143709165 container died 0932454f55264bea4a7e3ca17f96f1f2dd5826abe7da1bfc8fe8e3a334e33cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:52:59.570 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:52:59 smithi097 podman[72335]: 2024-09-10 10:52:59.12570482 +0000 UTC m=+3.431536278 container cleanup 0932454f55264bea4a7e3ca17f96f1f2dd5826abe7da1bfc8fe8e3a334e33cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T10:52:59.570 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:52:59 smithi097 bash[72335]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y 2024-09-10T10:53:00.300 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:53:00 smithi097 podman[72347]: 2024-09-10 10:53:00.044742766 +0000 UTC m=+4.210892141 container remove 0932454f55264bea4a7e3ca17f96f1f2dd5826abe7da1bfc8fe8e3a334e33cc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T10:53:00.301 INFO:journalctl@ceph.mgr.y.smithi097.stdout:Sep 10 10:53:00 smithi097 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-10T10:53:00.304 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T10:53:00.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:53:00.343 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T10:53:00.343 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T10:53:00.343 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.z 2024-09-10T10:53:00.678 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:53:00 smithi121 systemd[1]: Stopping Ceph mgr.z for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:53:00.984 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:53:00 smithi121 podman[71949]: 2024-09-10 10:53:00.677442568 +0000 UTC m=+0.143452147 container died 3fa7b94a051c0c7de7c0f09b2b7bfda54d2cb8ec5b2caa9126c1d92b4903861a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T10:53:01.291 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:53:01 smithi121 podman[71949]: 2024-09-10 10:53:01.091192053 +0000 UTC m=+0.557201631 container cleanup 3fa7b94a051c0c7de7c0f09b2b7bfda54d2cb8ec5b2caa9126c1d92b4903861a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T10:53:01.291 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 10 10:53:01 smithi121 bash[71949]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mgr-z 2024-09-10T10:53:01.472 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T10:53:01.507 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:53:01.508 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T10:53:01.508 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T10:53:01.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.0 2024-09-10T10:53:01.809 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:01 smithi092 systemd[1]: Stopping Ceph osd.0 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:53:02.111 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0[44642]: 2024-09-10T10:53:01.807+0000 7f00fee30640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:53:02.111 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0[44642]: 2024-09-10T10:53:01.807+0000 7f00fee30640 -1 osd.0 108 *** Got signal Terminated *** 2024-09-10T10:53:02.111 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0[44642]: 2024-09-10T10:53:01.807+0000 7f00fee30640 -1 osd.0 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:53:07.735 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:07 smithi092 podman[93323]: 2024-09-10 10:53:07.431970552 +0000 UTC m=+5.730400153 container died 303b0c8bbd28605395652822e0cb1c39eb44228322735c53cfdb9667c2f2ab63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:53:08.110 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:07 smithi092 podman[93323]: 2024-09-10 10:53:07.859137185 +0000 UTC m=+6.157566831 container cleanup 303b0c8bbd28605395652822e0cb1c39eb44228322735c53cfdb9667c2f2ab63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T10:53:08.110 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:07 smithi092 bash[93323]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0 2024-09-10T10:53:08.611 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:08 smithi092 podman[93352]: 2024-09-10 10:53:08.160806128 +0000 UTC m=+0.710507286 container remove 303b0c8bbd28605395652822e0cb1c39eb44228322735c53cfdb9667c2f2ab63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T10:53:08.890 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:08 smithi092 podman[93438]: 2024-09-10 10:53:08.527333999 +0000 UTC m=+0.016081664 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:53:08.891 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:08 smithi092 podman[93438]: 2024-09-10 10:53:08.653719795 +0000 UTC m=+0.142467494 container create 6c28957c7e03a0d5f13573b3aa76493b51e5aa17207d09c56dc532904ff29381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T10:53:09.361 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:08 smithi092 podman[93438]: 2024-09-10 10:53:08.889937027 +0000 UTC m=+0.378684682 container init 6c28957c7e03a0d5f13573b3aa76493b51e5aa17207d09c56dc532904ff29381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:53:09.361 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:08 smithi092 podman[93438]: 2024-09-10 10:53:08.893355017 +0000 UTC m=+0.382102677 container start 6c28957c7e03a0d5f13573b3aa76493b51e5aa17207d09c56dc532904ff29381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:53:09.361 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:08 smithi092 podman[93438]: 2024-09-10 10:53:08.973508747 +0000 UTC m=+0.462256410 container attach 6c28957c7e03a0d5f13573b3aa76493b51e5aa17207d09c56dc532904ff29381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:53:09.361 INFO:journalctl@ceph.osd.0.smithi092.stdout:Sep 10 10:53:09 smithi092 podman[93438]: 2024-09-10 10:53:09.119437313 +0000 UTC m=+0.608184966 container died 6c28957c7e03a0d5f13573b3aa76493b51e5aa17207d09c56dc532904ff29381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:53:09.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T10:53:09.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:53:09.802 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T10:53:09.802 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T10:53:09.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.1 2024-09-10T10:53:10.107 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:09 smithi097 systemd[1]: Stopping Ceph osd.1 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:53:10.570 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1[39656]: 2024-09-10T10:53:10.105+0000 7fa55b801640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:53:10.570 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1[39656]: 2024-09-10T10:53:10.105+0000 7fa55b801640 -1 osd.1 108 *** Got signal Terminated *** 2024-09-10T10:53:10.570 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1[39656]: 2024-09-10T10:53:10.105+0000 7fa55b801640 -1 osd.1 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:53:15.965 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:15 smithi097 podman[72459]: 2024-09-10 10:53:15.687780052 +0000 UTC m=+5.698297819 container died 79fd89126b60f110bb0ceeb0e8a4ac243fb568f8d784ac0abb170ce7cd30f259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T10:53:16.320 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:16 smithi097 podman[72459]: 2024-09-10 10:53:16.089145126 +0000 UTC m=+6.099662886 container cleanup 79fd89126b60f110bb0ceeb0e8a4ac243fb568f8d784ac0abb170ce7cd30f259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:53:16.320 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:16 smithi097 bash[72459]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1 2024-09-10T10:53:16.692 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:16 smithi097 podman[72473]: 2024-09-10 10:53:16.365987726 +0000 UTC m=+0.676864443 container remove 79fd89126b60f110bb0ceeb0e8a4ac243fb568f8d784ac0abb170ce7cd30f259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T10:53:16.954 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:16 smithi097 podman[72565]: 2024-09-10 10:53:16.591852179 +0000 UTC m=+0.015653067 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:53:16.954 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:16 smithi097 podman[72565]: 2024-09-10 10:53:16.725512486 +0000 UTC m=+0.149313361 container create a95f10d8393af4bb2c47e93b86f576c56f31e0463a8e14165ad9656b55589f76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T10:53:16.954 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:16 smithi097 podman[72565]: 2024-09-10 10:53:16.953445336 +0000 UTC m=+0.377246210 container init a95f10d8393af4bb2c47e93b86f576c56f31e0463a8e14165ad9656b55589f76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:53:17.228 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:16 smithi097 podman[72565]: 2024-09-10 10:53:16.956839476 +0000 UTC m=+0.380640362 container start a95f10d8393af4bb2c47e93b86f576c56f31e0463a8e14165ad9656b55589f76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T10:53:17.228 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:17 smithi097 podman[72565]: 2024-09-10 10:53:17.053341807 +0000 UTC m=+0.477142698 container attach a95f10d8393af4bb2c47e93b86f576c56f31e0463a8e14165ad9656b55589f76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:53:17.228 INFO:journalctl@ceph.osd.1.smithi097.stdout:Sep 10 10:53:17 smithi097 podman[72565]: 2024-09-10 10:53:17.202489525 +0000 UTC m=+0.626290417 container died a95f10d8393af4bb2c47e93b86f576c56f31e0463a8e14165ad9656b55589f76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T10:53:17.909 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T10:53:17.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:53:17.949 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T10:53:17.950 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T10:53:17.950 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.2 2024-09-10T10:53:18.269 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:17 smithi121 systemd[1]: Stopping Ceph osd.2 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:53:18.541 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2[40193]: 2024-09-10T10:53:18.268+0000 7f0f97992640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:53:18.541 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2[40193]: 2024-09-10T10:53:18.268+0000 7f0f97992640 -1 osd.2 108 *** Got signal Terminated *** 2024-09-10T10:53:18.541 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2[40193]: 2024-09-10T10:53:18.268+0000 7f0f97992640 -1 osd.2 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:53:24.041 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:23 smithi121 podman[72071]: 2024-09-10 10:53:23.758014799 +0000 UTC m=+5.613382269 container died fbc5c529a85faa692c9f9e37347ae21e0403b2933dd79cf28d7279440bd9eafa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T10:53:24.421 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:24 smithi121 podman[72071]: 2024-09-10 10:53:24.135095652 +0000 UTC m=+5.990463107 container cleanup fbc5c529a85faa692c9f9e37347ae21e0403b2933dd79cf28d7279440bd9eafa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:53:24.421 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:24 smithi121 bash[72071]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2 2024-09-10T10:53:24.728 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:24 smithi121 podman[72103]: 2024-09-10 10:53:24.419999206 +0000 UTC m=+0.656483899 container remove fbc5c529a85faa692c9f9e37347ae21e0403b2933dd79cf28d7279440bd9eafa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T10:53:24.982 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:24 smithi121 podman[72193]: 2024-09-10 10:53:24.630813051 +0000 UTC m=+0.015879102 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:53:24.982 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:24 smithi121 podman[72193]: 2024-09-10 10:53:24.7459729 +0000 UTC m=+0.131038952 container create 3e7e27f2aceb557fc4727ac4481ea50806b81ea24aa414f5f386235c223d1451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:53:25.246 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:24 smithi121 podman[72193]: 2024-09-10 10:53:24.981982617 +0000 UTC m=+0.367048669 container init 3e7e27f2aceb557fc4727ac4481ea50806b81ea24aa414f5f386235c223d1451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:53:25.246 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:24 smithi121 podman[72193]: 2024-09-10 10:53:24.985731701 +0000 UTC m=+0.370797762 container start 3e7e27f2aceb557fc4727ac4481ea50806b81ea24aa414f5f386235c223d1451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T10:53:25.246 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:25 smithi121 podman[72193]: 2024-09-10 10:53:25.099016589 +0000 UTC m=+0.484082647 container attach 3e7e27f2aceb557fc4727ac4481ea50806b81ea24aa414f5f386235c223d1451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T10:53:25.246 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 10 10:53:25 smithi121 podman[72193]: 2024-09-10 10:53:25.228403145 +0000 UTC m=+0.613469198 container died 3e7e27f2aceb557fc4727ac4481ea50806b81ea24aa414f5f386235c223d1451 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:53:25.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T10:53:26.006 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:53:26.007 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T10:53:26.007 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T10:53:26.007 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.3 2024-09-10T10:53:26.347 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:26 smithi092 systemd[1]: Stopping Ceph osd.3 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:53:26.610 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:53:26.346+0000 7f842f795640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:53:26.610 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:53:26.346+0000 7f842f795640 -1 osd.3 108 *** Got signal Terminated *** 2024-09-10T10:53:26.610 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:26 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:53:26.346+0000 7f842f795640 -1 osd.3 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:53:28.110 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:27 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:53:27.672+0000 7f842bdab640 -1 osd.3 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:06.538087+0000 front 2024-09-10T10:53:06.538121+0000 (oldest deadline 2024-09-10T10:53:27.638252+0000) 2024-09-10T10:53:28.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:28 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:28.488+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:29.034 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:28 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:28.716+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:29.110 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:28 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:53:28.719+0000 7f842bdab640 -1 osd.3 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:06.538087+0000 front 2024-09-10T10:53:06.538121+0000 (oldest deadline 2024-09-10T10:53:27.638252+0000) 2024-09-10T10:53:29.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:28 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:28.891+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:29.735 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:29.432+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:29.735 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:29.469+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:29.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:29.467+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:30.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:29 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:29.765+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:30.110 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:29 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:53:29.733+0000 7f842bdab640 -1 osd.3 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:06.538087+0000 front 2024-09-10T10:53:06.538121+0000 (oldest deadline 2024-09-10T10:53:27.638252+0000) 2024-09-10T10:53:30.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:29.878+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:30.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:29.890+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:30.783 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:30 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:30.474+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:30.783 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:30 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:30.399+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:30.790 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:30.477+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:31.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:30 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:30.777+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:31.110 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:30 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3[51213]: 2024-09-10T10:53:30.781+0000 7f842bdab640 -1 osd.3 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:06.538087+0000 front 2024-09-10T10:53:06.538121+0000 (oldest deadline 2024-09-10T10:53:27.638252+0000) 2024-09-10T10:53:31.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:30.847+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:31.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:30.936+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:31.790 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:31.492+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:31.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:31 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:31.380+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:31.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:31 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:31.481+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:32.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:31 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:31.813+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:32.230 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:31 smithi092 podman[93542]: 2024-09-10 10:53:31.938823486 +0000 UTC m=+5.738966259 container died 70903068c197a229bb4b96ce8981f87757e951405fe984b690fb4ea82f4570f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:53:32.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:31.960+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:32.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:31.850+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:32.564 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:32 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:32.429+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:32.564 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:32 smithi092 podman[93542]: 2024-09-10 10:53:32.328966528 +0000 UTC m=+6.129109299 container cleanup 70903068c197a229bb4b96ce8981f87757e951405fe984b690fb4ea82f4570f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T10:53:32.564 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:32 smithi092 bash[93542]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3 2024-09-10T10:53:32.565 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:32 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:32.463+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:32.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:32.535+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:32.860 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:32 smithi092 podman[93556]: 2024-09-10 10:53:32.563691754 +0000 UTC m=+0.628833338 container remove 70903068c197a229bb4b96ce8981f87757e951405fe984b690fb4ea82f4570f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T10:53:33.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:32 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:32.769+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:33.285 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:32 smithi092 podman[93644]: 2024-09-10 10:53:32.948052897 +0000 UTC m=+0.094810766 container create d406bf48fc5ca6c5959c6535dd1c0fb0917dff3a03e9b4470fbf342f6d90cfe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:53:33.285 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:32 smithi092 podman[93644]: 2024-09-10 10:53:32.868910813 +0000 UTC m=+0.015668695 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:53:33.285 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:33 smithi092 podman[93644]: 2024-09-10 10:53:33.192465827 +0000 UTC m=+0.339223696 container init d406bf48fc5ca6c5959c6535dd1c0fb0917dff3a03e9b4470fbf342f6d90cfe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:53:33.285 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:33 smithi092 podman[93644]: 2024-09-10 10:53:33.195814951 +0000 UTC m=+0.342572821 container start d406bf48fc5ca6c5959c6535dd1c0fb0917dff3a03e9b4470fbf342f6d90cfe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T10:53:33.285 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:33 smithi092 podman[93644]: 2024-09-10 10:53:33.2843143 +0000 UTC m=+0.431072175 container attach d406bf48fc5ca6c5959c6535dd1c0fb0917dff3a03e9b4470fbf342f6d90cfe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T10:53:33.290 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:32.930+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:33.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:32.840+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:33.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:33.388+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:33.611 INFO:journalctl@ceph.osd.3.smithi092.stdout:Sep 10 10:53:33 smithi092 podman[93644]: 2024-09-10 10:53:33.386363948 +0000 UTC m=+0.533121828 container died d406bf48fc5ca6c5959c6535dd1c0fb0917dff3a03e9b4470fbf342f6d90cfe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T10:53:33.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:33 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:33.454+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:33.890 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:33.555+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:34.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T10:53:34.049 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:53:34.049 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T10:53:34.049 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T10:53:34.050 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.4 2024-09-10T10:53:34.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:33 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:33.784+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:34.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:33.930+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:34.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:33 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:33.889+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:34.361 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:34 smithi097 systemd[1]: Stopping Ceph osd.4 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:53:34.610 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:34 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:34.451+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:34.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:34 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:34.384+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:34.785 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:34 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:53:34.360+0000 7f3cfd15b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:53:34.785 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:34 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:53:34.360+0000 7f3cfd15b640 -1 osd.4 108 *** Got signal Terminated *** 2024-09-10T10:53:34.785 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:34 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:53:34.360+0000 7f3cfd15b640 -1 osd.4 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:53:34.926 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:34.572+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:35.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:34 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:34.784+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:35.288 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:34.933+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:35.288 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:34.924+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:35.541 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:35 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:35.530+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:35.610 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:35.457+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:35.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:35 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:35.404+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:36.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:35 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:35.798+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:36.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:35 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:35.930+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:36.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:35 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:35.974+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:36.570 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:53:36.310+0000 7f3cf5769640 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.654454+0000 front 2024-09-10T10:53:11.654481+0000 (oldest deadline 2024-09-10T10:53:35.754646+0000) 2024-09-10T10:53:36.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:36.535+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:36.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:36 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:36.401+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:36.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:36 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:36.499+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:37.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:36.754+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:37.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:36.810+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:37.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:36 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:36.810+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:37.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:36.953+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:37.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:36 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:36.995+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:37.570 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:53:37.269+0000 7f3cf5769640 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.654454+0000 front 2024-09-10T10:53:11.654481+0000 (oldest deadline 2024-09-10T10:53:35.754646+0000) 2024-09-10T10:53:37.790 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:37 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:37.517+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:37.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:37.426+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:37.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:37.503+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:38.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:37.789+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:38.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:37.773+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:38.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:37 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:37.773+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:38.290 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:38 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:38.002+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:38.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:38 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:38.002+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:38.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:38 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:38.027+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:38.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:38 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:38.027+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:38.570 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:38 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:53:38.251+0000 7f3cf5769640 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.654454+0000 front 2024-09-10T10:53:11.654481+0000 (oldest deadline 2024-09-10T10:53:35.754646+0000) 2024-09-10T10:53:38.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:38 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:38.524+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:38.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:38.453+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:38.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:38 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:38.484+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:39.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:38 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:38.773+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:39.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:38 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:38.780+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:39.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:38 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:38.780+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:39.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:39 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:39.046+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:39.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:39 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:39.046+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:39.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:39 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:39.005+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:39.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:39 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:39.005+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:39.570 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:39 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4[46452]: 2024-09-10T10:53:39.270+0000 7f3cf5769640 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.654454+0000 front 2024-09-10T10:53:11.654481+0000 (oldest deadline 2024-09-10T10:53:35.754646+0000) 2024-09-10T10:53:39.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:39 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:39.439+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:39.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:39 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:39.455+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:39.983 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:39 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:39.556+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:40.070 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:39 smithi097 podman[72681]: 2024-09-10 10:53:39.865372301 +0000 UTC m=+5.614716027 container died a1b7ab3794c456ace734fca7f4b6a374fcffa211e02879bca42153c74bd7dba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T10:53:40.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:39 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:39.812+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:40.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:39 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:39.771+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:40.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:39 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:39.771+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:40.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:40 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:40.013+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:40.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:40 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:40.013+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:40.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:39 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:39.981+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:40.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:39 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:39.981+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:40.521 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:40 smithi097 podman[72681]: 2024-09-10 10:53:40.269065999 +0000 UTC m=+6.018409727 container cleanup a1b7ab3794c456ace734fca7f4b6a374fcffa211e02879bca42153c74bd7dba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:53:40.521 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:40 smithi097 bash[72681]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4 2024-09-10T10:53:40.790 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:40 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:40.524+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:40.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:40 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:40.524+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.519905+0000 front 2024-09-10T10:53:14.519963+0000 (oldest deadline 2024-09-10T10:53:40.420035+0000) 2024-09-10T10:53:40.820 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:40 smithi097 podman[72696]: 2024-09-10 10:53:40.520309377 +0000 UTC m=+0.657931495 container remove a1b7ab3794c456ace734fca7f4b6a374fcffa211e02879bca42153c74bd7dba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2) 2024-09-10T10:53:40.820 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:40 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:40.742+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:40.820 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:40 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:40.742+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:40.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:40.404+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:40.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:40.404+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:40.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:40.455+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:40.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:40 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:40.455+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:41.192 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:40 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:40.856+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:41.192 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:40 smithi097 podman[72787]: 2024-09-10 10:53:40.812147705 +0000 UTC m=+0.015726325 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:53:41.192 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:40 smithi097 podman[72787]: 2024-09-10 10:53:40.929648651 +0000 UTC m=+0.133227262 container create 4840c3880386d92d00e75f4cb6733a62b8827ce031e176a3d52c5ab0c15a3f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:53:41.192 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:41 smithi097 podman[72787]: 2024-09-10 10:53:41.191206461 +0000 UTC m=+0.394785078 container init 4840c3880386d92d00e75f4cb6733a62b8827ce031e176a3d52c5ab0c15a3f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T10:53:41.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:40 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:40.964+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:41.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:40 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:40.964+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:41.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:40 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:40.970+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:41.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:40 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:40.970+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:41.570 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:41 smithi097 podman[72787]: 2024-09-10 10:53:41.194797336 +0000 UTC m=+0.398375948 container start 4840c3880386d92d00e75f4cb6733a62b8827ce031e176a3d52c5ab0c15a3f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:53:41.570 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:41 smithi097 podman[72787]: 2024-09-10 10:53:41.274120276 +0000 UTC m=+0.477698895 container attach 4840c3880386d92d00e75f4cb6733a62b8827ce031e176a3d52c5ab0c15a3f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T10:53:41.570 INFO:journalctl@ceph.osd.4.smithi097.stdout:Sep 10 10:53:41 smithi097 podman[72787]: 2024-09-10 10:53:41.377562669 +0000 UTC m=+0.581141280 container died 4840c3880386d92d00e75f4cb6733a62b8827ce031e176a3d52c5ab0c15a3f66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T10:53:41.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:41 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:41.497+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:41.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:41 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:41.497+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.519905+0000 front 2024-09-10T10:53:14.519963+0000 (oldest deadline 2024-09-10T10:53:40.420035+0000) 2024-09-10T10:53:41.860 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:41 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:41.458+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:41.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:41 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:41.458+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:41.861 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:41 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:41.370+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:41.861 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:41 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:41.370+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:41.970 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:41 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:41.895+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:41.970 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:41 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:41.760+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:41.970 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:41 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:41.760+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:41.988 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T10:53:42.066 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:53:42.067 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T10:53:42.067 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T10:53:42.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.5 2024-09-10T10:53:42.291 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:42 smithi121 systemd[1]: Stopping Ceph osd.5 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:53:42.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:41 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:41.929+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:42.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:41 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:41.929+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:42.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:41 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:41.991+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:42.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:41 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:41.991+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:42.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:42.404+0000 7fbd2250e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:53:42.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:42.404+0000 7fbd2250e640 -1 osd.5 108 *** Got signal Terminated *** 2024-09-10T10:53:42.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:42.404+0000 7fbd2250e640 -1 osd.5 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:53:42.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:42.467+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:42.792 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:42.467+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.519905+0000 front 2024-09-10T10:53:14.519963+0000 (oldest deadline 2024-09-10T10:53:40.420035+0000) 2024-09-10T10:53:42.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:42.363+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:42.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:42.363+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:42.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:42.417+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:42.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:42.417+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:43.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:42.897+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:43.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:42.729+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:43.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:42 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:42.729+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:43.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:42.954+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:43.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:42 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:42.954+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:43.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:43 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:43.029+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:43.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:43 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:43.029+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:43.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:43 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:43.330+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:43.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:43 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:43.330+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:43.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:43 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:43.418+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:43.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:43 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:43.418+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:43.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:43 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:43.470+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:43.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:43 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:43.470+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.519905+0000 front 2024-09-10T10:53:14.519963+0000 (oldest deadline 2024-09-10T10:53:40.420035+0000) 2024-09-10T10:53:44.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:43 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:43.944+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:44.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:43 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:43.766+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:44.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:43 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:43.766+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:44.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:43 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:43.984+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:44.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:43 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:43.984+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:44.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:43 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:43.958+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:44.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:43 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:43.958+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:44.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:43 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:43.958+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:44.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:44 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:44.325+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:44.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:44 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:44.325+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:44.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:44 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:44.447+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:44.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:44 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:44.447+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:44.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:44 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:44.494+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:44.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:44 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:44.494+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.519905+0000 front 2024-09-10T10:53:14.519963+0000 (oldest deadline 2024-09-10T10:53:40.420035+0000) 2024-09-10T10:53:45.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:44 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:44.918+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:45.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:44 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:44.736+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:45.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:44 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:44.736+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:45.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:45 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:45.020+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:45.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:45 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:45.020+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:45.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:44 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:44.969+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:45.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:44 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:44.969+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:45.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:44 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:44.969+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:45.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:45 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:45.276+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:45.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:45 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:45.276+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:45.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:45 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:45.463+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:45.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:45 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:45.463+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:45.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:45 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:45.463+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:45.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:45 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:45.495+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:45.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:45 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:45.495+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.519905+0000 front 2024-09-10T10:53:14.519963+0000 (oldest deadline 2024-09-10T10:53:40.420035+0000) 2024-09-10T10:53:45.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:45 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:45.495+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.420632+0000 front 2024-09-10T10:53:20.420660+0000 (oldest deadline 2024-09-10T10:53:45.021298+0000) 2024-09-10T10:53:45.971 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:45 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:45.706+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:45.971 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:45 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:45.706+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:45.972 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:45 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:45.893+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:46.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:45 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:45.945+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:46.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:45 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:45.945+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:46.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:45 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:45.945+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:46.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:46 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:46.055+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:46.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:46 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:46.055+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:46.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:46 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:46.055+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:46.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:46 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:46.291+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:46.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:46 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:46.291+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:46.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:46 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:46.427+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:46.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:46 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:46.427+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:46.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:46 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:46.427+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:46.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:46 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:46.512+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.218074+0000 front 2024-09-10T10:53:05.218016+0000 (oldest deadline 2024-09-10T10:53:28.118140+0000) 2024-09-10T10:53:46.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:46 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:46.512+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.519905+0000 front 2024-09-10T10:53:14.519963+0000 (oldest deadline 2024-09-10T10:53:40.420035+0000) 2024-09-10T10:53:46.791 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:46 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5[46663]: 2024-09-10T10:53:46.512+0000 7fbd1eb24640 -1 osd.5 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.420632+0000 front 2024-09-10T10:53:20.420660+0000 (oldest deadline 2024-09-10T10:53:45.021298+0000) 2024-09-10T10:53:47.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:46 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:46.926+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:47.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:46 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:46.754+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:47.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:46 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:46.754+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:47.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:46 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:46.754+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:47.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:46 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:46.926+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:47.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:46 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:46.926+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:47.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:46 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:46.926+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:47.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:47 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:47.075+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:47.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:47 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:47.075+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:47.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:47 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:47.075+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:47.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:47 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:47.255+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:47.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:47 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:47.255+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:47.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:47 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:47.473+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:47.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:47 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:47.473+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:47.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:47 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:47.473+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:48.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:47 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:47.950+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:48.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:47 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:47.950+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:48.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:47 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:47.713+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:48.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:47 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:47.713+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:48.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:47 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:47.713+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:48.193 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:47 smithi121 podman[72298]: 2024-09-10 10:53:47.951062757 +0000 UTC m=+5.689248232 container died ab70d792f479e9e3fcf0d1411e844438257427e2d997531839507063cb2cbe0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T10:53:48.193 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:47 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:47.891+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:48.193 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:47 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:47.891+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:48.193 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:47 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:47.891+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:48.193 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:48 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:48.122+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:48.193 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:48 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:48.122+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:48.194 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:48 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:48.122+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:48.541 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:48 smithi121 podman[72298]: 2024-09-10 10:53:48.363003388 +0000 UTC m=+6.101188869 container cleanup ab70d792f479e9e3fcf0d1411e844438257427e2d997531839507063cb2cbe0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T10:53:48.541 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:48 smithi121 bash[72298]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5 2024-09-10T10:53:48.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:48 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:48.461+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:48.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:48 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:48.461+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:48.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:48 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:48.461+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:48.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:48 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:48.276+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:48.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:48 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:48.276+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:48.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:48 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:48.276+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:48.916 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:48 smithi121 podman[72314]: 2024-09-10 10:53:48.597954669 +0000 UTC m=+0.647867903 container remove ab70d792f479e9e3fcf0d1411e844438257427e2d997531839507063cb2cbe0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T10:53:49.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:48 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:48.950+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:49.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:48 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:48.950+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:49.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:48 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:48.702+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:49.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:48 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:48.702+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:49.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:48 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:48.702+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:49.282 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:49 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:49.121+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:49.283 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:49 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:49.121+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:49.283 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:49 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:49.121+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:49.283 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:49 smithi121 podman[72404]: 2024-09-10 10:53:48.925584292 +0000 UTC m=+0.015975550 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:53:49.283 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:49 smithi121 podman[72404]: 2024-09-10 10:53:49.023739566 +0000 UTC m=+0.114130811 container create 713f347e5842f2505dc978f8e97880700ff002b61b45c718e2f695634448d68b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T10:53:49.284 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:48 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:48.914+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:49.284 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:48 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:48.914+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:49.284 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:48 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:48.914+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:49.541 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:49 smithi121 podman[72404]: 2024-09-10 10:53:49.282127892 +0000 UTC m=+0.372519144 container init 713f347e5842f2505dc978f8e97880700ff002b61b45c718e2f695634448d68b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T10:53:49.541 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:49 smithi121 podman[72404]: 2024-09-10 10:53:49.286087204 +0000 UTC m=+0.376478449 container start 713f347e5842f2505dc978f8e97880700ff002b61b45c718e2f695634448d68b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T10:53:49.541 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:49 smithi121 podman[72404]: 2024-09-10 10:53:49.393192505 +0000 UTC m=+0.483583751 container attach 713f347e5842f2505dc978f8e97880700ff002b61b45c718e2f695634448d68b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:53:49.541 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 10 10:53:49 smithi121 podman[72404]: 2024-09-10 10:53:49.474270448 +0000 UTC m=+0.564661703 container died 713f347e5842f2505dc978f8e97880700ff002b61b45c718e2f695634448d68b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T10:53:49.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:49.461+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:49.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:49.461+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:49.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:49.461+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:49.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:49.304+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:49.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:49.304+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:49.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:49 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:49.304+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:50.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:49 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:49.908+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:50.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:49 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:49.908+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:50.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:49 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:49.698+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:50.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:49 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:49.698+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:50.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:49 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:49.698+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:50.101 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:49 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:49.890+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:50.101 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:49 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:49.890+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:50.101 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:49 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:49.890+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:50.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T10:53:50.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:53:50.197 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T10:53:50.197 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T10:53:50.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.6 2024-09-10T10:53:50.407 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:50.100+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:50.407 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:50.100+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:50.407 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:50.100+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:50.491 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:50 smithi092 systemd[1]: Stopping Ceph osd.6 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:53:50.491 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:50.300+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:50.491 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:50.300+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:50.491 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:50.300+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:50.860 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:50.489+0000 7fadccb50640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:53:50.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:50.489+0000 7fadccb50640 -1 osd.6 108 *** Got signal Terminated *** 2024-09-10T10:53:50.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:50.489+0000 7fadccb50640 -1 osd.6 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:53:50.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:50.506+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:50.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:50.506+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:50.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:50 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:50.506+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:51.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:50 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:50.878+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:51.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:50 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:50.878+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:51.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:50 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:50.747+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:51.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:50 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:50.747+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:51.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:50 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:50.747+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:51.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:50.930+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:51.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:50.930+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:51.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:50 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:50.930+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:51.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:51.101+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:51.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:51.101+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:51.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:51.101+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:51.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:51.268+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:51.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:51.268+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:51.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:51.268+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:51.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:51.466+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:51.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:51.466+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:51.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:51.466+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:52.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:51 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:51.851+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:52.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:51 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:51.851+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:52.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:51 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:51.758+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:52.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:51 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:51.758+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:52.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:51 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:51.758+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:52.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:52.123+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:52.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:52.123+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:52.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:52.123+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:52.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:51.893+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:52.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:51.893+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:52.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:51 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:51.893+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:52.489 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:52.220+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:52.489 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:52.220+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:52.489 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:52.220+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:52.860 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:52.488+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:52.860 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:52.488+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:52.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:52 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:52.488+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:53.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:52 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:52.852+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:53.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:52 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:52.852+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:53.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:52 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:52.725+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:53.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:52 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:52.725+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:53.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:52 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:52.725+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:53.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:53.154+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:53.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:53.154+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:53.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:53.154+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:53.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:52.914+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:53.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:52.914+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:53.292 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:52 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:52.914+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:53.531 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:53.179+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:53.532 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:53.179+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:53.532 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:53.179+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:53.532 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:53.179+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:53:53.860 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:53.529+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:53.860 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:53.529+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:53.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:53.529+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:53.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:53 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:53.529+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:27.377941+0000 front 2024-09-10T10:53:27.377977+0000 (oldest deadline 2024-09-10T10:53:52.678096+0000) 2024-09-10T10:53:54.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:53.838+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:54.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:53.838+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:54.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:53.717+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:54.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:53.717+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:54.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:53 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:53.717+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:54.135 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:53.880+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:54.135 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:53.880+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:54.135 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:53.880+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:54.135 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:53 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:53.880+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:53:54.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:54.133+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:54.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:54.133+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:54.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:54.133+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:54.571 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:54 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:54.150+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:54.571 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:54 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:54.150+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:54.571 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:54 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:54.150+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:54.571 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:54 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:54.150+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:53:54.860 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:54 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:54.570+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.975023+0000 front 2024-09-10T10:53:03.975129+0000 (oldest deadline 2024-09-10T10:53:29.275167+0000) 2024-09-10T10:53:54.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:54 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:54.570+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:15.076401+0000 front 2024-09-10T10:53:15.076462+0000 (oldest deadline 2024-09-10T10:53:40.376465+0000) 2024-09-10T10:53:54.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:54 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:54.570+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.377145+0000 front 2024-09-10T10:53:20.377085+0000 (oldest deadline 2024-09-10T10:53:45.076974+0000) 2024-09-10T10:53:54.861 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:54 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6[58000]: 2024-09-10T10:53:54.570+0000 7fadc515e640 -1 osd.6 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:27.377941+0000 front 2024-09-10T10:53:27.377977+0000 (oldest deadline 2024-09-10T10:53:52.678096+0000) 2024-09-10T10:53:55.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:54.818+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:55.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:54.818+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:55.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:54.749+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:55.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:54.749+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:55.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:54.749+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:55.130 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:54.869+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:55.130 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:54.869+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:55.130 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:54.869+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:55.130 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:54 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:54.869+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:53:55.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:55 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:55.128+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:55.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:55 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:55.128+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:55.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:55 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:55.128+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:55.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:55.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:55.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:55.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:55.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:55.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:55.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:55 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:55.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:53:56.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:55.810+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:56.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:55.810+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:56.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:55.735+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:56.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:55.735+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:56.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:55 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:55.735+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:56.283 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:55 smithi092 podman[93758]: 2024-09-10 10:53:55.963904022 +0000 UTC m=+5.566599919 container died fe39c0867d13b6588acfe5f7c2279119b967507f18c899cc8e62face5ec82053 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T10:53:56.283 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:56 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:56.162+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:56.283 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:56 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:56.162+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:56.283 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:56 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:56.162+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:56.284 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:56 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:56.162+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:53:56.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:55 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:55.902+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:56.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:55 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:55.902+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:56.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:55 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:55.902+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:56.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:55 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:55.902+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:53:56.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:56.100+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:56.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:56.100+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:56.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:56.100+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:56.610 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:56 smithi092 podman[93758]: 2024-09-10 10:53:56.364635229 +0000 UTC m=+5.967331126 container cleanup fe39c0867d13b6588acfe5f7c2279119b967507f18c899cc8e62face5ec82053 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:53:56.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:56 smithi092 bash[93758]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6 2024-09-10T10:53:56.969 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:56 smithi092 podman[93773]: 2024-09-10 10:53:56.624526704 +0000 UTC m=+0.658712173 container remove fe39c0867d13b6588acfe5f7c2279119b967507f18c899cc8e62face5ec82053 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:53:57.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:56.763+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:57.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:56.763+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:57.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:56.763+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:31.246654+0000 front 2024-09-10T10:53:31.246730+0000 (oldest deadline 2024-09-10T10:53:55.946615+0000) 2024-09-10T10:53:57.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:56.743+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:57.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:56.743+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:57.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:56.743+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:57.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:56 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:56.743+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:53:57.229 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:56 smithi092 podman[93860]: 2024-09-10 10:53:56.871767809 +0000 UTC m=+0.016002953 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:53:57.229 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:56 smithi092 podman[93860]: 2024-09-10 10:53:56.983595938 +0000 UTC m=+0.127831072 container create e77ec5bf1163f75edac5b95c0d7ea7eab5057a77ec4aff48ca6a409417360ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T10:53:57.229 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:57 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:57.148+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:57.229 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:57 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:57.148+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:57.229 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:57 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:57.148+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:57.229 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:57 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:57.148+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:53:57.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:56.870+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:57.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:56.870+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:57.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:56.870+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:57.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:56 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:56.870+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:53:57.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:57 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:57.081+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:57.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:57 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:57.081+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:57.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:57 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:57.081+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:57.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:57 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:57.081+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:53:57.610 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:57 smithi092 podman[93860]: 2024-09-10 10:53:57.228318334 +0000 UTC m=+0.372553483 container init e77ec5bf1163f75edac5b95c0d7ea7eab5057a77ec4aff48ca6a409417360ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T10:53:57.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:57 smithi092 podman[93860]: 2024-09-10 10:53:57.231690289 +0000 UTC m=+0.375925424 container start e77ec5bf1163f75edac5b95c0d7ea7eab5057a77ec4aff48ca6a409417360ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T10:53:57.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:57 smithi092 podman[93860]: 2024-09-10 10:53:57.311365109 +0000 UTC m=+0.455600255 container attach e77ec5bf1163f75edac5b95c0d7ea7eab5057a77ec4aff48ca6a409417360ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T10:53:57.611 INFO:journalctl@ceph.osd.6.smithi092.stdout:Sep 10 10:53:57 smithi092 podman[93860]: 2024-09-10 10:53:57.416630831 +0000 UTC m=+0.560865966 container died e77ec5bf1163f75edac5b95c0d7ea7eab5057a77ec4aff48ca6a409417360ce0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T10:53:58.006 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T10:53:58.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:53:58.045 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T10:53:58.046 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T10:53:58.046 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.7 2024-09-10T10:53:58.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:57 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:57.752+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:58.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:57 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:57.752+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:58.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:57 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:57.752+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:58.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:57 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:57.752+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:53:58.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:57 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:57.734+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:58.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:57 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:57.734+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:58.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:57 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:57.734+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:31.246654+0000 front 2024-09-10T10:53:31.246730+0000 (oldest deadline 2024-09-10T10:53:55.946615+0000) 2024-09-10T10:53:58.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:58 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:58.053+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:58.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:58 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:58.053+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:58.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:58 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:58.053+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:58.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:58 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:58.053+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:53:58.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:57 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:57.867+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:58.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:57 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:57.867+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:58.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:57 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:57.867+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:58.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:57 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:57.867+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:53:58.349 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:58 smithi097 systemd[1]: Stopping Ceph osd.7 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:53:58.360 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:58 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:58.174+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:58.360 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:58 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:58.174+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:58.360 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:58 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:58.174+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:58.360 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:58 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:58.174+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:53:58.700 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:58.347+0000 7ff77e8f1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:53:58.700 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:58.347+0000 7ff77e8f1640 -1 osd.7 108 *** Got signal Terminated *** 2024-09-10T10:53:58.700 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:58.347+0000 7ff77e8f1640 -1 osd.7 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:53:58.700 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:58.698+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:53:58.700 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:58.698+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:53:58.700 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:58.698+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:31.246654+0000 front 2024-09-10T10:53:31.246730+0000 (oldest deadline 2024-09-10T10:53:55.946615+0000) 2024-09-10T10:53:59.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:58.744+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:53:59.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:58.744+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:53:59.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:58.744+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:53:59.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:58 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:58.744+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:53:59.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:58 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:58.887+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:53:59.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:58 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:58.887+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:53:59.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:58 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:58.887+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:53:59.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:58 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:58.887+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:53:59.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:59 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:59.044+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:53:59.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:59 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:59.044+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:53:59.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:59 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:59.044+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:53:59.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:53:59 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:53:59.044+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:53:59.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:59 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:59.176+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:53:59.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:59 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:59.176+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:53:59.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:59 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:59.176+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:53:59.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:53:59 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:53:59.176+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:00.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:59 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:59.730+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:54:00.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:59 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:59.730+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:54:00.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:53:59 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:53:59.730+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:31.246654+0000 front 2024-09-10T10:53:31.246730+0000 (oldest deadline 2024-09-10T10:53:55.946615+0000) 2024-09-10T10:54:00.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:59 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:59.698+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:00.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:59 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:59.698+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:00.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:59 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:59.698+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:00.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:53:59 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:53:59.698+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:00.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:59 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:59.891+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:00.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:59 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:59.891+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:00.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:59 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:59.891+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:00.292 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:53:59 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:53:59.891+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:00.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:00 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:00.069+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:00.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:00 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:00.069+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:00.293 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:00 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:00.069+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:00.293 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:00 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:00.069+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:00.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:00.176+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:00.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:00.176+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:00.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:00.176+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:00.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:00.176+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:00.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:00 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:00.176+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:01.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:00 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:00.707+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:54:01.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:00 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:00.707+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:54:01.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:00 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:00.707+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:31.246654+0000 front 2024-09-10T10:53:31.246730+0000 (oldest deadline 2024-09-10T10:53:55.946615+0000) 2024-09-10T10:54:01.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:00 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:00.733+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:01.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:00 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:00.733+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:01.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:00 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:00.733+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:01.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:00 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:00.733+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:01.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:00 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:00.916+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:01.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:00 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:00.916+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:01.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:00 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:00.916+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:01.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:00 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:00.916+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:01.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:01.045+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:01.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:01.045+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:01.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:01.045+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:01.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:01.045+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:01.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:01.045+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:01.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:01.160+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:01.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:01.160+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:01.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:01.160+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:01.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:01.160+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:01.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:01 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:01.160+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:02.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:01 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:01.719+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:54:02.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:01 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:01.719+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:54:02.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:01 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:01.719+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:31.246654+0000 front 2024-09-10T10:53:31.246730+0000 (oldest deadline 2024-09-10T10:53:55.946615+0000) 2024-09-10T10:54:02.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:01 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:01.719+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:37.047327+0000 front 2024-09-10T10:53:37.047355+0000 (oldest deadline 2024-09-10T10:54:01.147461+0000) 2024-09-10T10:54:02.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:01 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:01.708+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:02.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:01 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:01.708+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:02.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:01 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:01.708+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:02.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:01 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:01.708+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:02.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:01 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:01.708+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:02.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:01.935+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:02.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:01.935+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:02.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:01.935+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:02.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:01 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:01.935+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:02.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:02 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:02.049+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:02.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:02 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:02.049+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:02.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:02 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:02.049+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:02.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:02 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:02.049+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:02.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:02 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:02.049+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:02.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:02 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:02.167+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:02.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:02 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:02.167+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:02.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:02 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:02.167+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:02.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:02 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:02.167+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:02.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:02 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:02.167+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:03.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:02 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:02.692+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:12.241986+0000 front 2024-09-10T10:53:12.242059+0000 (oldest deadline 2024-09-10T10:53:36.342179+0000) 2024-09-10T10:54:03.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:02 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:02.692+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.844236+0000 front 2024-09-10T10:53:20.844198+0000 (oldest deadline 2024-09-10T10:53:47.245062+0000) 2024-09-10T10:54:03.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:02 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:02.692+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:31.246654+0000 front 2024-09-10T10:53:31.246730+0000 (oldest deadline 2024-09-10T10:53:55.946615+0000) 2024-09-10T10:54:03.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:02 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7[52951]: 2024-09-10T10:54:02.692+0000 7ff776eff640 -1 osd.7 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:37.047327+0000 front 2024-09-10T10:53:37.047355+0000 (oldest deadline 2024-09-10T10:54:01.147461+0000) 2024-09-10T10:54:03.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:02 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:02.689+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:03.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:02 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:02.689+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:03.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:02 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:02.689+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:03.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:02 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:02.689+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:03.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:02 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:02.689+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:03.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:02 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:02.947+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:03.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:02 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:02.947+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:03.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:02 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:02.947+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:03.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:02 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:02.947+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:03.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:03.098+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:03.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:03.098+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:03.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:03.098+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:03.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:03.098+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:03.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:03.098+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:03.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:03 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:03.189+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:03.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:03 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:03.189+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:03.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:03 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:03.189+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:03.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:03 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:03.189+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:03.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:03 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:03.189+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:04.070 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:03 smithi097 podman[72901]: 2024-09-10 10:54:03.922989874 +0000 UTC m=+5.685152774 container died 5ac2b594af898e0be2edd02647ca6d04a4f504828c964a03aac40d74afb5059c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:54:04.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:03 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:03.704+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:04.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:03 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:03.704+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:04.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:03 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:03.704+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:04.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:03 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:03.704+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:04.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:03 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:03.704+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:04.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:03.937+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:04.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:03.937+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:04.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:03.937+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:04.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:03 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:03.937+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:04.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:04 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:04.074+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:04.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:04 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:04.074+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:04.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:04 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:04.074+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:04.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:04 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:04.074+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:04.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:04 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:04.074+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:04.512 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:04 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:04.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:04.512 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:04 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:04.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:04.513 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:04 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:04.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:04.513 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:04 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:04.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:04.513 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:04 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:04.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:04.649 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:04 smithi097 podman[72901]: 2024-09-10 10:54:04.422984086 +0000 UTC m=+6.185146985 container cleanup 5ac2b594af898e0be2edd02647ca6d04a4f504828c964a03aac40d74afb5059c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T10:54:04.649 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:04 smithi097 bash[72901]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7 2024-09-10T10:54:04.955 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:04 smithi097 podman[72915]: 2024-09-10 10:54:04.649008217 +0000 UTC m=+0.722926767 container remove 5ac2b594af898e0be2edd02647ca6d04a4f504828c964a03aac40d74afb5059c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T10:54:04.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:04 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:04.681+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:04.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:04 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:04.681+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:04.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:04 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:04.681+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:04.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:04 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:04.681+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:04.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:04 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:04.681+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:05.219 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:04 smithi097 podman[73003]: 2024-09-10 10:54:04.857192626 +0000 UTC m=+0.015520145 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:54:05.219 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:04 smithi097 podman[73003]: 2024-09-10 10:54:04.97475804 +0000 UTC m=+0.133085549 container create d0acbe6d2c1ea514af466a6a0f6f82d9766f2c35df9b608aa9e6d3882a551318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:54:05.220 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:05 smithi097 podman[73003]: 2024-09-10 10:54:05.219007759 +0000 UTC m=+0.377335269 container init d0acbe6d2c1ea514af466a6a0f6f82d9766f2c35df9b608aa9e6d3882a551318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-10T10:54:05.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:04 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:04.987+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:05.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:04 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:04.987+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:05.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:04 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:04.987+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:05.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:04 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:04.987+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:05.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:05 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:05.063+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:05.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:05 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:05.063+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:05.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:05 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:05.063+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:05.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:05 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:05.063+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:05.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:05 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:05.063+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:05.570 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:05 smithi097 podman[73003]: 2024-09-10 10:54:05.222401786 +0000 UTC m=+0.380729296 container start d0acbe6d2c1ea514af466a6a0f6f82d9766f2c35df9b608aa9e6d3882a551318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:54:05.570 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:05 smithi097 podman[73003]: 2024-09-10 10:54:05.310659379 +0000 UTC m=+0.468986890 container attach d0acbe6d2c1ea514af466a6a0f6f82d9766f2c35df9b608aa9e6d3882a551318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T10:54:05.570 INFO:journalctl@ceph.osd.7.smithi097.stdout:Sep 10 10:54:05 smithi097 podman[73003]: 2024-09-10 10:54:05.409292968 +0000 UTC m=+0.567620477 container died d0acbe6d2c1ea514af466a6a0f6f82d9766f2c35df9b608aa9e6d3882a551318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T10:54:05.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:05 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:05.256+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:05.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:05 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:05.256+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:05.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:05 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:05.256+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:05.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:05 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:05.256+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:05.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:05 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:05.256+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:05.973 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:05 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:05.668+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:05.973 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:05 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:05.668+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:05.973 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:05 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:05.668+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:05.974 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:05 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:05.668+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:05.974 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:05 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:05.668+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:06.001 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T10:54:06.081 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:06.081 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T10:54:06.081 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T10:54:06.082 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.8 2024-09-10T10:54:06.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:06.020+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:06.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:06.020+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:06.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:06.020+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:06.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:06.020+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:06.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:06 smithi121 systemd[1]: Stopping Ceph osd.8 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:54:06.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:06.104+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:06.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:06.104+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:06.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:06.104+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:06.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:06.104+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:06.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:06.104+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:06.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:06 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:06.252+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:06.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:06 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:06.252+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:06.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:06 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:06.252+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:06.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:06 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:06.252+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:06.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:06 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:06.252+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:06.791 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:06.373+0000 7f412d9f1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:54:06.791 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:06.373+0000 7f412d9f1640 -1 osd.8 108 *** Got signal Terminated *** 2024-09-10T10:54:06.791 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:06 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:06.373+0000 7f412d9f1640 -1 osd.8 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:54:07.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:06 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:06.633+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:07.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:06 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:06.633+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:07.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:06 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:06.633+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:07.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:06 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:06.633+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:07.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:06 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:06.633+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:07.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:07.006+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:07.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:07.006+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:07.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:07.006+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:07.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:07.006+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:07.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:07.119+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:07.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:07.119+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:07.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:07.119+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:07.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:07.119+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:07.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:07.119+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:07.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:07 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:07.223+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:07.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:07 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:07.223+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:07.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:07 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:07.223+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:07.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:07 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:07.223+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:07.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:07 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:07.223+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:08.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:07 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:07.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:08.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:07 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:07.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:08.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:07 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:07.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:08.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:07 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:07.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:08.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:07 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:07.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:08.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:07.975+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:08.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:07.975+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:08.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:07.975+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:08.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:07.975+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:08.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:07 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:07.975+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.862535+0000 front 2024-09-10T10:53:43.862550+0000 (oldest deadline 2024-09-10T10:54:07.962722+0000) 2024-09-10T10:54:08.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:08 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:08.080+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:08.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:08 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:08.080+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:08.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:08 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:08.080+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:08.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:08 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:08.080+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:08.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:08 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:08.080+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:08.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:08 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:08.217+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:08.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:08 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:08.218+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:08.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:08 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:08.218+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:08.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:08 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:08.218+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:08.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:08 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:08.218+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:09.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:08 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:08.637+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:09.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:08 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:08.637+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:09.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:08 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:08.637+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:09.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:08 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:08.637+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:09.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:08 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:08.637+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:09.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.017+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:09.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.017+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:09.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.017+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:09.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.017+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:09.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.017+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.862535+0000 front 2024-09-10T10:53:43.862550+0000 (oldest deadline 2024-09-10T10:54:07.962722+0000) 2024-09-10T10:54:09.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:09.033+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:09.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:09.033+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:09.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:09.033+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:09.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:09.033+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:09.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:09.033+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:09.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:09 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:09.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:09.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:09 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:09.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:09.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:09 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:09.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:09.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:09 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:09.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:09.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:09 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:09.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:10.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:09 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:09.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:10.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:09 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:09.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:10.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:09 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:09.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:10.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:09 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:09.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:10.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:09 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:09.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:10.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.999+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:10.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.999+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:10.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.999+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:10.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.999+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:10.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:09 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:09.999+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.862535+0000 front 2024-09-10T10:53:43.862550+0000 (oldest deadline 2024-09-10T10:54:07.962722+0000) 2024-09-10T10:54:10.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:10.011+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:10.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:10.011+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:10.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:10.011+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:10.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:10.011+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:10.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:10.011+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:10.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:10 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:10.180+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:10.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:10 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:10.180+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:10.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:10 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:10.180+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:10.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:10 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:10.180+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:10.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:10 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:10.180+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:10.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:10 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:10.180+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:11.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:10.576+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:11.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:10.576+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:11.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:10.576+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:11.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:10.576+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:11.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:10.576+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:11.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:10 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:10.576+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:11.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:10.958+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:02.455899+0000 front 2024-09-10T10:53:02.455811+0000 (oldest deadline 2024-09-10T10:53:28.355821+0000) 2024-09-10T10:54:11.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:10.958+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.658186+0000 front 2024-09-10T10:53:14.658163+0000 (oldest deadline 2024-09-10T10:53:36.958242+0000) 2024-09-10T10:54:11.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:10.958+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:22.259239+0000 front 2024-09-10T10:53:22.259263+0000 (oldest deadline 2024-09-10T10:53:43.959478+0000) 2024-09-10T10:54:11.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:10.958+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:29.860691+0000 front 2024-09-10T10:53:29.860679+0000 (oldest deadline 2024-09-10T10:53:53.360489+0000) 2024-09-10T10:54:11.291 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:10 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8[53592]: 2024-09-10T10:54:10.958+0000 7f4125fff640 -1 osd.8 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.862535+0000 front 2024-09-10T10:53:43.862550+0000 (oldest deadline 2024-09-10T10:54:07.962722+0000) 2024-09-10T10:54:11.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:11 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:11.047+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:11.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:11 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:11.047+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:11.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:11 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:11.047+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:11.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:11 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:11.047+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:11.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:11 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:11.047+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:11.292 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:11 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:11.047+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:11.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:11 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:11.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:11.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:11 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:11.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:11.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:11 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:11.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:11.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:11 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:11.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:11.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:11 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:11.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:11.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:11 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:11.183+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:12.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:11 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:11.593+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:12.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:11 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:11.593+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:12.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:11 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:11.593+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:12.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:11 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:11.593+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:12.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:11 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:11.593+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:12.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:11 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:11.593+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:12.125 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:11 smithi121 podman[72518]: 2024-09-10 10:54:11.848833192 +0000 UTC m=+5.574202366 container died 998aa81b476999bfa73b5b0c02dd4deb0d333323b0dbf90cc991273db9b3595a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T10:54:12.125 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:12 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:12.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:12.125 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:12 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:12.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:12.125 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:12 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:12.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:12.125 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:12 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:12.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:12.125 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:12 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:12.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:12.125 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:12 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:12.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:12.510 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:12 smithi121 podman[72518]: 2024-09-10 10:54:12.222821986 +0000 UTC m=+5.948191160 container cleanup 998aa81b476999bfa73b5b0c02dd4deb0d333323b0dbf90cc991273db9b3595a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T10:54:12.510 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:12 smithi121 bash[72518]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8 2024-09-10T10:54:12.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:12 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:12.214+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:12.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:12 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:12.214+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:12.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:12 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:12.214+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:12.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:12 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:12.214+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:12.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:12 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:12.214+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:12.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:12 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:12.214+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:12.790 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:12 smithi121 podman[72534]: 2024-09-10 10:54:12.509604282 +0000 UTC m=+0.659001708 container remove 998aa81b476999bfa73b5b0c02dd4deb0d333323b0dbf90cc991273db9b3595a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T10:54:13.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:12 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:12.606+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:13.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:12 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:12.606+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:13.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:12 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:12.606+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:13.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:12 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:12.606+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:13.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:12 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:12.606+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:13.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:12 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:12.606+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:13.122 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:13 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:13.051+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:13.122 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:13 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:13.051+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:13.122 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:13 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:13.051+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:13.122 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:13 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:13.051+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:13.122 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:13 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:13.051+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:13.122 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:13 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:13.051+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:13.122 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:12 smithi121 podman[72622]: 2024-09-10 10:54:12.739814627 +0000 UTC m=+0.015713590 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:54:13.123 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:12 smithi121 podman[72622]: 2024-09-10 10:54:12.893989887 +0000 UTC m=+0.169888844 container create d75a25afd165c6c53a789e7696de355ab3ade9eb5b58ceb8f960b9dbae35d1b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T10:54:13.123 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:13 smithi121 podman[72622]: 2024-09-10 10:54:13.121460308 +0000 UTC m=+0.397359265 container init d75a25afd165c6c53a789e7696de355ab3ade9eb5b58ceb8f960b9dbae35d1b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T10:54:13.541 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:13 smithi121 podman[72622]: 2024-09-10 10:54:13.124810092 +0000 UTC m=+0.400709052 container start d75a25afd165c6c53a789e7696de355ab3ade9eb5b58ceb8f960b9dbae35d1b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T10:54:13.541 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:13 smithi121 podman[72622]: 2024-09-10 10:54:13.196559238 +0000 UTC m=+0.472458204 container attach d75a25afd165c6c53a789e7696de355ab3ade9eb5b58ceb8f960b9dbae35d1b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T10:54:13.541 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 10 10:54:13 smithi121 podman[72622]: 2024-09-10 10:54:13.313903321 +0000 UTC m=+0.589802291 container died d75a25afd165c6c53a789e7696de355ab3ade9eb5b58ceb8f960b9dbae35d1b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:54:13.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:13 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:13.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:13.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:13 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:13.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:13.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:13 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:13.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:13.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:13 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:13.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:13.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:13 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:13.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:13.612 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:13 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:13.210+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:13.964 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T10:54:14.008 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:14.009 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T10:54:14.009 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T10:54:14.009 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.9 2024-09-10T10:54:14.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:13 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:13.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:14.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:13 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:13.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:14.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:13 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:13.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:14.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:13 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:13.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:14.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:13 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:13.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:14.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:13 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:13.588+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:14.269 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:14 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:14.070+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:14.269 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:14 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:14.070+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:14.269 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:14 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:14.070+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:14.269 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:14 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:14.070+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:14.269 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:14 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:14.070+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:14.269 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:14 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:14.070+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:14.360 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 systemd[1]: Stopping Ceph osd.9 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:54:14.361 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:14.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:14.361 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:14.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:14.361 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:14.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:14.361 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:14.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:14.361 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:14.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:14.361 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:14.228+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:14.820 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:14 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:14.549+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:14.820 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:14 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:14.549+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:14.820 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:14 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:14.549+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:14.820 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:14 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:14.549+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:14.820 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:14 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:14.549+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:14.820 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:14 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:14.549+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:14.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:14.516+0000 7f797603a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:54:14.861 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:14.516+0000 7f797603a640 -1 osd.9 108 *** Got signal Terminated *** 2024-09-10T10:54:14.861 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:14 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:14.516+0000 7f797603a640 -1 osd.9 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:54:15.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:15 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:15.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:15.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:15 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:15.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:15.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:15 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:15.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:15.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:15 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:15.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:15.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:15 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:15.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:15.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:15 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:15.064+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:15.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:15 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:15.271+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:15.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:15 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:15.271+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:15.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:15 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:15.271+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:15.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:15 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:15.271+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:15.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:15 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:15.271+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:15.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:15 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:15.271+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:16.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:15 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:15.582+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:16.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:15 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:15.582+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:16.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:15 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:15.582+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:16.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:15 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:15.582+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:16.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:15 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:15.582+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:16.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:15 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:15.582+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:16.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:16 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:16.052+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:16.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:16 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:16.052+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:16.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:16 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:16.052+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:16.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:16 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:16.052+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:16.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:16 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:16.052+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:16.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:16 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:16.052+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:16.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:16.317+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:16.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:16.317+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:16.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:16.317+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:16.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:16.317+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:16.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:16.317+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:16.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:16 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:16.317+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:16.993 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:16 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:16.625+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:16.994 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:16 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:16.625+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:16.994 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:16 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:16.625+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:16.994 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:16 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:16.625+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:16.994 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:16 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:16.625+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:16.994 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:16 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:16.625+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:17.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:17 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:17.065+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:17.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:17 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:17.065+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:17.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:17 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:17.065+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:17.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:17 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:17.065+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:17.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:17 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:17.065+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:17.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:17 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:17.065+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:17.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:17 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:17.284+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:17.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:17 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:17.284+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:17.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:17 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:17.284+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:17.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:17 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:17.284+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:17.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:17 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:17.284+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:17.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:17 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:17.284+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:17.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:17 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:17.579+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:17.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:17 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:17.579+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:17.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:17 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:17.579+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:17.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:17 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:17.579+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:17.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:17 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:17.579+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:17.955 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:17 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:17.579+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:18.442 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:18.058+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:18.442 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:18.058+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:18.442 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:18.058+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:18.442 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:18.058+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:18.443 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:18.058+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:18.443 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:18 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:18.058+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:18.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:18 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:18.297+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:18.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:18 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:18.297+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:18.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:18 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:18.297+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:18.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:18 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:18.297+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:18.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:18 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:18.297+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:18.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:18 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:18.297+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:18.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:18 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:18.297+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:52.062663+0000 front 2024-09-10T10:53:52.062712+0000 (oldest deadline 2024-09-10T10:54:17.962666+0000) 2024-09-10T10:54:19.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:18 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:18.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:19.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:18 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:18.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:19.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:18 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:18.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:19.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:18 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:18.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:19.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:18 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:18.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:19.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:18 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:18.611+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:19.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:19 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:19.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:19.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:19 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:19.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:19.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:19 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:19.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:19.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:19 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:19.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:19.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:19 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:19.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:19.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:19 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:19.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:19.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:19.263+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.654280+0000 front 2024-09-10T10:53:05.654333+0000 (oldest deadline 2024-09-10T10:53:28.554402+0000) 2024-09-10T10:54:19.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:19.263+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.455367+0000 front 2024-09-10T10:53:14.455460+0000 (oldest deadline 2024-09-10T10:53:39.755489+0000) 2024-09-10T10:54:19.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:19.263+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.456704+0000 front 2024-09-10T10:53:21.456793+0000 (oldest deadline 2024-09-10T10:53:47.356612+0000) 2024-09-10T10:54:19.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:19.263+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.857770+0000 front 2024-09-10T10:53:30.857805+0000 (oldest deadline 2024-09-10T10:53:52.557876+0000) 2024-09-10T10:54:19.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:19.263+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.459863+0000 front 2024-09-10T10:53:36.459798+0000 (oldest deadline 2024-09-10T10:53:59.959858+0000) 2024-09-10T10:54:19.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:19.263+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:43.961505+0000 front 2024-09-10T10:53:43.961553+0000 (oldest deadline 2024-09-10T10:54:09.261369+0000) 2024-09-10T10:54:19.611 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:19 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9[64948]: 2024-09-10T10:54:19.263+0000 7f796e648640 -1 osd.9 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:52.062663+0000 front 2024-09-10T10:53:52.062712+0000 (oldest deadline 2024-09-10T10:54:17.962666+0000) 2024-09-10T10:54:20.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:19 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:19.640+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:20.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:19 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:19.640+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:20.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:19 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:19.640+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:20.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:19 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:19.640+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:20.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:19 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:19.640+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:20.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:19 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:19.640+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:20.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:19 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:19.640+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:53.105361+0000 front 2024-09-10T10:53:53.105323+0000 (oldest deadline 2024-09-10T10:54:19.005170+0000) 2024-09-10T10:54:20.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:20 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:20.006+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:20.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:20 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:20.006+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:20.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:20 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:20.006+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:20.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:20 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:20.006+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:20.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:20 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:20.006+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:20.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:20 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:20.006+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:20.334 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:20 smithi092 podman[93971]: 2024-09-10 10:54:20.08331026 +0000 UTC m=+5.868966225 container died c39f031ed49e1c0e949f9d968c08513e7ba0b3cebcffe46e4f9c620b65491857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T10:54:20.601 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:20 smithi092 podman[93971]: 2024-09-10 10:54:20.416177668 +0000 UTC m=+6.201833624 container cleanup c39f031ed49e1c0e949f9d968c08513e7ba0b3cebcffe46e4f9c620b65491857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:54:20.601 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:20 smithi092 bash[93971]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9 2024-09-10T10:54:20.860 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:20 smithi092 podman[93987]: 2024-09-10 10:54:20.60063007 +0000 UTC m=+0.512271681 container remove c39f031ed49e1c0e949f9d968c08513e7ba0b3cebcffe46e4f9c620b65491857 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:54:21.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:20 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:20.598+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:21.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:20 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:20.598+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:21.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:20 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:20.598+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:21.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:20 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:20.598+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:21.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:20 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:20.598+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:21.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:20 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:20.598+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:21.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:20 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:20.598+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:53.105361+0000 front 2024-09-10T10:53:53.105323+0000 (oldest deadline 2024-09-10T10:54:19.005170+0000) 2024-09-10T10:54:21.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:21 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:21.012+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:21.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:21 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:21.012+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:21.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:21 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:21.012+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:21.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:21 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:21.012+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:21.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:21 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:21.012+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:21.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:21 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:21.012+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:21.304 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:21 smithi092 podman[94073]: 2024-09-10 10:54:20.912972193 +0000 UTC m=+0.015928546 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:54:21.304 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:21 smithi092 podman[94073]: 2024-09-10 10:54:21.017971978 +0000 UTC m=+0.120928332 container create e8794133e384aae75ad835d4c02e129bfe4e696572565b5dd6f2ede36a0633b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T10:54:21.305 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:21 smithi092 podman[94073]: 2024-09-10 10:54:21.220232868 +0000 UTC m=+0.323189224 container init e8794133e384aae75ad835d4c02e129bfe4e696572565b5dd6f2ede36a0633b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T10:54:21.305 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:21 smithi092 podman[94073]: 2024-09-10 10:54:21.223509832 +0000 UTC m=+0.326466194 container start e8794133e384aae75ad835d4c02e129bfe4e696572565b5dd6f2ede36a0633b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:54:21.305 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:21 smithi092 podman[94073]: 2024-09-10 10:54:21.303607669 +0000 UTC m=+0.406564031 container attach e8794133e384aae75ad835d4c02e129bfe4e696572565b5dd6f2ede36a0633b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True) 2024-09-10T10:54:21.610 INFO:journalctl@ceph.osd.9.smithi092.stdout:Sep 10 10:54:21 smithi092 podman[94073]: 2024-09-10 10:54:21.406526568 +0000 UTC m=+0.509482923 container died e8794133e384aae75ad835d4c02e129bfe4e696572565b5dd6f2ede36a0633b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:54:21.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T10:54:22.021 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:22.021 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T10:54:22.021 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T10:54:22.021 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.10 2024-09-10T10:54:22.049 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:21 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:21.631+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:22.050 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:21 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:21.631+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:22.050 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:21 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:21.631+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:22.050 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:21 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:21.631+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:22.050 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:21 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:21.631+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:22.050 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:21 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:21.631+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:22.050 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:21 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:21.631+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:53.105361+0000 front 2024-09-10T10:53:53.105323+0000 (oldest deadline 2024-09-10T10:54:19.005170+0000) 2024-09-10T10:54:22.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:22 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:22.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:22.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:22 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:22.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:22.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:22 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:22.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:22.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:22 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:22.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:22.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:22 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:22.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:22.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:22 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:22.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:22.319 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 systemd[1]: Stopping Ceph osd.10 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:54:22.678 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.333+0000 7f20a8f01640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:54:22.679 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.333+0000 7f20a8f01640 -1 osd.10 108 *** Got signal Terminated *** 2024-09-10T10:54:22.679 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.333+0000 7f20a8f01640 -1 osd.10 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:54:23.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.677+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:23.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.677+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:23.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.677+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:23.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.677+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:23.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.677+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:23.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.677+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:23.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:22 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:22.677+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:53.105361+0000 front 2024-09-10T10:53:53.105323+0000 (oldest deadline 2024-09-10T10:54:19.005170+0000) 2024-09-10T10:54:23.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:23 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:23.004+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:23.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:23 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:23.004+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:23.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:23 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:23.004+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:23.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:23 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:23.004+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:23.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:23 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:23.004+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:23.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:23 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:23.004+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:24.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:23 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:23.676+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:24.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:23 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:23.676+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:24.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:23 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:23.676+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:24.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:23 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:23.676+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:24.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:23 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:23.676+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:24.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:23 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:23.676+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:24.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:23 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:23.676+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:53.105361+0000 front 2024-09-10T10:53:53.105323+0000 (oldest deadline 2024-09-10T10:54:19.005170+0000) 2024-09-10T10:54:24.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:24 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:24.030+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:24.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:24 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:24.030+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:24.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:24 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:24.030+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:24.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:24 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:24.030+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:24.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:24 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:24.030+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:24.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:24 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:24.030+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:25.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:24 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:24.697+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:25.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:24 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:24.697+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:25.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:24 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:24.697+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:25.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:24 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:24.697+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:25.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:24 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:24.697+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:25.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:24 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:24.697+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:25.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:24 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:24.697+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:53.105361+0000 front 2024-09-10T10:53:53.105323+0000 (oldest deadline 2024-09-10T10:54:19.005170+0000) 2024-09-10T10:54:25.290 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:25 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:25.028+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:25.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:25 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:25.028+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:25.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:25 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:25.028+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:25.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:25 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:25.028+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:25.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:25 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:25.028+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:25.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:25 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:25.028+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:25.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:25 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:25.028+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:26.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:25 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:25.693+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:26.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:25 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:25.693+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:26.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:25 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:25.693+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:26.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:25 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:25.693+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:26.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:25 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:25.693+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:26.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:25 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:25.693+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:26.071 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:25 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:25.693+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:53.105361+0000 front 2024-09-10T10:53:53.105323+0000 (oldest deadline 2024-09-10T10:54:19.005170+0000) 2024-09-10T10:54:26.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:26 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:26.046+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:26.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:26 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:26.046+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:26.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:26 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:26.046+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:26.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:26 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:26.046+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:26.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:26 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:26.046+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:26.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:26 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:26.046+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:26.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:26 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:26.046+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:27.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:26 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:26.720+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:05.198677+0000 front 2024-09-10T10:53:05.198782+0000 (oldest deadline 2024-09-10T10:53:28.698667+0000) 2024-09-10T10:54:27.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:26 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:26.720+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:11.500461+0000 front 2024-09-10T10:53:11.500612+0000 (oldest deadline 2024-09-10T10:53:36.200572+0000) 2024-09-10T10:54:27.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:26 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:26.720+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:20.301516+0000 front 2024-09-10T10:53:20.301489+0000 (oldest deadline 2024-09-10T10:53:46.201489+0000) 2024-09-10T10:54:27.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:26 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:26.720+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.902369+0000 front 2024-09-10T10:53:30.902527+0000 (oldest deadline 2024-09-10T10:53:56.202369+0000) 2024-09-10T10:54:27.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:26 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:26.720+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.202855+0000 front 2024-09-10T10:53:36.202804+0000 (oldest deadline 2024-09-10T10:54:01.502841+0000) 2024-09-10T10:54:27.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:26 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:26.720+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:46.704244+0000 front 2024-09-10T10:53:46.704337+0000 (oldest deadline 2024-09-10T10:54:09.604166+0000) 2024-09-10T10:54:27.070 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:26 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10[59977]: 2024-09-10T10:54:26.720+0000 7f20a150f640 -1 osd.10 108 heartbeat_check: no reply from 172.21.15.92:6822 osd.6 since back 2024-09-10T10:53:53.105361+0000 front 2024-09-10T10:53:53.105323+0000 (oldest deadline 2024-09-10T10:54:19.005170+0000) 2024-09-10T10:54:27.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:27 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:27.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:27.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:27 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:27.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:27.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:27 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:27.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:27.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:27 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:27.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:27.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:27 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:27.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:27.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:27 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:27.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:27.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:27 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:27.026+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:28.142 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:27 smithi097 podman[73118]: 2024-09-10 10:54:27.853965216 +0000 UTC m=+5.639996219 container died f593411ca95944f29a68b8ed607b30c84a378858e511bf3096e8e3d7c9114372 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T10:54:28.142 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:28 smithi097 podman[73118]: 2024-09-10 10:54:28.141274939 +0000 UTC m=+5.927305940 container cleanup f593411ca95944f29a68b8ed607b30c84a378858e511bf3096e8e3d7c9114372 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T10:54:28.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:28 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:28.062+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:28.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:28 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:28.062+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:28.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:28 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:28.062+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:28.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:28 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:28.062+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:28.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:28 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:28.062+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:28.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:28 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:28.062+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:28.494 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:28 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:28.062+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:28.570 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:28 smithi097 bash[73118]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10 2024-09-10T10:54:28.570 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:28 smithi097 podman[73134]: 2024-09-10 10:54:28.376177142 +0000 UTC m=+0.521447395 container remove f593411ca95944f29a68b8ed607b30c84a378858e511bf3096e8e3d7c9114372 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:54:28.933 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:28 smithi097 podman[73225]: 2024-09-10 10:54:28.585164999 +0000 UTC m=+0.015937563 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:54:28.933 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:28 smithi097 podman[73225]: 2024-09-10 10:54:28.7188028 +0000 UTC m=+0.149575405 container create d8d4af50d25fbc3d045aa9d0922c4ff1638d203c8353634b5addc5b47d989d8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T10:54:28.933 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:28 smithi097 podman[73225]: 2024-09-10 10:54:28.929541435 +0000 UTC m=+0.360314007 container init d8d4af50d25fbc3d045aa9d0922c4ff1638d203c8353634b5addc5b47d989d8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:54:28.933 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:28 smithi097 podman[73225]: 2024-09-10 10:54:28.93287023 +0000 UTC m=+0.363642796 container start d8d4af50d25fbc3d045aa9d0922c4ff1638d203c8353634b5addc5b47d989d8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T10:54:29.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:29.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:29.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:29.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:29.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:29.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:29.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:29.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:29.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:29.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:29.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:29.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:29.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:29 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:29.038+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:29.320 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:29 smithi097 podman[73225]: 2024-09-10 10:54:29.021084405 +0000 UTC m=+0.451856976 container attach d8d4af50d25fbc3d045aa9d0922c4ff1638d203c8353634b5addc5b47d989d8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T10:54:29.320 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:29 smithi097 podman[73225]: 2024-09-10 10:54:29.117821126 +0000 UTC m=+0.548593694 container died d8d4af50d25fbc3d045aa9d0922c4ff1638d203c8353634b5addc5b47d989d8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T10:54:29.666 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T10:54:29.729 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:29 smithi097 podman[73248]: 2024-09-10 10:54:29.640904077 +0000 UTC m=+0.514131903 container remove d8d4af50d25fbc3d045aa9d0922c4ff1638d203c8353634b5addc5b47d989d8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:54:29.730 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:29 smithi097 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.10.service: Deactivated successfully. 2024-09-10T10:54:29.730 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:29 smithi097 systemd[1]: Stopped Ceph osd.10 for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:54:29.730 INFO:journalctl@ceph.osd.10.smithi097.stdout:Sep 10 10:54:29 smithi097 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.10.service: Consumed 9min 5.434s CPU time. 2024-09-10T10:54:29.744 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:29.744 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T10:54:29.744 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T10:54:29.745 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.11 2024-09-10T10:54:30.041 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:29 smithi121 systemd[1]: Stopping Ceph osd.11 for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:54:30.041 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.017+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:30.041 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.017+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:30.041 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.017+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:30.041 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.017+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:30.042 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.017+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:30.042 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.017+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:30.042 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.017+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:30.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.042+0000 7f9abde47640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:54:30.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.042+0000 7f9abde47640 -1 osd.11 108 *** Got signal Terminated *** 2024-09-10T10:54:30.541 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.042+0000 7f9abde47640 -1 osd.11 108 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T10:54:31.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.993+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:31.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.993+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:31.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.993+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:31.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.993+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:31.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.993+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:31.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.993+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:31.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:30 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:30.993+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:32.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:31.975+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:32.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:31.975+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:32.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:31.975+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:32.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:31.975+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:32.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:31.975+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:32.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:31.975+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:32.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:31 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:31.975+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:33.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:32.965+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:33.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:32.965+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:33.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:32.965+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:33.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:32.965+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:33.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:32.965+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:33.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:32.965+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:33.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:32.965+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:33.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:32 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:32.965+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6820 osd.8 since back 2024-09-10T10:54:08.409032+0000 front 2024-09-10T10:54:08.409088+0000 (oldest deadline 2024-09-10T10:54:32.508964+0000) 2024-09-10T10:54:34.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:33.999+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:34.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:33.999+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:34.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:33.999+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:34.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:33.999+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:34.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:33.999+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:34.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:33.999+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:34.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:33.999+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:34.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:33.999+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6820 osd.8 since back 2024-09-10T10:54:08.409032+0000 front 2024-09-10T10:54:08.409088+0000 (oldest deadline 2024-09-10T10:54:32.508964+0000) 2024-09-10T10:54:35.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:34.997+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6806 osd.0 since back 2024-09-10T10:53:03.699895+0000 front 2024-09-10T10:53:03.699714+0000 (oldest deadline 2024-09-10T10:53:29.599599+0000) 2024-09-10T10:54:35.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:34.997+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6804 osd.1 since back 2024-09-10T10:53:14.900413+0000 front 2024-09-10T10:53:14.900427+0000 (oldest deadline 2024-09-10T10:53:37.200489+0000) 2024-09-10T10:54:35.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:34.997+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-10T10:53:21.301440+0000 front 2024-09-10T10:53:21.301517+0000 (oldest deadline 2024-09-10T10:53:45.301945+0000) 2024-09-10T10:54:35.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:34.997+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.92:6814 osd.3 since back 2024-09-10T10:53:30.602948+0000 front 2024-09-10T10:53:30.603077+0000 (oldest deadline 2024-09-10T10:53:56.403305+0000) 2024-09-10T10:54:35.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:34.997+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6812 osd.4 since back 2024-09-10T10:53:36.904461+0000 front 2024-09-10T10:53:36.904365+0000 (oldest deadline 2024-09-10T10:54:00.304937+0000) 2024-09-10T10:54:35.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:34.997+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6812 osd.5 since back 2024-09-10T10:53:45.506417+0000 front 2024-09-10T10:53:45.506382+0000 (oldest deadline 2024-09-10T10:54:10.806432+0000) 2024-09-10T10:54:35.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:34.997+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.97:6820 osd.7 since back 2024-09-10T10:54:00.207792+0000 front 2024-09-10T10:54:00.207864+0000 (oldest deadline 2024-09-10T10:54:24.307763+0000) 2024-09-10T10:54:35.291 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:34 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11[60605]: 2024-09-10T10:54:34.997+0000 7f9ab6455640 -1 osd.11 108 heartbeat_check: no reply from 172.21.15.121:6820 osd.8 since back 2024-09-10T10:54:08.409032+0000 front 2024-09-10T10:54:08.409088+0000 (oldest deadline 2024-09-10T10:54:32.508964+0000) 2024-09-10T10:54:35.869 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:35 smithi121 podman[72737]: 2024-09-10 10:54:35.586283539 +0000 UTC m=+5.646670444 container died 354bb65fdc0e5561628b79754ac9564e1b74bf8f064a9aa98d48373b67a787f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T10:54:36.236 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:35 smithi121 podman[72737]: 2024-09-10 10:54:35.992738493 +0000 UTC m=+6.053125395 container cleanup 354bb65fdc0e5561628b79754ac9564e1b74bf8f064a9aa98d48373b67a787f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-10T10:54:36.236 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:35 smithi121 bash[72737]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11 2024-09-10T10:54:36.540 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:36 smithi121 podman[72751]: 2024-09-10 10:54:36.235471291 +0000 UTC m=+0.639768528 container remove 354bb65fdc0e5561628b79754ac9564e1b74bf8f064a9aa98d48373b67a787f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T10:54:36.864 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:36 smithi121 podman[72841]: 2024-09-10 10:54:36.459001453 +0000 UTC m=+0.015908443 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T10:54:36.864 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:36 smithi121 podman[72841]: 2024-09-10 10:54:36.561255414 +0000 UTC m=+0.118162437 container create 38f470c1c9e45a57c8c30fe938541c7fd104671a2a318bcd6215a087bdaffc83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T10:54:36.865 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:36 smithi121 podman[72841]: 2024-09-10 10:54:36.780737136 +0000 UTC m=+0.337644117 container init 38f470c1c9e45a57c8c30fe938541c7fd104671a2a318bcd6215a087bdaffc83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:54:36.865 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:36 smithi121 podman[72841]: 2024-09-10 10:54:36.7842842 +0000 UTC m=+0.341191181 container start 38f470c1c9e45a57c8c30fe938541c7fd104671a2a318bcd6215a087bdaffc83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T10:54:36.865 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:36 smithi121 podman[72841]: 2024-09-10 10:54:36.863688433 +0000 UTC m=+0.420595414 container attach 38f470c1c9e45a57c8c30fe938541c7fd104671a2a318bcd6215a087bdaffc83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T10:54:37.258 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 10 10:54:36 smithi121 podman[72841]: 2024-09-10 10:54:36.97587759 +0000 UTC m=+0.532784574 container died 38f470c1c9e45a57c8c30fe938541c7fd104671a2a318bcd6215a087bdaffc83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T10:54:37.532 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T10:54:37.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:37.570 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T10:54:37.570 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T10:54:37.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.a 2024-09-10T10:54:37.860 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:54:37 smithi092 systemd[1]: Stopping Ceph mds.a for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:54:38.111 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:54:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a[71696]: 2024-09-10T10:54:37.880+0000 7f09a5f25640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:54:38.111 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:54:37 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a[71696]: 2024-09-10T10:54:37.880+0000 7f09a5f25640 -1 mds.a *** got signal Terminated *** 2024-09-10T10:54:42.167 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:54:41 smithi092 podman[94186]: 2024-09-10 10:54:41.887458609 +0000 UTC m=+4.128796648 container died 10ee7b374e51defb2789af80d3b36272914dca7f7609824d9f21afd8bc369f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T10:54:42.611 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:54:42 smithi092 podman[94186]: 2024-09-10 10:54:42.232496596 +0000 UTC m=+4.473834679 container cleanup 10ee7b374e51defb2789af80d3b36272914dca7f7609824d9f21afd8bc369f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T10:54:42.611 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:54:42 smithi092 bash[94186]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a 2024-09-10T10:54:42.611 INFO:journalctl@ceph.mds.a.smithi092.stdout:Sep 10 10:54:42 smithi092 podman[94213]: 2024-09-10 10:54:42.408714048 +0000 UTC m=+0.511738346 container remove 10ee7b374e51defb2789af80d3b36272914dca7f7609824d9f21afd8bc369f6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T10:54:42.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T10:54:42.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:42.665 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T10:54:42.665 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T10:54:42.665 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.d 2024-09-10T10:54:42.971 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:54:42 smithi092 systemd[1]: Stopping Ceph mds.d for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:54:43.360 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:54:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-d[70481]: 2024-09-10T10:54:42.969+0000 7f86956e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:54:43.361 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:54:42 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-d[70481]: 2024-09-10T10:54:42.969+0000 7f86956e0640 -1 mds.d *** got signal Terminated *** 2024-09-10T10:54:45.158 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:54:44 smithi092 podman[94318]: 2024-09-10 10:54:44.894778308 +0000 UTC m=+2.018480038 container died e0172f59930c19e064d3474fae4348d4c17f1cd61f500b2a6ec1f39b13a14b12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T10:54:45.547 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:54:45 smithi092 podman[94318]: 2024-09-10 10:54:45.245160459 +0000 UTC m=+2.368862176 container cleanup e0172f59930c19e064d3474fae4348d4c17f1cd61f500b2a6ec1f39b13a14b12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:54:45.547 INFO:journalctl@ceph.mds.d.smithi092.stdout:Sep 10 10:54:45 smithi092 bash[94318]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-d 2024-09-10T10:54:45.678 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T10:54:45.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:45.711 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T10:54:45.711 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T10:54:45.711 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.g 2024-09-10T10:54:45.860 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:54:45 smithi092 systemd[1]: Stopping Ceph mds.g for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:54:46.360 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:54:46 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g[71356]: 2024-09-10T10:54:46.032+0000 7f72fc7f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:54:46.360 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:54:46 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g[71356]: 2024-09-10T10:54:46.032+0000 7f72fc7f2640 -1 mds.g *** got signal Terminated *** 2024-09-10T10:54:50.325 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:54:50 smithi092 podman[94438]: 2024-09-10 10:54:50.047617127 +0000 UTC m=+4.117039707 container died edd545cebd5cfe529e9e619e2b058e69082d6017ddb056acb7a0a23224bbc8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD) 2024-09-10T10:54:50.610 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:54:50 smithi092 podman[94438]: 2024-09-10 10:54:50.415323285 +0000 UTC m=+4.484745864 container cleanup edd545cebd5cfe529e9e619e2b058e69082d6017ddb056acb7a0a23224bbc8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T10:54:50.611 INFO:journalctl@ceph.mds.g.smithi092.stdout:Sep 10 10:54:50 smithi092 bash[94438]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-g 2024-09-10T10:54:50.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T10:54:50.882 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:50.882 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T10:54:50.883 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T10:54:50.883 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.j 2024-09-10T10:54:51.220 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:54:50 smithi092 systemd[1]: Stopping Ceph mds.j for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:54:51.610 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:54:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-j[70068]: 2024-09-10T10:54:51.218+0000 7fb636cc1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:54:51.611 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:54:51 smithi092 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-j[70068]: 2024-09-10T10:54:51.218+0000 7fb636cc1640 -1 mds.j *** got signal Terminated *** 2024-09-10T10:54:53.671 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:54:53 smithi092 podman[94560]: 2024-09-10 10:54:53.381537629 +0000 UTC m=+2.273224700 container died d21554bd25e8f57dc1ecd6f91a7a2a83dc387f1dc7331d6321b8c0c4b7c5dd0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T10:54:54.012 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:54:53 smithi092 podman[94560]: 2024-09-10 10:54:53.752548075 +0000 UTC m=+2.644235146 container cleanup d21554bd25e8f57dc1ecd6f91a7a2a83dc387f1dc7331d6321b8c0c4b7c5dd0f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2) 2024-09-10T10:54:54.013 INFO:journalctl@ceph.mds.j.smithi092.stdout:Sep 10 10:54:53 smithi092 bash[94560]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-j 2024-09-10T10:54:54.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T10:54:54.206 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:54.206 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T10:54:54.206 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T10:54:54.207 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.b 2024-09-10T10:54:54.570 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:54:54 smithi097 systemd[1]: Stopping Ceph mds.b for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:54:54.862 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:54:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-b[65470]: 2024-09-10T10:54:54.574+0000 7f8e015ca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:54:54.862 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:54:54 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-b[65470]: 2024-09-10T10:54:54.574+0000 7f8e015ca640 -1 mds.b *** got signal Terminated *** 2024-09-10T10:54:58.960 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:54:58 smithi097 podman[73328]: 2024-09-10 10:54:58.583113286 +0000 UTC m=+4.186195412 container died 3ffb6fb77e350ecf03d49489402e4be0c5af84b90122a8bb2e1873293058a9aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T10:54:59.320 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:54:59 smithi097 podman[73328]: 2024-09-10 10:54:59.033091443 +0000 UTC m=+4.636173567 container cleanup 3ffb6fb77e350ecf03d49489402e4be0c5af84b90122a8bb2e1873293058a9aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:54:59.320 INFO:journalctl@ceph.mds.b.smithi097.stdout:Sep 10 10:54:59 smithi097 bash[73328]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-b 2024-09-10T10:54:59.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T10:54:59.509 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:54:59.509 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T10:54:59.509 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T10:54:59.509 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.e 2024-09-10T10:55:00.072 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:54:59 smithi097 systemd[1]: Stopping Ceph mds.e for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:55:00.072 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:54:59 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e[64867]: 2024-09-10T10:54:59.820+0000 7f6ff979d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:55:00.072 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:54:59 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e[64867]: 2024-09-10T10:54:59.820+0000 7f6ff979d640 -1 mds.e *** got signal Terminated *** 2024-09-10T10:55:03.023 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:55:02 smithi097 podman[73459]: 2024-09-10 10:55:02.660861359 +0000 UTC m=+2.938954804 container died 40985850e5ce7514341aec9ddfafdb1f30bc54ec623d145dde513d1adfc20271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T10:55:03.320 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:55:03 smithi097 podman[73459]: 2024-09-10 10:55:03.095193205 +0000 UTC m=+3.373286648 container cleanup 40985850e5ce7514341aec9ddfafdb1f30bc54ec623d145dde513d1adfc20271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T10:55:03.320 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:55:03 smithi097 bash[73459]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e 2024-09-10T10:55:03.320 INFO:journalctl@ceph.mds.e.smithi097.stdout:Sep 10 10:55:03 smithi097 podman[73472]: 2024-09-10 10:55:03.255090111 +0000 UTC m=+0.587650105 container remove 40985850e5ce7514341aec9ddfafdb1f30bc54ec623d145dde513d1adfc20271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2) 2024-09-10T10:55:03.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T10:55:03.512 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:55:03.512 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T10:55:03.512 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T10:55:03.512 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.h 2024-09-10T10:55:03.820 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:03 smithi097 systemd[1]: Stopping Ceph mds.h for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:55:04.320 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:03 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h[65169]: 2024-09-10T10:55:03.849+0000 7ff37b6d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:55:04.320 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:03 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h[65169]: 2024-09-10T10:55:03.849+0000 7ff37b6d7640 -1 mds.h *** got signal Terminated *** 2024-09-10T10:55:06.934 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:06 smithi097 podman[73581]: 2024-09-10 10:55:06.675451281 +0000 UTC m=+2.952013802 container died bb73635fbcac5fc7e43d688f291b31b99df8a9955704634289ac8055f2d7c0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:55:07.209 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:07 smithi097 podman[73581]: 2024-09-10 10:55:07.02407719 +0000 UTC m=+3.300639698 container cleanup bb73635fbcac5fc7e43d688f291b31b99df8a9955704634289ac8055f2d7c0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T10:55:07.209 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:07 smithi097 bash[73581]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h 2024-09-10T10:55:07.437 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T10:55:07.459 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:07 smithi097 podman[73593]: 2024-09-10 10:55:07.208682177 +0000 UTC m=+0.526416234 container remove bb73635fbcac5fc7e43d688f291b31b99df8a9955704634289ac8055f2d7c0d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T10:55:07.459 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:07 smithi097 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-10T10:55:07.460 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:07 smithi097 systemd[1]: Stopped Ceph mds.h for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:55:07.460 INFO:journalctl@ceph.mds.h.smithi097.stdout:Sep 10 10:55:07 smithi097 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.h.service: Consumed 2.933s CPU time. 2024-09-10T10:55:07.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:55:07.470 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T10:55:07.470 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T10:55:07.470 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.k 2024-09-10T10:55:07.796 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:07 smithi097 systemd[1]: Stopping Ceph mds.k for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:55:08.070 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:07 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k[64553]: 2024-09-10T10:55:07.794+0000 7f186d58f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:55:08.070 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:07 smithi097 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k[64553]: 2024-09-10T10:55:07.794+0000 7f186d58f640 -1 mds.k *** got signal Terminated *** 2024-09-10T10:55:10.929 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:10 smithi097 podman[73703]: 2024-09-10 10:55:10.666347682 +0000 UTC m=+2.961458187 container died 1b0d84ec6d76647534f1d2eb2999d66692d1efa9d1789686c8bee472227abeb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T10:55:11.198 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:11 smithi097 podman[73703]: 2024-09-10 10:55:11.0109949 +0000 UTC m=+3.306105413 container cleanup 1b0d84ec6d76647534f1d2eb2999d66692d1efa9d1789686c8bee472227abeb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T10:55:11.198 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:11 smithi097 bash[73703]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k 2024-09-10T10:55:11.427 DEBUG:teuthology.orchestra.run.smithi097:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T10:55:11.449 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:11 smithi097 podman[73718]: 2024-09-10 10:55:11.19772098 +0000 UTC m=+0.526528224 container remove 1b0d84ec6d76647534f1d2eb2999d66692d1efa9d1789686c8bee472227abeb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:55:11.449 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:11 smithi097 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.k.service: Deactivated successfully. 2024-09-10T10:55:11.449 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:11 smithi097 systemd[1]: Stopped Ceph mds.k for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:55:11.449 INFO:journalctl@ceph.mds.k.smithi097.stdout:Sep 10 10:55:11 smithi097 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.k.service: Consumed 2.803s CPU time. 2024-09-10T10:55:11.459 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:55:11.459 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T10:55:11.459 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T10:55:11.459 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.c 2024-09-10T10:55:11.791 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:55:11 smithi121 systemd[1]: Stopping Ceph mds.c for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:55:12.290 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:55:11 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c[65602]: 2024-09-10T10:55:11.897+0000 7f5554e61640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:55:12.291 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:55:11 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c[65602]: 2024-09-10T10:55:11.897+0000 7f5554e61640 -1 mds.c *** got signal Terminated *** 2024-09-10T10:55:15.041 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:55:14 smithi121 podman[72946]: 2024-09-10 10:55:14.681382156 +0000 UTC m=+3.023666852 container died 0d2c7a22d4f38de297edeb7d041ec3f8435154a2eb99769e2670e0e3e832b625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T10:55:15.432 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:55:15 smithi121 podman[72946]: 2024-09-10 10:55:15.163845702 +0000 UTC m=+3.506130398 container cleanup 0d2c7a22d4f38de297edeb7d041ec3f8435154a2eb99769e2670e0e3e832b625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T10:55:15.432 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 10 10:55:15 smithi121 bash[72946]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-c 2024-09-10T10:55:15.575 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T10:55:15.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:55:15.611 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T10:55:15.611 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T10:55:15.612 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.f 2024-09-10T10:55:16.041 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:55:15 smithi121 systemd[1]: Stopping Ceph mds.f for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:55:16.041 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:55:15 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f[65302]: 2024-09-10T10:55:15.918+0000 7f1d711f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:55:16.041 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:55:15 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f[65302]: 2024-09-10T10:55:15.918+0000 7f1d711f2640 -1 mds.f *** got signal Terminated *** 2024-09-10T10:55:19.003 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:55:18 smithi121 podman[73079]: 2024-09-10 10:55:18.694303705 +0000 UTC m=+2.867488552 container died 6bb8c45fcf4976ba2b7235dc10736ddc6fd91e2636bf55baedc97eba37d0223b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T10:55:19.291 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:55:19 smithi121 podman[73079]: 2024-09-10 10:55:19.100931716 +0000 UTC m=+3.274116551 container cleanup 6bb8c45fcf4976ba2b7235dc10736ddc6fd91e2636bf55baedc97eba37d0223b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-09-10T10:55:19.291 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 10 10:55:19 smithi121 bash[73079]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-f 2024-09-10T10:55:19.541 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T10:55:19.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:55:19.575 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T10:55:19.575 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T10:55:19.575 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.i 2024-09-10T10:55:19.897 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:19 smithi121 systemd[1]: Stopping Ceph mds.i for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:55:20.290 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:19 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: 2024-09-10T10:55:19.896+0000 7f5a8277e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:55:20.291 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:19 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i[65907]: 2024-09-10T10:55:19.896+0000 7f5a8277e640 -1 mds.i *** got signal Terminated *** 2024-09-10T10:55:23.030 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:22 smithi121 podman[73200]: 2024-09-10 10:55:22.680072079 +0000 UTC m=+2.885660652 container died 2f90512ba3ddf77125029bed87fd50f657b553c27c9fb9f9162815ac91d9b5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T10:55:23.291 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:23 smithi121 podman[73200]: 2024-09-10 10:55:23.11282669 +0000 UTC m=+3.318415311 container cleanup 2f90512ba3ddf77125029bed87fd50f657b553c27c9fb9f9162815ac91d9b5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T10:55:23.291 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:23 smithi121 bash[73200]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i 2024-09-10T10:55:23.541 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T10:55:23.563 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:23 smithi121 podman[73213]: 2024-09-10 10:55:23.305678608 +0000 UTC m=+0.619366820 container remove 2f90512ba3ddf77125029bed87fd50f657b553c27c9fb9f9162815ac91d9b5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T10:55:23.563 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:23 smithi121 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-10T10:55:23.563 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:23 smithi121 systemd[1]: Stopped Ceph mds.i for 0df4af84-6f5f-11ef-bcea-c7b262605968. 2024-09-10T10:55:23.563 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 10 10:55:23 smithi121 systemd[1]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.i.service: Consumed 10.736s CPU time. 2024-09-10T10:55:23.573 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:55:23.573 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T10:55:23.574 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T10:55:23.574 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.l 2024-09-10T10:55:23.884 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:55:23 smithi121 systemd[1]: Stopping Ceph mds.l for 0df4af84-6f5f-11ef-bcea-c7b262605968... 2024-09-10T10:55:24.291 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:55:23 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l[64999]: 2024-09-10T10:55:23.882+0000 7fc6e4840640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T10:55:24.291 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:55:23 smithi121 ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l[64999]: 2024-09-10T10:55:23.882+0000 7fc6e4840640 -1 mds.l *** got signal Terminated *** 2024-09-10T10:55:26.992 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:55:26 smithi121 podman[73321]: 2024-09-10 10:55:26.697799767 +0000 UTC m=+2.907880996 container died 4a0a8c05093e0cdfd2ec955835a0fd3d3ce7a63c9b5791f94f264ee00751bc15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T10:55:27.291 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:55:27 smithi121 podman[73321]: 2024-09-10 10:55:27.082656299 +0000 UTC m=+3.292737535 container cleanup 4a0a8c05093e0cdfd2ec955835a0fd3d3ce7a63c9b5791f94f264ee00751bc15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T10:55:27.291 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 10 10:55:27 smithi121 bash[73321]: ceph-0df4af84-6f5f-11ef-bcea-c7b262605968-mds-l 2024-09-10T10:55:27.519 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0df4af84-6f5f-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T10:55:27.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T10:55:27.551 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T10:55:27.551 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T10:55:27.753 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:55:30.277 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T10:55:30.477 INFO:teuthology.orchestra.run.smithi097.stdout:Deleting cluster with fsid: 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:55:33.017 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T10:55:33.218 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:55:35.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:55:35.759 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:55:35.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T10:55:35.818 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T10:55:35.820 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026/remote/smithi092/crash 2024-09-10T10:55:35.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/crash -- . 2024-09-10T10:55:35.863 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T10:55:35.863 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now 2024-09-10T10:55:35.865 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026/remote/smithi097/crash 2024-09-10T10:55:35.866 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/crash -- . 2024-09-10T10:55:35.912 INFO:teuthology.orchestra.run.smithi097.stderr:tar: /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T10:55:35.912 INFO:teuthology.orchestra.run.smithi097.stderr:tar: Error is not recoverable: exiting now 2024-09-10T10:55:35.914 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026/remote/smithi121/crash 2024-09-10T10:55:35.915 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/crash -- . 2024-09-10T10:55:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:tar: /var/lib/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T10:55:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:tar: Error is not recoverable: exiting now 2024-09-10T10:55:35.959 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T10:55:35.959 DEBUG:teuthology.orchestra.run.smithi092:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T10:55:36.019 INFO:tasks.cephadm:Compressing logs... 2024-09-10T10:55:36.019 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T10:55:36.021 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T10:55:36.024 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T10:55:36.053 INFO:teuthology.orchestra.run.smithi121.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T10:55:36.055 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T10:55:36.056 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T10:55:36.056 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T10:55:36.056 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T10:55:36.060 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T10:55:36.062 INFO:teuthology.orchestra.run.smithi097.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T10:55:36.062 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T10:55:36.062 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T10:55:36.062 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T10:55:36.062 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T10:55:36.065 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T10:55:36.065 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T10:55:36.065 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T10:55:36.066 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T10:55:36.066 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T10:55:36.066 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T10:55:36.066 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log 2024-09-10T10:55:36.066 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T10:55:36.066 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T10:55:36.066 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T10:55:36.066 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T10:55:36.073 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 82.1% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T10:55:36.084 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T10:55:36.084 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T10:55:36.084 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T10:55:36.085 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T10:55:36.085 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T10:55:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T10:55:36.086 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T10:55:36.088 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T10:55:36.088 INFO:teuthology.orchestra.run.smithi092.stderr:gzip/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.cephadm.log: -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T10:55:36.088 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T10:55:36.088 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log 2024-09-10T10:55:36.088 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T10:55:36.088 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T10:55:36.088 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T10:55:36.088 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T10:55:36.088 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T10:55:36.089 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 86.9% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T10:55:36.156 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.1% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T10:55:36.165 INFO:teuthology.orchestra.run.smithi121.stderr: 90.6% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T10:55:36.195 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T10:55:36.225 INFO:teuthology.orchestra.run.smithi121.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T10:55:36.239 INFO:teuthology.orchestra.run.smithi092.stderr: 90.4% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T10:55:36.250 INFO:teuthology.orchestra.run.smithi092.stderr: 84.7% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T10:55:36.252 INFO:teuthology.orchestra.run.smithi097.stderr: 90.6% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T10:55:36.290 INFO:teuthology.orchestra.run.smithi097.stderr: 92.2% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T10:55:36.316 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T10:55:36.329 INFO:teuthology.orchestra.run.smithi092.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T10:55:36.347 INFO:teuthology.orchestra.run.smithi121.stderr: 92.3% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T10:55:36.358 INFO:teuthology.orchestra.run.smithi092.stderr: 94.5% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T10:55:36.363 INFO:teuthology.orchestra.run.smithi092.stderr: 90.9% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T10:55:36.366 INFO:teuthology.orchestra.run.smithi097.stderr: 90.9% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T10:55:36.387 INFO:teuthology.orchestra.run.smithi092.stderr: 94.7% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T10:55:36.560 INFO:teuthology.orchestra.run.smithi097.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T10:55:36.685 INFO:teuthology.orchestra.run.smithi092.stderr: 93.3% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T10:55:36.780 INFO:teuthology.orchestra.run.smithi097.stderr: 86.9% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T10:55:36.783 INFO:teuthology.orchestra.run.smithi121.stderr: 93.5% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T10:55:36.813 INFO:teuthology.orchestra.run.smithi097.stderr: 94.1% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T10:55:36.830 INFO:teuthology.orchestra.run.smithi092.stderr: 93.3% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T10:55:36.838 INFO:teuthology.orchestra.run.smithi097.stderr: 93.6% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T10:55:36.967 INFO:teuthology.orchestra.run.smithi097.stderr: 93.7% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T10:55:37.007 INFO:teuthology.orchestra.run.smithi092.stderr: 90.3% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T10:55:37.551 INFO:teuthology.orchestra.run.smithi121.stderr: 91.8% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T10:55:38.603 INFO:teuthology.orchestra.run.smithi097.stderr: 91.8% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T10:55:38.719 INFO:teuthology.orchestra.run.smithi092.stderr: 90.2% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T10:55:39.821 INFO:teuthology.orchestra.run.smithi121.stderr: 93.6% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T10:55:39.900 INFO:teuthology.orchestra.run.smithi097.stderr: 93.7% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T10:55:40.921 INFO:teuthology.orchestra.run.smithi121.stderr: 93.7% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T10:55:41.635 INFO:teuthology.orchestra.run.smithi121.stderr: 93.6% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T10:56:19.883 INFO:teuthology.orchestra.run.smithi121.stderr: 91.3% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T10:56:33.935 INFO:teuthology.orchestra.run.smithi121.stderr: 91.3% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T10:56:36.269 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T10:56:37.870 INFO:teuthology.orchestra.run.smithi097.stderr: 91.2% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T10:56:39.769 INFO:teuthology.orchestra.run.smithi097.stderr: 91.5% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T10:56:44.383 INFO:teuthology.orchestra.run.smithi121.stderr: 91.2% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T10:56:44.385 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-10T10:56:44.385 INFO:teuthology.orchestra.run.smithi121.stderr:real 1m8.346s 2024-09-10T10:56:44.385 INFO:teuthology.orchestra.run.smithi121.stderr:user 3m38.011s 2024-09-10T10:56:44.385 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m6.907s 2024-09-10T10:56:45.677 INFO:teuthology.orchestra.run.smithi092.stderr: 91.6% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T10:57:05.327 INFO:teuthology.orchestra.run.smithi097.stderr: 91.3% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T10:57:07.799 INFO:teuthology.orchestra.run.smithi092.stderr: 91.0% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T10:57:12.625 INFO:teuthology.orchestra.run.smithi097.stderr: 91.1% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T10:57:12.627 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-09-10T10:57:12.627 INFO:teuthology.orchestra.run.smithi097.stderr:real 1m36.589s 2024-09-10T10:57:12.627 INFO:teuthology.orchestra.run.smithi097.stderr:user 3m59.315s 2024-09-10T10:57:12.627 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m8.070s 2024-09-10T10:57:14.456 INFO:teuthology.orchestra.run.smithi092.stderr: 91.2% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T10:57:38.877 INFO:teuthology.orchestra.run.smithi092.stderr: 91.0% -- replaced with /var/log/ceph/0df4af84-6f5f-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T10:57:38.879 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-10T10:57:38.879 INFO:teuthology.orchestra.run.smithi092.stderr:real 2m2.844s 2024-09-10T10:57:38.879 INFO:teuthology.orchestra.run.smithi092.stderr:user 3m50.873s 2024-09-10T10:57:38.879 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m7.625s 2024-09-10T10:57:38.879 INFO:tasks.cephadm:Archiving logs... 2024-09-10T10:57:38.880 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026/remote/smithi092/log 2024-09-10T10:57:38.881 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T10:58:18.979 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026/remote/smithi097/log 2024-09-10T10:58:18.980 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T10:58:59.810 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026/remote/smithi121/log 2024-09-10T10:58:59.811 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T10:59:39.342 INFO:tasks.cephadm:Removing cluster... 2024-09-10T10:59:39.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 --force 2024-09-10T10:59:39.544 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:59:40.138 DEBUG:teuthology.orchestra.run.smithi097:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 --force 2024-09-10T10:59:40.341 INFO:teuthology.orchestra.run.smithi097.stdout:Deleting cluster with fsid: 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:59:40.895 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0df4af84-6f5f-11ef-bcea-c7b262605968 --force 2024-09-10T10:59:41.097 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: 0df4af84-6f5f-11ef-bcea-c7b262605968 2024-09-10T10:59:41.793 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T10:59:41.794 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T10:59:41.812 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T10:59:41.831 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T10:59:41.846 INFO:tasks.cephadm:Teardown complete 2024-09-10T10:59:41.846 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T10:59:41.857 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T10:59:41.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T10:59:41.860 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T10:59:41.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T10:59:41.988 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T10:59:41.998 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T10:59:41.999 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:59:42.001 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:59:42.004 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T10:59:42.014 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:59:42.017 INFO:teuthology.orchestra.run.smithi097.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:59:42.018 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-10T10:59:42.019 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:59:42.019 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-10T10:59:42.019 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 -336us[ -331us] +/- 46ms 2024-09-10T10:59:42.019 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 +112us[ +117us] +/- 72ms 2024-09-10T10:59:42.019 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +478us[ +482us] +/- 73ms 2024-09-10T10:59:42.019 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:59:42.040 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:59:42.040 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-10T10:59:42.040 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 -334us[ -323us] +/- 46ms 2024-09-10T10:59:42.041 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 +129us[ +140us] +/- 72ms 2024-09-10T10:59:42.041 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +466us[ +477us] +/- 73ms 2024-09-10T10:59:42.041 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:59:42.046 INFO:teuthology.orchestra.run.smithi097.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T10:59:42.046 INFO:teuthology.orchestra.run.smithi097.stdout:=============================================================================== 2024-09-10T10:59:42.046 INFO:teuthology.orchestra.run.smithi097.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 -335us[ -312us] +/- 46ms 2024-09-10T10:59:42.047 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 +137us[ +160us] +/- 72ms 2024-09-10T10:59:42.047 INFO:teuthology.orchestra.run.smithi097.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +476us[ +476us] +/- 73ms 2024-09-10T10:59:42.047 INFO:teuthology.orchestra.run.smithi097.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T10:59:42.048 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T10:59:42.058 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T10:59:42.059 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T10:59:42.141 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T10:59:42.279 DEBUG:teuthology.orchestra.run.smithi097:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T10:59:42.426 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T10:59:42.541 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:59:42.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:59:42.571 DEBUG:teuthology.orchestra.run.smithi097:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:59:42.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:59:42.603 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T10:59:42.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:59:42.631 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T10:59:42.642 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T10:59:42.708 INFO:teuthology.task.internal:Duration was 2404.314675 seconds 2024-09-10T10:59:42.709 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T10:59:42.733 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T10:59:42.733 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T10:59:42.735 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T10:59:42.738 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T10:59:42.791 INFO:teuthology.orchestra.run.smithi097.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:59:42.794 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:59:42.797 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T10:59:43.131 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T10:59:43.131 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-09-10T10:59:43.132 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T10:59:43.153 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-09-10T10:59:43.153 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T10:59:43.178 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-09-10T10:59:43.178 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T10:59:43.222 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T10:59:43.222 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T10:59:43.225 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T10:59:43.227 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T10:59:43.288 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T10:59:43.288 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T10:59:43.300 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T10:59:43.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T10:59:43.814 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T10:59:43.826 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T10:59:43.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T10:59:43.863 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T10:59:43.906 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T10:59:43.958 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T10:59:43.969 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:59:43.971 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:59:43.974 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:59:43.998 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-09-10T10:59:43.999 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-09-10T10:59:44.000 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-09-10T10:59:44.028 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:59:44.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:59:44.071 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:59:44.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:59:44.087 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T10:59:44.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T10:59:44.102 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T10:59:44.400 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T10:59:44.445 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026/remote/smithi092 2024-09-10T10:59:44.445 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T10:59:44.492 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026/remote/smithi097 2024-09-10T10:59:44.492 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T10:59:44.532 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7899026/remote/smithi121 2024-09-10T10:59:44.532 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T10:59:44.570 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T10:59:44.570 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T10:59:44.573 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T10:59:44.575 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T10:59:44.620 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T10:59:44.635 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T10:59:44.635 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T10:59:44.693 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T10:59:44.694 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T10:59:44.696 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T10:59:44.698 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T10:59:44.709 INFO:teuthology.orchestra.run.smithi092.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 10:59 /home/ubuntu/cephtest 2024-09-10T10:59:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 10:59 /home/ubuntu/cephtest 2024-09-10T10:59:44.713 INFO:teuthology.orchestra.run.smithi121.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 10:59 /home/ubuntu/cephtest 2024-09-10T10:59:44.725 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T10:59:44.748 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T10:59:44.881 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/postgres}} duration: 2404.314675092697 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T10:59:44.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T10:59:44.962 INFO:teuthology.run:pass